2023-10-06T04:26:25.939 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T04:26:25.939 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283 --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283/orig.config.yaml 2023-10-06T04:26:25.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:26:26.059 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283 branch: wip-yuri3-testing-2023-10-05-0943-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} email: yweinste@redhat.com first_in_suite: false job_id: '7412283' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri3-testing-2023-10-05-0943-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - force file system read-only - bad backtrace - MDS in read-only mode - \(MDS_READ_ONLY\) sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-10-05-0943-quincy sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4002 sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri3-testing-2023-10-05-0943-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_auto_repair teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:54:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T04:26:26.059 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa; will attempt to use it 2023-10-06T04:26:26.060 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa/tasks 2023-10-06T04:26:26.060 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T04:26:26.061 INFO:teuthology.task.internal:Checking packages... 2023-10-06T04:26:26.084 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564' 2023-10-06T04:26:26.085 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T04:26:26.085 INFO:teuthology.packaging:ref: None 2023-10-06T04:26:26.085 INFO:teuthology.packaging:tag: None 2023-10-06T04:26:26.085 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T04:26:26.085 INFO:teuthology.packaging:sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:26:26.085 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T04:26:26.227 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1274-g68e53a4a-1focal 2023-10-06T04:26:26.228 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T04:26:26.234 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T04:26:26.234 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T04:26:26.240 INFO:teuthology.task.internal:Saving configuration 2023-10-06T04:26:26.256 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T04:26:26.262 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:26:26.288 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:20:33.053824', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T04:26:26.310 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:20:33.052591', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T04:26:26.310 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T04:26:26.316 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T04:26:26.317 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T04:26:26.317 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T04:26:26.394 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa2dd774040>, signals=[15]) 2023-10-06T04:26:26.395 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T04:26:26.402 INFO:teuthology.task.internal:Opening connections... 2023-10-06T04:26:26.402 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:26:26.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:26:26.456 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:26:26.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:26:26.501 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T04:26:26.507 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-10-06T04:26:26.535 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-10-06T04:26:26.535 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-10-06T04:26:26.584 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu" 2023-10-06T04:26:26.584 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T04:26:26.584 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu 2023-10-06T04:26:26.584 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian 2023-10-06T04:26:26.584 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T04:26:26.584 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="20.04" 2023-10-06T04:26:26.584 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T04:26:26.584 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T04:26:26.584 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T04:26:26.585 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T04:26:26.585 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=focal 2023-10-06T04:26:26.585 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=focal 2023-10-06T04:26:26.585 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-10-06T04:26:26.609 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-10-06T04:26:26.616 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-10-06T04:26:26.616 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-10-06T04:26:26.663 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu" 2023-10-06T04:26:26.663 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T04:26:26.663 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu 2023-10-06T04:26:26.663 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian 2023-10-06T04:26:26.663 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T04:26:26.663 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="20.04" 2023-10-06T04:26:26.663 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T04:26:26.663 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T04:26:26.663 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T04:26:26.664 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T04:26:26.664 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=focal 2023-10-06T04:26:26.664 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=focal 2023-10-06T04:26:26.664 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-10-06T04:26:26.693 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T04:26:26.702 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T04:26:26.770 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T04:26:26.770 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:26:26.772 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:26:26.778 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T04:26:26.784 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T04:26:26.785 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:26:26.787 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:26:26.797 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T04:26:26.926 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T04:26:26.940 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-06T04:26:26.940 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-06T04:26:26.941 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:26:26.941 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:26:26.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:26:26.946 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-10-06T04:26:26.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:26:26.948 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2023-10-06T04:26:26.953 INFO:teuthology.orchestra.run.smithi037.stdout:5.4.0-124-generic 2023-10-06T04:26:26.954 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.4.0-124-generic 2023-10-06T04:26:26.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get clean 2023-10-06T04:26:26.955 INFO:teuthology.orchestra.run.smithi083.stdout:5.4.0-124-generic 2023-10-06T04:26:26.955 INFO:teuthology.task.kernel:Running kernel on smithi083: 5.4.0-124-generic 2023-10-06T04:26:26.955 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get clean 2023-10-06T04:26:27.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get update 2023-10-06T04:26:27.090 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get update 2023-10-06T04:26:27.236 INFO:teuthology.orchestra.run.smithi037.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-06T04:26:27.241 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T04:26:27.255 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-06T04:26:27.312 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-06T04:26:27.349 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T04:26:27.352 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-06T04:26:27.431 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-06T04:26:27.569 INFO:teuthology.orchestra.run.smithi037.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-06T04:26:27.623 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-06T04:26:27.701 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-06T04:26:27.713 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-06T04:26:27.725 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-06T04:26:27.728 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-06T04:26:27.729 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-06T04:26:27.729 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-06T04:26:27.738 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-06T04:26:27.741 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-06T04:26:27.741 INFO:teuthology.orchestra.run.smithi083.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-06T04:26:27.746 INFO:teuthology.orchestra.run.smithi037.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-06T04:26:27.748 INFO:teuthology.orchestra.run.smithi037.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T04:26:27.748 INFO:teuthology.orchestra.run.smithi037.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-06T04:26:27.756 INFO:teuthology.orchestra.run.smithi037.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-06T04:26:27.758 INFO:teuthology.orchestra.run.smithi083.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-06T04:26:27.759 INFO:teuthology.orchestra.run.smithi083.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-06T04:26:27.760 INFO:teuthology.orchestra.run.smithi037.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-06T04:26:27.762 INFO:teuthology.orchestra.run.smithi083.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T04:26:27.762 INFO:teuthology.orchestra.run.smithi037.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-06T04:26:27.763 INFO:teuthology.orchestra.run.smithi083.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-06T04:26:27.768 INFO:teuthology.orchestra.run.smithi083.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-06T04:26:27.769 INFO:teuthology.orchestra.run.smithi037.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-06T04:26:27.770 INFO:teuthology.orchestra.run.smithi037.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-06T04:26:27.770 INFO:teuthology.orchestra.run.smithi037.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-06T04:26:27.770 INFO:teuthology.orchestra.run.smithi037.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-06T04:26:27.773 INFO:teuthology.orchestra.run.smithi037.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-06T04:26:27.775 INFO:teuthology.orchestra.run.smithi083.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-06T04:26:27.778 INFO:teuthology.orchestra.run.smithi083.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-06T04:26:27.780 INFO:teuthology.orchestra.run.smithi083.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-06T04:26:27.780 INFO:teuthology.orchestra.run.smithi083.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-06T04:26:27.789 INFO:teuthology.orchestra.run.smithi083.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-06T04:26:27.790 INFO:teuthology.orchestra.run.smithi083.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-06T04:26:27.790 INFO:teuthology.orchestra.run.smithi083.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-06T04:26:27.791 INFO:teuthology.orchestra.run.smithi083.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-06T04:26:27.791 INFO:teuthology.orchestra.run.smithi083.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-06T04:26:27.806 INFO:teuthology.orchestra.run.smithi083.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-06T04:26:27.806 INFO:teuthology.orchestra.run.smithi083.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-06T04:26:27.806 INFO:teuthology.orchestra.run.smithi083.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-06T04:26:27.915 INFO:teuthology.orchestra.run.smithi037.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-06T04:26:27.929 INFO:teuthology.orchestra.run.smithi083.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-06T04:26:28.162 INFO:teuthology.orchestra.run.smithi037.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-06T04:26:28.255 INFO:teuthology.orchestra.run.smithi083.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-06T04:26:28.325 INFO:teuthology.orchestra.run.smithi037.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-06T04:26:28.339 INFO:teuthology.orchestra.run.smithi037.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-06T04:26:28.339 INFO:teuthology.orchestra.run.smithi037.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-06T04:26:28.403 INFO:teuthology.orchestra.run.smithi037.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-06T04:26:28.404 INFO:teuthology.orchestra.run.smithi037.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-06T04:26:28.420 INFO:teuthology.orchestra.run.smithi037.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T04:26:28.443 INFO:teuthology.orchestra.run.smithi083.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-06T04:26:28.457 INFO:teuthology.orchestra.run.smithi083.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-06T04:26:28.457 INFO:teuthology.orchestra.run.smithi083.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-06T04:26:28.458 INFO:teuthology.orchestra.run.smithi083.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-06T04:26:28.526 INFO:teuthology.orchestra.run.smithi083.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-06T04:26:28.532 INFO:teuthology.orchestra.run.smithi083.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T04:26:28.532 INFO:teuthology.orchestra.run.smithi083.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-06T04:26:28.544 INFO:teuthology.orchestra.run.smithi083.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-06T04:26:28.584 INFO:teuthology.orchestra.run.smithi037.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-06T04:26:28.742 INFO:teuthology.orchestra.run.smithi083.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-06T04:26:29.157 INFO:teuthology.orchestra.run.smithi083.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-06T04:26:29.163 INFO:teuthology.orchestra.run.smithi083.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-06T04:26:29.165 INFO:teuthology.orchestra.run.smithi083.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-06T04:26:29.173 INFO:teuthology.orchestra.run.smithi083.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-06T04:26:29.175 INFO:teuthology.orchestra.run.smithi083.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-06T04:26:29.218 INFO:teuthology.orchestra.run.smithi037.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-06T04:26:29.257 INFO:teuthology.orchestra.run.smithi037.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-06T04:26:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-06T04:26:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-06T04:26:29.273 INFO:teuthology.orchestra.run.smithi037.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-06T04:26:29.274 INFO:teuthology.orchestra.run.smithi037.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-06T04:26:29.274 INFO:teuthology.orchestra.run.smithi037.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-06T04:26:29.275 INFO:teuthology.orchestra.run.smithi037.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-06T04:26:29.300 INFO:teuthology.orchestra.run.smithi037.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-06T04:26:29.302 INFO:teuthology.orchestra.run.smithi037.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-06T04:26:29.466 INFO:teuthology.orchestra.run.smithi037.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-06T04:26:29.649 INFO:teuthology.orchestra.run.smithi037.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-06T04:26:29.671 INFO:teuthology.orchestra.run.smithi037.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-06T04:26:31.577 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 17.6 MB in 3s (7,037 kB/s) 2023-10-06T04:26:31.722 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 17.6 MB in 3s (6,723 kB/s) 2023-10-06T04:26:33.031 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2023-10-06T04:26:33.054 DEBUG:teuthology.orchestra.run.smithi083:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T04:26:33.119 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2023-10-06T04:26:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2023-10-06T04:26:33.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T04:26:33.299 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2023-10-06T04:26:33.299 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2023-10-06T04:26:33.359 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2023-10-06T04:26:33.473 INFO:teuthology.orchestra.run.smithi083.stdout:The following additional packages will be installed: 2023-10-06T04:26:33.473 INFO:teuthology.orchestra.run.smithi083.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T04:26:33.473 INFO:teuthology.orchestra.run.smithi083.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-06T04:26:33.473 INFO:teuthology.orchestra.run.smithi083.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-06T04:26:33.474 INFO:teuthology.orchestra.run.smithi083.stdout:Suggested packages: 2023-10-06T04:26:33.474 INFO:teuthology.orchestra.run.smithi083.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-06T04:26:33.475 INFO:teuthology.orchestra.run.smithi083.stdout:Recommended packages: 2023-10-06T04:26:33.475 INFO:teuthology.orchestra.run.smithi083.stdout: thermald 2023-10-06T04:26:33.521 INFO:teuthology.orchestra.run.smithi083.stdout:The following NEW packages will be installed: 2023-10-06T04:26:33.521 INFO:teuthology.orchestra.run.smithi083.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T04:26:33.521 INFO:teuthology.orchestra.run.smithi083.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-06T04:26:33.521 INFO:teuthology.orchestra.run.smithi083.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-06T04:26:33.522 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages will be upgraded: 2023-10-06T04:26:33.522 INFO:teuthology.orchestra.run.smithi083.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-06T04:26:33.566 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2023-10-06T04:26:33.568 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2023-10-06T04:26:33.703 INFO:teuthology.orchestra.run.smithi083.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T04:26:33.703 INFO:teuthology.orchestra.run.smithi083.stdout:Need to get 77.0 MB of archives. 2023-10-06T04:26:33.703 INFO:teuthology.orchestra.run.smithi083.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-06T04:26:33.703 INFO:teuthology.orchestra.run.smithi083.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-06T04:26:33.759 INFO:teuthology.orchestra.run.smithi037.stdout:The following additional packages will be installed: 2023-10-06T04:26:33.759 INFO:teuthology.orchestra.run.smithi037.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T04:26:33.759 INFO:teuthology.orchestra.run.smithi037.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-06T04:26:33.759 INFO:teuthology.orchestra.run.smithi037.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-06T04:26:33.760 INFO:teuthology.orchestra.run.smithi037.stdout:Suggested packages: 2023-10-06T04:26:33.760 INFO:teuthology.orchestra.run.smithi037.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-06T04:26:33.760 INFO:teuthology.orchestra.run.smithi037.stdout:Recommended packages: 2023-10-06T04:26:33.760 INFO:teuthology.orchestra.run.smithi037.stdout: thermald 2023-10-06T04:26:33.816 INFO:teuthology.orchestra.run.smithi037.stdout:The following NEW packages will be installed: 2023-10-06T04:26:33.816 INFO:teuthology.orchestra.run.smithi037.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T04:26:33.816 INFO:teuthology.orchestra.run.smithi037.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-06T04:26:33.817 INFO:teuthology.orchestra.run.smithi037.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-06T04:26:33.818 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages will be upgraded: 2023-10-06T04:26:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-06T04:26:33.873 INFO:teuthology.orchestra.run.smithi037.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T04:26:33.873 INFO:teuthology.orchestra.run.smithi037.stdout:Need to get 77.0 MB of archives. 2023-10-06T04:26:33.873 INFO:teuthology.orchestra.run.smithi037.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-06T04:26:33.873 INFO:teuthology.orchestra.run.smithi037.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-06T04:26:34.271 INFO:teuthology.orchestra.run.smithi037.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-06T04:26:34.389 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-06T04:26:34.861 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-06T04:26:34.929 INFO:teuthology.orchestra.run.smithi037.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-06T04:26:34.929 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-06T04:26:34.929 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-06T04:26:35.049 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-06T04:26:35.061 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-06T04:26:35.130 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-06T04:26:35.752 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 77.0 MB in 1s (62.3 MB/s) 2023-10-06T04:26:35.936 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-06T04:26:36.419 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-06T04:26:36.419 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-06T04:26:36.420 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-06T04:26:36.722 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-06T04:26:36.756 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-06T04:26:37.505 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 77.0 MB in 3s (23.9 MB/s) 2023-10-06T04:26:37.654 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-06T04:26:37.659 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T04:26:37.695 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-06T04:26:37.758 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:39.407 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-06T04:26:39.412 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T04:26:39.492 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:39.733 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-06T04:26:39.747 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T04:26:39.853 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:40.945 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-06T04:26:40.958 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T04:26:41.003 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:41.342 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-06T04:26:41.357 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T04:26:41.447 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:42.495 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-06T04:26:42.508 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T04:26:42.562 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:45.832 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T04:26:45.959 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T04:26:46.284 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T04:26:46.404 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T04:26:46.698 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-06T04:26:46.715 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-06T04:26:46.757 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T04:26:47.507 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T04:26:47.990 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T04:26:48.018 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T04:26:48.146 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T04:26:48.474 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-06T04:26:48.487 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-06T04:26:48.532 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T04:26:52.275 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-06T04:26:52.299 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T04:26:52.333 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:53.874 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-06T04:26:53.898 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T04:26:53.941 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:55.140 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T04:26:55.392 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T04:26:55.741 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T04:26:55.863 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:55.989 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:56.694 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T04:26:56.816 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T04:26:57.105 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T04:26:57.229 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:57.266 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:57.380 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:58.457 INFO:teuthology.orchestra.run.smithi037.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-06T04:26:58.457 INFO:teuthology.orchestra.run.smithi037.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-06T04:26:58.602 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-06T04:26:58.607 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:59.712 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:26:59.724 INFO:teuthology.orchestra.run.smithi083.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-06T04:26:59.725 INFO:teuthology.orchestra.run.smithi083.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-06T04:26:59.835 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-06T04:26:59.936 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:27:00.946 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-06T04:27:01.097 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-06T04:27:01.104 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-06T04:27:01.224 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:27:01.230 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-06T04:27:01.293 INFO:teuthology.orchestra.run.smithi037.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-06T04:27:01.294 INFO:teuthology.orchestra.run.smithi037.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-06T04:27:01.357 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T04:27:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-06T04:27:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-06T04:27:23.493 INFO:teuthology.orchestra.run.smithi037.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-06T04:27:23.493 INFO:teuthology.orchestra.run.smithi037.stdout:Sourcing file `/etc/default/grub' 2023-10-06T04:27:23.513 INFO:teuthology.orchestra.run.smithi037.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T04:27:23.531 INFO:teuthology.orchestra.run.smithi037.stdout:Generating grub configuration file ... 2023-10-06T04:27:23.869 INFO:teuthology.orchestra.run.smithi037.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T04:27:23.894 INFO:teuthology.orchestra.run.smithi037.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T04:27:24.101 INFO:teuthology.orchestra.run.smithi083.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-06T04:27:24.101 INFO:teuthology.orchestra.run.smithi083.stdout:Sourcing file `/etc/default/grub' 2023-10-06T04:27:24.122 INFO:teuthology.orchestra.run.smithi083.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T04:27:24.142 INFO:teuthology.orchestra.run.smithi083.stdout:Generating grub configuration file ... 2023-10-06T04:27:24.302 INFO:teuthology.orchestra.run.smithi037.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T04:27:24.314 INFO:teuthology.orchestra.run.smithi037.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T04:27:24.439 INFO:teuthology.orchestra.run.smithi083.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T04:27:24.462 INFO:teuthology.orchestra.run.smithi083.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T04:27:24.816 INFO:teuthology.orchestra.run.smithi083.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T04:27:24.828 INFO:teuthology.orchestra.run.smithi083.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T04:27:27.064 INFO:teuthology.orchestra.run.smithi037.stdout:done 2023-10-06T04:27:27.505 INFO:teuthology.orchestra.run.smithi083.stdout:done 2023-10-06T04:27:27.511 DEBUG:teuthology.orchestra.run.smithi037:> dpkg -s linux-image-generic 2023-10-06T04:27:27.557 INFO:teuthology.orchestra.run.smithi037.stdout:Package: linux-image-generic 2023-10-06T04:27:27.557 INFO:teuthology.orchestra.run.smithi037.stdout:Status: install ok installed 2023-10-06T04:27:27.558 INFO:teuthology.orchestra.run.smithi037.stdout:Priority: optional 2023-10-06T04:27:27.558 INFO:teuthology.orchestra.run.smithi037.stdout:Section: kernel 2023-10-06T04:27:27.558 INFO:teuthology.orchestra.run.smithi037.stdout:Installed-Size: 20 2023-10-06T04:27:27.558 INFO:teuthology.orchestra.run.smithi037.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T04:27:27.558 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: amd64 2023-10-06T04:27:27.558 INFO:teuthology.orchestra.run.smithi037.stdout:Source: linux-meta 2023-10-06T04:27:27.558 INFO:teuthology.orchestra.run.smithi037.stdout:Version: 5.4.0.164.161 2023-10-06T04:27:27.558 INFO:teuthology.orchestra.run.smithi037.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T04:27:27.558 INFO:teuthology.orchestra.run.smithi037.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T04:27:27.558 INFO:teuthology.orchestra.run.smithi037.stdout:Recommends: thermald 2023-10-06T04:27:27.558 INFO:teuthology.orchestra.run.smithi037.stdout:Description: Generic Linux kernel image 2023-10-06T04:27:27.559 INFO:teuthology.orchestra.run.smithi037.stdout: This package will always depend on the latest generic kernel image 2023-10-06T04:27:27.559 INFO:teuthology.orchestra.run.smithi037.stdout: available. 2023-10-06T04:27:27.559 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-06T04:27:27.559 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T04:27:27.559 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T04:27:27.559 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-06T04:27:27.559 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T04:27:27.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get clean 2023-10-06T04:27:27.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get update 2023-10-06T04:27:27.793 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T04:27:27.793 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T04:27:27.798 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T04:27:27.816 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T04:27:27.911 DEBUG:teuthology.orchestra.run.smithi083:> dpkg -s linux-image-generic 2023-10-06T04:27:28.001 INFO:teuthology.orchestra.run.smithi083.stdout:Package: linux-image-generic 2023-10-06T04:27:28.001 INFO:teuthology.orchestra.run.smithi083.stdout:Status: install ok installed 2023-10-06T04:27:28.001 INFO:teuthology.orchestra.run.smithi083.stdout:Priority: optional 2023-10-06T04:27:28.001 INFO:teuthology.orchestra.run.smithi083.stdout:Section: kernel 2023-10-06T04:27:28.001 INFO:teuthology.orchestra.run.smithi083.stdout:Installed-Size: 20 2023-10-06T04:27:28.001 INFO:teuthology.orchestra.run.smithi083.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T04:27:28.001 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: amd64 2023-10-06T04:27:28.001 INFO:teuthology.orchestra.run.smithi083.stdout:Source: linux-meta 2023-10-06T04:27:28.001 INFO:teuthology.orchestra.run.smithi083.stdout:Version: 5.4.0.164.161 2023-10-06T04:27:28.002 INFO:teuthology.orchestra.run.smithi083.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T04:27:28.002 INFO:teuthology.orchestra.run.smithi083.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T04:27:28.002 INFO:teuthology.orchestra.run.smithi083.stdout:Recommends: thermald 2023-10-06T04:27:28.002 INFO:teuthology.orchestra.run.smithi083.stdout:Description: Generic Linux kernel image 2023-10-06T04:27:28.002 INFO:teuthology.orchestra.run.smithi083.stdout: This package will always depend on the latest generic kernel image 2023-10-06T04:27:28.002 INFO:teuthology.orchestra.run.smithi083.stdout: available. 2023-10-06T04:27:28.002 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-06T04:27:28.002 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T04:27:28.002 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T04:27:28.003 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-06T04:27:28.003 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi083.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T04:27:28.003 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get clean 2023-10-06T04:27:28.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get update 2023-10-06T04:27:28.216 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T04:27:28.216 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T04:27:28.222 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T04:27:28.239 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T04:27:29.589 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2023-10-06T04:27:29.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T04:27:29.689 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2023-10-06T04:27:29.873 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2023-10-06T04:27:29.874 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2023-10-06T04:27:29.954 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2023-10-06T04:27:29.983 DEBUG:teuthology.orchestra.run.smithi083:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T04:27:30.058 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2023-10-06T04:27:30.091 INFO:teuthology.orchestra.run.smithi037.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-06T04:27:30.091 INFO:teuthology.orchestra.run.smithi037.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T04:27:30.095 DEBUG:teuthology.orchestra.run.smithi037:> dpkg -s linux-image-generic 2023-10-06T04:27:30.118 INFO:teuthology.orchestra.run.smithi037.stdout:Package: linux-image-generic 2023-10-06T04:27:30.118 INFO:teuthology.orchestra.run.smithi037.stdout:Status: install ok installed 2023-10-06T04:27:30.118 INFO:teuthology.orchestra.run.smithi037.stdout:Priority: optional 2023-10-06T04:27:30.118 INFO:teuthology.orchestra.run.smithi037.stdout:Section: kernel 2023-10-06T04:27:30.118 INFO:teuthology.orchestra.run.smithi037.stdout:Installed-Size: 20 2023-10-06T04:27:30.118 INFO:teuthology.orchestra.run.smithi037.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T04:27:30.118 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: amd64 2023-10-06T04:27:30.119 INFO:teuthology.orchestra.run.smithi037.stdout:Source: linux-meta 2023-10-06T04:27:30.119 INFO:teuthology.orchestra.run.smithi037.stdout:Version: 5.4.0.164.161 2023-10-06T04:27:30.119 INFO:teuthology.orchestra.run.smithi037.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T04:27:30.119 INFO:teuthology.orchestra.run.smithi037.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T04:27:30.119 INFO:teuthology.orchestra.run.smithi037.stdout:Recommends: thermald 2023-10-06T04:27:30.119 INFO:teuthology.orchestra.run.smithi037.stdout:Description: Generic Linux kernel image 2023-10-06T04:27:30.119 INFO:teuthology.orchestra.run.smithi037.stdout: This package will always depend on the latest generic kernel image 2023-10-06T04:27:30.119 INFO:teuthology.orchestra.run.smithi037.stdout: available. 2023-10-06T04:27:30.119 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-10-06T04:27:30.124 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.rzc8gF8zhd 2023-10-06T04:27:30.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub/grub.cfg /tmp/tmp.rzc8gF8zhd 2023-10-06T04:27:30.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.rzc8gF8zhd 2023-10-06T04:27:30.257 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2023-10-06T04:27:30.257 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2023-10-06T04:27:30.287 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.rzc8gF8zhd is 9KB 2023-10-06T04:27:30.305 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.rzc8gF8zhd 2023-10-06T04:27:30.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-06T04:27:30.370 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:27:30.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-06T04:27:30.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-06T04:27:30.412 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-06T04:27:30.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo update-grub 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi083.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-06T04:27:30.465 INFO:teuthology.orchestra.run.smithi083.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T04:27:30.467 DEBUG:teuthology.orchestra.run.smithi083:> dpkg -s linux-image-generic 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi083.stdout:Package: linux-image-generic 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi083.stdout:Status: install ok installed 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi083.stdout:Priority: optional 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi083.stdout:Section: kernel 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi083.stdout:Installed-Size: 20 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi083.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T04:27:30.490 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: amd64 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi083.stdout:Source: linux-meta 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi083.stdout:Version: 5.4.0.164.161 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi083.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi083.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi083.stdout:Recommends: thermald 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi083.stdout:Description: Generic Linux kernel image 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi083.stdout: This package will always depend on the latest generic kernel image 2023-10-06T04:27:30.491 INFO:teuthology.orchestra.run.smithi083.stdout: available. 2023-10-06T04:27:30.491 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2023-10-06T04:27:30.497 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.8qgKkht6dV 2023-10-06T04:27:30.497 DEBUG:teuthology.orchestra.run.smithi083:> sudo cp /boot/grub/grub.cfg /tmp/tmp.8qgKkht6dV 2023-10-06T04:27:30.508 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.8qgKkht6dV 2023-10-06T04:27:30.591 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.8qgKkht6dV is 9KB 2023-10-06T04:27:30.607 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.8qgKkht6dV 2023-10-06T04:27:30.615 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-06T04:27:30.673 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:27:30.673 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-06T04:27:30.673 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-06T04:27:30.702 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-06T04:27:30.703 DEBUG:teuthology.orchestra.run.smithi083:> sudo update-grub 2023-10-06T04:27:31.798 INFO:teuthology.orchestra.run.smithi037.stderr:Sourcing file `/etc/default/grub' 2023-10-06T04:27:31.804 INFO:teuthology.orchestra.run.smithi037.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T04:27:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2023-10-06T04:27:32.025 INFO:teuthology.orchestra.run.smithi083.stderr:Sourcing file `/etc/default/grub' 2023-10-06T04:27:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T04:27:32.049 INFO:teuthology.orchestra.run.smithi083.stderr:Generating grub configuration file ... 2023-10-06T04:27:32.077 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T04:27:32.089 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T04:27:32.282 INFO:teuthology.orchestra.run.smithi083.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T04:27:32.294 INFO:teuthology.orchestra.run.smithi083.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T04:27:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T04:27:32.492 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T04:27:32.641 INFO:teuthology.orchestra.run.smithi083.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T04:27:32.652 INFO:teuthology.orchestra.run.smithi083.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T04:27:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:done 2023-10-06T04:27:34.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2023-10-06T04:27:34.303 INFO:teuthology.orchestra.run.smithi083.stderr:done 2023-10-06T04:27:34.304 DEBUG:teuthology.orchestra.run.smithi083:> sudo shutdown -r now 2023-10-06T04:28:04.114 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-06T04:28:04.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:28:04.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:28:04.308 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-06T04:28:04.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:28:04.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:28:22.522 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-10-06T04:28:22.778 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-06T04:28:31.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:28:31.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:28:31.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:28:31.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:28:34.842 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-06T04:28:46.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:28:46.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:28:49.914 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-10-06T04:29:01.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:29:01.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:29:04.990 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-10-06T04:29:18.546 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-10-06T04:29:19.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:29:19.137 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-164-generic"... 2023-10-06T04:29:19.137 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2023-10-06T04:29:19.144 INFO:teuthology.orchestra.run.smithi083.stdout:5.4.0-164-generic 2023-10-06T04:29:19.144 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-06T04:29:19.144 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:29:19.144 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T04:29:19.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:29:19.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:29:20.145 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-06T04:29:20.146 DEBUG:teuthology.orchestra.run.smithi083:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T04:29:20.202 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-10-06T04:29:20.229 INFO:teuthology.orchestra.run.smithi083.stdout:ttyS1 2023-10-06T04:29:20.261 DEBUG:teuthology.parallel:result is None 2023-10-06T04:29:20.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:29:20.734 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-164-generic"... 2023-10-06T04:29:20.734 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-10-06T04:29:20.742 INFO:teuthology.orchestra.run.smithi037.stdout:5.4.0-164-generic 2023-10-06T04:29:20.742 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-06T04:29:20.742 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:29:20.742 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T04:29:21.744 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-06T04:29:21.744 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T04:29:21.831 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2023-10-06T04:29:21.864 DEBUG:teuthology.parallel:result is None 2023-10-06T04:29:21.864 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T04:29:21.872 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T04:29:21.873 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:29:21.876 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:29:21.883 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T04:29:21.894 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T04:29:21.908 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T04:29:21.909 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:29:21.927 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:29:21.954 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T04:29:21.965 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T04:29:21.965 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:29:21.967 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:29:21.983 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:29:21.993 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:29:22.023 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:29:22.034 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:29:22.036 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T04:29:22.047 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T04:29:22.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:29:22.050 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:29:22.066 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T04:29:22.078 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T04:29:22.079 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:29:22.107 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:29:22.114 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:29:22.121 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:29:22.128 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:29:22.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:29:22.196 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:29:22.204 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:29:22.211 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:29:22.211 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:29:22.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2023-10-06T04:29:22.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2023-10-06T04:29:22.282 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T04:29:22.294 INFO:teuthology.task.internal:Starting timer... 2023-10-06T04:29:22.294 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T04:29:22.314 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T04:29:22.326 DEBUG:teuthology.task.selinux:Excluding smithi037: OS 'ubuntu' does not support SELinux 2023-10-06T04:29:22.326 DEBUG:teuthology.task.selinux:Excluding smithi083: OS 'ubuntu' does not support SELinux 2023-10-06T04:29:22.327 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T04:29:22.327 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-06T04:29:22.327 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T04:29:22.327 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T04:29:22.342 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T04:29:22.347 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T04:29:22.458 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T04:29:22.473 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T04:29:22.474 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi083.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T04:35:14.996 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi083.front.sepia.ceph.com')] 2023-10-06T04:35:14.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:35:14.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:35:15.049 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-10-06T04:35:15.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:35:15.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:35:15.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:35:15.224 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-10-06T04:35:15.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:35:15.344 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T04:35:15.357 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T04:35:15.358 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:35:15.358 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:35:15.360 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:35:15.360 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:35:15.389 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:15 ntpd[22771]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T04:35:15.390 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:15 ntpd[22771]: Command line: ntpd -gq 2023-10-06T04:35:15.391 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:15 ntpd[22771]: proto: precision = 0.102 usec (-23) 2023-10-06T04:35:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T04:35:15.392 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:15 ntpd[22771]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T04:35:15.392 INFO:teuthology.orchestra.run.smithi037.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T04:35:15.393 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:15 ntpd[22771]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T04:35:15.393 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:15 ntpd[22771]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T04:35:15.393 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:15 ntpd[22771]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T04:35:15.393 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:15 ntpd[22771]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T04:35:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:15 ntpd[22771]: Listen normally on 3 ens1f0 172.21.15.37:123 2023-10-06T04:35:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:15 ntpd[22771]: Listen normally on 4 lo [::1]:123 2023-10-06T04:35:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:15 ntpd[22771]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:fe88:7794%3]:123 2023-10-06T04:35:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:15 ntpd[22771]: Listening on routing socket on fd #22 for interface updates 2023-10-06T04:35:15.395 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:15 ntpd[22850]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T04:35:15.395 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:15 ntpd[22850]: Command line: ntpd -gq 2023-10-06T04:35:15.395 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:15 ntpd[22850]: proto: precision = 0.070 usec (-24) 2023-10-06T04:35:15.395 INFO:teuthology.orchestra.run.smithi083.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T04:35:15.395 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:15 ntpd[22850]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T04:35:15.396 INFO:teuthology.orchestra.run.smithi083.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T04:35:15.397 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:15 ntpd[22850]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T04:35:15.397 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:15 ntpd[22850]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T04:35:15.397 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:15 ntpd[22850]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T04:35:15.397 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:15 ntpd[22850]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T04:35:15.397 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:15 ntpd[22850]: Listen normally on 3 enp3s0f1 172.21.15.83:123 2023-10-06T04:35:15.397 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:15 ntpd[22850]: Listen normally on 4 lo [::1]:123 2023-10-06T04:35:15.397 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:15 ntpd[22850]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce91%5]:123 2023-10-06T04:35:15.397 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:15 ntpd[22850]: Listening on routing socket on fd #22 for interface updates 2023-10-06T04:35:16.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:16 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:16.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:16 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:16.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:16 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:16.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:16 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:16.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:16 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:16.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:16 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:16.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:16 ntpd[22771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:16.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:16 ntpd[22771]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:16.393 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:16 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:16.393 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:16 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:16.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:16 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:16.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:16 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:16.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:16 ntpd[22850]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:16.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:16 ntpd[22850]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:17.390 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:17 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:17.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:17 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:17.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:17 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:17.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:17 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:17.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:17 ntpd[22771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:17.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:17 ntpd[22771]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:18.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:18 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:18.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:18 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:18.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:18 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:18.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:18 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:18.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:18 ntpd[22771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:18.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:18 ntpd[22771]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:18.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:18 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:18.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:18 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:18.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:18 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:18.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:18 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:18.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:18 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:18.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:18 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:18.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:18 ntpd[22850]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:18.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:18 ntpd[22850]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:18.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:18 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:18.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:18 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:18.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:18 ntpd[22850]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:18.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:18 ntpd[22850]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:19.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:19 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:19.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:19 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:19.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:19 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:19.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:19 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:19.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:19 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:19.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:19 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:19.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:19 ntpd[22771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:19.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:19 ntpd[22771]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:19.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:19 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:19.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:19 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:19.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:19 ntpd[22771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:19.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:19 ntpd[22771]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:19.393 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:19 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:19.393 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:19 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:19.393 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:19 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:19.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:19 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:19.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:19 ntpd[22850]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:19.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:19 ntpd[22850]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:20.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:20 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:20.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:20 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:20.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:20 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:20.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:20 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:20.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:20 ntpd[22771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:20.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:20 ntpd[22771]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:20.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:20.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:20.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:20.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:20.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:20.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:20.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:20.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:20.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:20.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:20.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:20.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:20.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:20.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:20 ntpd[22850]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:21.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:21 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:21.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:21 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:21.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:21 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:21.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:21 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:21.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:21 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:21.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:21 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:21.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:21 ntpd[22771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:21.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:21 ntpd[22771]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:21.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:21 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:21.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:21 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:21.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:21 ntpd[22771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:21.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:21 ntpd[22771]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:21.393 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:21 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:21.393 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:21 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:21.393 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:21 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:21.393 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:21 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:21.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:21 ntpd[22850]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:21.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:21 ntpd[22850]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:22.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:22 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:22.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:22 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:22.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:22 ntpd[22771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:22.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:22 ntpd[22771]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:22.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:22 ntpd[22771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:22.391 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:22 ntpd[22771]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: 6 Oct 04:35:22 ntpd[22771]: ntpd: time slew +0.002778 s 2023-10-06T04:35:22.391 INFO:teuthology.orchestra.run.smithi037.stdout:ntpd: time slew +0.002778s 2023-10-06T04:35:22.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:22 ntpd[22771]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T04:35:22.392 INFO:teuthology.orchestra.run.smithi037.stderr: 6 Oct 04:35:22 ntpd[22771]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T04:35:22.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:22.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:22.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:22.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:22.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:22.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:22.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:22.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:22.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T04:35:22.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T04:35:22.394 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T04:35:22.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T04:35:22.395 INFO:teuthology.orchestra.run.smithi083.stdout: 6 Oct 04:35:22 ntpd[22850]: ntpd: time slew -0.000582 s 2023-10-06T04:35:22.395 INFO:teuthology.orchestra.run.smithi083.stdout:ntpd: time slew -0.000582s 2023-10-06T04:35:22.395 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T04:35:22.396 INFO:teuthology.orchestra.run.smithi083.stderr: 6 Oct 04:35:22 ntpd[22850]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T04:35:22.464 INFO:teuthology.orchestra.run.smithi037.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T04:35:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================== 2023-10-06T04:35:22.465 INFO:teuthology.orchestra.run.smithi037.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T04:35:22.465 INFO:teuthology.orchestra.run.smithi037.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T04:35:22.465 INFO:teuthology.orchestra.run.smithi037.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T04:35:22.465 INFO:teuthology.orchestra.run.smithi037.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T04:35:22.466 INFO:teuthology.orchestra.run.smithi083.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T04:35:22.466 INFO:teuthology.orchestra.run.smithi083.stdout:============================================================================== 2023-10-06T04:35:22.466 INFO:teuthology.orchestra.run.smithi083.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T04:35:22.466 INFO:teuthology.orchestra.run.smithi083.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T04:35:22.466 INFO:teuthology.orchestra.run.smithi083.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T04:35:22.466 INFO:teuthology.orchestra.run.smithi083.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T04:35:22.467 INFO:teuthology.run_tasks:Running task install... 2023-10-06T04:35:22.477 DEBUG:teuthology.task.install:project ceph 2023-10-06T04:35:22.477 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}} 2023-10-06T04:35:22.477 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'} 2023-10-06T04:35:22.477 INFO:teuthology.task.install:Using flavor: default 2023-10-06T04:35:22.483 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T04:35:22.483 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T04:35:22.484 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-key list | grep Ceph 2023-10-06T04:35:22.484 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-key list | grep Ceph 2023-10-06T04:35:22.582 INFO:teuthology.orchestra.run.smithi083.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T04:35:22.585 INFO:teuthology.orchestra.run.smithi037.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T04:35:22.640 INFO:teuthology.orchestra.run.smithi083.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T04:35:22.641 INFO:teuthology.orchestra.run.smithi083.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T04:35:22.642 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T04:35:22.642 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T04:35:22.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:35:22.647 INFO:teuthology.orchestra.run.smithi037.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T04:35:22.647 INFO:teuthology.orchestra.run.smithi037.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T04:35:22.648 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T04:35:22.648 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T04:35:22.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:35:22.783 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default/ 2023-10-06T04:35:22.783 INFO:teuthology.task.install.deb:Package version is 17.2.6-1274-g68e53a4a-1focal 2023-10-06T04:35:22.787 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default/ 2023-10-06T04:35:22.788 INFO:teuthology.task.install.deb:Package version is 17.2.6-1274-g68e53a4a-1focal 2023-10-06T04:35:22.891 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:35:22.891 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T04:35:22.907 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get update 2023-10-06T04:35:22.947 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:35:22.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T04:35:22.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get update 2023-10-06T04:35:23.103 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T04:35:23.108 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T04:35:23.125 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T04:35:23.150 INFO:teuthology.orchestra.run.smithi083.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal InRelease 2023-10-06T04:35:23.159 INFO:teuthology.orchestra.run.smithi037.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal InRelease 2023-10-06T04:35:23.171 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T04:35:23.180 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T04:35:23.195 INFO:teuthology.orchestra.run.smithi083.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T04:35:23.203 INFO:teuthology.orchestra.run.smithi037.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T04:35:23.224 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T04:35:23.224 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main i386 Packages [3,391 B] 2023-10-06T04:35:23.225 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main i386 Packages [3,391 B] 2023-10-06T04:35:23.242 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:8 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T04:35:23.245 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:6 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T04:35:23.264 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T04:35:23.267 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T04:35:23.294 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T04:35:23.380 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T04:35:23.776 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 28.4 kB in 1s (43.7 kB/s) 2023-10-06T04:35:23.888 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 28.4 kB in 1s (37.1 kB/s) 2023-10-06T04:35:24.856 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2023-10-06T04:35:24.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1274-g68e53a4a-1focal cephadm=17.2.6-1274-g68e53a4a-1focal ceph-mds=17.2.6-1274-g68e53a4a-1focal ceph-mgr=17.2.6-1274-g68e53a4a-1focal ceph-common=17.2.6-1274-g68e53a4a-1focal ceph-fuse=17.2.6-1274-g68e53a4a-1focal ceph-test=17.2.6-1274-g68e53a4a-1focal ceph-volume=17.2.6-1274-g68e53a4a-1focal radosgw=17.2.6-1274-g68e53a4a-1focal python3-rados=17.2.6-1274-g68e53a4a-1focal python3-rgw=17.2.6-1274-g68e53a4a-1focal python3-cephfs=17.2.6-1274-g68e53a4a-1focal python3-rbd=17.2.6-1274-g68e53a4a-1focal libcephfs2=17.2.6-1274-g68e53a4a-1focal libcephfs-dev=17.2.6-1274-g68e53a4a-1focal librados2=17.2.6-1274-g68e53a4a-1focal librbd1=17.2.6-1274-g68e53a4a-1focal rbd-fuse=17.2.6-1274-g68e53a4a-1focal python3-cephfs=17.2.6-1274-g68e53a4a-1focal cephfs-shell=17.2.6-1274-g68e53a4a-1focal cephfs-top=17.2.6-1274-g68e53a4a-1focal cephfs-mirror=17.2.6-1274-g68e53a4a-1focal 2023-10-06T04:35:24.922 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2023-10-06T04:35:24.948 DEBUG:teuthology.orchestra.run.smithi083:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1274-g68e53a4a-1focal cephadm=17.2.6-1274-g68e53a4a-1focal ceph-mds=17.2.6-1274-g68e53a4a-1focal ceph-mgr=17.2.6-1274-g68e53a4a-1focal ceph-common=17.2.6-1274-g68e53a4a-1focal ceph-fuse=17.2.6-1274-g68e53a4a-1focal ceph-test=17.2.6-1274-g68e53a4a-1focal ceph-volume=17.2.6-1274-g68e53a4a-1focal radosgw=17.2.6-1274-g68e53a4a-1focal python3-rados=17.2.6-1274-g68e53a4a-1focal python3-rgw=17.2.6-1274-g68e53a4a-1focal python3-cephfs=17.2.6-1274-g68e53a4a-1focal python3-rbd=17.2.6-1274-g68e53a4a-1focal libcephfs2=17.2.6-1274-g68e53a4a-1focal libcephfs-dev=17.2.6-1274-g68e53a4a-1focal librados2=17.2.6-1274-g68e53a4a-1focal librbd1=17.2.6-1274-g68e53a4a-1focal rbd-fuse=17.2.6-1274-g68e53a4a-1focal python3-cephfs=17.2.6-1274-g68e53a4a-1focal cephfs-shell=17.2.6-1274-g68e53a4a-1focal cephfs-top=17.2.6-1274-g68e53a4a-1focal cephfs-mirror=17.2.6-1274-g68e53a4a-1focal 2023-10-06T04:35:24.951 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2023-10-06T04:35:25.020 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2023-10-06T04:35:25.158 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2023-10-06T04:35:25.159 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2023-10-06T04:35:25.219 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2023-10-06T04:35:25.219 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2023-10-06T04:35:25.348 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T04:35:25.349 INFO:teuthology.orchestra.run.smithi037.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T04:35:25.349 INFO:teuthology.orchestra.run.smithi037.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T04:35:25.349 INFO:teuthology.orchestra.run.smithi037.stdout:The following additional packages will be installed: 2023-10-06T04:35:25.349 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T04:35:25.350 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T04:35:25.351 INFO:teuthology.orchestra.run.smithi037.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T04:35:25.351 INFO:teuthology.orchestra.run.smithi037.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T04:35:25.351 INFO:teuthology.orchestra.run.smithi037.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T04:35:25.351 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T04:35:25.351 INFO:teuthology.orchestra.run.smithi037.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T04:35:25.351 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T04:35:25.351 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T04:35:25.351 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T04:35:25.351 INFO:teuthology.orchestra.run.smithi037.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T04:35:25.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T04:35:25.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T04:35:25.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T04:35:25.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T04:35:25.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T04:35:25.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T04:35:25.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T04:35:25.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T04:35:25.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T04:35:25.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T04:35:25.352 INFO:teuthology.orchestra.run.smithi037.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T04:35:25.353 INFO:teuthology.orchestra.run.smithi037.stdout:Suggested packages: 2023-10-06T04:35:25.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T04:35:25.353 INFO:teuthology.orchestra.run.smithi037.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T04:35:25.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T04:35:25.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T04:35:25.353 INFO:teuthology.orchestra.run.smithi037.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T04:35:25.354 INFO:teuthology.orchestra.run.smithi037.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T04:35:25.354 INFO:teuthology.orchestra.run.smithi037.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T04:35:25.354 INFO:teuthology.orchestra.run.smithi037.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T04:35:25.354 INFO:teuthology.orchestra.run.smithi037.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T04:35:25.354 INFO:teuthology.orchestra.run.smithi037.stdout:Recommended packages: 2023-10-06T04:35:25.354 INFO:teuthology.orchestra.run.smithi037.stdout: btrfs-tools 2023-10-06T04:35:25.398 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T04:35:25.398 INFO:teuthology.orchestra.run.smithi083.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T04:35:25.398 INFO:teuthology.orchestra.run.smithi083.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T04:35:25.398 INFO:teuthology.orchestra.run.smithi083.stdout:The following additional packages will be installed: 2023-10-06T04:35:25.398 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T04:35:25.399 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T04:35:25.399 INFO:teuthology.orchestra.run.smithi083.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T04:35:25.399 INFO:teuthology.orchestra.run.smithi083.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T04:35:25.399 INFO:teuthology.orchestra.run.smithi083.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T04:35:25.401 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T04:35:25.401 INFO:teuthology.orchestra.run.smithi083.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T04:35:25.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T04:35:25.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T04:35:25.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T04:35:25.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T04:35:25.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T04:35:25.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T04:35:25.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout:Suggested packages: 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T04:35:25.402 INFO:teuthology.orchestra.run.smithi083.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T04:35:25.403 INFO:teuthology.orchestra.run.smithi083.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T04:35:25.403 INFO:teuthology.orchestra.run.smithi083.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T04:35:25.403 INFO:teuthology.orchestra.run.smithi083.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T04:35:25.403 INFO:teuthology.orchestra.run.smithi083.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T04:35:25.403 INFO:teuthology.orchestra.run.smithi083.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T04:35:25.403 INFO:teuthology.orchestra.run.smithi083.stdout:Recommended packages: 2023-10-06T04:35:25.403 INFO:teuthology.orchestra.run.smithi083.stdout: btrfs-tools 2023-10-06T04:35:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:The following NEW packages will be installed: 2023-10-06T04:35:25.477 INFO:teuthology.orchestra.run.smithi037.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T04:35:25.477 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T04:35:25.477 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T04:35:25.477 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T04:35:25.477 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T04:35:25.477 INFO:teuthology.orchestra.run.smithi037.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T04:35:25.477 INFO:teuthology.orchestra.run.smithi037.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T04:35:25.478 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T04:35:25.478 INFO:teuthology.orchestra.run.smithi037.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T04:35:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T04:35:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T04:35:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T04:35:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T04:35:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T04:35:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T04:35:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T04:35:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T04:35:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T04:35:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T04:35:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T04:35:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T04:35:25.480 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T04:35:25.480 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T04:35:25.480 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T04:35:25.480 INFO:teuthology.orchestra.run.smithi037.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T04:35:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages will be upgraded: 2023-10-06T04:35:25.480 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 librbd1 2023-10-06T04:35:25.523 INFO:teuthology.orchestra.run.smithi083.stdout:The following NEW packages will be installed: 2023-10-06T04:35:25.524 INFO:teuthology.orchestra.run.smithi083.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T04:35:25.524 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T04:35:25.524 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T04:35:25.524 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T04:35:25.524 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T04:35:25.524 INFO:teuthology.orchestra.run.smithi083.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T04:35:25.524 INFO:teuthology.orchestra.run.smithi083.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T04:35:25.526 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T04:35:25.526 INFO:teuthology.orchestra.run.smithi083.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T04:35:25.526 INFO:teuthology.orchestra.run.smithi083.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T04:35:25.526 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T04:35:25.526 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T04:35:25.526 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T04:35:25.526 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T04:35:25.527 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T04:35:25.527 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T04:35:25.527 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T04:35:25.527 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T04:35:25.527 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T04:35:25.527 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T04:35:25.527 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T04:35:25.527 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T04:35:25.527 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T04:35:25.527 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T04:35:25.527 INFO:teuthology.orchestra.run.smithi083.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T04:35:25.528 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages will be upgraded: 2023-10-06T04:35:25.528 INFO:teuthology.orchestra.run.smithi083.stdout: librados2 librbd1 2023-10-06T04:35:25.593 INFO:teuthology.orchestra.run.smithi083.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-06T04:35:25.593 INFO:teuthology.orchestra.run.smithi083.stdout:Need to get 210 MB of archives. 2023-10-06T04:35:25.593 INFO:teuthology.orchestra.run.smithi083.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T04:35:25.593 INFO:teuthology.orchestra.run.smithi083.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T04:35:25.611 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T04:35:25.620 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T04:35:25.647 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T04:35:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-06T04:35:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:Need to get 210 MB of archives. 2023-10-06T04:35:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T04:35:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T04:35:25.673 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1274-g68e53a4a-1focal [3,501 kB] 2023-10-06T04:35:25.675 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T04:35:25.677 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T04:35:25.687 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T04:35:25.689 INFO:teuthology.orchestra.run.smithi083.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T04:35:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1274-g68e53a4a-1focal [3,501 kB] 2023-10-06T04:35:25.707 INFO:teuthology.orchestra.run.smithi083.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T04:35:25.708 INFO:teuthology.orchestra.run.smithi083.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T04:35:25.713 INFO:teuthology.orchestra.run.smithi083.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T04:35:25.743 INFO:teuthology.orchestra.run.smithi083.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T04:35:25.745 INFO:teuthology.orchestra.run.smithi083.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T04:35:25.751 INFO:teuthology.orchestra.run.smithi083.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T04:35:25.753 INFO:teuthology.orchestra.run.smithi083.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T04:35:25.753 INFO:teuthology.orchestra.run.smithi083.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T04:35:25.754 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T04:35:25.755 INFO:teuthology.orchestra.run.smithi083.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T04:35:25.756 INFO:teuthology.orchestra.run.smithi083.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T04:35:25.756 INFO:teuthology.orchestra.run.smithi083.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T04:35:25.757 INFO:teuthology.orchestra.run.smithi083.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T04:35:25.762 INFO:teuthology.orchestra.run.smithi083.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T04:35:25.775 INFO:teuthology.orchestra.run.smithi083.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T04:35:25.776 INFO:teuthology.orchestra.run.smithi083.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T04:35:25.776 INFO:teuthology.orchestra.run.smithi083.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T04:35:25.777 INFO:teuthology.orchestra.run.smithi083.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T04:35:25.777 INFO:teuthology.orchestra.run.smithi083.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T04:35:25.778 INFO:teuthology.orchestra.run.smithi083.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T04:35:25.779 INFO:teuthology.orchestra.run.smithi083.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T04:35:25.780 INFO:teuthology.orchestra.run.smithi083.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T04:35:25.781 INFO:teuthology.orchestra.run.smithi083.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T04:35:25.788 INFO:teuthology.orchestra.run.smithi037.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T04:35:25.796 INFO:teuthology.orchestra.run.smithi083.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T04:35:25.797 INFO:teuthology.orchestra.run.smithi083.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T04:35:25.801 INFO:teuthology.orchestra.run.smithi083.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T04:35:25.801 INFO:teuthology.orchestra.run.smithi083.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T04:35:25.802 INFO:teuthology.orchestra.run.smithi083.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T04:35:25.802 INFO:teuthology.orchestra.run.smithi083.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T04:35:25.814 INFO:teuthology.orchestra.run.smithi083.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T04:35:25.816 INFO:teuthology.orchestra.run.smithi083.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T04:35:25.817 INFO:teuthology.orchestra.run.smithi083.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T04:35:25.818 INFO:teuthology.orchestra.run.smithi083.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T04:35:25.830 INFO:teuthology.orchestra.run.smithi083.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T04:35:25.831 INFO:teuthology.orchestra.run.smithi083.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T04:35:25.832 INFO:teuthology.orchestra.run.smithi083.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T04:35:25.833 INFO:teuthology.orchestra.run.smithi083.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T04:35:25.833 INFO:teuthology.orchestra.run.smithi083.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T04:35:25.898 INFO:teuthology.orchestra.run.smithi083.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1274-g68e53a4a-1focal [3,551 kB] 2023-10-06T04:35:25.912 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T04:35:25.917 INFO:teuthology.orchestra.run.smithi083.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T04:35:25.932 INFO:teuthology.orchestra.run.smithi083.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T04:35:25.933 INFO:teuthology.orchestra.run.smithi083.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T04:35:25.944 INFO:teuthology.orchestra.run.smithi083.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T04:35:25.945 INFO:teuthology.orchestra.run.smithi083.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T04:35:25.945 INFO:teuthology.orchestra.run.smithi083.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T04:35:25.945 INFO:teuthology.orchestra.run.smithi083.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T04:35:25.946 INFO:teuthology.orchestra.run.smithi083.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T04:35:25.946 INFO:teuthology.orchestra.run.smithi083.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T04:35:25.946 INFO:teuthology.orchestra.run.smithi083.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T04:35:25.952 INFO:teuthology.orchestra.run.smithi083.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T04:35:25.952 INFO:teuthology.orchestra.run.smithi083.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T04:35:25.969 INFO:teuthology.orchestra.run.smithi083.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T04:35:25.973 INFO:teuthology.orchestra.run.smithi083.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T04:35:25.975 INFO:teuthology.orchestra.run.smithi083.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T04:35:25.978 INFO:teuthology.orchestra.run.smithi083.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T04:35:25.979 INFO:teuthology.orchestra.run.smithi083.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T04:35:25.981 INFO:teuthology.orchestra.run.smithi083.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T04:35:25.983 INFO:teuthology.orchestra.run.smithi083.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T04:35:25.984 INFO:teuthology.orchestra.run.smithi083.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T04:35:25.998 INFO:teuthology.orchestra.run.smithi083.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T04:35:26.000 INFO:teuthology.orchestra.run.smithi083.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T04:35:26.036 INFO:teuthology.orchestra.run.smithi083.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T04:35:26.037 INFO:teuthology.orchestra.run.smithi083.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T04:35:26.037 INFO:teuthology.orchestra.run.smithi083.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T04:35:26.050 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T04:35:26.060 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T04:35:26.072 INFO:teuthology.orchestra.run.smithi083.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1274-g68e53a4a-1focal [760 kB] 2023-10-06T04:35:26.073 INFO:teuthology.orchestra.run.smithi083.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T04:35:26.073 INFO:teuthology.orchestra.run.smithi083.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T04:35:26.074 INFO:teuthology.orchestra.run.smithi083.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T04:35:26.090 INFO:teuthology.orchestra.run.smithi083.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T04:35:26.090 INFO:teuthology.orchestra.run.smithi083.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T04:35:26.090 INFO:teuthology.orchestra.run.smithi083.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T04:35:26.090 INFO:teuthology.orchestra.run.smithi083.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T04:35:26.091 INFO:teuthology.orchestra.run.smithi083.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T04:35:26.092 INFO:teuthology.orchestra.run.smithi083.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T04:35:26.104 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T04:35:26.106 INFO:teuthology.orchestra.run.smithi083.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T04:35:26.106 INFO:teuthology.orchestra.run.smithi083.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1274-g68e53a4a-1focal [413 kB] 2023-10-06T04:35:26.107 INFO:teuthology.orchestra.run.smithi083.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T04:35:26.108 INFO:teuthology.orchestra.run.smithi083.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T04:35:26.116 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T04:35:26.120 INFO:teuthology.orchestra.run.smithi083.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1274-g68e53a4a-1focal [22.5 kB] 2023-10-06T04:35:26.120 INFO:teuthology.orchestra.run.smithi083.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1274-g68e53a4a-1focal [200 kB] 2023-10-06T04:35:26.127 INFO:teuthology.orchestra.run.smithi083.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1274-g68e53a4a-1focal [47.1 kB] 2023-10-06T04:35:26.128 INFO:teuthology.orchestra.run.smithi083.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1274-g68e53a4a-1focal [386 kB] 2023-10-06T04:35:26.142 INFO:teuthology.orchestra.run.smithi083.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1274-g68e53a4a-1focal [5,567 kB] 2023-10-06T04:35:26.164 INFO:teuthology.orchestra.run.smithi037.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1274-g68e53a4a-1focal [3,551 kB] 2023-10-06T04:35:26.198 INFO:teuthology.orchestra.run.smithi037.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T04:35:26.203 INFO:teuthology.orchestra.run.smithi037.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T04:35:26.226 INFO:teuthology.orchestra.run.smithi037.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T04:35:26.452 INFO:teuthology.orchestra.run.smithi037.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1274-g68e53a4a-1focal [760 kB] 2023-10-06T04:35:26.473 INFO:teuthology.orchestra.run.smithi083.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1274-g68e53a4a-1focal [116 kB] 2023-10-06T04:35:26.474 INFO:teuthology.orchestra.run.smithi083.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1274-g68e53a4a-1focal [479 kB] 2023-10-06T04:35:26.509 INFO:teuthology.orchestra.run.smithi037.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1274-g68e53a4a-1focal [413 kB] 2023-10-06T04:35:26.515 INFO:teuthology.orchestra.run.smithi037.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T04:35:26.532 INFO:teuthology.orchestra.run.smithi083.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1274-g68e53a4a-1focal [27.7 MB] 2023-10-06T04:35:26.547 INFO:teuthology.orchestra.run.smithi037.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1274-g68e53a4a-1focal [22.5 kB] 2023-10-06T04:35:26.548 INFO:teuthology.orchestra.run.smithi037.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1274-g68e53a4a-1focal [200 kB] 2023-10-06T04:35:26.563 INFO:teuthology.orchestra.run.smithi037.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1274-g68e53a4a-1focal [47.1 kB] 2023-10-06T04:35:26.565 INFO:teuthology.orchestra.run.smithi037.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1274-g68e53a4a-1focal [386 kB] 2023-10-06T04:35:26.587 INFO:teuthology.orchestra.run.smithi037.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1274-g68e53a4a-1focal [5,567 kB] 2023-10-06T04:35:26.915 INFO:teuthology.orchestra.run.smithi037.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1274-g68e53a4a-1focal [116 kB] 2023-10-06T04:35:26.921 INFO:teuthology.orchestra.run.smithi037.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1274-g68e53a4a-1focal [479 kB] 2023-10-06T04:35:26.947 INFO:teuthology.orchestra.run.smithi037.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T04:35:26.949 INFO:teuthology.orchestra.run.smithi037.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1274-g68e53a4a-1focal [27.7 MB] 2023-10-06T04:35:27.129 INFO:teuthology.orchestra.run.smithi037.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T04:35:27.160 INFO:teuthology.orchestra.run.smithi037.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T04:35:27.166 INFO:teuthology.orchestra.run.smithi037.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T04:35:27.191 INFO:teuthology.orchestra.run.smithi037.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T04:35:27.195 INFO:teuthology.orchestra.run.smithi037.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T04:35:27.198 INFO:teuthology.orchestra.run.smithi037.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T04:35:27.211 INFO:teuthology.orchestra.run.smithi037.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T04:35:27.213 INFO:teuthology.orchestra.run.smithi037.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T04:35:27.214 INFO:teuthology.orchestra.run.smithi037.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T04:35:27.380 INFO:teuthology.orchestra.run.smithi037.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T04:35:27.544 INFO:teuthology.orchestra.run.smithi037.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T04:35:27.684 INFO:teuthology.orchestra.run.smithi037.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T04:35:27.703 INFO:teuthology.orchestra.run.smithi037.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T04:35:27.715 INFO:teuthology.orchestra.run.smithi037.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T04:35:27.792 INFO:teuthology.orchestra.run.smithi037.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T04:35:27.813 INFO:teuthology.orchestra.run.smithi037.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T04:35:27.853 INFO:teuthology.orchestra.run.smithi037.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T04:35:27.883 INFO:teuthology.orchestra.run.smithi037.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T04:35:27.887 INFO:teuthology.orchestra.run.smithi037.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T04:35:27.982 INFO:teuthology.orchestra.run.smithi037.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T04:35:28.147 INFO:teuthology.orchestra.run.smithi037.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T04:35:28.331 INFO:teuthology.orchestra.run.smithi037.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T04:35:28.428 INFO:teuthology.orchestra.run.smithi037.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T04:35:28.504 INFO:teuthology.orchestra.run.smithi037.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1274-g68e53a4a-1focal [6,449 kB] 2023-10-06T04:35:28.514 INFO:teuthology.orchestra.run.smithi037.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T04:35:28.621 INFO:teuthology.orchestra.run.smithi037.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T04:35:28.650 INFO:teuthology.orchestra.run.smithi037.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T04:35:28.654 INFO:teuthology.orchestra.run.smithi037.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T04:35:28.678 INFO:teuthology.orchestra.run.smithi037.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T04:35:28.699 INFO:teuthology.orchestra.run.smithi037.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T04:35:28.700 INFO:teuthology.orchestra.run.smithi037.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1274-g68e53a4a-1focal [221 kB] 2023-10-06T04:35:28.707 INFO:teuthology.orchestra.run.smithi037.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1274-g68e53a4a-1focal [152 kB] 2023-10-06T04:35:28.713 INFO:teuthology.orchestra.run.smithi037.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1274-g68e53a4a-1focal [1,590 kB] 2023-10-06T04:35:28.715 INFO:teuthology.orchestra.run.smithi037.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T04:35:28.717 INFO:teuthology.orchestra.run.smithi037.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T04:35:28.792 INFO:teuthology.orchestra.run.smithi037.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1274-g68e53a4a-1focal [7,846 kB] 2023-10-06T04:35:28.886 INFO:teuthology.orchestra.run.smithi037.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T04:35:29.007 INFO:teuthology.orchestra.run.smithi083.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1274-g68e53a4a-1focal [6,449 kB] 2023-10-06T04:35:29.168 INFO:teuthology.orchestra.run.smithi037.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1274-g68e53a4a-1focal [28.7 MB] 2023-10-06T04:35:29.564 INFO:teuthology.orchestra.run.smithi083.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1274-g68e53a4a-1focal [221 kB] 2023-10-06T04:35:29.586 INFO:teuthology.orchestra.run.smithi083.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1274-g68e53a4a-1focal [152 kB] 2023-10-06T04:35:29.602 INFO:teuthology.orchestra.run.smithi083.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1274-g68e53a4a-1focal [1,590 kB] 2023-10-06T04:35:29.763 INFO:teuthology.orchestra.run.smithi083.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1274-g68e53a4a-1focal [7,846 kB] 2023-10-06T04:35:29.865 INFO:teuthology.orchestra.run.smithi037.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T04:35:29.890 INFO:teuthology.orchestra.run.smithi037.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T04:35:29.891 INFO:teuthology.orchestra.run.smithi037.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T04:35:29.963 INFO:teuthology.orchestra.run.smithi037.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T04:35:29.963 INFO:teuthology.orchestra.run.smithi037.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T04:35:29.963 INFO:teuthology.orchestra.run.smithi037.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T04:35:29.964 INFO:teuthology.orchestra.run.smithi037.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T04:35:29.964 INFO:teuthology.orchestra.run.smithi037.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T04:35:29.965 INFO:teuthology.orchestra.run.smithi037.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T04:35:29.965 INFO:teuthology.orchestra.run.smithi037.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T04:35:30.129 INFO:teuthology.orchestra.run.smithi037.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T04:35:30.296 INFO:teuthology.orchestra.run.smithi037.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T04:35:30.378 INFO:teuthology.orchestra.run.smithi037.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T04:35:30.572 INFO:teuthology.orchestra.run.smithi083.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1274-g68e53a4a-1focal [28.7 MB] 2023-10-06T04:35:30.628 INFO:teuthology.orchestra.run.smithi037.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T04:35:30.694 INFO:teuthology.orchestra.run.smithi037.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T04:35:30.695 INFO:teuthology.orchestra.run.smithi037.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1274-g68e53a4a-1focal [3,928 B] 2023-10-06T04:35:30.695 INFO:teuthology.orchestra.run.smithi037.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1274-g68e53a4a-1focal [870 kB] 2023-10-06T04:35:30.698 INFO:teuthology.orchestra.run.smithi037.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T04:35:30.700 INFO:teuthology.orchestra.run.smithi037.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T04:35:30.709 INFO:teuthology.orchestra.run.smithi037.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1274-g68e53a4a-1focal [2,406 kB] 2023-10-06T04:35:30.726 INFO:teuthology.orchestra.run.smithi037.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1274-g68e53a4a-1focal [79.1 kB] 2023-10-06T04:35:30.727 INFO:teuthology.orchestra.run.smithi037.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1274-g68e53a4a-1focal [117 kB] 2023-10-06T04:35:30.728 INFO:teuthology.orchestra.run.smithi037.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1274-g68e53a4a-1focal [1,760 kB] 2023-10-06T04:35:30.742 INFO:teuthology.orchestra.run.smithi037.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T04:35:30.769 INFO:teuthology.orchestra.run.smithi037.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T04:35:30.771 INFO:teuthology.orchestra.run.smithi037.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T04:35:30.813 INFO:teuthology.orchestra.run.smithi037.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1274-g68e53a4a-1focal [7,886 kB] 2023-10-06T04:35:30.892 INFO:teuthology.orchestra.run.smithi037.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T04:35:31.065 INFO:teuthology.orchestra.run.smithi037.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T04:35:31.189 INFO:teuthology.orchestra.run.smithi037.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1274-g68e53a4a-1focal [4,040 B] 2023-10-06T04:35:31.189 INFO:teuthology.orchestra.run.smithi037.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1274-g68e53a4a-1focal [56.3 MB] 2023-10-06T04:35:31.887 INFO:teuthology.orchestra.run.smithi037.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T04:35:31.889 INFO:teuthology.orchestra.run.smithi037.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T04:35:31.890 INFO:teuthology.orchestra.run.smithi037.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T04:35:31.891 INFO:teuthology.orchestra.run.smithi037.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T04:35:31.892 INFO:teuthology.orchestra.run.smithi037.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T04:35:31.894 INFO:teuthology.orchestra.run.smithi037.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T04:35:31.909 INFO:teuthology.orchestra.run.smithi037.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T04:35:31.909 INFO:teuthology.orchestra.run.smithi037.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T04:35:31.910 INFO:teuthology.orchestra.run.smithi037.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T04:35:31.967 INFO:teuthology.orchestra.run.smithi037.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T04:35:32.134 INFO:teuthology.orchestra.run.smithi037.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T04:35:32.419 INFO:teuthology.orchestra.run.smithi037.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T04:35:32.440 INFO:teuthology.orchestra.run.smithi037.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T04:35:32.591 INFO:teuthology.orchestra.run.smithi037.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T04:35:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T04:35:33.782 INFO:teuthology.orchestra.run.smithi083.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1274-g68e53a4a-1focal [3,928 B] 2023-10-06T04:35:33.782 INFO:teuthology.orchestra.run.smithi083.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1274-g68e53a4a-1focal [870 kB] 2023-10-06T04:35:33.797 INFO:teuthology.orchestra.run.smithi083.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1274-g68e53a4a-1focal [2,406 kB] 2023-10-06T04:35:33.989 INFO:teuthology.orchestra.run.smithi083.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1274-g68e53a4a-1focal [79.1 kB] 2023-10-06T04:35:33.992 INFO:teuthology.orchestra.run.smithi083.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1274-g68e53a4a-1focal [117 kB] 2023-10-06T04:35:33.995 INFO:teuthology.orchestra.run.smithi083.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1274-g68e53a4a-1focal [1,760 kB] 2023-10-06T04:35:34.056 INFO:teuthology.orchestra.run.smithi037.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1274-g68e53a4a-1focal [229 kB] 2023-10-06T04:35:34.061 INFO:teuthology.orchestra.run.smithi037.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1274-g68e53a4a-1focal [239 kB] 2023-10-06T04:35:34.065 INFO:teuthology.orchestra.run.smithi037.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1274-g68e53a4a-1focal [22.0 kB] 2023-10-06T04:35:34.078 INFO:teuthology.orchestra.run.smithi083.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1274-g68e53a4a-1focal [7,886 kB] 2023-10-06T04:35:34.124 INFO:teuthology.orchestra.run.smithi037.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1274-g68e53a4a-1focal [12.8 kB] 2023-10-06T04:35:34.124 INFO:teuthology.orchestra.run.smithi037.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1274-g68e53a4a-1focal [21.9 kB] 2023-10-06T04:35:34.125 INFO:teuthology.orchestra.run.smithi037.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1274-g68e53a4a-1focal [17.0 MB] 2023-10-06T04:35:34.773 INFO:teuthology.orchestra.run.smithi083.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1274-g68e53a4a-1focal [4,040 B] 2023-10-06T04:35:34.774 INFO:teuthology.orchestra.run.smithi083.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1274-g68e53a4a-1focal [56.3 MB] 2023-10-06T04:35:34.854 INFO:teuthology.orchestra.run.smithi037.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1274-g68e53a4a-1focal [79.4 kB] 2023-10-06T04:35:35.489 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 210 MB in 9s (22.4 MB/s) 2023-10-06T04:35:35.622 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T04:35:35.679 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-06T04:35:35.683 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T04:35:35.720 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T04:35:36.048 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T04:35:36.064 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T04:35:36.106 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T04:35:36.409 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T04:35:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T04:35:36.467 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T04:35:36.778 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T04:35:36.801 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T04:35:36.879 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T04:35:37.042 INFO:teuthology.orchestra.run.smithi083.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1274-g68e53a4a-1focal [229 kB] 2023-10-06T04:35:37.048 INFO:teuthology.orchestra.run.smithi083.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1274-g68e53a4a-1focal [239 kB] 2023-10-06T04:35:37.052 INFO:teuthology.orchestra.run.smithi083.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1274-g68e53a4a-1focal [22.0 kB] 2023-10-06T04:35:37.053 INFO:teuthology.orchestra.run.smithi083.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1274-g68e53a4a-1focal [12.8 kB] 2023-10-06T04:35:37.053 INFO:teuthology.orchestra.run.smithi083.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1274-g68e53a4a-1focal [21.9 kB] 2023-10-06T04:35:37.054 INFO:teuthology.orchestra.run.smithi083.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1274-g68e53a4a-1focal [17.0 MB] 2023-10-06T04:35:37.276 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../004-librbd1_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:37.399 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librbd1 (17.2.6-1274-g68e53a4a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T04:35:37.586 INFO:teuthology.orchestra.run.smithi083.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1274-g68e53a4a-1focal [79.4 kB] 2023-10-06T04:35:38.111 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../005-librados2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:38.210 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 210 MB in 12s (17.4 MB/s) 2023-10-06T04:35:38.270 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librados2 (17.2.6-1274-g68e53a4a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T04:35:38.388 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T04:35:38.444 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-06T04:35:38.448 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T04:35:38.495 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T04:35:38.811 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T04:35:38.829 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T04:35:38.864 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T04:35:38.957 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T04:35:38.973 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:39.015 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libcephfs2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:39.117 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T04:35:39.134 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T04:35:39.175 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T04:35:39.360 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rados. 2023-10-06T04:35:39.380 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:39.418 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rados (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:39.603 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T04:35:39.619 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T04:35:39.703 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T04:35:39.771 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T04:35:39.787 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:35:39.862 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-ceph-argparse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:40.098 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../004-librbd1_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:40.131 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T04:35:40.149 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:40.189 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cephfs (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:40.257 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librbd1 (17.2.6-1274-g68e53a4a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T04:35:40.577 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T04:35:40.597 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:35:40.735 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:40.965 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../005-librados2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:41.095 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librados2 (17.2.6-1274-g68e53a4a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T04:35:41.116 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T04:35:41.132 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T04:35:41.174 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T04:35:41.427 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T04:35:41.446 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:41.490 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rbd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:41.824 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T04:35:41.841 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T04:35:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T04:35:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T04:35:41.907 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libcephfs2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:42.218 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-rados. 2023-10-06T04:35:42.234 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:42.268 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-rados (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:42.304 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T04:35:42.322 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T04:35:42.354 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T04:35:42.708 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T04:35:42.728 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T04:35:42.766 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T04:35:42.913 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T04:35:42.932 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:35:42.971 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-ceph-argparse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:43.161 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T04:35:43.178 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T04:35:43.219 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T04:35:43.248 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T04:35:43.268 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:43.332 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cephfs (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:43.555 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T04:35:43.571 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T04:35:43.605 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T04:35:43.677 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T04:35:43.696 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:35:43.726 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:44.073 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T04:35:44.075 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T04:35:44.092 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T04:35:44.092 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T04:35:44.131 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T04:35:44.144 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T04:35:44.417 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T04:35:44.433 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:44.475 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-rbd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:44.637 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T04:35:44.654 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T04:35:44.695 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T04:35:44.850 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T04:35:44.869 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T04:35:44.908 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T04:35:45.040 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T04:35:45.058 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T04:35:45.098 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T04:35:45.337 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T04:35:45.356 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T04:35:45.395 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T04:35:45.492 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T04:35:45.512 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T04:35:45.551 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T04:35:45.757 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T04:35:45.776 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T04:35:45.815 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T04:35:45.937 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librgw2. 2023-10-06T04:35:45.954 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../022-librgw2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:45.995 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librgw2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:46.235 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T04:35:46.250 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T04:35:46.294 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T04:35:46.621 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T04:35:46.637 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T04:35:46.696 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T04:35:46.798 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T04:35:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:47.199 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T04:35:47.234 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liboath0. 2023-10-06T04:35:47.234 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T04:35:47.242 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T04:35:47.267 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T04:35:47.283 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T04:35:47.637 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T04:35:47.654 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:47.696 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libradosstriper1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:47.826 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T04:35:47.845 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T04:35:47.894 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T04:35:48.182 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-common. 2023-10-06T04:35:48.201 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:48.232 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T04:35:48.257 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T04:35:48.331 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T04:35:48.709 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T04:35:48.728 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T04:35:48.800 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T04:35:49.170 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package librgw2. 2023-10-06T04:35:49.189 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../022-librgw2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:49.270 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librgw2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:50.097 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T04:35:50.113 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:50.147 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-rgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:50.475 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package liboath0. 2023-10-06T04:35:50.493 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T04:35:50.566 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T04:35:50.904 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T04:35:50.920 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:50.962 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libradosstriper1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:51.021 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-base. 2023-10-06T04:35:51.040 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:51.089 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-base (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:51.382 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-common. 2023-10-06T04:35:51.398 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:51.432 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:52.125 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T04:35:52.145 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T04:35:52.183 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T04:35:52.587 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T04:35:52.603 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T04:35:52.644 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T04:35:52.945 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T04:35:52.965 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:35:53.014 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:53.394 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T04:35:53.410 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T04:35:53.452 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T04:35:53.788 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T04:35:53.804 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T04:35:53.846 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T04:35:54.173 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-base. 2023-10-06T04:35:54.190 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:35:54.225 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T04:35:54.240 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-base (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:54.242 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T04:35:54.283 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T04:35:54.619 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T04:35:54.635 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T04:35:54.677 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T04:35:54.989 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T04:35:55.006 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T04:35:55.039 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T04:35:55.294 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T04:35:55.312 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T04:35:55.352 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T04:35:55.367 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T04:35:55.383 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T04:35:55.425 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T04:35:55.714 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T04:35:55.731 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T04:35:55.761 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-mako. 2023-10-06T04:35:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T04:35:55.781 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T04:35:55.819 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T04:35:56.058 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T04:35:56.074 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:35:56.116 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:35:56.423 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T04:35:56.442 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T04:35:56.555 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T04:35:56.575 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T04:35:56.605 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T04:35:56.914 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T04:35:56.975 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T04:35:56.993 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T04:35:57.033 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T04:35:57.200 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T04:35:57.216 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T04:35:57.250 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T04:35:57.445 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T04:35:57.462 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T04:35:57.505 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T04:35:57.513 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-webob. 2023-10-06T04:35:57.533 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T04:35:57.561 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T04:35:57.831 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T04:35:57.850 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T04:35:57.864 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T04:35:57.884 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T04:35:57.922 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T04:35:57.931 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T04:35:58.258 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T04:35:58.275 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T04:35:58.316 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T04:35:58.686 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T04:35:58.703 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T04:35:58.747 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T04:35:59.068 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T04:35:59.088 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T04:35:59.106 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T04:35:59.122 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T04:35:59.127 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T04:35:59.164 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T04:35:59.475 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-paste. 2023-10-06T04:35:59.491 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T04:35:59.504 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T04:35:59.522 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T04:35:59.533 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T04:35:59.562 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T04:35:59.878 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T04:35:59.895 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T04:35:59.932 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-mako. 2023-10-06T04:35:59.936 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T04:35:59.948 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T04:35:59.990 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T04:36:00.264 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T04:36:00.284 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T04:36:00.322 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T04:36:00.335 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T04:36:00.354 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T04:36:00.418 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T04:36:00.592 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T04:36:00.608 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T04:36:00.650 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T04:36:00.755 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T04:36:00.771 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T04:36:00.813 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T04:36:00.961 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T04:36:00.980 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T04:36:01.019 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T04:36:01.158 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-webob. 2023-10-06T04:36:01.174 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T04:36:01.216 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T04:36:01.390 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T04:36:01.407 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T04:36:01.448 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T04:36:01.585 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T04:36:01.601 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T04:36:01.644 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T04:36:01.827 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T04:36:01.843 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:01.885 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:01.980 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T04:36:01.995 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T04:36:02.063 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T04:36:02.246 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T04:36:02.263 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:02.314 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:02.441 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T04:36:02.458 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T04:36:02.536 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T04:36:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T04:36:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:02.840 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mon (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:02.894 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T04:36:02.910 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T04:36:02.971 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T04:36:03.305 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-paste. 2023-10-06T04:36:03.322 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T04:36:03.364 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T04:36:03.742 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T04:36:03.758 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T04:36:03.800 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T04:36:04.052 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T04:36:04.069 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:04.119 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-osd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:04.136 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T04:36:04.153 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T04:36:04.228 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T04:36:04.565 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T04:36:04.580 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T04:36:04.623 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T04:36:04.986 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T04:36:05.000 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T04:36:05.042 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T04:36:05.405 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T04:36:05.424 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T04:36:05.463 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T04:36:05.900 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T04:36:05.920 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:05.958 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:06.378 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T04:36:06.397 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:06.436 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:06.947 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph. 2023-10-06T04:36:06.963 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../055-ceph_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:06.990 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T04:36:07.005 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:07.006 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:07.089 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mon (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:07.380 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T04:36:07.400 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:07.442 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:07.869 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T04:36:07.886 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:07.960 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mds (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:08.260 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T04:36:08.276 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:08.359 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-osd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:08.513 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephadm. 2023-10-06T04:36:08.530 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../058-cephadm_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:08.571 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:08.891 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T04:36:08.907 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T04:36:08.949 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T04:36:09.285 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T04:36:09.304 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:09.343 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:09.721 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T04:36:09.739 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T04:36:09.779 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T04:36:10.032 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T04:36:10.051 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T04:36:10.123 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T04:36:10.401 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T04:36:10.418 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T04:36:10.459 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T04:36:10.803 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-routes. 2023-10-06T04:36:10.820 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T04:36:10.861 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T04:36:11.214 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T04:36:11.233 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:11.272 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:11.321 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph. 2023-10-06T04:36:11.339 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../055-ceph_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:11.404 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:11.740 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T04:36:11.757 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:11.790 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T04:36:11.809 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T04:36:11.850 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T04:36:12.153 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T04:36:12.170 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T04:36:12.211 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T04:36:12.252 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T04:36:12.267 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:12.335 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mds (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:12.913 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package cephadm. 2023-10-06T04:36:12.922 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T04:36:12.930 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../058-cephadm_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:12.939 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T04:36:12.971 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:12.980 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T04:36:13.341 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T04:36:13.358 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T04:36:13.399 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T04:36:13.785 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T04:36:13.802 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:13.843 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:14.314 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T04:36:14.331 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T04:36:14.372 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T04:36:14.597 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T04:36:14.614 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T04:36:14.654 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T04:36:14.909 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T04:36:14.929 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T04:36:14.966 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T04:36:14.967 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T04:36:14.985 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T04:36:15.058 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T04:36:15.343 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T04:36:15.359 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T04:36:15.379 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T04:36:15.396 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T04:36:15.401 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T04:36:15.437 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T04:36:15.787 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-routes. 2023-10-06T04:36:15.806 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T04:36:15.845 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T04:36:16.187 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T04:36:16.206 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:16.241 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T04:36:16.244 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:16.256 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:16.299 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:16.844 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T04:36:16.860 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T04:36:16.902 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T04:36:17.246 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T04:36:17.265 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T04:36:17.329 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T04:36:17.406 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T04:36:17.423 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T04:36:17.464 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T04:36:17.716 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T04:36:17.733 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T04:36:17.774 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T04:36:17.783 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T04:36:17.802 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T04:36:17.833 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T04:36:18.145 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T04:36:18.165 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T04:36:18.203 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T04:36:18.556 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T04:36:18.574 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T04:36:18.614 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T04:36:18.942 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T04:36:18.959 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T04:36:19.000 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T04:36:19.133 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T04:36:19.150 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T04:36:19.191 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T04:36:19.320 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T04:36:19.336 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T04:36:19.394 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T04:36:19.681 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T04:36:19.698 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T04:36:19.738 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T04:36:19.803 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T04:36:19.821 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T04:36:19.861 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T04:36:20.092 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T04:36:20.110 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T04:36:20.150 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T04:36:20.307 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T04:36:20.323 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T04:36:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T04:36:20.580 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T04:36:20.596 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T04:36:20.646 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T04:36:20.933 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T04:36:20.950 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T04:36:21.010 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T04:36:21.148 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T04:36:21.165 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:21.231 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:21.580 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T04:36:21.597 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:21.647 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:21.966 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T04:36:21.983 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T04:36:22.024 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T04:36:22.392 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T04:36:22.394 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T04:36:22.412 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T04:36:22.413 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T04:36:22.452 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T04:36:22.474 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T04:36:22.763 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package jq. 2023-10-06T04:36:22.781 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T04:36:22.820 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T04:36:22.821 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T04:36:22.836 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T04:36:22.878 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T04:36:23.067 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package socat. 2023-10-06T04:36:23.084 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T04:36:23.125 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T04:36:23.265 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T04:36:23.282 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T04:36:23.323 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T04:36:23.459 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T04:36:23.475 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T04:36:23.517 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T04:36:23.701 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T04:36:23.721 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T04:36:23.759 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T04:36:23.863 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-test. 2023-10-06T04:36:23.882 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:23.921 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-test (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:24.104 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T04:36:24.120 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T04:36:24.178 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T04:36:24.532 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T04:36:24.548 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T04:36:24.617 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T04:36:24.951 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T04:36:24.968 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T04:36:25.009 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T04:36:25.379 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T04:36:25.398 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T04:36:25.437 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T04:36:25.910 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T04:36:25.927 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T04:36:25.968 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T04:36:26.338 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T04:36:26.355 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T04:36:26.396 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T04:36:27.094 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T04:36:27.110 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:27.152 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:27.538 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T04:36:27.555 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T04:36:27.596 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T04:36:28.033 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T04:36:28.050 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T04:36:28.091 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T04:36:28.394 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package jq. 2023-10-06T04:36:28.411 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T04:36:28.469 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T04:36:28.755 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package socat. 2023-10-06T04:36:28.771 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T04:36:28.813 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T04:36:28.942 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T04:36:28.959 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:28.991 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-volume (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:29.198 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T04:36:29.217 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T04:36:29.256 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T04:36:29.421 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T04:36:29.439 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:29.479 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephfs-mirror (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:29.661 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-test. 2023-10-06T04:36:29.677 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:29.719 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-test (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:29.774 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T04:36:29.794 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T04:36:29.849 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T04:36:30.102 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T04:36:30.119 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:30.160 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephfs-shell (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:30.424 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T04:36:30.441 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:30.483 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephfs-top (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:30.719 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T04:36:30.738 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T04:36:30.777 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T04:36:31.339 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T04:36:31.355 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:31.395 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libcephfs-dev (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:31.790 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T04:36:31.857 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T04:36:32.219 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T04:36:32.238 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T04:36:32.278 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T04:36:33.988 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T04:36:34.009 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T04:36:34.046 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T04:36:34.415 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T04:36:34.432 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T04:36:34.473 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T04:36:34.781 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T04:36:34.798 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:34.809 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-attr. 2023-10-06T04:36:34.828 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T04:36:34.839 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-volume (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:34.867 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T04:36:35.212 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T04:36:35.229 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T04:36:35.295 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T04:36:35.295 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T04:36:35.313 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:35.353 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking cephfs-mirror (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:35.556 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T04:36:35.575 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T04:36:35.606 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T04:36:35.748 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T04:36:35.764 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T04:36:35.806 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T04:36:35.985 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T04:36:36.002 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T04:36:36.042 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T04:36:36.101 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T04:36:36.120 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:36.184 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking cephfs-shell (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:36.474 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T04:36:36.490 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T04:36:36.513 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T04:36:36.530 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T04:36:36.534 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking cephfs-top (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:36.571 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T04:36:36.820 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T04:36:36.836 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T04:36:36.857 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T04:36:36.878 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T04:36:36.894 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T04:36:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T04:36:37.310 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T04:36:37.328 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T04:36:37.377 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T04:36:37.440 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T04:36:37.456 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:37.497 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libcephfs-dev (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:37.713 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T04:36:37.732 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T04:36:37.771 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T04:36:37.933 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T04:36:37.953 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T04:36:38.009 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T04:36:38.166 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-py. 2023-10-06T04:36:38.185 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T04:36:38.224 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T04:36:38.355 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T04:36:38.373 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T04:36:38.413 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T04:36:38.581 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T04:36:38.598 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T04:36:38.639 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T04:36:38.942 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T04:36:38.962 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T04:36:38.999 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T04:36:39.353 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T04:36:39.374 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T04:36:39.411 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T04:36:39.697 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T04:36:39.715 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T04:36:39.755 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T04:36:40.094 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T04:36:40.112 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T04:36:40.177 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T04:36:40.492 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package radosgw. 2023-10-06T04:36:40.513 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../114-radosgw_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:40.538 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T04:36:40.558 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T04:36:40.558 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking radosgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:40.596 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T04:36:40.974 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-attr. 2023-10-06T04:36:40.991 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T04:36:41.032 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T04:36:41.394 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T04:36:41.413 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T04:36:41.452 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T04:36:41.788 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T04:36:41.805 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T04:36:41.871 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T04:36:42.242 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T04:36:42.259 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T04:36:42.263 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T04:36:42.281 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:42.321 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking rbd-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:42.333 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T04:36:42.643 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T04:36:42.862 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T04:36:42.879 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T04:36:42.920 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T04:36:42.954 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T04:36:43.080 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T04:36:43.207 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T04:36:43.289 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T04:36:43.307 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T04:36:43.347 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T04:36:43.727 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T04:36:43.745 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T04:36:43.758 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:43.785 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T04:36:44.105 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T04:36:44.125 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T04:36:44.196 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T04:36:44.413 INFO:teuthology.orchestra.run.smithi037.stdout:Adding system user cephadm....done 2023-10-06T04:36:44.566 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-py. 2023-10-06T04:36:44.574 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T04:36:44.583 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T04:36:44.624 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T04:36:44.724 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T04:36:45.006 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T04:36:45.023 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T04:36:45.064 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T04:36:45.077 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T04:36:45.361 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T04:36:45.487 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T04:36:45.613 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T04:36:45.900 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T04:36:45.917 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T04:36:45.958 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T04:36:45.973 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T04:36:46.362 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T04:36:46.379 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T04:36:46.400 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T04:36:46.420 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T04:36:46.710 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T04:36:46.764 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T04:36:46.785 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T04:36:46.822 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T04:36:47.011 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T04:36:47.314 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T04:36:47.615 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T04:36:47.660 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package radosgw. 2023-10-06T04:36:47.677 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../114-radosgw_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:47.743 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking radosgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:47.924 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-ceph-argparse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:48.259 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T04:36:48.385 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T04:36:48.769 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T04:36:49.045 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T04:36:49.371 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T04:36:49.497 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T04:36:49.547 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T04:36:49.564 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T04:36:49.605 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking rbd-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:49.891 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T04:36:49.950 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T04:36:50.200 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T04:36:50.264 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T04:36:50.390 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T04:36:50.494 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T04:36:50.542 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T04:36:50.777 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:50.863 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T04:36:51.165 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T04:36:51.507 INFO:teuthology.orchestra.run.smithi083.stdout:Adding system user cephadm....done 2023-10-06T04:36:51.532 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T04:36:51.694 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T04:36:51.841 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T04:36:51.853 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T04:36:52.159 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T04:36:52.247 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T04:36:52.285 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T04:36:52.411 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T04:36:52.581 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T04:36:52.707 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T04:36:52.715 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T04:36:52.858 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T04:36:53.117 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T04:36:53.176 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T04:36:53.460 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T04:36:53.604 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T04:36:53.836 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T04:36:53.942 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T04:36:54.188 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T04:36:54.239 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T04:36:54.289 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:54.557 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T04:36:54.609 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T04:36:54.744 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T04:36:54.900 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T04:36:55.103 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T04:36:55.193 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-ceph-argparse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:36:55.229 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T04:36:55.339 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T04:36:55.477 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T04:36:55.632 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T04:36:55.638 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T04:36:55.921 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T04:36:55.934 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T04:36:56.059 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T04:36:56.214 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T04:36:56.218 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T04:36:56.536 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T04:36:56.548 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T04:36:56.674 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T04:36:56.821 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T04:36:57.076 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T04:36:57.114 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T04:36:57.235 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T04:36:57.360 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T04:36:57.499 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T04:36:57.721 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T04:36:57.817 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T04:36:58.066 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T04:36:58.127 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T04:36:58.402 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T04:36:58.474 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T04:36:58.721 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T04:36:58.734 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T04:36:58.885 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T04:36:59.027 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T04:36:59.182 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T04:36:59.370 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T04:36:59.504 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T04:36:59.516 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T04:36:59.642 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T04:36:59.656 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T04:36:59.769 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T04:36:59.935 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T04:37:00.111 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T04:37:00.345 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T04:37:00.412 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librados2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:00.564 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T04:37:00.638 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T04:37:01.048 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T04:37:01.418 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T04:37:01.576 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:01.904 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T04:37:02.071 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:02.072 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T04:37:02.222 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T04:37:02.346 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T04:37:02.457 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T04:37:02.583 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T04:37:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T04:37:02.734 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T04:37:03.015 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T04:37:03.027 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T04:37:03.309 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T04:37:03.387 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T04:37:03.434 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T04:37:03.504 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T04:37:03.664 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T04:37:03.802 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libcephfs2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:03.928 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T04:37:03.990 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T04:37:04.255 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libradosstriper1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:04.333 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T04:37:04.406 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T04:37:04.626 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T04:37:04.740 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T04:37:04.777 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T04:37:05.070 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T04:37:05.363 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T04:37:05.631 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T04:37:05.795 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librbd1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:05.946 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T04:37:06.024 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T04:37:06.081 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T04:37:06.198 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T04:37:06.292 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T04:37:06.316 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T04:37:06.443 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T04:37:06.617 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T04:37:06.743 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T04:37:06.769 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T04:37:07.146 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-modules-core (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:07.171 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T04:37:07.272 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:07.299 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T04:37:07.450 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T04:37:07.503 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T04:37:07.504 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T04:37:07.812 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T04:37:07.957 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libcephfs-dev (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:08.058 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T04:37:08.119 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librados2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:08.270 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T04:37:08.360 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T04:37:08.694 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T04:37:09.063 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rados (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:09.231 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librgw2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:09.358 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephfs-top (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:09.495 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rbd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:09.637 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up rbd-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:09.743 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:09.780 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T04:37:09.869 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T04:37:10.020 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T04:37:10.065 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T04:37:10.374 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:10.429 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T04:37:10.500 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cephfs (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:10.626 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephfs-shell (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:10.731 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T04:37:10.752 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T04:37:11.025 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T04:37:11.183 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T04:37:11.526 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libcephfs2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:11.677 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T04:37:11.739 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:12.024 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libradosstriper1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:12.155 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T04:37:12.319 INFO:teuthology.orchestra.run.smithi037.stdout:Adding group ceph....done 2023-10-06T04:37:12.531 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T04:37:12.846 INFO:teuthology.orchestra.run.smithi037.stdout:Adding system user ceph....done 2023-10-06T04:37:13.022 INFO:teuthology.orchestra.run.smithi037.stdout:Setting system user ceph properties....done 2023-10-06T04:37:13.049 INFO:teuthology.orchestra.run.smithi037.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T04:37:13.200 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T04:37:13.516 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T04:37:13.570 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librbd1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:13.721 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T04:37:13.847 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T04:37:13.985 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephfs-mirror (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:13.999 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T04:37:14.147 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T04:37:14.207 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T04:37:14.207 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T04:37:14.434 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T04:37:14.560 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T04:37:14.669 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-test (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:14.828 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up radosgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:14.972 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-modules-core (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:15.108 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T04:37:15.108 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T04:37:15.123 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:15.357 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T04:37:15.357 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T04:37:15.807 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-base (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:15.824 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libcephfs-dev (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:15.950 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T04:37:16.200 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T04:37:16.310 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T04:37:16.652 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mds (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:16.881 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T04:37:16.881 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T04:37:16.995 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T04:37:17.328 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:17.376 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-rados (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:17.502 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librgw2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:17.557 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T04:37:17.557 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T04:37:17.661 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up cephfs-top (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:17.812 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-rbd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:17.938 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up rbd-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:18.030 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-osd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:18.089 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T04:37:18.390 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T04:37:18.472 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T04:37:18.472 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T04:37:18.675 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-rgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:18.826 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cephfs (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:18.931 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:18.976 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up cephfs-shell (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:19.057 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:19.103 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T04:37:19.225 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mon (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:19.454 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T04:37:19.454 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T04:37:19.878 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:20.020 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:20.034 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:20.146 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-dashboard (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:20.297 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-volume (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:20.433 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T04:37:20.584 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T04:37:20.670 INFO:teuthology.orchestra.run.smithi083.stdout:Adding group ceph....done 2023-10-06T04:37:20.877 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T04:37:21.122 INFO:teuthology.orchestra.run.smithi083.stdout:Adding system user ceph....done 2023-10-06T04:37:21.298 INFO:teuthology.orchestra.run.smithi083.stdout:Setting system user ceph properties....done 2023-10-06T04:37:21.331 INFO:teuthology.orchestra.run.smithi083.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T04:37:21.476 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T04:37:21.790 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T04:37:22.303 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up cephfs-mirror (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:22.524 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T04:37:22.525 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T04:37:23.005 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-test (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:23.131 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up radosgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:23.431 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T04:37:23.431 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T04:37:23.871 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T04:37:24.075 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-base (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T04:37:24.487 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T04:37:24.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T04:37:24.565 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2023-10-06T04:37:24.777 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2023-10-06T04:37:24.777 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2023-10-06T04:37:24.937 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mds (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:24.988 INFO:teuthology.orchestra.run.smithi037.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T04:37:24.988 INFO:teuthology.orchestra.run.smithi037.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T04:37:24.988 INFO:teuthology.orchestra.run.smithi037.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T04:37:24.988 INFO:teuthology.orchestra.run.smithi037.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T04:37:24.988 INFO:teuthology.orchestra.run.smithi037.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T04:37:24.989 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T04:37:24.989 INFO:teuthology.orchestra.run.smithi037.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T04:37:24.989 INFO:teuthology.orchestra.run.smithi037.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T04:37:24.989 INFO:teuthology.orchestra.run.smithi037.stdout:The following additional packages will be installed: 2023-10-06T04:37:24.989 INFO:teuthology.orchestra.run.smithi037.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T04:37:24.990 INFO:teuthology.orchestra.run.smithi037.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T04:37:24.990 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T04:37:24.990 INFO:teuthology.orchestra.run.smithi037.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T04:37:24.991 INFO:teuthology.orchestra.run.smithi037.stdout:Suggested packages: 2023-10-06T04:37:24.992 INFO:teuthology.orchestra.run.smithi037.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T04:37:24.992 INFO:teuthology.orchestra.run.smithi037.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T04:37:25.041 INFO:teuthology.orchestra.run.smithi037.stdout:The following NEW packages will be installed: 2023-10-06T04:37:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T04:37:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T04:37:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T04:37:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T04:37:25.043 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages will be upgraded: 2023-10-06T04:37:25.044 INFO:teuthology.orchestra.run.smithi037.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T04:37:25.151 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T04:37:25.152 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T04:37:25.228 INFO:teuthology.orchestra.run.smithi037.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-06T04:37:25.228 INFO:teuthology.orchestra.run.smithi037.stdout:Need to get 10.4 MB of archives. 2023-10-06T04:37:25.228 INFO:teuthology.orchestra.run.smithi037.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T04:37:25.228 INFO:teuthology.orchestra.run.smithi037.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T04:37:25.628 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:25.850 INFO:teuthology.orchestra.run.smithi037.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T04:37:25.852 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T04:37:25.853 INFO:teuthology.orchestra.run.smithi037.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T04:37:25.855 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T04:37:25.855 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T04:37:25.866 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T04:37:25.868 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T04:37:25.966 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T04:37:25.969 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T04:37:25.976 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T04:37:25.981 INFO:teuthology.orchestra.run.smithi037.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T04:37:25.982 INFO:teuthology.orchestra.run.smithi037.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T04:37:26.149 INFO:teuthology.orchestra.run.smithi037.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T04:37:26.280 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-osd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:26.419 INFO:teuthology.orchestra.run.smithi037.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T04:37:26.546 INFO:teuthology.orchestra.run.smithi037.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T04:37:26.551 INFO:teuthology.orchestra.run.smithi037.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T04:37:26.646 INFO:teuthology.orchestra.run.smithi037.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T04:37:26.650 INFO:teuthology.orchestra.run.smithi037.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T04:37:26.733 INFO:teuthology.orchestra.run.smithi037.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T04:37:26.790 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T04:37:26.790 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T04:37:26.809 INFO:teuthology.orchestra.run.smithi037.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T04:37:26.809 INFO:teuthology.orchestra.run.smithi037.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T04:37:26.898 INFO:teuthology.orchestra.run.smithi037.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T04:37:26.898 INFO:teuthology.orchestra.run.smithi037.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T04:37:27.093 INFO:teuthology.orchestra.run.smithi037.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T04:37:27.341 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:27.467 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:27.635 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mon (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:27.731 INFO:teuthology.orchestra.run.smithi037.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T04:37:27.844 INFO:teuthology.orchestra.run.smithi037.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T04:37:27.854 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T04:37:27.854 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T04:37:27.860 INFO:teuthology.orchestra.run.smithi037.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T04:37:27.862 INFO:teuthology.orchestra.run.smithi037.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T04:37:27.863 INFO:teuthology.orchestra.run.smithi037.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T04:37:27.865 INFO:teuthology.orchestra.run.smithi037.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T04:37:28.205 INFO:teuthology.orchestra.run.smithi037.stdout:Preconfiguring packages ... 2023-10-06T04:37:28.311 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:28.354 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 10.4 MB in 3s (3,708 kB/s) 2023-10-06T04:37:28.453 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:28.604 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-dashboard (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:28.630 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T04:37:28.635 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T04:37:28.780 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-volume (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T04:37:28.790 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T04:37:28.916 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T04:37:29.101 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T04:37:29.394 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T04:37:30.115 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T04:37:31.525 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T04:37:31.530 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T04:37:31.704 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T04:37:32.088 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T04:37:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T04:37:32.555 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T04:37:32.648 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T04:37:33.073 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T04:37:33.077 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T04:37:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T04:37:33.174 DEBUG:teuthology.orchestra.run.smithi083:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T04:37:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T04:37:33.245 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2023-10-06T04:37:33.448 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2023-10-06T04:37:33.448 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2023-10-06T04:37:33.635 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T04:37:33.648 INFO:teuthology.orchestra.run.smithi083.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T04:37:33.648 INFO:teuthology.orchestra.run.smithi083.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T04:37:33.649 INFO:teuthology.orchestra.run.smithi083.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T04:37:33.649 INFO:teuthology.orchestra.run.smithi083.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T04:37:33.649 INFO:teuthology.orchestra.run.smithi083.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T04:37:33.649 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T04:37:33.649 INFO:teuthology.orchestra.run.smithi083.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T04:37:33.649 INFO:teuthology.orchestra.run.smithi083.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T04:37:33.650 INFO:teuthology.orchestra.run.smithi083.stdout:The following additional packages will be installed: 2023-10-06T04:37:33.650 INFO:teuthology.orchestra.run.smithi083.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T04:37:33.650 INFO:teuthology.orchestra.run.smithi083.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T04:37:33.651 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T04:37:33.651 INFO:teuthology.orchestra.run.smithi083.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T04:37:33.652 INFO:teuthology.orchestra.run.smithi083.stdout:Suggested packages: 2023-10-06T04:37:33.652 INFO:teuthology.orchestra.run.smithi083.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T04:37:33.652 INFO:teuthology.orchestra.run.smithi083.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T04:37:33.701 INFO:teuthology.orchestra.run.smithi083.stdout:The following NEW packages will be installed: 2023-10-06T04:37:33.701 INFO:teuthology.orchestra.run.smithi083.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T04:37:33.702 INFO:teuthology.orchestra.run.smithi083.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T04:37:33.702 INFO:teuthology.orchestra.run.smithi083.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T04:37:33.702 INFO:teuthology.orchestra.run.smithi083.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T04:37:33.703 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages will be upgraded: 2023-10-06T04:37:33.704 INFO:teuthology.orchestra.run.smithi083.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T04:37:33.765 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T04:37:33.886 INFO:teuthology.orchestra.run.smithi083.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-06T04:37:33.887 INFO:teuthology.orchestra.run.smithi083.stdout:Need to get 10.4 MB of archives. 2023-10-06T04:37:33.887 INFO:teuthology.orchestra.run.smithi083.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T04:37:33.887 INFO:teuthology.orchestra.run.smithi083.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T04:37:34.286 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T04:37:34.444 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T04:37:34.507 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T04:37:34.509 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T04:37:34.510 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T04:37:34.523 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T04:37:34.525 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T04:37:34.624 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T04:37:34.626 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T04:37:34.633 INFO:teuthology.orchestra.run.smithi083.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T04:37:34.638 INFO:teuthology.orchestra.run.smithi083.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T04:37:34.639 INFO:teuthology.orchestra.run.smithi083.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T04:37:34.805 INFO:teuthology.orchestra.run.smithi083.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T04:37:35.024 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T04:37:35.043 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T04:37:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T04:37:35.207 INFO:teuthology.orchestra.run.smithi083.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T04:37:35.212 INFO:teuthology.orchestra.run.smithi083.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T04:37:35.291 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T04:37:35.307 INFO:teuthology.orchestra.run.smithi083.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T04:37:35.311 INFO:teuthology.orchestra.run.smithi083.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T04:37:35.394 INFO:teuthology.orchestra.run.smithi083.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T04:37:35.468 INFO:teuthology.orchestra.run.smithi083.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T04:37:35.469 INFO:teuthology.orchestra.run.smithi083.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T04:37:35.558 INFO:teuthology.orchestra.run.smithi083.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T04:37:35.558 INFO:teuthology.orchestra.run.smithi083.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T04:37:35.752 INFO:teuthology.orchestra.run.smithi083.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T04:37:36.390 INFO:teuthology.orchestra.run.smithi083.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T04:37:36.503 INFO:teuthology.orchestra.run.smithi083.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T04:37:36.519 INFO:teuthology.orchestra.run.smithi083.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T04:37:36.521 INFO:teuthology.orchestra.run.smithi083.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T04:37:36.522 INFO:teuthology.orchestra.run.smithi083.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T04:37:36.524 INFO:teuthology.orchestra.run.smithi083.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T04:37:36.838 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package dump. 2023-10-06T04:37:36.850 INFO:teuthology.orchestra.run.smithi083.stdout:Preconfiguring packages ... 2023-10-06T04:37:36.857 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T04:37:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T04:37:37.025 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 10.4 MB in 3s (3,710 kB/s) 2023-10-06T04:37:37.225 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package indent. 2023-10-06T04:37:37.246 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T04:37:37.275 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T04:37:37.364 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T04:37:37.368 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T04:37:37.549 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T04:37:37.586 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T04:37:37.604 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T04:37:37.645 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T04:37:37.997 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T04:37:38.016 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T04:37:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T04:37:38.342 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T04:37:38.362 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T04:37:38.392 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T04:37:38.728 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T04:37:38.746 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T04:37:38.786 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T04:37:38.974 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T04:37:39.064 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T04:37:39.081 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T04:37:39.122 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T04:37:39.467 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T04:37:39.484 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T04:37:39.525 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T04:37:39.853 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T04:37:39.889 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T04:37:39.936 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T04:37:40.264 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T04:37:40.281 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T04:37:40.314 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T04:37:40.426 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T04:37:40.431 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T04:37:40.597 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T04:37:40.727 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T04:37:40.742 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T04:37:40.783 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T04:37:41.013 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T04:37:41.128 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T04:37:41.145 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T04:37:41.186 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T04:37:41.211 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T04:37:41.430 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T04:37:41.448 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T04:37:41.488 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T04:37:41.594 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T04:37:42.057 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T04:37:42.062 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T04:37:42.227 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T04:37:42.530 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T04:37:42.551 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T04:37:42.718 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T04:37:42.849 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T04:37:42.866 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T04:37:43.516 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package modemmanager. 2023-10-06T04:37:43.533 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T04:37:43.585 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T04:37:43.742 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T04:37:43.873 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T04:37:44.230 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T04:37:44.248 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T04:37:44.288 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T04:37:44.435 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T04:37:44.454 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T04:37:44.493 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T04:37:44.821 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package dump. 2023-10-06T04:37:44.841 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T04:37:44.844 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package network-manager. 2023-10-06T04:37:44.863 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T04:37:44.887 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T04:37:44.927 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T04:37:45.210 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package indent. 2023-10-06T04:37:45.226 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T04:37:45.266 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T04:37:45.643 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ppp. 2023-10-06T04:37:45.660 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T04:37:45.661 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T04:37:45.679 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T04:37:45.719 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T04:37:45.931 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T04:37:46.114 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T04:37:46.131 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T04:37:46.172 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T04:37:46.273 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T04:37:46.290 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T04:37:46.331 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T04:37:46.425 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T04:37:46.442 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T04:37:46.475 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T04:37:46.718 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T04:37:46.736 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T04:37:46.794 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T04:37:46.861 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T04:37:46.879 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T04:37:46.920 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T04:37:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T04:37:47.047 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T04:37:47.079 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T04:37:47.239 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T04:37:47.258 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T04:37:47.297 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T04:37:47.449 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T04:37:47.470 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T04:37:47.518 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T04:37:47.633 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T04:37:47.651 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T04:37:47.717 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T04:37:47.841 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T04:37:48.095 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T04:37:48.111 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T04:37:48.138 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T04:37:48.178 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T04:37:48.455 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T04:37:48.539 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T04:37:48.558 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T04:37:48.654 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T04:37:48.890 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T04:37:49.292 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T04:37:49.292 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T04:37:49.511 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T04:37:49.527 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T04:37:49.560 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T04:37:49.768 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T04:37:49.919 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T04:37:49.929 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T04:37:49.949 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T04:37:49.987 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T04:37:50.045 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T04:37:50.155 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T04:37:50.265 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T04:37:50.280 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T04:37:50.282 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T04:37:50.357 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T04:37:50.432 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T04:37:50.910 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T04:37:50.927 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T04:37:50.968 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T04:37:51.413 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package modemmanager. 2023-10-06T04:37:51.416 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T04:37:51.430 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T04:37:51.482 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T04:37:51.654 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T04:37:51.749 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T04:37:51.814 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T04:37:51.940 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T04:37:52.091 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T04:37:52.161 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T04:37:52.178 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T04:37:52.226 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T04:37:52.261 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T04:37:52.402 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T04:37:52.520 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T04:37:52.671 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T04:37:52.797 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T04:37:52.841 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package network-manager. 2023-10-06T04:37:52.861 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T04:37:52.924 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T04:37:52.982 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T04:37:53.108 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T04:37:53.731 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ppp. 2023-10-06T04:37:53.752 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T04:37:53.850 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:37:53.850 INFO:teuthology.orchestra.run.smithi037.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T04:37:53.850 INFO:teuthology.orchestra.run.smithi037.stdout:which means they are currently configured by ifupdown: 2023-10-06T04:37:53.850 INFO:teuthology.orchestra.run.smithi037.stdout:- ens1f0 2023-10-06T04:37:53.850 INFO:teuthology.orchestra.run.smithi037.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T04:37:53.851 INFO:teuthology.orchestra.run.smithi037.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T04:37:53.851 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:37:54.015 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T04:37:54.017 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T04:37:54.357 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T04:37:54.812 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T04:37:54.833 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T04:37:54.913 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T04:37:54.971 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T04:37:55.358 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T04:37:55.375 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T04:37:55.403 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T04:37:55.476 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T04:37:55.530 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T04:37:55.672 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T04:37:55.761 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T04:37:55.778 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T04:37:55.798 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T04:37:55.819 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T04:37:55.949 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T04:37:56.084 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T04:37:56.214 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T04:37:56.234 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T04:37:56.283 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T04:37:56.360 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T04:37:56.360 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T04:37:56.602 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T04:37:56.862 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T04:37:56.953 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T04:37:56.988 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T04:37:57.104 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T04:37:57.105 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T04:37:57.230 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T04:37:57.257 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T04:37:57.558 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T04:37:57.701 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T04:37:57.701 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T04:37:58.175 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T04:37:58.335 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T04:37:58.494 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T04:37:58.620 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T04:37:58.787 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T04:37:58.913 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T04:37:59.952 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T04:38:00.189 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T04:38:00.284 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T04:38:00.349 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T04:38:00.500 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T04:38:00.659 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T04:38:00.785 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T04:38:01.004 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T04:38:01.163 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T04:38:01.289 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T04:38:01.440 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T04:38:01.633 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T04:38:01.768 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T04:38:01.836 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T04:38:01.969 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T04:38:02.550 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:02.550 INFO:teuthology.orchestra.run.smithi083.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T04:38:02.550 INFO:teuthology.orchestra.run.smithi083.stdout:which means they are currently configured by ifupdown: 2023-10-06T04:38:02.550 INFO:teuthology.orchestra.run.smithi083.stdout:- enp3s0f1 2023-10-06T04:38:02.550 INFO:teuthology.orchestra.run.smithi083.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T04:38:02.550 INFO:teuthology.orchestra.run.smithi083.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T04:38:02.551 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:02.710 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T04:38:02.864 INFO:teuthology.orchestra.run.smithi037.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T04:38:02.867 DEBUG:teuthology.parallel:result is None 2023-10-06T04:38:03.040 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T04:38:03.572 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T04:38:04.088 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T04:38:04.256 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T04:38:04.425 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T04:38:04.550 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T04:38:04.718 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T04:38:04.844 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T04:38:05.439 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T04:38:05.439 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T04:38:05.972 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T04:38:06.081 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T04:38:06.232 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T04:38:06.417 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T04:38:06.693 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T04:38:10.446 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T04:38:10.555 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T04:38:11.506 INFO:teuthology.orchestra.run.smithi083.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T04:38:11.508 DEBUG:teuthology.parallel:result is None 2023-10-06T04:38:11.509 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:38:11.743 DEBUG:teuthology.orchestra.run.smithi037:> dpkg-query -W -f '${Version}' ceph 2023-10-06T04:38:11.766 INFO:teuthology.orchestra.run.smithi037.stdout:17.2.6-1274-g68e53a4a-1focal 2023-10-06T04:38:11.767 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274-g68e53a4a-1focal 2023-10-06T04:38:11.767 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274-g68e53a4a-1focal is installed. 2023-10-06T04:38:11.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:38:11.982 DEBUG:teuthology.orchestra.run.smithi083:> dpkg-query -W -f '${Version}' ceph 2023-10-06T04:38:12.004 INFO:teuthology.orchestra.run.smithi083.stdout:17.2.6-1274-g68e53a4a-1focal 2023-10-06T04:38:12.005 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274-g68e53a4a-1focal 2023-10-06T04:38:12.005 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274-g68e53a4a-1focal is installed. 2023-10-06T04:38:12.005 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T04:38:12.005 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:12.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:38:12.021 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:12.021 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:38:12.062 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T04:38:12.062 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:12.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:38:12.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:38:12.089 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:12.089 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:38:12.104 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:38:12.120 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T04:38:12.120 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:12.120 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:38:12.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:38:12.190 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:12.190 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:38:12.206 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:38:12.217 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T04:38:12.217 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:12.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:38:12.233 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:38:12.292 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:12.292 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:38:12.309 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:38:12.365 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T04:38:12.427 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T04:38:12.427 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2023-10-06T04:38:12.429 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /var/log/ceph 2023-10-06T04:38:12.445 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T04:38:12.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:38:12.486 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:38:12.501 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T04:38:12.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:38:12.503 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:38:12.520 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T04:38:12.520 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T04:38:12.520 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T04:38:12.521 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:12.521 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:38:12.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:12.603 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:12.603 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:38:12.610 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:12.700 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T04:38:12.700 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'force file system read-only', 'bad backtrace', 'MDS in read-only mode', '\\(MDS_READ_ONLY\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T04:38:12.701 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283', 'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412283', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'force file system read-only', 'bad backtrace', 'MDS in read-only mode', '\\(MDS_READ_ONLY\\)'], 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4002, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi083.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_auto_repair']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:54:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T04:38:12.701 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:38:12.704 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:38:12.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:38:12.754 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:38:12.771 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:12.771 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:38:12.776 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:38:12.776 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2023-10-06T04:38:12.782 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:38:12.782 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:12.782 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 359 Links: 1 2023-10-06T04:38:12.782 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:12.782 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-10-06 04:33:36.733672492 +0000 2023-10-06T04:38:12.782 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-10-06 04:33:36.441679223 +0000 2023-10-06T04:38:12.782 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-10-06 04:33:36.441679223 +0000 2023-10-06T04:38:12.782 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-10-06T04:38:12.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:38:12.839 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-10-06T04:38:12.839 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-10-06T04:38:12.839 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000393848 s, 1.3 MB/s 2023-10-06T04:38:12.840 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:38:12.848 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2023-10-06T04:38:12.854 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:38:12.855 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:12.855 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-10-06T04:38:12.855 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:12.855 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-10-06 04:33:37.237660875 +0000 2023-10-06T04:38:12.855 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-10-06 04:33:36.941667698 +0000 2023-10-06T04:38:12.855 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-10-06 04:33:36.941667698 +0000 2023-10-06T04:38:12.855 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-10-06T04:38:12.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:38:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-10-06T04:38:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-10-06T04:38:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000373804 s, 1.4 MB/s 2023-10-06T04:38:12.912 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:38:12.920 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2023-10-06T04:38:12.926 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:38:12.927 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:12.927 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-10-06T04:38:12.927 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:12.927 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-10-06 04:33:37.477655342 +0000 2023-10-06T04:38:12.927 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-10-06 04:33:37.473655435 +0000 2023-10-06T04:38:12.927 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-10-06 04:33:37.473655435 +0000 2023-10-06T04:38:12.927 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-10-06T04:38:12.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:38:12.987 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-10-06T04:38:12.987 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-10-06T04:38:12.987 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000404611 s, 1.3 MB/s 2023-10-06T04:38:12.988 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:38:12.996 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2023-10-06T04:38:13.003 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:38:13.003 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:13.003 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 380 Links: 1 2023-10-06T04:38:13.003 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:13.003 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-10-06 04:33:38.229638009 +0000 2023-10-06T04:38:13.003 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-10-06 04:33:37.965644094 +0000 2023-10-06T04:38:13.003 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-10-06 04:33:37.965644094 +0000 2023-10-06T04:38:13.003 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-10-06T04:38:13.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:38:13.059 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-10-06T04:38:13.059 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-10-06T04:38:13.059 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.00041967 s, 1.2 MB/s 2023-10-06T04:38:13.060 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:38:13.068 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:13.069 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:13.069 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:38:13.076 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:38:13.076 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2023-10-06T04:38:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:38:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:13.125 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 358 Links: 1 2023-10-06T04:38:13.125 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:13.126 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 04:33:39.610979410 +0000 2023-10-06T04:38:13.126 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 04:33:39.318986129 +0000 2023-10-06T04:38:13.126 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 04:33:39.318986129 +0000 2023-10-06T04:38:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T04:38:13.126 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:38:13.138 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T04:38:13.138 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T04:38:13.138 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000416885 s, 1.2 MB/s 2023-10-06T04:38:13.140 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:38:13.149 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2023-10-06T04:38:13.197 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:38:13.197 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:13.197 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 367 Links: 1 2023-10-06T04:38:13.197 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:13.198 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 04:33:39.838974163 +0000 2023-10-06T04:38:13.198 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 04:33:39.834974256 +0000 2023-10-06T04:38:13.198 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 04:33:39.834974256 +0000 2023-10-06T04:38:13.198 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T04:38:13.198 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:38:13.212 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T04:38:13.212 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T04:38:13.213 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000393331 s, 1.3 MB/s 2023-10-06T04:38:13.213 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:38:13.221 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2023-10-06T04:38:13.269 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:38:13.269 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:13.269 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 374 Links: 1 2023-10-06T04:38:13.269 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:13.269 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 04:33:40.654955385 +0000 2023-10-06T04:38:13.269 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 04:33:40.362962104 +0000 2023-10-06T04:38:13.270 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 04:33:40.362962104 +0000 2023-10-06T04:38:13.270 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T04:38:13.270 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:38:13.284 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T04:38:13.285 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T04:38:13.285 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000408122 s, 1.3 MB/s 2023-10-06T04:38:13.286 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:38:13.294 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2023-10-06T04:38:13.345 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:38:13.345 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:13.346 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 378 Links: 1 2023-10-06T04:38:13.346 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:13.346 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 04:33:41.166943602 +0000 2023-10-06T04:38:13.346 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 04:33:40.878950231 +0000 2023-10-06T04:38:13.346 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 04:33:40.878950231 +0000 2023-10-06T04:38:13.346 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T04:38:13.346 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:38:13.359 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T04:38:13.359 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T04:38:13.359 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000412941 s, 1.2 MB/s 2023-10-06T04:38:13.360 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:38:13.369 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:13.369 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:38:13.370 INFO:tasks.ceph:Generating config... 2023-10-06T04:38:13.371 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T04:38:13.371 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T04:38:13.371 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T04:38:13.371 INFO:tasks.ceph:[client] pid file = 2023-10-06T04:38:13.371 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T04:38:13.372 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T04:38:13.372 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T04:38:13.372 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T04:38:13.372 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T04:38:13.372 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T04:38:13.372 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T04:38:13.373 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T04:38:13.373 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T04:38:13.374 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T04:38:13.374 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T04:38:13.374 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T04:38:13.374 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T04:38:13.375 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T04:38:13.375 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T04:38:13.375 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T04:38:13.375 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T04:38:13.375 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T04:38:13.376 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T04:38:13.376 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-06T04:38:13.376 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-06T04:38:13.376 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T04:38:13.376 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T04:38:13.377 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-06T04:38:13.377 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T04:38:13.377 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T04:38:13.377 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T04:38:13.378 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T04:38:13.378 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T04:38:13.378 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T04:38:13.378 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T04:38:13.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T04:38:13.414 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T04:38:13.417 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T04:38:13.498 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:38:13.511 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '172.21.15.83'), ('mon.c', '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]')] 2023-10-06T04:38:13.511 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T04:38:13.512 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:13.513 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:38:13.518 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --add b 172.21.15.83 --addv c '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:13.558 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:13.558 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid 77bb67cc-15eb-432c-9ac1-b724f40102d2 2023-10-06T04:38:13.558 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = octopus 2023-10-06T04:38:13.559 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2023-10-06T04:38:13.559 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 77bb67cc-15eb-432c-9ac1-b724f40102d2 2023-10-06T04:38:13.559 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2023-10-06T04:38:13.556068+0000 2023-10-06T04:38:13.559 INFO:teuthology.orchestra.run.smithi037.stdout:created 2023-10-06T04:38:13.556068+0000 2023-10-06T04:38:13.559 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 15 (octopus) 2023-10-06T04:38:13.560 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2023-10-06T04:38:13.560 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2023-10-06T04:38:13.560 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.b 2023-10-06T04:38:13.560 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2023-10-06T04:38:13.560 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T04:38:13.562 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:38:13.610 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 77bb67cc-15eb-432c-9ac1-b724f40102d2... 2023-10-06T04:38:13.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:38:13.615 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:38:13.648 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-10-06T04:38:13.648 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-10-06T04:38:13.648 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:38:13.648 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-10-06T04:38:13.648 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.649 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-10-06T04:38:13.649 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.649 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-10-06T04:38:13.649 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.649 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-10-06T04:38:13.649 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-10-06T04:38:13.650 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.650 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-10-06T04:38:13.650 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-10-06T04:38:13.650 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.650 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:38:13.650 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-10-06T04:38:13.651 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.651 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:38:13.651 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:38:13.651 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.651 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-10-06T04:38:13.651 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.652 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-10-06T04:38:13.652 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-10-06T04:38:13.652 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:38:13.652 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:38:13.652 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-10-06T04:38:13.652 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:38:13.653 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-10-06T04:38:13.653 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:38:13.653 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:38:13.653 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-10-06T04:38:13.653 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.653 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:38:13.653 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.654 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-10-06T04:38:13.654 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.654 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-10-06T04:38:13.654 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.654 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-10-06T04:38:13.655 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-10-06T04:38:13.655 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-10-06T04:38:13.655 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]" 2023-10-06T04:38:13.655 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 77bb67cc-15eb-432c-9ac1-b724f40102d2 2023-10-06T04:38:13.655 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.655 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-10-06T04:38:13.656 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-10-06T04:38:13.656 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.656 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-10-06T04:38:13.656 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-10-06T04:38:13.656 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:38:13.656 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.656 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-10-06T04:38:13.657 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-10-06T04:38:13.657 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.657 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-10-06T04:38:13.657 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-10-06T04:38:13.657 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-10-06T04:38:13.657 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.658 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-10-06T04:38:13.658 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-10-06T04:38:13.658 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.658 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:38:13.658 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.658 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-10-06T04:38:13.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.659 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-10-06T04:38:13.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.659 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:38:13.659 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-10-06T04:38:13.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.660 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-10-06T04:38:13.660 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-10-06T04:38:13.660 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-10-06T04:38:13.660 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-10-06T04:38:13.660 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 20 2023-10-06T04:38:13.660 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 20 2023-10-06T04:38:13.661 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T04:38:13.661 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-10-06T04:38:13.661 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 10 2023-10-06T04:38:13.661 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:38:13.661 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-10-06T04:38:13.661 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:38:13.662 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:38:13.662 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-10-06T04:38:13.662 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T04:38:13.662 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.662 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-10-06T04:38:13.662 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T04:38:13.662 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-10-06T04:38:13.663 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T04:38:13.663 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T04:38:13.663 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:38:13.663 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:38:13.663 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-10-06T04:38:13.663 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.664 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-10-06T04:38:13.664 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T04:38:13.664 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T04:38:13.664 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-10-06T04:38:13.664 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T04:38:13.664 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-10-06T04:38:13.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-10-06T04:38:13.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:38:13.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-10-06T04:38:13.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-10-06T04:38:13.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:38:13.665 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.666 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:38:13.666 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:38:13.666 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:38:13.666 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.667 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:38:13.667 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:38:13.667 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:38:13.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.667 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-10-06T04:38:13.667 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:38:13.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.668 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:38:13.668 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-10-06T04:38:13.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:13.668 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-10-06T04:38:13.668 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-10-06T04:38:13.669 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-10-06T04:38:13.669 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-10-06T04:38:13.669 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:38:13.669 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:38:13.669 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-10-06T04:38:13.669 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-10-06T04:38:13.670 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T04:38:13.670 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-10-06T04:38:13.670 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T04:38:13.670 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T04:38:13.670 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-10-06T04:38:13.671 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-10-06T04:38:13.671 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-10-06T04:38:13.671 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-10-06T04:38:13.671 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-10-06T04:38:13.671 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-10-06T04:38:13.671 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-10-06T04:38:13.672 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-10-06T04:38:13.672 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-10-06T04:38:13.672 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T04:38:13.672 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-10-06T04:38:13.672 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2023-10-06T04:38:13.672 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-10-06T04:38:13.673 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2023-10-06T04:38:13.673 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T04:38:13.673 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T04:38:13.673 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T04:38:13.676 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2023-10-06T04:38:13.676 INFO:teuthology.orchestra.run.smithi083.stdout: chdir = "" 2023-10-06T04:38:13.676 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:38:13.676 INFO:teuthology.orchestra.run.smithi083.stdout: auth supported = cephx 2023-10-06T04:38:13.676 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.677 INFO:teuthology.orchestra.run.smithi083.stdout: filestore xattr use omap = true 2023-10-06T04:38:13.677 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.677 INFO:teuthology.orchestra.run.smithi083.stdout: mon clock drift allowed = 1.000 2023-10-06T04:38:13.677 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.677 INFO:teuthology.orchestra.run.smithi083.stdout: osd crush chooseleaf type = 0 2023-10-06T04:38:13.677 INFO:teuthology.orchestra.run.smithi083.stdout: auth debug = true 2023-10-06T04:38:13.677 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.678 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on old message = true 2023-10-06T04:38:13.678 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on bug = true 2023-10-06T04:38:13.678 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.678 INFO:teuthology.orchestra.run.smithi083.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:38:13.678 INFO:teuthology.orchestra.run.smithi083.stdout: mon pg warn max object skew = 0 2023-10-06T04:38:13.678 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.678 INFO:teuthology.orchestra.run.smithi083.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:38:13.678 INFO:teuthology.orchestra.run.smithi083.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:38:13.679 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.679 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default size = 2 2023-10-06T04:38:13.679 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.679 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow primary affinity = true 2023-10-06T04:38:13.679 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow pg remap = true 2023-10-06T04:38:13.679 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:38:13.679 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:38:13.679 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on no sortbitwise = false 2023-10-06T04:38:13.680 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:38:13.680 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on too few osds = false 2023-10-06T04:38:13.680 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:38:13.680 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:38:13.680 INFO:teuthology.orchestra.run.smithi083.stdout: mon_allow_pool_size_one = true 2023-10-06T04:38:13.680 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.681 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:38:13.681 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.681 INFO:teuthology.orchestra.run.smithi083.stdout: osd default data pool replay window = 5 2023-10-06T04:38:13.681 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.681 INFO:teuthology.orchestra.run.smithi083.stdout: mon allow pool delete = true 2023-10-06T04:38:13.681 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.681 INFO:teuthology.orchestra.run.smithi083.stdout: mon cluster log file level = debug 2023-10-06T04:38:13.681 INFO:teuthology.orchestra.run.smithi083.stdout: debug asserts on shutdown = true 2023-10-06T04:38:13.681 INFO:teuthology.orchestra.run.smithi083.stdout: mon health detail to clog = false 2023-10-06T04:38:13.681 INFO:teuthology.orchestra.run.smithi083.stdout: mon host = "172.21.15.37,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]" 2023-10-06T04:38:13.682 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = 77bb67cc-15eb-432c-9ac1-b724f40102d2 2023-10-06T04:38:13.682 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.682 INFO:teuthology.orchestra.run.smithi083.stdout:[osd] 2023-10-06T04:38:13.682 INFO:teuthology.orchestra.run.smithi083.stdout: osd journal size = 100 2023-10-06T04:38:13.682 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.682 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub load threshold = 5.0 2023-10-06T04:38:13.682 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub max interval = 600 2023-10-06T04:38:13.682 INFO:teuthology.orchestra.run.smithi083.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:38:13.682 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.682 INFO:teuthology.orchestra.run.smithi083.stdout: osd recover clone overlap = true 2023-10-06T04:38:13.682 INFO:teuthology.orchestra.run.smithi083.stdout: osd recovery max chunk = 1048576 2023-10-06T04:38:13.682 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.683 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug shutdown = true 2023-10-06T04:38:13.683 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug op order = true 2023-10-06T04:38:13.683 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug verify stray on activate = true 2023-10-06T04:38:13.683 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.683 INFO:teuthology.orchestra.run.smithi083.stdout: osd open classes on start = true 2023-10-06T04:38:13.683 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug pg log writeout = true 2023-10-06T04:38:13.683 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.683 INFO:teuthology.orchestra.run.smithi083.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:38:13.683 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.683 INFO:teuthology.orchestra.run.smithi083.stdout: osd map max advance = 10 2023-10-06T04:38:13.683 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.683 INFO:teuthology.orchestra.run.smithi083.stdout: journal zero on create = true 2023-10-06T04:38:13.684 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.684 INFO:teuthology.orchestra.run.smithi083.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:38:13.684 INFO:teuthology.orchestra.run.smithi083.stdout: filestore apply finisher threads = 3 2023-10-06T04:38:13.684 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.684 INFO:teuthology.orchestra.run.smithi083.stdout: bdev debug aio = true 2023-10-06T04:38:13.684 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug misdirected ops = true 2023-10-06T04:38:13.684 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore block size = 96636764160 2023-10-06T04:38:13.684 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore fsck on mount = True 2023-10-06T04:38:13.684 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluefs = 20 2023-10-06T04:38:13.684 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluestore = 20 2023-10-06T04:38:13.684 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T04:38:13.685 INFO:teuthology.orchestra.run.smithi083.stdout: debug osd = 20 2023-10-06T04:38:13.685 INFO:teuthology.orchestra.run.smithi083.stdout: debug rocksdb = 10 2023-10-06T04:38:13.685 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:38:13.685 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd full ratio = 0.9 2023-10-06T04:38:13.685 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:38:13.685 INFO:teuthology.orchestra.run.smithi083.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:38:13.685 INFO:teuthology.orchestra.run.smithi083.stdout: osd objectstore = bluestore 2023-10-06T04:38:13.685 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2023-10-06T04:38:13.685 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.685 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr] 2023-10-06T04:38:13.685 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T04:38:13.686 INFO:teuthology.orchestra.run.smithi083.stdout: debug mgr = 20 2023-10-06T04:38:13.686 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2023-10-06T04:38:13.686 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2023-10-06T04:38:13.686 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:38:13.687 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:38:13.687 INFO:teuthology.orchestra.run.smithi083.stdout: mgr/telemetry/nag = false 2023-10-06T04:38:13.687 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.687 INFO:teuthology.orchestra.run.smithi083.stdout:[mon] 2023-10-06T04:38:13.687 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T04:38:13.687 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2023-10-06T04:38:13.687 INFO:teuthology.orchestra.run.smithi083.stdout: debug paxos = 20 2023-10-06T04:38:13.687 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2023-10-06T04:38:13.687 INFO:teuthology.orchestra.run.smithi083.stdout: mon data avail warn = 5 2023-10-06T04:38:13.687 INFO:teuthology.orchestra.run.smithi083.stdout: mon mgr mkfs grace = 240 2023-10-06T04:38:13.687 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:38:13.687 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd reporter subtree level = osd 2023-10-06T04:38:13.688 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd prime pg temp = true 2023-10-06T04:38:13.688 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:38:13.688 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.688 INFO:teuthology.orchestra.run.smithi083.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:38:13.688 INFO:teuthology.orchestra.run.smithi083.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:38:13.688 INFO:teuthology.orchestra.run.smithi083.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:38:13.688 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.688 INFO:teuthology.orchestra.run.smithi083.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:38:13.688 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:38:13.688 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:38:13.688 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.689 INFO:teuthology.orchestra.run.smithi083.stdout: # 1m isn't quite enough 2023-10-06T04:38:13.689 INFO:teuthology.orchestra.run.smithi083.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:38:13.689 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.689 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:38:13.689 INFO:teuthology.orchestra.run.smithi083.stdout: mon op complaint time = 120 2023-10-06T04:38:13.689 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:38:13.689 INFO:teuthology.orchestra.run.smithi083.stdout:[client] 2023-10-06T04:38:13.689 INFO:teuthology.orchestra.run.smithi083.stdout: rgw cache enabled = true 2023-10-06T04:38:13.689 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable ops log = true 2023-10-06T04:38:13.690 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable usage log = true 2023-10-06T04:38:13.690 INFO:teuthology.orchestra.run.smithi083.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:38:13.690 INFO:teuthology.orchestra.run.smithi083.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:38:13.690 INFO:teuthology.orchestra.run.smithi083.stdout: client mount timeout = 600 2023-10-06T04:38:13.690 INFO:teuthology.orchestra.run.smithi083.stdout: debug client = 20 2023-10-06T04:38:13.690 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T04:38:13.690 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = "" 2023-10-06T04:38:13.690 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2023-10-06T04:38:13.690 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2023-10-06T04:38:13.690 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.a] 2023-10-06T04:38:13.690 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.b] 2023-10-06T04:38:13.691 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.c] 2023-10-06T04:38:13.691 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2023-10-06T04:38:13.691 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2023-10-06T04:38:13.691 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2023-10-06T04:38:13.691 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2023-10-06T04:38:13.691 INFO:teuthology.orchestra.run.smithi083.stdout:[mds] 2023-10-06T04:38:13.691 INFO:teuthology.orchestra.run.smithi083.stdout: debug mds = 20 2023-10-06T04:38:13.691 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T04:38:13.691 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug frag = True 2023-10-06T04:38:13.692 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug scatterstat = True 2023-10-06T04:38:13.692 INFO:teuthology.orchestra.run.smithi083.stdout: mds op complaint time = 180 2023-10-06T04:38:13.692 INFO:teuthology.orchestra.run.smithi083.stdout: mds verify scatter = True 2023-10-06T04:38:13.692 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2023-10-06T04:38:13.692 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2023-10-06T04:38:13.692 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2023-10-06T04:38:13.693 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T04:38:13.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T04:38:13.765 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T04:38:13.765 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:13.766 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T04:38:13.770 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:13.770 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T04:38:13.777 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:38:13.777 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:13.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:38:13.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:38:13.800 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:13.801 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:13.851 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:38:13.851 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:13.851 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:38:13.852 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:38:13.878 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:13.878 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:13.885 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T04:38:13.885 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T04:38:13.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:38:13.930 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:38:13.933 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:38:13.977 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:38:13.979 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T04:38:13.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:38:14.025 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:38:14.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T04:38:14.043 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:38:14.085 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:38:14.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T04:38:14.103 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:38:14.150 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:38:14.153 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T04:38:14.165 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:38:14.205 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:38:14.207 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T04:38:14.217 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T04:38:14.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T04:38:14.255 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T04:38:14.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T04:38:14.303 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T04:38:14.319 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T04:38:14.356 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T04:38:14.364 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T04:38:14.394 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T04:38:14.404 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T04:38:14.404 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:38:14.404 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T04:38:14.420 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:14.420 INFO:tasks.ceph:role: osd.0 2023-10-06T04:38:14.420 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:38:14.420 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:38:14.956 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:14.956 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:14.956 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:14.957 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 2023-10-06T04:38:14.957 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:14.957 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:14.957 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:14.957 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:14.957 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:14.957 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:14.958 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-10-06T04:38:14.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T04:38:15.052 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T04:38:15.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:15.065 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T04:38:15.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T04:38:15.124 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:15.125 INFO:tasks.ceph:role: osd.1 2023-10-06T04:38:15.125 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:38:15.125 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:38:15.625 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:15.625 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:15.625 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:15.625 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 2023-10-06T04:38:15.625 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:15.625 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:15.625 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:15.626 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:15.626 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:15.626 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:15.627 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-10-06T04:38:15.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T04:38:15.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T04:38:15.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T04:38:15.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T04:38:15.684 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:15.685 INFO:tasks.ceph:role: osd.2 2023-10-06T04:38:15.685 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:38:15.685 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:38:16.198 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:16.198 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:16.198 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:16.198 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 2023-10-06T04:38:16.198 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:16.198 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:16.199 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:16.199 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:16.199 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:16.199 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:16.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-10-06T04:38:16.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T04:38:16.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T04:38:16.270 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T04:38:16.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:16.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T04:38:16.328 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:16.328 INFO:tasks.ceph:role: osd.3 2023-10-06T04:38:16.328 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:38:16.328 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:38:16.806 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:16.806 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:16.807 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:16.807 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 2023-10-06T04:38:16.807 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:16.807 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:16.807 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:16.807 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:16.807 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:16.807 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:16.809 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-10-06T04:38:16.809 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T04:38:16.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T04:38:16.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:16.870 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T04:38:16.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:16.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:16.945+0000 7fa0ad8703c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T04:38:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:16.945+0000 7fa0ad8703c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T04:38:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:16.945+0000 7fa0ad8703c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:38:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:16.945+0000 7fa0ad8703c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:38:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:16.945+0000 7fa0ad8703c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:38:16.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:16.953+0000 7fa0ad8703c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T04:38:17.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:17.761+0000 7fa0ad8703c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:18.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:18.545+0000 7fa0ad8703c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:19.333+0000 7fa0ad8703c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:20.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T04:38:20.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:20.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:20.245+0000 7ff8c20483c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T04:38:20.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:20.245+0000 7ff8c20483c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T04:38:20.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:20.245+0000 7ff8c20483c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:38:20.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:20.245+0000 7ff8c20483c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:38:20.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:20.245+0000 7ff8c20483c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:38:20.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:20.245+0000 7ff8c20483c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T04:38:20.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:20.817+0000 7ff8c20483c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:21.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:21.597+0000 7ff8c20483c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:22.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:22.381+0000 7ff8c20483c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:23.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T04:38:23.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:23.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:23.317+0000 7f13285143c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T04:38:23.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:23.317+0000 7f13285143c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T04:38:23.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:23.317+0000 7f13285143c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:38:23.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:23.317+0000 7f13285143c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:38:23.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:23.317+0000 7f13285143c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:38:23.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:23.317+0000 7f13285143c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T04:38:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:23.877+0000 7f13285143c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:24.661+0000 7f13285143c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:25.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:25.441+0000 7f13285143c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:26.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T04:38:26.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:26.409+0000 7f1a4719b3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T04:38:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:26.409+0000 7f1a4719b3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T04:38:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:26.409+0000 7f1a4719b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:38:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:26.409+0000 7f1a4719b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:38:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:26.409+0000 7f1a4719b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:38:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:26.409+0000 7f1a4719b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T04:38:26.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:26.981+0000 7f1a4719b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:27.757+0000 7f1a4719b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:28.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:28.553+0000 7f1a4719b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:29.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T04:38:29.436 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T04:38:29.453 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:29.453 INFO:tasks.ceph:role: osd.4 2023-10-06T04:38:29.454 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:38:29.454 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:38:30.021 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:30.022 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:30.022 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:30.022 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T04:38:30.022 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:30.022 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:30.022 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:30.022 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:30.022 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:30.022 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:30.025 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T04:38:30.025 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T04:38:30.116 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T04:38:30.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:30.127 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T04:38:30.128 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T04:38:30.137 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:30.137 INFO:tasks.ceph:role: osd.5 2023-10-06T04:38:30.138 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:38:30.138 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:38:30.687 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:30.687 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:30.687 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:30.687 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T04:38:30.687 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:30.687 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:30.687 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:30.687 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:30.687 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:30.687 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:30.689 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T04:38:30.689 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T04:38:30.730 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T04:38:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T04:38:30.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:30.741 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T04:38:30.798 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:30.798 INFO:tasks.ceph:role: osd.6 2023-10-06T04:38:30.798 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:38:30.798 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:38:31.263 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:31.263 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:31.263 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:31.263 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T04:38:31.263 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:31.263 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:31.264 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:31.264 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:31.264 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:31.264 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:31.265 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T04:38:31.265 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T04:38:31.317 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T04:38:31.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:31.327 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T04:38:31.327 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T04:38:31.342 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:31.343 INFO:tasks.ceph:role: osd.7 2023-10-06T04:38:31.343 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:38:31.343 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:38:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:31.851 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:31.851 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:31.851 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T04:38:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:31.851 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:31.851 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:31.852 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T04:38:31.853 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T04:38:31.923 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T04:38:31.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:31.936 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T04:38:31.936 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:32.016 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:32.011+0000 7f4e994e73c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T04:38:32.017 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:32.011+0000 7f4e994e73c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T04:38:32.017 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:32.011+0000 7f4e994e73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:38:32.017 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:32.011+0000 7f4e994e73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:38:32.018 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:32.011+0000 7f4e994e73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:38:32.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:32.015+0000 7f4e994e73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T04:38:32.828 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:32.823+0000 7f4e994e73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:33.609 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:33.603+0000 7f4e994e73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:34.410 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:34.403+0000 7f4e994e73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:35.263 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T04:38:35.280 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:35.359+0000 7fa6be89e3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T04:38:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:35.359+0000 7fa6be89e3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T04:38:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:35.359+0000 7fa6be89e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:38:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:35.359+0000 7fa6be89e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:38:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:35.359+0000 7fa6be89e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:38:35.364 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:35.359+0000 7fa6be89e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T04:38:35.928 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:35.923+0000 7fa6be89e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:36.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:36.707+0000 7fa6be89e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:37.501 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:37.495+0000 7fa6be89e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:38.346 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T04:38:38.362 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:38.400 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:38.395+0000 7fc6fabdf3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T04:38:38.400 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:38.395+0000 7fc6fabdf3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T04:38:38.400 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:38.395+0000 7fc6fabdf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:38:38.400 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:38.395+0000 7fc6fabdf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:38:38.400 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:38.395+0000 7fc6fabdf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:38:38.401 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:38.395+0000 7fc6fabdf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T04:38:38.965 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:38.959+0000 7fc6fabdf3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:39.767 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:39.763+0000 7fc6fabdf3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:40.556 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:40.551+0000 7fc6fabdf3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:41.434 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T04:38:41.493 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:41.537 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:41.531+0000 7f90a72013c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T04:38:41.538 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:41.531+0000 7f90a72013c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T04:38:41.538 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:41.531+0000 7f90a72013c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:38:41.538 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:41.531+0000 7f90a72013c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:38:41.538 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:41.531+0000 7f90a72013c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:38:41.539 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:41.535+0000 7f90a72013c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T04:38:42.104 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:42.099+0000 7f90a72013c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:42.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:42.705 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:42.900 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:42.895+0000 7f90a72013c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:43.681 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:43.675+0000 7f90a72013c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:44.538 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T04:38:44.553 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T04:38:44.553 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:44.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T04:38:44.570 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:44.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T04:38:44.586 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:44.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T04:38:44.643 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:44.644 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T04:38:44.653 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:44.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T04:38:44.668 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:44.668 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T04:38:44.681 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:44.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T04:38:44.740 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:44.740 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T04:38:44.756 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:44.756 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T04:38:44.813 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:44.813 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T04:38:44.825 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:44.825 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T04:38:44.836 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:44.836 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T04:38:44.850 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:44.850 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T04:38:44.862 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:44.862 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T04:38:44.916 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:44.916 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T04:38:44.923 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:44.923 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T04:38:44.929 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:44.929 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T04:38:44.936 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:44.936 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T04:38:44.942 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T04:38:44.943 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:38:44.945 DEBUG:teuthology.orchestra.run.smithi083:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:38:44.989 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2023-10-06T04:38:44.989 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA1jx9lDRlRNxAAXQyULCYNLpCmk2wGrYQdFA== 2023-10-06T04:38:44.989 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-10-06T04:38:44.989 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA2jx9lOJ5qARAAsrI6rKjWz9nRWFOt3Y+PqQ== 2023-10-06T04:38:44.989 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-10-06T04:38:44.989 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA2jx9lUkX8BBAAnme43cfieXYJ9Su7RsbS4Q== 2023-10-06T04:38:44.989 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2023-10-06T04:38:44.989 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA4jx9l/DyXOBAAzNFj0ooJ5/gyMftDwzeIlg== 2023-10-06T04:38:44.989 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2023-10-06T04:38:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA8jx9lIzTRDhAA0Mk4SuNJdtaRS0kzMweOOQ== 2023-10-06T04:38:44.990 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2023-10-06T04:38:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA/jx9lNqwfExAAGO+OBHAP8JCfGnY7jDuP1Q== 2023-10-06T04:38:44.990 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2023-10-06T04:38:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBCjx9lGZqMGBAAKlgYTGI0/J4itMisLtuBtQ== 2023-10-06T04:38:44.990 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2023-10-06T04:38:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA1jx9lX9oxOhAACDvgyzcGRrnVSVDAx+LzOw== 2023-10-06T04:38:44.990 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-10-06T04:38:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA2jx9lfHbsCBAAtqsK3RVBoxm1lxiD6xvs2Q== 2023-10-06T04:38:44.990 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-10-06T04:38:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA2jx9l58opDBAA35WNoMLpqmtJdWSSZXc64Q== 2023-10-06T04:38:44.991 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2023-10-06T04:38:44.991 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBIjx9le+3tABAAUgbf+fMuquiP3PEQSPwN0g== 2023-10-06T04:38:44.991 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2023-10-06T04:38:44.991 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBLjx9lo2yUFRAAGTmYOWUH6Z2oGz3iUfbnZQ== 2023-10-06T04:38:44.991 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2023-10-06T04:38:44.991 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBOjx9lPNTIFxAAplImPCR+TZMSH032LvqX8Q== 2023-10-06T04:38:44.991 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2023-10-06T04:38:44.991 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBRjx9lSP/+HxAAu8/0hIUn5ltVb2kRHQShag== 2023-10-06T04:38:44.991 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-10-06T04:38:44.991 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA2jx9lEpkaDxAARPlbdi95Jplvg+MqEnvRtQ== 2023-10-06T04:38:44.992 INFO:teuthology.orchestra.run.smithi037.stdout:[client.2] 2023-10-06T04:38:44.992 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA2jx9lODj8ERAAtL4c9GBGm8/aWvdps6m9nQ== 2023-10-06T04:38:44.992 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2023-10-06T04:38:44.992 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA2jx9l7A4oFRAAHbqwpcFGrhOffbCbjsCImw== 2023-10-06T04:38:44.992 INFO:teuthology.orchestra.run.smithi037.stdout:[client.3] 2023-10-06T04:38:44.992 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA2jx9lcZ10FxAAJg1NGICFz7QsIBKg/fPlHg== 2023-10-06T04:38:44.998 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.y] 2023-10-06T04:38:44.998 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA1jx9lDRlRNxAAXQyULCYNLpCmk2wGrYQdFA== 2023-10-06T04:38:44.998 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2023-10-06T04:38:44.999 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA2jx9lOJ5qARAAsrI6rKjWz9nRWFOt3Y+PqQ== 2023-10-06T04:38:44.999 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2023-10-06T04:38:44.999 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA2jx9lUkX8BBAAnme43cfieXYJ9Su7RsbS4Q== 2023-10-06T04:38:44.999 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.0] 2023-10-06T04:38:44.999 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA4jx9l/DyXOBAAzNFj0ooJ5/gyMftDwzeIlg== 2023-10-06T04:38:44.999 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.1] 2023-10-06T04:38:44.999 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA8jx9lIzTRDhAA0Mk4SuNJdtaRS0kzMweOOQ== 2023-10-06T04:38:44.999 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.2] 2023-10-06T04:38:44.999 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA/jx9lNqwfExAAGO+OBHAP8JCfGnY7jDuP1Q== 2023-10-06T04:38:45.000 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.3] 2023-10-06T04:38:45.000 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBCjx9lGZqMGBAAKlgYTGI0/J4itMisLtuBtQ== 2023-10-06T04:38:45.000 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.x] 2023-10-06T04:38:45.000 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA1jx9lX9oxOhAACDvgyzcGRrnVSVDAx+LzOw== 2023-10-06T04:38:45.000 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2023-10-06T04:38:45.000 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA2jx9lfHbsCBAAtqsK3RVBoxm1lxiD6xvs2Q== 2023-10-06T04:38:45.000 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2023-10-06T04:38:45.000 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA2jx9l58opDBAA35WNoMLpqmtJdWSSZXc64Q== 2023-10-06T04:38:45.000 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.4] 2023-10-06T04:38:45.000 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBIjx9le+3tABAAUgbf+fMuquiP3PEQSPwN0g== 2023-10-06T04:38:45.000 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.5] 2023-10-06T04:38:45.001 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBLjx9lo2yUFRAAGTmYOWUH6Z2oGz3iUfbnZQ== 2023-10-06T04:38:45.001 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.6] 2023-10-06T04:38:45.001 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBOjx9lPNTIFxAAplImPCR+TZMSH032LvqX8Q== 2023-10-06T04:38:45.001 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.7] 2023-10-06T04:38:45.001 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBRjx9lSP/+HxAAu8/0hIUn5ltVb2kRHQShag== 2023-10-06T04:38:45.001 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2023-10-06T04:38:45.001 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA2jx9lEpkaDxAARPlbdi95Jplvg+MqEnvRtQ== 2023-10-06T04:38:45.001 INFO:teuthology.orchestra.run.smithi083.stdout:[client.2] 2023-10-06T04:38:45.001 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA2jx9lODj8ERAAtL4c9GBGm8/aWvdps6m9nQ== 2023-10-06T04:38:45.001 INFO:teuthology.orchestra.run.smithi083.stdout:[client.1] 2023-10-06T04:38:45.001 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA2jx9l7A4oFRAAHbqwpcFGrhOffbCbjsCImw== 2023-10-06T04:38:45.001 INFO:teuthology.orchestra.run.smithi083.stdout:[client.3] 2023-10-06T04:38:45.002 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQA2jx9lcZ10FxAAJg1NGICFz7QsIBKg/fPlHg== 2023-10-06T04:38:45.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:38:45.038 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:38:45.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:38:45.084 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:38:45.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:38:45.132 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:38:45.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.221 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.268 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.354 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.401 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.444 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:38:45.446 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:38:45.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:38:45.535 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:38:45.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:38:45.583 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:38:45.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.631 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.676 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.721 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.723 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.809 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.811 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:38:45.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:38:45.938 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:38:45.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:38:45.988 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:38:46.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:38:46.078 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:38:46.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:38:46.129 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:38:46.174 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T04:38:46.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T04:38:46.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:38:46.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T04:38:46.255 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T04:38:46.272 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:38:46.328 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T04:38:46.341 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T04:38:46.352 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:38:46.454 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T04:38:46.466 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:46.468 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:46.473 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T04:38:46.473 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T04:38:46.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T04:38:46.518 INFO:tasks.ceph.mon.a:Started 2023-10-06T04:38:46.518 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T04:38:46.518 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T04:38:46.520 INFO:tasks.ceph.mon.b:Started 2023-10-06T04:38:46.520 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T04:38:46.521 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T04:38:46.523 INFO:tasks.ceph.mon.c:Started 2023-10-06T04:38:46.523 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T04:38:46.523 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T04:38:46.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T04:38:46.525 INFO:tasks.ceph.mgr.y:Started 2023-10-06T04:38:46.525 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T04:38:46.525 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T04:38:46.528 INFO:tasks.ceph.mgr.x:Started 2023-10-06T04:38:46.528 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T04:38:46.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T04:38:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72dc38b700 1 Processor -- start 2023-10-06T04:38:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72dc38b700 1 -- start start 2023-10-06T04:38:46.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72dc38b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 0x7f72d406b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:46.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72dc38b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f72d4155f40 0x7f72d40cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:46.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72dc38b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d406b180 con 0x7f72d40c7da0 2023-10-06T04:38:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72dc38b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d4156390 con 0x7f72d4155f40 2023-10-06T04:38:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72dc38b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d406aba0 con 0x7f72d4155b70 2023-10-06T04:38:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72da127700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 0x7f72d406b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72d9926700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f72d4155f40 0x7f72d40cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72da127700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 0x7f72d406b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:35730/0 (socket says 172.21.15.37:35730) 2023-10-06T04:38:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72da127700 1 -- 172.21.15.37:0/741463439 learned_addr learned my addr 172.21.15.37:0/741463439 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:38:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72da127700 1 -- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 msgr2=0x7f72d406b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T04:38:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72da127700 1 -- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 msgr2=0x7f72d406b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:38:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72da127700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 0x7f72d406b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:38:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72d9926700 1 -- 172.21.15.37:0/741463439 >> v2:172.21.15.83:3300/0 conn(0x7f72d4155f40 msgr2=0x7f72d40cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T04:38:46.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72d9926700 1 -- 172.21.15.37:0/741463439 >> v2:172.21.15.83:3300/0 conn(0x7f72d4155f40 msgr2=0x7f72d40cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:38:46.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72d9926700 1 --2- 172.21.15.37:0/741463439 >> v2:172.21.15.83:3300/0 conn(0x7f72d4155f40 0x7f72d40cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:38:46.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72da127700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 0x7f72d406b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T04:38:46.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.625+0000 7f72d9926700 1 --2- 172.21.15.37:0/741463439 >> v2:172.21.15.83:3300/0 conn(0x7f72d4155f40 0x7f72d40cb210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T04:38:46.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739655780 0 0) 0x7f72d406b180 con 0x7f72d40c7da0 2023-10-06T04:38:46.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c0003570 con 0x7f72d40c7da0 2023-10-06T04:38:46.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 78146583 0 0) 0x7f72c0003570 con 0x7f72d40c7da0 2023-10-06T04:38:46.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 msgr2=0x7f72d406b610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:38:46.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 0x7f72d406b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:46.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 >> v2:172.21.15.83:3300/0 conn(0x7f72d4155f40 msgr2=0x7f72d40cb210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:38:46.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 --2- 172.21.15.37:0/741463439 >> v2:172.21.15.83:3300/0 conn(0x7f72d4155f40 0x7f72d40cb210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:46.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40cbb80 con 0x7f72d40c7da0 2023-10-06T04:38:46.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 <== mon.1 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f72c4001470 con 0x7f72d40c7da0 2023-10-06T04:38:46.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 >> v1:172.21.15.83:6789/0 conn(0x7f72d40c7da0 legacy=0x7f72d40c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:46.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c0003ae0 0x7f72c0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:46.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 0x7f72c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:46.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72c0004d50 0x7f72c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:46.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4156390 con 0x7f72c0003ae0 2023-10-06T04:38:46.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d406aba0 con 0x7f72c0004d50 2023-10-06T04:38:46.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c000bcc0 con 0x7f72d4155b70 2023-10-06T04:38:46.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72da127700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c0003ae0 0x7f72c0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:46.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72d9926700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 0x7f72c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:46.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72da928700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72c0004d50 0x7f72c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:46.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72da127700 1 -- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 msgr2=0x7f72c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:46.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72da127700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72d4155b70 0x7f72c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:46.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72da127700 1 -- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72c0004d50 msgr2=0x7f72c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:46.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72da127700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72c0004d50 0x7f72c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:46.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.685+0000 7f72da127700 1 -- 172.21.15.37:0/741463439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c0003570 con 0x7f72c0003ae0 2023-10-06T04:38:46.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.689+0000 7f72da127700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c0003ae0 0x7f72c0003ef0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009650 tx=0x7f72cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4c8b72197fbb88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:46.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.693+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0097a0 con 0x7f72c0003ae0 2023-10-06T04:38:46.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.693+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc007b50 con 0x7f72c0003ae0 2023-10-06T04:38:46.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.693+0000 7f72d9125700 1 -- 172.21.15.37:0/741463439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc012460 con 0x7f72c0003ae0 2023-10-06T04:38:46.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.693+0000 7f72dc38b700 1 -- 172.21.15.37:0/741463439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c0003ae0 msgr2=0x7f72c0003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:46.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.693+0000 7f72dc38b700 1 --2- 172.21.15.37:0/741463439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c0003ae0 0x7f72c0003ef0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009650 tx=0x7f72cc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:46.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.693+0000 7f72da928700 1 -- 172.21.15.37:0/741463439 reap_dead start 2023-10-06T04:38:46.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.693+0000 7f72dc38b700 1 -- 172.21.15.37:0/741463439 shutdown_connections 2023-10-06T04:38:46.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.693+0000 7f72dc38b700 1 -- 172.21.15.37:0/741463439 >> 172.21.15.37:0/741463439 conn(0x7f72d40cc180 msgr2=0x7f72d40cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:46.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.693+0000 7f72dc38b700 1 -- 172.21.15.37:0/741463439 shutdown_connections 2023-10-06T04:38:46.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.693+0000 7f72dc38b700 1 -- 172.21.15.37:0/741463439 wait complete. 2023-10-06T04:38:46.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.693+0000 7f72dc38b700 1 Processor -- start 2023-10-06T04:38:46.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.693+0000 7f72dc38b700 1 -- start start 2023-10-06T04:38:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72dc38b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72c0003ae0 0x7f72d40b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72dc38b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72d4165190 0x7f72d4144fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72dc38b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d4156510 0x7f72d406df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72dc38b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4145500 con 0x7f72d4156510 2023-10-06T04:38:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72dc38b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40af9f0 con 0x7f72d4165190 2023-10-06T04:38:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72dc38b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40afcd0 con 0x7f72c0003ae0 2023-10-06T04:38:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72da928700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d4156510 0x7f72d406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72da127700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72c0003ae0 0x7f72d40b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:46.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72da928700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d4156510 0x7f72d406df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59578/0 (socket says 172.21.15.37:59578) 2023-10-06T04:38:46.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72da127700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72c0003ae0 0x7f72d40b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:35774/0 (socket says 172.21.15.37:35774) 2023-10-06T04:38:46.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72da928700 1 -- 172.21.15.37:0/403298358 learned_addr learned my addr 172.21.15.37:0/403298358 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:38:46.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72d9926700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72d4165190 0x7f72d4144fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72da928700 1 -- 172.21.15.37:0/403298358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72c0003ae0 msgr2=0x7f72d40b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72da928700 1 --2- 172.21.15.37:0/403298358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72c0003ae0 0x7f72d40b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72da928700 1 -- 172.21.15.37:0/403298358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72d4165190 msgr2=0x7f72d4144fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72da928700 1 --2- 172.21.15.37:0/403298358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72d4165190 0x7f72d4144fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72da928700 1 -- 172.21.15.37:0/403298358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4156cf0 con 0x7f72d4156510 2023-10-06T04:38:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72da127700 1 --2- 172.21.15.37:0/403298358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72c0003ae0 0x7f72d40b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:38:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72d9926700 1 --2- 172.21.15.37:0/403298358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72d4165190 0x7f72d4144fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:38:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72da928700 1 --2- 172.21.15.37:0/403298358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d4156510 0x7f72d406df20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f72c400f880 tx=0x7f72d406b0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72ca7fc700 1 -- 172.21.15.37:0/403298358 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4014680 con 0x7f72d4156510 2023-10-06T04:38:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72ca7fc700 1 -- 172.21.15.37:0/403298358 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c40147e0 con 0x7f72d4156510 2023-10-06T04:38:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72dc38b700 1 -- 172.21.15.37:0/403298358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d4156fd0 con 0x7f72d4156510 2023-10-06T04:38:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72ca7fc700 1 -- 172.21.15.37:0/403298358 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4014ba0 con 0x7f72d4156510 2023-10-06T04:38:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72dc38b700 1 -- 172.21.15.37:0/403298358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d4156980 con 0x7f72d4156510 2023-10-06T04:38:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72ca7fc700 1 -- 172.21.15.37:0/403298358 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f72c401f460 con 0x7f72d4156510 2023-10-06T04:38:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.697+0000 7f72ca7fc700 1 -- 172.21.15.37:0/403298358 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f72c4013720 con 0x7f72d4156510 2023-10-06T04:38:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.701+0000 7f72dc38b700 1 -- 172.21.15.37:0/403298358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d40afe60 con 0x7f72d4156510 2023-10-06T04:38:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.701+0000 7f72ca7fc700 1 -- 172.21.15.37:0/403298358 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f72c401f8a0 con 0x7f72d4156510 2023-10-06T04:38:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.773+0000 7f72dc38b700 1 -- 172.21.15.37:0/403298358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f72d4070ee0 con 0x7f72d4156510 2023-10-06T04:38:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.781+0000 7f72ca7fc700 1 -- 172.21.15.37:0/403298358 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f72c4002ab0 con 0x7f72d4156510 2023-10-06T04:38:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.781+0000 7f72dc38b700 1 -- 172.21.15.37:0/403298358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d4156510 msgr2=0x7f72d406df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.781+0000 7f72dc38b700 1 --2- 172.21.15.37:0/403298358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d4156510 0x7f72d406df20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f72c400f880 tx=0x7f72d406b0f0 comp rx=0 tx=0).stop 2023-10-06T04:38:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.781+0000 7f72dc38b700 1 -- 172.21.15.37:0/403298358 shutdown_connections 2023-10-06T04:38:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.781+0000 7f72dc38b700 1 --2- 172.21.15.37:0/403298358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72d4165190 0x7f72d4144fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.781+0000 7f72dc38b700 1 --2- 172.21.15.37:0/403298358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d4156510 0x7f72d406df20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.781+0000 7f72dc38b700 1 --2- 172.21.15.37:0/403298358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72c0003ae0 0x7f72d40b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.781+0000 7f72dc38b700 1 -- 172.21.15.37:0/403298358 >> 172.21.15.37:0/403298358 conn(0x7f72d40cc180 msgr2=0x7f72d40c0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.781+0000 7f72dc38b700 1 -- 172.21.15.37:0/403298358 shutdown_connections 2023-10-06T04:38:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:46.781+0000 7f72dc38b700 1 -- 172.21.15.37:0/403298358 wait complete. 2023-10-06T04:38:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2023-10-06T04:38:46.799 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T04:38:46.800 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:46.800 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T04:38:46.813 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:46.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T04:38:46.826 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:46.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T04:38:46.840 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:38:46.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T04:38:46.895 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:46.896 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T04:38:46.911 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:46.912 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T04:38:46.914 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:46.909+0000 7f3720383000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:38:46.969 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:46.969 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T04:38:46.978 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:38:46.978 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T04:38:46.988 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 61e9946e-403f-4948-9740-1862fbe3105d 0 2023-10-06T04:38:47.036 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:47.031+0000 7f8fc08f9000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:38:47.137 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.131+0000 7f1adf0f4700 1 Processor -- start 2023-10-06T04:38:47.137 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.131+0000 7f1adf0f4700 1 -- start start 2023-10-06T04:38:47.139 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ad806e190 0x7f1ad806e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.140 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1ad8159bd0 0x7f1ad806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.140 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad80c66c0 con 0x7f1ad80ac6f0 2023-10-06T04:38:47.140 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad80c6910 con 0x7f1ad806e190 2023-10-06T04:38:47.140 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad80c6bf0 con 0x7f1ad8159bd0 2023-10-06T04:38:47.140 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1add8f1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1ad8159bd0 0x7f1ad806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.140 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1add8f1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1ad8159bd0 0x7f1ad806ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52346/0 (socket says 172.21.15.83:52346) 2023-10-06T04:38:47.140 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1add8f1700 1 -- 172.21.15.83:0/319197143 learned_addr learned my addr 172.21.15.83:0/319197143 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:38:47.140 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1ade0f2700 1 --2- 172.21.15.83:0/319197143 >> v2:172.21.15.37:3300/0 conn(0x7f1ad806e190 0x7f1ad806e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.141 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1add8f1700 1 -- 172.21.15.83:0/319197143 >> v2:172.21.15.37:3300/0 conn(0x7f1ad806e190 msgr2=0x7f1ad806e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:47.141 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1add8f1700 1 --2- 172.21.15.83:0/319197143 >> v2:172.21.15.37:3300/0 conn(0x7f1ad806e190 0x7f1ad806e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.141 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1add8f1700 1 -- 172.21.15.83:0/319197143 >> v1:172.21.15.37:6789/0 conn(0x7f1ad80ac6f0 legacy=0x7f1ad80c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:47.141 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1add8f1700 1 -- 172.21.15.83:0/319197143 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad80c6ed0 con 0x7f1ad8159bd0 2023-10-06T04:38:47.141 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1add8f1700 1 --2- 172.21.15.83:0/319197143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ad8159bd0 0x7f1ad806ecb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ad806b030 tx=0x7f1ac800a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57085d12700cbeb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:47.141 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1add0f0700 1 -- 172.21.15.83:0/319197143 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800ca00 con 0x7f1ad8159bd0 2023-10-06T04:38:47.141 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1add0f0700 1 -- 172.21.15.83:0/319197143 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac800cb60 con 0x7f1ad8159bd0 2023-10-06T04:38:47.141 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1add0f0700 1 -- 172.21.15.83:0/319197143 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac80183f0 con 0x7f1ad8159bd0 2023-10-06T04:38:47.142 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 -- 172.21.15.83:0/319197143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ad8159bd0 msgr2=0x7f1ad806ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.142 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 --2- 172.21.15.83:0/319197143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ad8159bd0 0x7f1ad806ecb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ad806b030 tx=0x7f1ac800a3f0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.142 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 -- 172.21.15.83:0/319197143 shutdown_connections 2023-10-06T04:38:47.142 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 --2- 172.21.15.83:0/319197143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ad8159bd0 0x7f1ad806ecb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.143 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 --2- 172.21.15.83:0/319197143 >> v2:172.21.15.37:3300/0 conn(0x7f1ad806e190 0x7f1ad806e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.143 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 -- 172.21.15.83:0/319197143 >> 172.21.15.83:0/319197143 conn(0x7f1ad80c9570 msgr2=0x7f1ad8067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:47.143 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 -- 172.21.15.83:0/319197143 shutdown_connections 2023-10-06T04:38:47.143 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.135+0000 7f1adf0f4700 1 -- 172.21.15.83:0/319197143 wait complete. 2023-10-06T04:38:47.143 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1adf0f4700 1 Processor -- start 2023-10-06T04:38:47.143 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1adf0f4700 1 -- start start 2023-10-06T04:38:47.145 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1adf0f4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ad806e190 0x7f1ad80c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.145 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1adf0f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ad80ac6f0 0x7f1ad80af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.145 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1adf0f4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ad8159bd0 0x7f1ad8155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.145 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1adf0f4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8164710 con 0x7f1ad80ac6f0 2023-10-06T04:38:47.145 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1adf0f4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80c5f50 con 0x7f1ad806e190 2023-10-06T04:38:47.146 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1adf0f4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8155fa0 con 0x7f1ad8159bd0 2023-10-06T04:38:47.146 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ade0f2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ad806e190 0x7f1ad80c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.146 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ade8f3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ad8159bd0 0x7f1ad8155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.146 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ade0f2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ad806e190 0x7f1ad80c2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52360/0 (socket says 172.21.15.83:52360) 2023-10-06T04:38:47.146 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ade0f2700 1 -- 172.21.15.83:0/697167195 learned_addr learned my addr 172.21.15.83:0/697167195 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:38:47.146 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1add8f1700 1 --2- 172.21.15.83:0/697167195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ad80ac6f0 0x7f1ad80af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.147 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ade0f2700 1 -- 172.21.15.83:0/697167195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ad8159bd0 msgr2=0x7f1ad8155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.147 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ade0f2700 1 --2- 172.21.15.83:0/697167195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ad8159bd0 0x7f1ad8155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.147 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ade0f2700 1 -- 172.21.15.83:0/697167195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ad80ac6f0 msgr2=0x7f1ad80af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.147 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ade0f2700 1 --2- 172.21.15.83:0/697167195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ad80ac6f0 0x7f1ad80af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.147 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ade0f2700 1 -- 172.21.15.83:0/697167195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac800a690 con 0x7f1ad806e190 2023-10-06T04:38:47.147 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ade8f3700 1 --2- 172.21.15.83:0/697167195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ad8159bd0 0x7f1ad8155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:38:47.148 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ade0f2700 1 --2- 172.21.15.83:0/697167195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ad806e190 0x7f1ad80c2460 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400c8b0 tx=0x7f1ad4008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:47.148 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ace7fc700 1 -- 172.21.15.83:0/697167195 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4011600 con 0x7f1ad806e190 2023-10-06T04:38:47.148 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ace7fc700 1 -- 172.21.15.83:0/697167195 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad4011760 con 0x7f1ad806e190 2023-10-06T04:38:47.148 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ace7fc700 1 -- 172.21.15.83:0/697167195 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4011b20 con 0x7f1ad806e190 2023-10-06T04:38:47.148 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1adf0f4700 1 -- 172.21.15.83:0/697167195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad80c0b20 con 0x7f1ad806e190 2023-10-06T04:38:47.149 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1adf0f4700 1 -- 172.21.15.83:0/697167195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad80b1a20 con 0x7f1ad806e190 2023-10-06T04:38:47.149 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ace7fc700 1 -- 172.21.15.83:0/697167195 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1ad4019680 con 0x7f1ad806e190 2023-10-06T04:38:47.149 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1ace7fc700 1 -- 172.21.15.83:0/697167195 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1ad4021770 con 0x7f1ad806e190 2023-10-06T04:38:47.150 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.139+0000 7f1adf0f4700 1 -- 172.21.15.83:0/697167195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad80708a0 con 0x7f1ad806e190 2023-10-06T04:38:47.150 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.143+0000 7f1ace7fc700 1 -- 172.21.15.83:0/697167195 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1ad40386d0 con 0x7f1ad806e190 2023-10-06T04:38:47.223 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.219+0000 7f1adf0f4700 1 -- 172.21.15.83:0/697167195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "61e9946e-403f-4948-9740-1862fbe3105d", "id": 0} v 0) v1 -- 0x7f1ad806c7b0 con 0x7f1ad806e190 2023-10-06T04:38:47.234 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.227+0000 7f1ace7fc700 1 -- 172.21.15.83:0/697167195 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "61e9946e-403f-4948-9740-1862fbe3105d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1ad4027070 con 0x7f1ad806e190 2023-10-06T04:38:47.234 INFO:teuthology.orchestra.run.smithi083.stdout:0 2023-10-06T04:38:47.236 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.231+0000 7f1adf0f4700 1 -- 172.21.15.83:0/697167195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ad806e190 msgr2=0x7f1ad80c2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.236 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.231+0000 7f1adf0f4700 1 --2- 172.21.15.83:0/697167195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ad806e190 0x7f1ad80c2460 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400c8b0 tx=0x7f1ad4008040 comp rx=0 tx=0).stop 2023-10-06T04:38:47.236 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.231+0000 7f1adf0f4700 1 -- 172.21.15.83:0/697167195 shutdown_connections 2023-10-06T04:38:47.236 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.231+0000 7f1adf0f4700 1 --2- 172.21.15.83:0/697167195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ad8159bd0 0x7f1ad8155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.236 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.231+0000 7f1adf0f4700 1 --2- 172.21.15.83:0/697167195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ad80ac6f0 0x7f1ad80af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.236 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.231+0000 7f1adf0f4700 1 --2- 172.21.15.83:0/697167195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ad806e190 0x7f1ad80c2460 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.236 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.231+0000 7f1adf0f4700 1 -- 172.21.15.83:0/697167195 >> 172.21.15.83:0/697167195 conn(0x7f1ad80c9570 msgr2=0x7f1ad80accd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:47.236 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.231+0000 7f1adf0f4700 1 -- 172.21.15.83:0/697167195 shutdown_connections 2023-10-06T04:38:47.236 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.231+0000 7f1adf0f4700 1 -- 172.21.15.83:0/697167195 wait complete. 2023-10-06T04:38:47.252 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 43d3d13b-f3ee-4773-a9bb-3381f73c16e0 1 2023-10-06T04:38:47.360 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51f04e700 1 Processor -- start 2023-10-06T04:38:47.360 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51f04e700 1 -- start start 2023-10-06T04:38:47.366 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51f04e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd518159bd0 0x7fd51806e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.366 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51f04e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5180c66c0 con 0x7fd51806e190 2023-10-06T04:38:47.366 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51f04e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5180c6910 con 0x7fd5180ac6f0 2023-10-06T04:38:47.366 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51f04e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5180c6bf0 con 0x7fd518159bd0 2023-10-06T04:38:47.367 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51e84d700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd5180ac6f0 0x7fd5180c76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56766/0 (socket says 172.21.15.83:56766) 2023-10-06T04:38:47.367 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51e84d700 1 -- 172.21.15.83:0/745669342 learned_addr learned my addr 172.21.15.83:0/745669342 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T04:38:47.367 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d84b700 1 --2- 172.21.15.83:0/745669342 >> v2:172.21.15.37:3300/0 conn(0x7fd518159bd0 0x7fd51806e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.367 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772578813 0 0) 0x7fd5180c6910 con 0x7fd5180ac6f0 2023-10-06T04:38:47.367 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd500003570 con 0x7fd5180ac6f0 2023-10-06T04:38:47.367 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289673980 0 0) 0x7fd5180c66c0 con 0x7fd51806e190 2023-10-06T04:38:47.367 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5180c6910 con 0x7fd51806e190 2023-10-06T04:38:47.368 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2519285 0 0) 0x7fd500003570 con 0x7fd5180ac6f0 2023-10-06T04:38:47.368 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 >> v2:172.21.15.37:3300/0 conn(0x7fd518159bd0 msgr2=0x7fd51806e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:47.368 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d04a700 1 --2- 172.21.15.83:0/745669342 >> v2:172.21.15.37:3300/0 conn(0x7fd518159bd0 0x7fd51806e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.368 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 >> v1:172.21.15.37:6789/0 conn(0x7fd51806e190 legacy=0x7fd51806ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.368 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180c6ed0 con 0x7fd5180ac6f0 2023-10-06T04:38:47.368 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 <== mon.1 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7fd508001470 con 0x7fd5180ac6f0 2023-10-06T04:38:47.368 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d84b700 1 --2- 172.21.15.83:0/745669342 >> v2:172.21.15.37:3300/0 conn(0x7fd518159bd0 0x7fd51806e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:38:47.368 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.355+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 >> v1:172.21.15.83:6789/0 conn(0x7fd5180ac6f0 legacy=0x7fd5180c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.368 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d04a700 1 --2- 172.21.15.83:0/745669342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd500003bf0 0x7fd500003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.368 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d04a700 1 --2- 172.21.15.83:0/745669342 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 0x7fd500004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.369 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d04a700 1 --2- 172.21.15.83:0/745669342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5000051c0 0x7fd50000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.369 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180c6bf0 con 0x7fd5000051c0 2023-10-06T04:38:47.369 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50000c160 con 0x7fd500003bf0 2023-10-06T04:38:47.369 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50000c320 con 0x7fd500004810 2023-10-06T04:38:47.369 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d84b700 1 --2- 172.21.15.83:0/745669342 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 0x7fd500004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.369 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51e84d700 1 --2- 172.21.15.83:0/745669342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5000051c0 0x7fd50000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.369 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51e04c700 1 --2- 172.21.15.83:0/745669342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd500003bf0 0x7fd500003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.369 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d84b700 1 -- 172.21.15.83:0/745669342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd500003bf0 msgr2=0x7fd500003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:47.369 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d84b700 1 --2- 172.21.15.83:0/745669342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd500003bf0 0x7fd500003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.369 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d84b700 1 -- 172.21.15.83:0/745669342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5000051c0 msgr2=0x7fd50000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:47.369 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d84b700 1 --2- 172.21.15.83:0/745669342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5000051c0 0x7fd50000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.370 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51e84d700 1 -- 172.21.15.83:0/745669342 reap_dead start 2023-10-06T04:38:47.370 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d84b700 1 -- 172.21.15.83:0/745669342 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd500003570 con 0x7fd500004810 2023-10-06T04:38:47.370 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d84b700 1 --2- 172.21.15.83:0/745669342 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 0x7fd500004c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd50c006f00 tx=0x7fd50c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef8b881724fce37f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:47.370 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c009740 con 0x7fd500004810 2023-10-06T04:38:47.370 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00e920 con 0x7fd500004810 2023-10-06T04:38:47.370 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51d04a700 1 -- 172.21.15.83:0/745669342 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00ece0 con 0x7fd500004810 2023-10-06T04:38:47.370 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51f04e700 1 -- 172.21.15.83:0/745669342 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 msgr2=0x7fd500004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.370 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51f04e700 1 --2- 172.21.15.83:0/745669342 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 0x7fd500004c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd50c006f00 tx=0x7fd50c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.370 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51f04e700 1 -- 172.21.15.83:0/745669342 shutdown_connections 2023-10-06T04:38:47.370 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51f04e700 1 --2- 172.21.15.83:0/745669342 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 0x7fd500004c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.370 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51f04e700 1 -- 172.21.15.83:0/745669342 >> 172.21.15.83:0/745669342 conn(0x7fd5180c9570 msgr2=0x7fd518067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:47.370 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51f04e700 1 -- 172.21.15.83:0/745669342 shutdown_connections 2023-10-06T04:38:47.371 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51f04e700 1 -- 172.21.15.83:0/745669342 wait complete. 2023-10-06T04:38:47.371 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51f04e700 1 Processor -- start 2023-10-06T04:38:47.371 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.359+0000 7fd51f04e700 1 -- start start 2023-10-06T04:38:47.373 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51f04e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 0x7fd518168920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.374 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51f04e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5180c59d0 0x7fd5181521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.374 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51f04e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd518158030 0x7fd5181584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.374 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51f04e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180c4180 con 0x7fd518158030 2023-10-06T04:38:47.374 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51f04e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd518168e60 con 0x7fd5180c59d0 2023-10-06T04:38:47.374 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51f04e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181589e0 con 0x7fd500004810 2023-10-06T04:38:47.374 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51e04c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 0x7fd518168920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.374 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51d84b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5180c59d0 0x7fd5181521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.374 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51e04c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 0x7fd518168920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:52748/0 (socket says 172.21.15.83:52748) 2023-10-06T04:38:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51e04c700 1 -- 172.21.15.83:0/4083778996 learned_addr learned my addr 172.21.15.83:0/4083778996 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:38:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51e84d700 1 --2- 172.21.15.83:0/4083778996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd518158030 0x7fd5181584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51e04c700 1 -- 172.21.15.83:0/4083778996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5180c59d0 msgr2=0x7fd5181521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51e04c700 1 --2- 172.21.15.83:0/4083778996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5180c59d0 0x7fd5181521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51e04c700 1 -- 172.21.15.83:0/4083778996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd518158030 msgr2=0x7fd5181584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51e04c700 1 --2- 172.21.15.83:0/4083778996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd518158030 0x7fd5181584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51e04c700 1 -- 172.21.15.83:0/4083778996 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180c3920 con 0x7fd500004810 2023-10-06T04:38:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51d84b700 1 --2- 172.21.15.83:0/4083778996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5180c59d0 0x7fd5181521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:38:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51e04c700 1 --2- 172.21.15.83:0/4083778996 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 0x7fd518168920 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd51000d110 tx=0x7fd510001be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd5167fc700 1 -- 172.21.15.83:0/4083778996 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000dd00 con 0x7fd500004810 2023-10-06T04:38:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd5167fc700 1 -- 172.21.15.83:0/4083778996 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51000de60 con 0x7fd500004810 2023-10-06T04:38:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd5167fc700 1 -- 172.21.15.83:0/4083778996 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510016680 con 0x7fd500004810 2023-10-06T04:38:47.376 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51f04e700 1 -- 172.21.15.83:0/4083778996 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5180c3ea0 con 0x7fd500004810 2023-10-06T04:38:47.376 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd51f04e700 1 -- 172.21.15.83:0/4083778996 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5180c35b0 con 0x7fd500004810 2023-10-06T04:38:47.376 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd5167fc700 1 -- 172.21.15.83:0/4083778996 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd510016a70 con 0x7fd500004810 2023-10-06T04:38:47.376 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.363+0000 7fd5167fc700 1 -- 172.21.15.83:0/4083778996 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fd5100208e0 con 0x7fd500004810 2023-10-06T04:38:47.376 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.367+0000 7fd51f04e700 1 -- 172.21.15.83:0/4083778996 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5180c3110 con 0x7fd500004810 2023-10-06T04:38:47.376 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.367+0000 7fd5167fc700 1 -- 172.21.15.83:0/4083778996 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd5100293e0 con 0x7fd500004810 2023-10-06T04:38:47.447 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.443+0000 7fd51f04e700 1 -- 172.21.15.83:0/4083778996 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "43d3d13b-f3ee-4773-a9bb-3381f73c16e0", "id": 1} v 0) v1 -- 0x7fd5180c5610 con 0x7fd500004810 2023-10-06T04:38:47.458 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.451+0000 7fd5167fc700 1 -- 172.21.15.83:0/4083778996 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43d3d13b-f3ee-4773-a9bb-3381f73c16e0", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd510020af0 con 0x7fd500004810 2023-10-06T04:38:47.458 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T04:38:47.460 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.455+0000 7fd51f04e700 1 -- 172.21.15.83:0/4083778996 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 msgr2=0x7fd518168920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.460 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.455+0000 7fd51f04e700 1 --2- 172.21.15.83:0/4083778996 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 0x7fd518168920 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd51000d110 tx=0x7fd510001be0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.460 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.455+0000 7fd51f04e700 1 -- 172.21.15.83:0/4083778996 shutdown_connections 2023-10-06T04:38:47.460 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.455+0000 7fd51f04e700 1 --2- 172.21.15.83:0/4083778996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5180c59d0 0x7fd5181521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.460 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.455+0000 7fd51f04e700 1 --2- 172.21.15.83:0/4083778996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd518158030 0x7fd5181584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.460 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.455+0000 7fd51f04e700 1 --2- 172.21.15.83:0/4083778996 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd500004810 0x7fd518168920 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.460 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.455+0000 7fd51f04e700 1 -- 172.21.15.83:0/4083778996 >> 172.21.15.83:0/4083778996 conn(0x7fd5180c9570 msgr2=0x7fd518157230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:47.460 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.455+0000 7fd51f04e700 1 -- 172.21.15.83:0/4083778996 shutdown_connections 2023-10-06T04:38:47.460 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.455+0000 7fd51f04e700 1 -- 172.21.15.83:0/4083778996 wait complete. 2023-10-06T04:38:47.472 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 0dc99a64-f6a6-414f-8e83-0e5d715cbd30 2 2023-10-06T04:38:47.557 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:47.553+0000 7f3720383000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:38:47.584 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a6468700 1 Processor -- start 2023-10-06T04:38:47.584 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a6468700 1 -- start start 2023-10-06T04:38:47.584 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a6468700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a015bfe0 0x7f34a00ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.584 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a6468700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34a0068400 0x7f34a006a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.585 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a6468700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a00ac490 con 0x7f34a015c3b0 2023-10-06T04:38:47.585 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a6468700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a00ad1c0 con 0x7f34a0068400 2023-10-06T04:38:47.585 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a6468700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00acd30 con 0x7f34a015bfe0 2023-10-06T04:38:47.585 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a4c65700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f34a015c3b0 0x7f34a0067cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56776/0 (socket says 172.21.15.83:56776) 2023-10-06T04:38:47.585 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a5466700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a015bfe0 0x7f34a00ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.585 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a4c65700 1 -- 172.21.15.83:0/529843474 learned_addr learned my addr 172.21.15.83:0/529843474 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T04:38:47.585 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a5c67700 1 --2- 172.21.15.83:0/529843474 >> v2:172.21.15.37:3300/0 conn(0x7f34a0068400 0x7f34a006a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.585 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f3493fff700 1 -- 172.21.15.83:0/529843474 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95380710 0 0) 0x7f34a00ac490 con 0x7f34a015c3b0 2023-10-06T04:38:47.585 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a5466700 1 -- 172.21.15.83:0/529843474 >> v2:172.21.15.37:3300/0 conn(0x7f34a0068400 msgr2=0x7f34a006a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:47.585 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a5466700 1 --2- 172.21.15.83:0/529843474 >> v2:172.21.15.37:3300/0 conn(0x7f34a0068400 0x7f34a006a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.586 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a5466700 1 -- 172.21.15.83:0/529843474 >> v1:172.21.15.83:6789/0 conn(0x7f34a015c3b0 legacy=0x7f34a0067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.586 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a5466700 1 -- 172.21.15.83:0/529843474 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a00af090 con 0x7f34a015bfe0 2023-10-06T04:38:47.586 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f34a5466700 1 --2- 172.21.15.83:0/529843474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a015bfe0 0x7f34a00ae580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f34940098d0 tx=0x7f34940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a95da64be12db0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:47.586 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.575+0000 7f3493fff700 1 -- 172.21.15.83:0/529843474 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400b640 con 0x7f34a015bfe0 2023-10-06T04:38:47.586 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.579+0000 7f3493fff700 1 -- 172.21.15.83:0/529843474 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400b7a0 con 0x7f34a015bfe0 2023-10-06T04:38:47.586 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.579+0000 7f3493fff700 1 -- 172.21.15.83:0/529843474 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400bb60 con 0x7f34a015bfe0 2023-10-06T04:38:47.586 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.579+0000 7f34a6468700 1 -- 172.21.15.83:0/529843474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a015bfe0 msgr2=0x7f34a00ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.586 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.579+0000 7f34a6468700 1 --2- 172.21.15.83:0/529843474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a015bfe0 0x7f34a00ae580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f34940098d0 tx=0x7f34940091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.586 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.579+0000 7f34a6468700 1 -- 172.21.15.83:0/529843474 shutdown_connections 2023-10-06T04:38:47.586 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.579+0000 7f34a6468700 1 --2- 172.21.15.83:0/529843474 >> v2:172.21.15.37:3300/0 conn(0x7f34a0068400 0x7f34a006a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.586 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.579+0000 7f34a6468700 1 --2- 172.21.15.83:0/529843474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a015bfe0 0x7f34a00ae580 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.587 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.579+0000 7f34a6468700 1 -- 172.21.15.83:0/529843474 >> 172.21.15.83:0/529843474 conn(0x7f34a006e7c0 msgr2=0x7f34a006ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:47.587 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.579+0000 7f34a6468700 1 -- 172.21.15.83:0/529843474 shutdown_connections 2023-10-06T04:38:47.587 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.579+0000 7f34a6468700 1 -- 172.21.15.83:0/529843474 wait complete. 2023-10-06T04:38:47.589 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.579+0000 7f34a6468700 1 Processor -- start 2023-10-06T04:38:47.589 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.579+0000 7f34a6468700 1 -- start start 2023-10-06T04:38:47.589 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a6468700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a0068400 0x7f34a0169f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.589 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a6468700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34a015bfe0 0x7f34a00a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.589 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a6468700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a015c3b0 0x7f34a0159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.589 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a6468700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a01599b0 con 0x7f34a015c3b0 2023-10-06T04:38:47.590 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a6468700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a01455d0 con 0x7f34a015bfe0 2023-10-06T04:38:47.590 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a6468700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a015a7d0 con 0x7f34a0068400 2023-10-06T04:38:47.590 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a5466700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a0068400 0x7f34a0169f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.590 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a4c65700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34a015bfe0 0x7f34a00a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.590 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a5466700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a0068400 0x7f34a0169f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:52762/0 (socket says 172.21.15.83:52762) 2023-10-06T04:38:47.590 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a5466700 1 -- 172.21.15.83:0/277240987 learned_addr learned my addr 172.21.15.83:0/277240987 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:38:47.590 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a5c67700 1 --2- 172.21.15.83:0/277240987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a015c3b0 0x7f34a0159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.590 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a4c65700 1 -- 172.21.15.83:0/277240987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a0068400 msgr2=0x7f34a0169f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.590 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a4c65700 1 --2- 172.21.15.83:0/277240987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a0068400 0x7f34a0169f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.590 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a4c65700 1 -- 172.21.15.83:0/277240987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a015c3b0 msgr2=0x7f34a0159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.591 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a4c65700 1 --2- 172.21.15.83:0/277240987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a015c3b0 0x7f34a0159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.591 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a4c65700 1 -- 172.21.15.83:0/277240987 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940093c0 con 0x7f34a015bfe0 2023-10-06T04:38:47.591 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a5466700 1 --2- 172.21.15.83:0/277240987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a0068400 0x7f34a0169f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:38:47.591 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a4c65700 1 --2- 172.21.15.83:0/277240987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34a015bfe0 0x7f34a00a6310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c4f0 tx=0x7f349c007f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:47.591 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34917fa700 1 -- 172.21.15.83:0/277240987 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c00cea0 con 0x7f34a015bfe0 2023-10-06T04:38:47.591 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34917fa700 1 -- 172.21.15.83:0/277240987 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c005b30 con 0x7f34a015bfe0 2023-10-06T04:38:47.591 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a6468700 1 -- 172.21.15.83:0/277240987 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a0159bc0 con 0x7f34a015bfe0 2023-10-06T04:38:47.591 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34917fa700 1 -- 172.21.15.83:0/277240987 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0070d0 con 0x7f34a015bfe0 2023-10-06T04:38:47.591 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a6468700 1 -- 172.21.15.83:0/277240987 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a015a180 con 0x7f34a015bfe0 2023-10-06T04:38:47.591 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34917fa700 1 -- 172.21.15.83:0/277240987 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f349c01c440 con 0x7f34a015bfe0 2023-10-06T04:38:47.591 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34917fa700 1 -- 172.21.15.83:0/277240987 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f349c007700 con 0x7f34a015bfe0 2023-10-06T04:38:47.592 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.583+0000 7f34a6468700 1 -- 172.21.15.83:0/277240987 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a015a940 con 0x7f34a015bfe0 2023-10-06T04:38:47.593 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.587+0000 7f34917fa700 1 -- 172.21.15.83:0/277240987 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f349c017070 con 0x7f34a015bfe0 2023-10-06T04:38:47.615 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:47.609+0000 7f3720383000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:38:47.667 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.663+0000 7f34a6468700 1 -- 172.21.15.83:0/277240987 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0dc99a64-f6a6-414f-8e83-0e5d715cbd30", "id": 2} v 0) v1 -- 0x7f34a00708a0 con 0x7f34a015bfe0 2023-10-06T04:38:47.678 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.671+0000 7f34917fa700 1 -- 172.21.15.83:0/277240987 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0dc99a64-f6a6-414f-8e83-0e5d715cbd30", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f349c01c880 con 0x7f34a015bfe0 2023-10-06T04:38:47.679 INFO:teuthology.orchestra.run.smithi083.stdout:2 2023-10-06T04:38:47.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.675+0000 7f34a6468700 1 -- 172.21.15.83:0/277240987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34a015bfe0 msgr2=0x7f34a00a6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.675+0000 7f34a6468700 1 --2- 172.21.15.83:0/277240987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34a015bfe0 0x7f34a00a6310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c4f0 tx=0x7f349c007f50 comp rx=0 tx=0).stop 2023-10-06T04:38:47.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.675+0000 7f34a6468700 1 -- 172.21.15.83:0/277240987 shutdown_connections 2023-10-06T04:38:47.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.675+0000 7f34a6468700 1 --2- 172.21.15.83:0/277240987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34a015bfe0 0x7f34a00a6310 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.675+0000 7f34a6468700 1 --2- 172.21.15.83:0/277240987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a015c3b0 0x7f34a0159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.675+0000 7f34a6468700 1 --2- 172.21.15.83:0/277240987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34a0068400 0x7f34a0169f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.675+0000 7f34a6468700 1 -- 172.21.15.83:0/277240987 >> 172.21.15.83:0/277240987 conn(0x7f34a006e7c0 msgr2=0x7f34a00b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:47.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.675+0000 7f34a6468700 1 -- 172.21.15.83:0/277240987 shutdown_connections 2023-10-06T04:38:47.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.675+0000 7f34a6468700 1 -- 172.21.15.83:0/277240987 wait complete. 2023-10-06T04:38:47.681 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:47.675+0000 7f8fc08f9000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:38:47.694 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 3f3f6ae4-129d-4639-9327-723828581123 3 2023-10-06T04:38:47.734 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:47.729+0000 7f3720383000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:38:47.740 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:47.735+0000 7f8fc08f9000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:38:47.792 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb3aa0c700 1 Processor -- start 2023-10-06T04:38:47.794 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb3aa0c700 1 -- start start 2023-10-06T04:38:47.794 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb3aa0c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbb3406cfb0 0x7fbb34167dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.794 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb3aa0c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb340c7260 con 0x7fbb34067cf0 2023-10-06T04:38:47.794 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb3aa0c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb340c9210 con 0x7fbb340caff0 2023-10-06T04:38:47.794 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb3aa0c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb340c8660 con 0x7fbb3406cfb0 2023-10-06T04:38:47.794 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb337fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fbb340caff0 0x7fbb340680c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56792/0 (socket says 172.21.15.83:56792) 2023-10-06T04:38:47.794 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb337fe700 1 -- 172.21.15.83:0/2465693300 learned_addr learned my addr 172.21.15.83:0/2465693300 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T04:38:47.794 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb38fa9700 1 --2- 172.21.15.83:0/2465693300 >> v2:172.21.15.83:3300/0 conn(0x7fbb3406cfb0 0x7fbb34167dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.794 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb32ffd700 1 -- 172.21.15.83:0/2465693300 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829185836 0 0) 0x7fbb340c9210 con 0x7fbb340caff0 2023-10-06T04:38:47.795 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb32ffd700 1 -- 172.21.15.83:0/2465693300 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb1c003570 con 0x7fbb340caff0 2023-10-06T04:38:47.795 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb38fa9700 1 -- 172.21.15.83:0/2465693300 >> v1:172.21.15.83:6789/0 conn(0x7fbb340caff0 legacy=0x7fbb340680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.795 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb38fa9700 1 -- 172.21.15.83:0/2465693300 >> v1:172.21.15.37:6789/0 conn(0x7fbb34067cf0 legacy=0x7fbb340cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.795 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb38fa9700 1 -- 172.21.15.83:0/2465693300 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb340cb4f0 con 0x7fbb3406cfb0 2023-10-06T04:38:47.796 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.787+0000 7fbb38fa9700 1 --2- 172.21.15.83:0/2465693300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb3406cfb0 0x7fbb34167dc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009e60 tx=0x7fbb2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d150e20ee5126c88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:47.796 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb32ffd700 1 -- 172.21.15.83:0/2465693300 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c00e070 con 0x7fbb3406cfb0 2023-10-06T04:38:47.796 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb32ffd700 1 -- 172.21.15.83:0/2465693300 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c00bbf0 con 0x7fbb3406cfb0 2023-10-06T04:38:47.796 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb32ffd700 1 -- 172.21.15.83:0/2465693300 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c012430 con 0x7fbb3406cfb0 2023-10-06T04:38:47.796 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/2465693300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb3406cfb0 msgr2=0x7fbb34167dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.796 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 --2- 172.21.15.83:0/2465693300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb3406cfb0 0x7fbb34167dc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009e60 tx=0x7fbb2c009780 comp rx=0 tx=0).stop 2023-10-06T04:38:47.797 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/2465693300 shutdown_connections 2023-10-06T04:38:47.797 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 --2- 172.21.15.83:0/2465693300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb3406cfb0 0x7fbb34167dc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.797 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/2465693300 >> 172.21.15.83:0/2465693300 conn(0x7fbb340698d0 msgr2=0x7fbb340cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:47.797 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/2465693300 shutdown_connections 2023-10-06T04:38:47.797 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/2465693300 wait complete. 2023-10-06T04:38:47.797 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 Processor -- start 2023-10-06T04:38:47.798 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 -- start start 2023-10-06T04:38:47.800 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb34067cf0 0x7fbb340ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.800 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb3406cfb0 0x7fbb340af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.800 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb340caff0 0x7fbb340afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:47.800 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb340c41e0 con 0x7fbb340caff0 2023-10-06T04:38:47.800 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb340c44c0 con 0x7fbb34067cf0 2023-10-06T04:38:47.800 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb3aa0c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb340c47a0 con 0x7fbb3406cfb0 2023-10-06T04:38:47.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb33fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb34067cf0 0x7fbb340ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb33fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb34067cf0 0x7fbb340ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37572/0 (socket says 172.21.15.83:37572) 2023-10-06T04:38:47.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb33fff700 1 -- 172.21.15.83:0/1462781073 learned_addr learned my addr 172.21.15.83:0/1462781073 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:38:47.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.791+0000 7fbb337fe700 1 --2- 172.21.15.83:0/1462781073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb3406cfb0 0x7fbb340af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb38fa9700 1 --2- 172.21.15.83:0/1462781073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb340caff0 0x7fbb340afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:47.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb33fff700 1 -- 172.21.15.83:0/1462781073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb3406cfb0 msgr2=0x7fbb340af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb33fff700 1 --2- 172.21.15.83:0/1462781073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb3406cfb0 0x7fbb340af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb33fff700 1 -- 172.21.15.83:0/1462781073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb340caff0 msgr2=0x7fbb340afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.802 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb33fff700 1 --2- 172.21.15.83:0/1462781073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb340caff0 0x7fbb340afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.802 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb33fff700 1 -- 172.21.15.83:0/1462781073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c009a20 con 0x7fbb34067cf0 2023-10-06T04:38:47.802 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb33fff700 1 --2- 172.21.15.83:0/1462781073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb34067cf0 0x7fbb340ae750 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400c4e0 tx=0x7fbb2400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:47.803 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb1bfff700 1 -- 172.21.15.83:0/1462781073 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24011590 con 0x7fbb34067cf0 2023-10-06T04:38:47.803 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb1bfff700 1 -- 172.21.15.83:0/1462781073 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb24011710 con 0x7fbb34067cf0 2023-10-06T04:38:47.803 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/1462781073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb340c4a80 con 0x7fbb34067cf0 2023-10-06T04:38:47.803 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb1bfff700 1 -- 172.21.15.83:0/1462781073 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24011ad0 con 0x7fbb34067cf0 2023-10-06T04:38:47.803 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/1462781073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb340aec90 con 0x7fbb34067cf0 2023-10-06T04:38:47.804 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/1462781073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb34070ee0 con 0x7fbb34067cf0 2023-10-06T04:38:47.804 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb1bfff700 1 -- 172.21.15.83:0/1462781073 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fbb2401c6c0 con 0x7fbb34067cf0 2023-10-06T04:38:47.804 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.795+0000 7fbb1bfff700 1 -- 172.21.15.83:0/1462781073 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fbb240128c0 con 0x7fbb34067cf0 2023-10-06T04:38:47.804 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.799+0000 7fbb1bfff700 1 -- 172.21.15.83:0/1462781073 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fbb24017070 con 0x7fbb34067cf0 2023-10-06T04:38:47.856 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:47.851+0000 7f8fc08f9000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:38:47.878 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.871+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/1462781073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3f3f6ae4-129d-4639-9327-723828581123", "id": 3} v 0) v1 -- 0x7fbb3415c580 con 0x7fbb34067cf0 2023-10-06T04:38:47.888 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.883+0000 7fbb1bfff700 1 -- 172.21.15.83:0/1462781073 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f3f6ae4-129d-4639-9327-723828581123", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbb24012cb0 con 0x7fbb34067cf0 2023-10-06T04:38:47.889 INFO:teuthology.orchestra.run.smithi083.stdout:3 2023-10-06T04:38:47.891 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.883+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/1462781073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb34067cf0 msgr2=0x7fbb340ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:47.891 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.883+0000 7fbb3aa0c700 1 --2- 172.21.15.83:0/1462781073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb34067cf0 0x7fbb340ae750 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400c4e0 tx=0x7fbb2400c7f0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.891 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.883+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/1462781073 shutdown_connections 2023-10-06T04:38:47.891 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.883+0000 7fbb3aa0c700 1 --2- 172.21.15.83:0/1462781073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb340caff0 0x7fbb340afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.891 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.883+0000 7fbb3aa0c700 1 --2- 172.21.15.83:0/1462781073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb3406cfb0 0x7fbb340af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.891 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.883+0000 7fbb3aa0c700 1 --2- 172.21.15.83:0/1462781073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb34067cf0 0x7fbb340ae750 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:47.891 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.883+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/1462781073 >> 172.21.15.83:0/1462781073 conn(0x7fbb340698d0 msgr2=0x7fbb34157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:47.891 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.883+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/1462781073 shutdown_connections 2023-10-06T04:38:47.892 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.883+0000 7fbb3aa0c700 1 -- 172.21.15.83:0/1462781073 wait complete. 2023-10-06T04:38:47.901 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 08659d6f-1c95-40c4-99ab-8179ed28fd85 4 2023-10-06T04:38:47.978 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:47.973+0000 7f3720383000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:38:48.005 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.999+0000 7fc0064a6700 1 Processor -- start 2023-10-06T04:38:48.005 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.999+0000 7fc0064a6700 1 -- start start 2023-10-06T04:38:48.007 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.999+0000 7fc0064a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 0x7fc000066db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.007 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.999+0000 7fc0064a6700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00006aa90 con 0x7fc000158bb0 2023-10-06T04:38:48.007 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.999+0000 7fc0064a6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc000069c20 con 0x7fc0000669e0 2023-10-06T04:38:48.007 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.999+0000 7fc0064a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc000069e80 con 0x7fc0000c8180 2023-10-06T04:38:48.007 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.999+0000 7fbffffff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc0000669e0 0x7fc000069510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56798/0 (socket says 172.21.15.83:56798) 2023-10-06T04:38:48.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.999+0000 7fbffffff700 1 -- 172.21.15.83:0/1545045030 learned_addr learned my addr 172.21.15.83:0/1545045030 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T04:38:48.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:47.999+0000 7fbfff7fe700 1 --2- 172.21.15.83:0/1545045030 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 0x7fc000066db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fbffeffd700 1 -- 172.21.15.83:0/1545045030 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014941608 0 0) 0x7fc000069c20 con 0x7fc0000669e0 2023-10-06T04:38:48.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fbffeffd700 1 -- 172.21.15.83:0/1545045030 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfe8003570 con 0x7fc0000669e0 2023-10-06T04:38:48.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fbfff7fe700 1 -- 172.21.15.83:0/1545045030 >> v1:172.21.15.83:6789/0 conn(0x7fc0000669e0 legacy=0x7fc000069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fbfff7fe700 1 -- 172.21.15.83:0/1545045030 >> v1:172.21.15.37:6789/0 conn(0x7fc000158bb0 legacy=0x7fc000159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fbfff7fe700 1 -- 172.21.15.83:0/1545045030 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00006a160 con 0x7fc0000c8180 2023-10-06T04:38:48.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fbfff7fe700 1 --2- 172.21.15.83:0/1545045030 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 0x7fc000066db0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009910 tx=0x7fbff40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2af1d394a92cd5c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:48.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fbffeffd700 1 -- 172.21.15.83:0/1545045030 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff400b680 con 0x7fc0000c8180 2023-10-06T04:38:48.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fbffeffd700 1 -- 172.21.15.83:0/1545045030 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff400b7e0 con 0x7fc0000c8180 2023-10-06T04:38:48.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fbffeffd700 1 -- 172.21.15.83:0/1545045030 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff400bba0 con 0x7fc0000c8180 2023-10-06T04:38:48.009 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fc0064a6700 1 -- 172.21.15.83:0/1545045030 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 msgr2=0x7fc000066db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.009 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fc0064a6700 1 --2- 172.21.15.83:0/1545045030 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 0x7fc000066db0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009910 tx=0x7fbff40091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.010 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fc0064a6700 1 -- 172.21.15.83:0/1545045030 shutdown_connections 2023-10-06T04:38:48.010 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fc0064a6700 1 --2- 172.21.15.83:0/1545045030 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 0x7fc000066db0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.010 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fc0064a6700 1 -- 172.21.15.83:0/1545045030 >> 172.21.15.83:0/1545045030 conn(0x7fc0000cdb00 msgr2=0x7fc0000cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:48.010 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fc0064a6700 1 -- 172.21.15.83:0/1545045030 shutdown_connections 2023-10-06T04:38:48.010 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fc0064a6700 1 -- 172.21.15.83:0/1545045030 wait complete. 2023-10-06T04:38:48.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fc0064a6700 1 Processor -- start 2023-10-06T04:38:48.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.003+0000 7fc0064a6700 1 -- start start 2023-10-06T04:38:48.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fc0064a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0000669e0 0x7fc00015b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.015 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fc0064a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 0x7fc0000c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.015 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fc0064a6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc000158bb0 0x7fc0001699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.015 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fc0064a6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00015d2c0 con 0x7fc0000669e0 2023-10-06T04:38:48.015 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fc0064a6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00015ce30 con 0x7fc000158bb0 2023-10-06T04:38:48.016 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fc0064a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00015c220 con 0x7fc0000c8180 2023-10-06T04:38:48.016 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfff7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 0x7fc0000c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.016 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fc004a43700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc000158bb0 0x7fc0001699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.016 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfff7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 0x7fc0000c7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:52790/0 (socket says 172.21.15.83:52790) 2023-10-06T04:38:48.017 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfff7fe700 1 -- 172.21.15.83:0/2931111057 learned_addr learned my addr 172.21.15.83:0/2931111057 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:38:48.017 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbffffff700 1 --2- 172.21.15.83:0/2931111057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0000669e0 0x7fc00015b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.017 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfff7fe700 1 -- 172.21.15.83:0/2931111057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc000158bb0 msgr2=0x7fc0001699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.017 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfff7fe700 1 --2- 172.21.15.83:0/2931111057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc000158bb0 0x7fc0001699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.017 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfff7fe700 1 -- 172.21.15.83:0/2931111057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0000669e0 msgr2=0x7fc00015b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.017 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfff7fe700 1 --2- 172.21.15.83:0/2931111057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0000669e0 0x7fc00015b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.017 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfff7fe700 1 -- 172.21.15.83:0/2931111057 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff4009420 con 0x7fc0000c8180 2023-10-06T04:38:48.018 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfff7fe700 1 --2- 172.21.15.83:0/2931111057 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 0x7fc0000c7130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc000069db0 tx=0x7fbff4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:48.018 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfe7fff700 1 -- 172.21.15.83:0/2931111057 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff400bb60 con 0x7fc0000c8180 2023-10-06T04:38:48.018 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfe7fff700 1 -- 172.21.15.83:0/2931111057 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4000c90 con 0x7fc0000c8180 2023-10-06T04:38:48.018 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fc0064a6700 1 -- 172.21.15.83:0/2931111057 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00015c500 con 0x7fc0000c8180 2023-10-06T04:38:48.018 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfe7fff700 1 -- 172.21.15.83:0/2931111057 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff401a660 con 0x7fc0000c8180 2023-10-06T04:38:48.018 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fc0064a6700 1 -- 172.21.15.83:0/2931111057 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00015cac0 con 0x7fc0000c8180 2023-10-06T04:38:48.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfe7fff700 1 -- 172.21.15.83:0/2931111057 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fbff401ac50 con 0x7fc0000c8180 2023-10-06T04:38:48.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fbfe7fff700 1 -- 172.21.15.83:0/2931111057 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fbff4011bf0 con 0x7fc0000c8180 2023-10-06T04:38:48.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.007+0000 7fc0064a6700 1 -- 172.21.15.83:0/2931111057 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00015cfa0 con 0x7fc0000c8180 2023-10-06T04:38:48.020 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.011+0000 7fbfe7fff700 1 -- 172.21.15.83:0/2931111057 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fbff4034060 con 0x7fc0000c8180 2023-10-06T04:38:48.032 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:48.025+0000 7f3720383000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:38:48.079 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:48.075+0000 7f8fc08f9000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:38:48.089 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.083+0000 7fc0064a6700 1 -- 172.21.15.83:0/2931111057 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "08659d6f-1c95-40c4-99ab-8179ed28fd85", "id": 4} v 0) v1 -- 0x7fc000070ee0 con 0x7fc0000c8180 2023-10-06T04:38:48.099 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.095+0000 7fbfe7fff700 1 -- 172.21.15.83:0/2931111057 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08659d6f-1c95-40c4-99ab-8179ed28fd85", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbff4015020 con 0x7fc0000c8180 2023-10-06T04:38:48.099 INFO:teuthology.orchestra.run.smithi083.stdout:4 2023-10-06T04:38:48.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.095+0000 7fc0064a6700 1 -- 172.21.15.83:0/2931111057 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 msgr2=0x7fc0000c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.095+0000 7fc0064a6700 1 --2- 172.21.15.83:0/2931111057 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 0x7fc0000c7130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc000069db0 tx=0x7fbff4017000 comp rx=0 tx=0).stop 2023-10-06T04:38:48.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.095+0000 7fc0064a6700 1 -- 172.21.15.83:0/2931111057 shutdown_connections 2023-10-06T04:38:48.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.095+0000 7fc0064a6700 1 --2- 172.21.15.83:0/2931111057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc000158bb0 0x7fc0001699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.095+0000 7fc0064a6700 1 --2- 172.21.15.83:0/2931111057 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0000c8180 0x7fc0000c7130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.095+0000 7fc0064a6700 1 --2- 172.21.15.83:0/2931111057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0000669e0 0x7fc00015b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.095+0000 7fc0064a6700 1 -- 172.21.15.83:0/2931111057 >> 172.21.15.83:0/2931111057 conn(0x7fc0000cdb00 msgr2=0x7fc0000ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:48.102 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.095+0000 7fc0064a6700 1 -- 172.21.15.83:0/2931111057 shutdown_connections 2023-10-06T04:38:48.102 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.095+0000 7fc0064a6700 1 -- 172.21.15.83:0/2931111057 wait complete. 2023-10-06T04:38:48.112 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new a7470b79-8f88-4f4b-9fdb-0aacb6de8311 5 2023-10-06T04:38:48.130 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:48.123+0000 7f8fc08f9000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:38:48.209 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.203+0000 7f3f58cd4700 1 Processor -- start 2023-10-06T04:38:48.209 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.203+0000 7f3f58cd4700 1 -- start start 2023-10-06T04:38:48.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.203+0000 7f3f58cd4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406f140 0x7f3f5406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f58cd4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5415ae50 con 0x7f3f540c2c60 2023-10-06T04:38:48.211 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f58cd4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f54068760 con 0x7f3f5406e190 2023-10-06T04:38:48.211 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f58cd4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540ad370 con 0x7f3f5406f140 2023-10-06T04:38:48.211 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f52ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406f140 0x7f3f5406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.211 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f537fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3f5406e190 0x7f3f5415b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56810/0 (socket says 172.21.15.83:56810) 2023-10-06T04:38:48.211 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f537fe700 1 -- 172.21.15.83:0/3004757113 learned_addr learned my addr 172.21.15.83:0/3004757113 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T04:38:48.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f52ffd700 1 -- 172.21.15.83:0/3004757113 >> v1:172.21.15.83:6789/0 conn(0x7f3f5406e190 legacy=0x7f3f5415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f52ffd700 1 -- 172.21.15.83:0/3004757113 >> v1:172.21.15.37:6789/0 conn(0x7f3f540c2c60 legacy=0x7f3f54159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:48.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f527fc700 1 -- 172.21.15.83:0/3004757113 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834017032 0 0) 0x7f3f54068760 con 0x7f3f5406e190 2023-10-06T04:38:48.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f52ffd700 1 -- 172.21.15.83:0/3004757113 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f54068a40 con 0x7f3f5406f140 2023-10-06T04:38:48.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f52ffd700 1 --2- 172.21.15.83:0/3004757113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406f140 0x7f3f5406e560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009910 tx=0x7f3f480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d092a0fd530f35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:48.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f527fc700 1 -- 172.21.15.83:0/3004757113 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800b820 con 0x7f3f5406f140 2023-10-06T04:38:48.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f527fc700 1 -- 172.21.15.83:0/3004757113 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4800b980 con 0x7f3f5406f140 2023-10-06T04:38:48.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f527fc700 1 -- 172.21.15.83:0/3004757113 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800bd20 con 0x7f3f5406f140 2023-10-06T04:38:48.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f58cd4700 1 -- 172.21.15.83:0/3004757113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406f140 msgr2=0x7f3f5406e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f58cd4700 1 --2- 172.21.15.83:0/3004757113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406f140 0x7f3f5406e560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009910 tx=0x7f3f480091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f58cd4700 1 -- 172.21.15.83:0/3004757113 shutdown_connections 2023-10-06T04:38:48.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f58cd4700 1 --2- 172.21.15.83:0/3004757113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406f140 0x7f3f5406e560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f58cd4700 1 -- 172.21.15.83:0/3004757113 >> 172.21.15.83:0/3004757113 conn(0x7f3f540c9570 msgr2=0x7f3f54067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:48.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f58cd4700 1 -- 172.21.15.83:0/3004757113 shutdown_connections 2023-10-06T04:38:48.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f58cd4700 1 -- 172.21.15.83:0/3004757113 wait complete. 2023-10-06T04:38:48.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f58cd4700 1 Processor -- start 2023-10-06T04:38:48.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.207+0000 7f3f58cd4700 1 -- start start 2023-10-06T04:38:48.217 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f58cd4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406e190 0x7f3f540c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.217 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f58cd4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f5406f140 0x7f3f54151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.217 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f58cd4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540c2c60 0x7f3f5414c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.217 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f58cd4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54153260 con 0x7f3f540c2c60 2023-10-06T04:38:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f58cd4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54152650 con 0x7f3f5406f140 2023-10-06T04:38:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f58cd4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54152930 con 0x7f3f5406e190 2023-10-06T04:38:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f537fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406e190 0x7f3f540c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f537fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406e190 0x7f3f540c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:52814/0 (socket says 172.21.15.83:52814) 2023-10-06T04:38:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f537fe700 1 -- 172.21.15.83:0/2570421134 learned_addr learned my addr 172.21.15.83:0/2570421134 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:38:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f52ffd700 1 --2- 172.21.15.83:0/2570421134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f5406f140 0x7f3f54151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f53fff700 1 --2- 172.21.15.83:0/2570421134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540c2c60 0x7f3f5414c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f537fe700 1 -- 172.21.15.83:0/2570421134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f5406f140 msgr2=0x7f3f54151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f537fe700 1 --2- 172.21.15.83:0/2570421134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f5406f140 0x7f3f54151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f537fe700 1 -- 172.21.15.83:0/2570421134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540c2c60 msgr2=0x7f3f5414c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f537fe700 1 --2- 172.21.15.83:0/2570421134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540c2c60 0x7f3f5414c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f537fe700 1 -- 172.21.15.83:0/2570421134 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f48009420 con 0x7f3f5406e190 2023-10-06T04:38:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f53fff700 1 --2- 172.21.15.83:0/2570421134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540c2c60 0x7f3f5414c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f537fe700 1 --2- 172.21.15.83:0/2570421134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406e190 0x7f3f540c7cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400c7e0 tx=0x7f3f44007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f3b7fe700 1 -- 172.21.15.83:0/2570421134 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44005b30 con 0x7f3f5406e190 2023-10-06T04:38:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f3b7fe700 1 -- 172.21.15.83:0/2570421134 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f44005c90 con 0x7f3f5406e190 2023-10-06T04:38:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f58cd4700 1 -- 172.21.15.83:0/2570421134 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f54152c10 con 0x7f3f5406e190 2023-10-06T04:38:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f3b7fe700 1 -- 172.21.15.83:0/2570421134 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44007300 con 0x7f3f5406e190 2023-10-06T04:38:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f58cd4700 1 -- 172.21.15.83:0/2570421134 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f54152360 con 0x7f3f5406e190 2023-10-06T04:38:48.220 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f3b7fe700 1 -- 172.21.15.83:0/2570421134 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3f4401c440 con 0x7f3f5406e190 2023-10-06T04:38:48.220 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f3b7fe700 1 -- 172.21.15.83:0/2570421134 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f3f44005e00 con 0x7f3f5406e190 2023-10-06T04:38:48.220 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.211+0000 7f3f58cd4700 1 -- 172.21.15.83:0/2570421134 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f540708a0 con 0x7f3f5406e190 2023-10-06T04:38:48.221 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.215+0000 7f3f3b7fe700 1 -- 172.21.15.83:0/2570421134 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3f44017070 con 0x7f3f5406e190 2023-10-06T04:38:48.233 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:48.229+0000 7f3720383000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:38:48.298 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.291+0000 7f3f58cd4700 1 -- 172.21.15.83:0/2570421134 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a7470b79-8f88-4f4b-9fdb-0aacb6de8311", "id": 5} v 0) v1 -- 0x7f3f5415aae0 con 0x7f3f5406e190 2023-10-06T04:38:48.300 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:48.297+0000 7f3720383000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:38:48.308 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.303+0000 7f3f3b7fe700 1 -- 172.21.15.83:0/2570421134 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7470b79-8f88-4f4b-9fdb-0aacb6de8311", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3f4401c830 con 0x7f3f5406e190 2023-10-06T04:38:48.308 INFO:teuthology.orchestra.run.smithi083.stdout:5 2023-10-06T04:38:48.310 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:48.303+0000 7f8fc08f9000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:38:48.311 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.303+0000 7f3f58cd4700 1 -- 172.21.15.83:0/2570421134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406e190 msgr2=0x7f3f540c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.311 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.303+0000 7f3f58cd4700 1 --2- 172.21.15.83:0/2570421134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406e190 0x7f3f540c7cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400c7e0 tx=0x7f3f44007df0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.311 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.303+0000 7f3f58cd4700 1 -- 172.21.15.83:0/2570421134 shutdown_connections 2023-10-06T04:38:48.311 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.303+0000 7f3f58cd4700 1 --2- 172.21.15.83:0/2570421134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f5406f140 0x7f3f54151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.311 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.303+0000 7f3f58cd4700 1 --2- 172.21.15.83:0/2570421134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540c2c60 0x7f3f5414c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.311 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.303+0000 7f3f58cd4700 1 --2- 172.21.15.83:0/2570421134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5406e190 0x7f3f540c7cc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.311 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.303+0000 7f3f58cd4700 1 -- 172.21.15.83:0/2570421134 >> 172.21.15.83:0/2570421134 conn(0x7f3f540c9570 msgr2=0x7f3f54158230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:48.311 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.303+0000 7f3f58cd4700 1 -- 172.21.15.83:0/2570421134 shutdown_connections 2023-10-06T04:38:48.312 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.303+0000 7f3f58cd4700 1 -- 172.21.15.83:0/2570421134 wait complete. 2023-10-06T04:38:48.326 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new d2e1ba14-42a5-4eeb-87da-00d86fb901af 6 2023-10-06T04:38:48.369 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:48.365+0000 7f3720383000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:38:48.372 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:48.367+0000 7f8fc08f9000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:38:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b298e700 1 Processor -- start 2023-10-06T04:38:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b298e700 1 -- start start 2023-10-06T04:38:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b298e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f82ac0c68f0 0x7f82ac0c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b298e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0669c0 0x7f82ac0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b298e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ac0ad700 con 0x7f82ac0c78e0 2023-10-06T04:38:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b298e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ac0ad9e0 con 0x7f82ac0c68f0 2023-10-06T04:38:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b298e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac0adcc0 con 0x7f82ac0669c0 2023-10-06T04:38:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b118b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0669c0 0x7f82ac0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b118b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0669c0 0x7f82ac0ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:52820/0 (socket says 172.21.15.83:52820) 2023-10-06T04:38:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b118b700 1 -- 172.21.15.83:0/3223129525 learned_addr learned my addr 172.21.15.83:0/3223129525 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:38:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b198c700 1 --2- 172.21.15.83:0/3223129525 >> v2:172.21.15.83:3300/0 conn(0x7f82ac0c68f0 0x7f82ac0c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b118b700 1 -- 172.21.15.83:0/3223129525 >> v2:172.21.15.83:3300/0 conn(0x7f82ac0c68f0 msgr2=0x7f82ac0c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b118b700 1 --2- 172.21.15.83:0/3223129525 >> v2:172.21.15.83:3300/0 conn(0x7f82ac0c68f0 0x7f82ac0c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b118b700 1 -- 172.21.15.83:0/3223129525 >> v1:172.21.15.83:6789/0 conn(0x7f82ac0c78e0 legacy=0x7f82ac0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b118b700 1 -- 172.21.15.83:0/3223129525 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac0adfa0 con 0x7f82ac0669c0 2023-10-06T04:38:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b118b700 1 --2- 172.21.15.83:0/3223129525 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0669c0 0x7f82ac0ace20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f829c00bc50 tx=0x7f829c00b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4c22f8f9ea43e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b098a700 1 -- 172.21.15.83:0/3223129525 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c00dc80 con 0x7f82ac0669c0 2023-10-06T04:38:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b098a700 1 -- 172.21.15.83:0/3223129525 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c00dde0 con 0x7f82ac0669c0 2023-10-06T04:38:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.419+0000 7f82b098a700 1 -- 172.21.15.83:0/3223129525 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c0196b0 con 0x7f82ac0669c0 2023-10-06T04:38:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 -- 172.21.15.83:0/3223129525 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0669c0 msgr2=0x7f82ac0ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 --2- 172.21.15.83:0/3223129525 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0669c0 0x7f82ac0ace20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f829c00bc50 tx=0x7f829c00b4f0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 -- 172.21.15.83:0/3223129525 shutdown_connections 2023-10-06T04:38:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 --2- 172.21.15.83:0/3223129525 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0669c0 0x7f82ac0ace20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 --2- 172.21.15.83:0/3223129525 >> v2:172.21.15.83:3300/0 conn(0x7f82ac0c68f0 0x7f82ac0c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 -- 172.21.15.83:0/3223129525 >> 172.21.15.83:0/3223129525 conn(0x7f82ac0c9570 msgr2=0x7f82ac067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 -- 172.21.15.83:0/3223129525 shutdown_connections 2023-10-06T04:38:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 -- 172.21.15.83:0/3223129525 wait complete. 2023-10-06T04:38:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 Processor -- start 2023-10-06T04:38:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 -- start start 2023-10-06T04:38:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ac0669c0 0x7f82ac0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0c68f0 0x7f82ac1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82ac0c78e0 0x7f82ac14a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac157c80 con 0x7f82ac0c78e0 2023-10-06T04:38:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac157f60 con 0x7f82ac0669c0 2023-10-06T04:38:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b298e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac158240 con 0x7f82ac0c68f0 2023-10-06T04:38:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b118b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0c68f0 0x7f82ac1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b198c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ac0669c0 0x7f82ac0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b118b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0c68f0 0x7f82ac1571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:52828/0 (socket says 172.21.15.83:52828) 2023-10-06T04:38:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b118b700 1 -- 172.21.15.83:0/2033953581 learned_addr learned my addr 172.21.15.83:0/2033953581 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:38:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b198c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ac0669c0 0x7f82ac0af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37610/0 (socket says 172.21.15.83:37610) 2023-10-06T04:38:48.432 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.423+0000 7f82b218d700 1 --2- 172.21.15.83:0/2033953581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82ac0c78e0 0x7f82ac14a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.432 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82b198c700 1 -- 172.21.15.83:0/2033953581 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0c68f0 msgr2=0x7f82ac1571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.432 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82b198c700 1 --2- 172.21.15.83:0/2033953581 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0c68f0 0x7f82ac1571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82b198c700 1 -- 172.21.15.83:0/2033953581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82ac0c78e0 msgr2=0x7f82ac14a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82b198c700 1 --2- 172.21.15.83:0/2033953581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82ac0c78e0 0x7f82ac14a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82b198c700 1 -- 172.21.15.83:0/2033953581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c00b790 con 0x7f82ac0669c0 2023-10-06T04:38:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82b118b700 1 --2- 172.21.15.83:0/2033953581 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0c68f0 0x7f82ac1571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:38:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82b198c700 1 --2- 172.21.15.83:0/2033953581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ac0669c0 0x7f82ac0af0b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f82a800ea50 tx=0x7f82a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82a1ffb700 1 -- 172.21.15.83:0/2033953581 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a800c7f0 con 0x7f82ac0669c0 2023-10-06T04:38:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82a1ffb700 1 -- 172.21.15.83:0/2033953581 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a800c970 con 0x7f82ac0669c0 2023-10-06T04:38:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82b298e700 1 -- 172.21.15.83:0/2033953581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ac158520 con 0x7f82ac0669c0 2023-10-06T04:38:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82a1ffb700 1 -- 172.21.15.83:0/2033953581 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a800cd30 con 0x7f82ac0669c0 2023-10-06T04:38:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82b298e700 1 -- 172.21.15.83:0/2033953581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ac0af5f0 con 0x7f82ac0669c0 2023-10-06T04:38:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82a1ffb700 1 -- 172.21.15.83:0/2033953581 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f82a8005c80 con 0x7f82ac0669c0 2023-10-06T04:38:48.434 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82a1ffb700 1 -- 172.21.15.83:0/2033953581 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f82a8006620 con 0x7f82ac0669c0 2023-10-06T04:38:48.434 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.427+0000 7f82b298e700 1 -- 172.21.15.83:0/2033953581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ac0708a0 con 0x7f82ac0669c0 2023-10-06T04:38:48.436 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.431+0000 7f82a1ffb700 1 -- 172.21.15.83:0/2033953581 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f82a8021060 con 0x7f82ac0669c0 2023-10-06T04:38:48.436 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:48.431+0000 7f8fc08f9000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:38:48.506 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.499+0000 7f82b298e700 1 -- 172.21.15.83:0/2033953581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2e1ba14-42a5-4eeb-87da-00d86fb901af", "id": 6} v 0) v1 -- 0x7f82ac0ad360 con 0x7f82ac0669c0 2023-10-06T04:38:48.516 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.511+0000 7f82a1ffb700 1 -- 172.21.15.83:0/2033953581 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2e1ba14-42a5-4eeb-87da-00d86fb901af", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f82a8017070 con 0x7f82ac0669c0 2023-10-06T04:38:48.516 INFO:teuthology.orchestra.run.smithi083.stdout:6 2023-10-06T04:38:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.511+0000 7f82b298e700 1 -- 172.21.15.83:0/2033953581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ac0669c0 msgr2=0x7f82ac0af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.511+0000 7f82b298e700 1 --2- 172.21.15.83:0/2033953581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ac0669c0 0x7f82ac0af0b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f82a800ea50 tx=0x7f82a80091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.518 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.511+0000 7f82b298e700 1 -- 172.21.15.83:0/2033953581 shutdown_connections 2023-10-06T04:38:48.518 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.511+0000 7f82b298e700 1 --2- 172.21.15.83:0/2033953581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82ac0c78e0 0x7f82ac14a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.518 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.511+0000 7f82b298e700 1 --2- 172.21.15.83:0/2033953581 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ac0c68f0 0x7f82ac1571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.518 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.511+0000 7f82b298e700 1 --2- 172.21.15.83:0/2033953581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ac0669c0 0x7f82ac0af0b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.518 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.511+0000 7f82b298e700 1 -- 172.21.15.83:0/2033953581 >> 172.21.15.83:0/2033953581 conn(0x7f82ac0c9570 msgr2=0x7f82ac155710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:48.518 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.511+0000 7f82b298e700 1 -- 172.21.15.83:0/2033953581 shutdown_connections 2023-10-06T04:38:48.518 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.511+0000 7f82b298e700 1 -- 172.21.15.83:0/2033953581 wait complete. 2023-10-06T04:38:48.530 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new fbaa2bfd-b7b1-4c14-b952-1252d83181fb 7 2023-10-06T04:38:48.629 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.623+0000 7f944f59e700 1 Processor -- start 2023-10-06T04:38:48.629 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.623+0000 7f944f59e700 1 -- start start 2023-10-06T04:38:48.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.623+0000 7f944f59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9450069030 0x7f9450069480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.623+0000 7f944f59e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94500cf050 con 0x7f9450158d20 2023-10-06T04:38:48.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944f59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94500699c0 con 0x7f94500af860 2023-10-06T04:38:48.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944f59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94500d0680 con 0x7f9450069030 2023-10-06T04:38:48.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944dd9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9450069030 0x7f9450069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944ed9d700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f94500af860 0x7f94500afce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56830/0 (socket says 172.21.15.83:56830) 2023-10-06T04:38:48.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944dd9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9450069030 0x7f9450069480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37620/0 (socket says 172.21.15.83:37620) 2023-10-06T04:38:48.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944ed9d700 1 -- 172.21.15.83:0/671957681 learned_addr learned my addr 172.21.15.83:0/671957681 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T04:38:48.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944dd9b700 1 -- 172.21.15.83:0/671957681 >> v1:172.21.15.83:6789/0 conn(0x7f94500af860 legacy=0x7f94500afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944dd9b700 1 -- 172.21.15.83:0/671957681 >> v1:172.21.15.37:6789/0 conn(0x7f9450158d20 legacy=0x7f94500cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944dd9b700 1 -- 172.21.15.83:0/671957681 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94500ce1a0 con 0x7f9450069030 2023-10-06T04:38:48.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944dd9b700 1 --2- 172.21.15.83:0/671957681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9450069030 0x7f9450069480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9448009e60 tx=0x7f9448009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddeb07596ab6607e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:48.633 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944d59a700 1 -- 172.21.15.83:0/671957681 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944800e070 con 0x7f9450069030 2023-10-06T04:38:48.633 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944d59a700 1 -- 172.21.15.83:0/671957681 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944800bc30 con 0x7f9450069030 2023-10-06T04:38:48.633 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944d59a700 1 -- 172.21.15.83:0/671957681 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9448012430 con 0x7f9450069030 2023-10-06T04:38:48.633 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944f59e700 1 -- 172.21.15.83:0/671957681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9450069030 msgr2=0x7f9450069480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.633 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944f59e700 1 --2- 172.21.15.83:0/671957681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9450069030 0x7f9450069480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9448009e60 tx=0x7f9448009780 comp rx=0 tx=0).stop 2023-10-06T04:38:48.633 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944f59e700 1 -- 172.21.15.83:0/671957681 shutdown_connections 2023-10-06T04:38:48.634 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944f59e700 1 --2- 172.21.15.83:0/671957681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9450069030 0x7f9450069480 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.634 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944f59e700 1 -- 172.21.15.83:0/671957681 >> 172.21.15.83:0/671957681 conn(0x7f9450068780 msgr2=0x7f94500cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:48.634 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944f59e700 1 -- 172.21.15.83:0/671957681 shutdown_connections 2023-10-06T04:38:48.634 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944f59e700 1 -- 172.21.15.83:0/671957681 wait complete. 2023-10-06T04:38:48.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944f59e700 1 Processor -- start 2023-10-06T04:38:48.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.627+0000 7f944f59e700 1 -- start start 2023-10-06T04:38:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9450069030 0x7f945015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94500af860 0x7f9450154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9450158d20 0x7f94500c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944f59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94500c8d40 con 0x7f9450069030 2023-10-06T04:38:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944f59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94500c80c0 con 0x7f9450158d20 2023-10-06T04:38:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94500c83a0 con 0x7f94500af860 2023-10-06T04:38:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944dd9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94500af860 0x7f9450154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944dd9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94500af860 0x7f9450154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:52836/0 (socket says 172.21.15.83:52836) 2023-10-06T04:38:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944dd9b700 1 -- 172.21.15.83:0/2787062345 learned_addr learned my addr 172.21.15.83:0/2787062345 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:38:48.638 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944ed9d700 1 --2- 172.21.15.83:0/2787062345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9450158d20 0x7f94500c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.638 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944e59c700 1 --2- 172.21.15.83:0/2787062345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9450069030 0x7f945015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.638 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944ed9d700 1 -- 172.21.15.83:0/2787062345 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94500af860 msgr2=0x7f9450154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.638 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944ed9d700 1 --2- 172.21.15.83:0/2787062345 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94500af860 0x7f9450154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.638 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944ed9d700 1 -- 172.21.15.83:0/2787062345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9450069030 msgr2=0x7f945015bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.638 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944ed9d700 1 --2- 172.21.15.83:0/2787062345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9450069030 0x7f945015bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.638 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944ed9d700 1 -- 172.21.15.83:0/2787062345 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9448009a20 con 0x7f9450158d20 2023-10-06T04:38:48.638 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944ed9d700 1 --2- 172.21.15.83:0/2787062345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9450158d20 0x7f94500c9140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f944000c560 tx=0x7f9440007e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:48.638 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f94467fc700 1 -- 172.21.15.83:0/2787062345 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440005b30 con 0x7f9450158d20 2023-10-06T04:38:48.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f94467fc700 1 -- 172.21.15.83:0/2787062345 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9440005c90 con 0x7f9450158d20 2023-10-06T04:38:48.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f94467fc700 1 -- 172.21.15.83:0/2787062345 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440007320 con 0x7f9450158d20 2023-10-06T04:38:48.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944f59e700 1 -- 172.21.15.83:0/2787062345 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94500c8680 con 0x7f9450158d20 2023-10-06T04:38:48.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944f59e700 1 -- 172.21.15.83:0/2787062345 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945015c0a0 con 0x7f9450158d20 2023-10-06T04:38:48.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f94467fc700 1 -- 172.21.15.83:0/2787062345 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f944001c6c0 con 0x7f9450158d20 2023-10-06T04:38:48.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f94467fc700 1 -- 172.21.15.83:0/2787062345 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f9440005e00 con 0x7f9450158d20 2023-10-06T04:38:48.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.631+0000 7f944f59e700 1 -- 172.21.15.83:0/2787062345 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94500708a0 con 0x7f9450158d20 2023-10-06T04:38:48.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.635+0000 7f94467fc700 1 -- 172.21.15.83:0/2787062345 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9440017070 con 0x7f9450158d20 2023-10-06T04:38:48.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.707+0000 7f944f59e700 1 -- 172.21.15.83:0/2787062345 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fbaa2bfd-b7b1-4c14-b952-1252d83181fb", "id": 7} v 0) v1 -- 0x7f94500ce440 con 0x7f9450158d20 2023-10-06T04:38:48.723 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.719+0000 7f94467fc700 1 -- 172.21.15.83:0/2787062345 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fbaa2bfd-b7b1-4c14-b952-1252d83181fb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9440007710 con 0x7f9450158d20 2023-10-06T04:38:48.723 INFO:teuthology.orchestra.run.smithi083.stdout:7 2023-10-06T04:38:48.725 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.719+0000 7f944f59e700 1 -- 172.21.15.83:0/2787062345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9450158d20 msgr2=0x7f94500c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.725 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.719+0000 7f944f59e700 1 --2- 172.21.15.83:0/2787062345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9450158d20 0x7f94500c9140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f944000c560 tx=0x7f9440007e40 comp rx=0 tx=0).stop 2023-10-06T04:38:48.725 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.719+0000 7f944f59e700 1 -- 172.21.15.83:0/2787062345 shutdown_connections 2023-10-06T04:38:48.725 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.719+0000 7f944f59e700 1 --2- 172.21.15.83:0/2787062345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9450158d20 0x7f94500c9140 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.725 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.719+0000 7f944f59e700 1 --2- 172.21.15.83:0/2787062345 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94500af860 0x7f9450154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.725 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.719+0000 7f944f59e700 1 --2- 172.21.15.83:0/2787062345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9450069030 0x7f945015bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.726 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.719+0000 7f944f59e700 1 -- 172.21.15.83:0/2787062345 >> 172.21.15.83:0/2787062345 conn(0x7f9450068780 msgr2=0x7f94501526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:48.726 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.719+0000 7f944f59e700 1 -- 172.21.15.83:0/2787062345 shutdown_connections 2023-10-06T04:38:48.726 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:38:48.719+0000 7f944f59e700 1 -- 172.21.15.83:0/2787062345 wait complete. 2023-10-06T04:38:48.738 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T04:38:48.738 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T04:38:48.740 INFO:tasks.ceph.osd.0:Started 2023-10-06T04:38:48.741 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T04:38:48.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T04:38:48.743 INFO:tasks.ceph.osd.1:Started 2023-10-06T04:38:48.743 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T04:38:48.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T04:38:48.745 INFO:tasks.ceph.osd.2:Started 2023-10-06T04:38:48.746 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T04:38:48.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T04:38:48.748 INFO:tasks.ceph.osd.3:Started 2023-10-06T04:38:48.748 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T04:38:48.748 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T04:38:48.750 INFO:tasks.ceph.osd.4:Started 2023-10-06T04:38:48.751 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T04:38:48.751 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T04:38:48.753 INFO:tasks.ceph.osd.5:Started 2023-10-06T04:38:48.753 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T04:38:48.753 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T04:38:48.755 INFO:tasks.ceph.osd.6:Started 2023-10-06T04:38:48.755 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T04:38:48.755 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T04:38:48.757 INFO:tasks.ceph.osd.7:Started 2023-10-06T04:38:48.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:38:48.833 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:48.829+0000 7f3720383000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:38:48.867 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:48.863+0000 7f8fc08f9000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:38:48.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654ff60700 1 Processor -- start 2023-10-06T04:38:48.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654ff60700 1 -- start start 2023-10-06T04:38:48.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654ff60700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65480af5e0 0x7f65480add60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654ff60700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65480ab420 0x7f65480ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654ff60700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65481572b0 con 0x7f65480667b0 2023-10-06T04:38:48.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654ff60700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6548157f30 con 0x7f65480ab420 2023-10-06T04:38:48.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654ff60700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6548157590 con 0x7f65480af5e0 2023-10-06T04:38:48.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654d4fb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65480ab420 0x7f65480ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654d4fb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65480ab420 0x7f65480ae2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59632/0 (socket says 172.21.15.37:59632) 2023-10-06T04:38:48.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654d4fb700 1 -- 172.21.15.37:0/1670840638 learned_addr learned my addr 172.21.15.37:0/1670840638 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:38:48.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654e4fd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f65480667b0 0x7f65480b0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40206/0 (socket says 172.21.15.37:40206) 2023-10-06T04:38:48.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654dcfc700 1 --2- 172.21.15.37:0/1670840638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65480af5e0 0x7f65480add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654d4fb700 1 -- 172.21.15.37:0/1670840638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65480af5e0 msgr2=0x7f65480add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:48.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654d4fb700 1 --2- 172.21.15.37:0/1670840638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65480af5e0 0x7f65480add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654d4fb700 1 -- 172.21.15.37:0/1670840638 >> v1:172.21.15.37:6789/0 conn(0x7f65480667b0 legacy=0x7f65480b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654d4fb700 1 -- 172.21.15.37:0/1670840638 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6548157870 con 0x7f65480ab420 2023-10-06T04:38:48.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.865+0000 7f654d4fb700 1 --2- 172.21.15.37:0/1670840638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480ab420 0x7f65480ae2a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f65440099b0 tx=0x7f6544009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a02b86c0967923 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:48.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ccfa700 1 -- 172.21.15.37:0/1670840638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544009ea0 con 0x7f65480ab420 2023-10-06T04:38:48.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ccfa700 1 -- 172.21.15.37:0/1670840638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654400b860 con 0x7f65480ab420 2023-10-06T04:38:48.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ccfa700 1 -- 172.21.15.37:0/1670840638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654400bc20 con 0x7f65480ab420 2023-10-06T04:38:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 -- 172.21.15.37:0/1670840638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480ab420 msgr2=0x7f65480ae2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 --2- 172.21.15.37:0/1670840638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480ab420 0x7f65480ae2a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f65440099b0 tx=0x7f6544009250 comp rx=0 tx=0).stop 2023-10-06T04:38:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 -- 172.21.15.37:0/1670840638 shutdown_connections 2023-10-06T04:38:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 --2- 172.21.15.37:0/1670840638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480ab420 0x7f65480ae2a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 --2- 172.21.15.37:0/1670840638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65480af5e0 0x7f65480add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 -- 172.21.15.37:0/1670840638 >> 172.21.15.37:0/1670840638 conn(0x7f65480ccc60 msgr2=0x7f654806c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:48.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 -- 172.21.15.37:0/1670840638 shutdown_connections 2023-10-06T04:38:48.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 -- 172.21.15.37:0/1670840638 wait complete. 2023-10-06T04:38:48.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 Processor -- start 2023-10-06T04:38:48.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 -- start start 2023-10-06T04:38:48.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480667b0 0x7f65481586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65480ab420 0x7f6548142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65480af5e0 0x7f65481539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:48.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6548158be0 con 0x7f65480667b0 2023-10-06T04:38:48.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6548167c60 con 0x7f65480af5e0 2023-10-06T04:38:48.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654ff60700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65480aa190 con 0x7f65480ab420 2023-10-06T04:38:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654dcfc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480667b0 0x7f65481586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654d4fb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65480ab420 0x7f6548142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654d4fb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65480ab420 0x7f6548142ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:35804/0 (socket says 172.21.15.37:35804) 2023-10-06T04:38:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654d4fb700 1 -- 172.21.15.37:0/1840263693 learned_addr learned my addr 172.21.15.37:0/1840263693 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:38:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654dcfc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480667b0 0x7f65481586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59642/0 (socket says 172.21.15.37:59642) 2023-10-06T04:38:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654e4fd700 1 --2- 172.21.15.37:0/1840263693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65480af5e0 0x7f65481539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654d4fb700 1 -- 172.21.15.37:0/1840263693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65480af5e0 msgr2=0x7f65481539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654d4fb700 1 --2- 172.21.15.37:0/1840263693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65480af5e0 0x7f65481539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654d4fb700 1 -- 172.21.15.37:0/1840263693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480667b0 msgr2=0x7f65481586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654d4fb700 1 --2- 172.21.15.37:0/1840263693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480667b0 0x7f65481586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654d4fb700 1 -- 172.21.15.37:0/1840263693 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440094f0 con 0x7f65480ab420 2023-10-06T04:38:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.869+0000 7f654d4fb700 1 --2- 172.21.15.37:0/1840263693 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65480ab420 0x7f6548142ac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6544006fd0 tx=0x7f6544017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.873+0000 7f653dffb700 1 -- 172.21.15.37:0/1840263693 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654401f070 con 0x7f65480ab420 2023-10-06T04:38:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.873+0000 7f653dffb700 1 -- 172.21.15.37:0/1840263693 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6544006b10 con 0x7f65480ab420 2023-10-06T04:38:48.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.873+0000 7f654ff60700 1 -- 172.21.15.37:0/1840263693 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65480cbaf0 con 0x7f65480ab420 2023-10-06T04:38:48.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.873+0000 7f653dffb700 1 -- 172.21.15.37:0/1840263693 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654400bc20 con 0x7f65480ab420 2023-10-06T04:38:48.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.873+0000 7f654ff60700 1 -- 172.21.15.37:0/1840263693 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6548167e80 con 0x7f65480ab420 2023-10-06T04:38:48.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.873+0000 7f653dffb700 1 -- 172.21.15.37:0/1840263693 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f65440118b0 con 0x7f65480ab420 2023-10-06T04:38:48.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.873+0000 7f653dffb700 1 -- 172.21.15.37:0/1840263693 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f6544011b60 con 0x7f65480ab420 2023-10-06T04:38:48.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.873+0000 7f654ff60700 1 -- 172.21.15.37:0/1840263693 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6548154bb0 con 0x7f65480ab420 2023-10-06T04:38:48.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.877+0000 7f653dffb700 1 -- 172.21.15.37:0/1840263693 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6548154bb0 con 0x7f65480ab420 2023-10-06T04:38:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.941+0000 7f654ff60700 1 -- 172.21.15.37:0/1840263693 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6548070ee0 con 0x7f65480ab420 2023-10-06T04:38:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.941+0000 7f653dffb700 1 -- 172.21.15.37:0/1840263693 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f6544028070 con 0x7f65480ab420 2023-10-06T04:38:48.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:38:48.946 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:38:48.712730+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:38:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.941+0000 7f654ff60700 1 -- 172.21.15.37:0/1840263693 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65480ab420 msgr2=0x7f6548142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.941+0000 7f654ff60700 1 --2- 172.21.15.37:0/1840263693 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65480ab420 0x7f6548142ac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6544006fd0 tx=0x7f6544017000 comp rx=0 tx=0).stop 2023-10-06T04:38:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.941+0000 7f654ff60700 1 -- 172.21.15.37:0/1840263693 shutdown_connections 2023-10-06T04:38:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.941+0000 7f654ff60700 1 --2- 172.21.15.37:0/1840263693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65480af5e0 0x7f65481539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.941+0000 7f654ff60700 1 --2- 172.21.15.37:0/1840263693 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65480ab420 0x7f6548142ac0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.941+0000 7f654ff60700 1 --2- 172.21.15.37:0/1840263693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480667b0 0x7f65481586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.941+0000 7f654ff60700 1 -- 172.21.15.37:0/1840263693 >> 172.21.15.37:0/1840263693 conn(0x7f65480ccc60 msgr2=0x7f6548150b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.941+0000 7f654ff60700 1 -- 172.21.15.37:0/1840263693 shutdown_connections 2023-10-06T04:38:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:38:48.941+0000 7f654ff60700 1 -- 172.21.15.37:0/1840263693 wait complete. 2023-10-06T04:38:48.960 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T04:38:48.960 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T04:38:48.960 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:48.953+0000 7f3720383000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:38:48.987 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:48.983+0000 7f8fc08f9000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:38:49.112 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T04:38:49.107+0000 7f2d11a853c0 -1 Falling back to public interface 2023-10-06T04:38:49.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T04:38:49.121+0000 7fa08cebb3c0 -1 Falling back to public interface 2023-10-06T04:38:49.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T04:38:49.121+0000 7fa08be84700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-10-06T04:38:49.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-10-06T04:38:49.121+0000 7fe996c4b3c0 -1 Falling back to public interface 2023-10-06T04:38:49.136 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T04:38:49.131+0000 7fca5aafd3c0 -1 Falling back to public interface 2023-10-06T04:38:49.289 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:49.285+0000 7f3720383000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:38:49.310 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:49.307+0000 7f8fc08f9000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:38:49.360 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T04:38:49.355+0000 7fba43dc43c0 -1 Falling back to public interface 2023-10-06T04:38:49.366 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T04:38:49.361+0000 7f316cc983c0 -1 Falling back to public interface 2023-10-06T04:38:49.378 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-10-06T04:38:49.373+0000 7fc2054c23c0 -1 Falling back to public interface 2023-10-06T04:38:49.388 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T04:38:49.383+0000 7f5f589993c0 -1 Falling back to public interface 2023-10-06T04:38:49.465 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:49.457+0000 7f3720383000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:38:49.478 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:49.471+0000 7f8fc08f9000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:38:49.529 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:49.525+0000 7f3720383000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:38:49.543 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:49.539+0000 7f8fc08f9000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:38:49.582 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:49.577+0000 7f3720383000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:38:49.593 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:49.587+0000 7f8fc08f9000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:38:49.642 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:49.637+0000 7f3720383000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:38:49.652 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:49.647+0000 7f8fc08f9000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:38:49.766 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:38:49.863 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f3319c0c700 1 Processor -- start 2023-10-06T04:38:49.863 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f3319c0c700 1 -- start start 2023-10-06T04:38:49.865 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f3319c0c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3314155830 0x7f3314156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:49.866 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f3319c0c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f331406ede0 0x7f331406f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:49.866 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f3319c0c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331406e670 con 0x7f331406be90 2023-10-06T04:38:49.866 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f3319c0c700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331406e950 con 0x7f331406ede0 2023-10-06T04:38:49.866 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f3319c0c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331406c670 con 0x7f3314155830 2023-10-06T04:38:49.866 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f331940b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f331406ede0 0x7f331406f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:49.866 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f331940b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f331406ede0 0x7f331406f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45196/0 (socket says 172.21.15.37:45196) 2023-10-06T04:38:49.866 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f3318c0a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3314155830 0x7f3314156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:49.867 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f331940b700 1 -- 172.21.15.37:0/4098820288 learned_addr learned my addr 172.21.15.37:0/4098820288 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:38:49.867 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f331940b700 1 -- 172.21.15.37:0/4098820288 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3314155830 msgr2=0x7f3314156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:49.867 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f331940b700 1 --2- 172.21.15.37:0/4098820288 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3314155830 0x7f3314156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:49.867 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f331940b700 1 -- 172.21.15.37:0/4098820288 >> v1:172.21.15.83:6789/0 conn(0x7f331406be90 legacy=0x7f33141570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:49.867 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.857+0000 7f331940b700 1 -- 172.21.15.37:0/4098820288 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331406c950 con 0x7f331406ede0 2023-10-06T04:38:49.867 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f331940b700 1 --2- 172.21.15.37:0/4098820288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331406ede0 0x7f331406f220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f330c009f20 tx=0x7f330c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c2515f4dd1cb51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:49.867 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f33137fe700 1 -- 172.21.15.37:0/4098820288 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00e070 con 0x7f331406ede0 2023-10-06T04:38:49.867 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f33137fe700 1 -- 172.21.15.37:0/4098820288 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c00b9d0 con 0x7f331406ede0 2023-10-06T04:38:49.867 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f33137fe700 1 -- 172.21.15.37:0/4098820288 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c0092e0 con 0x7f331406ede0 2023-10-06T04:38:49.868 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f3319c0c700 1 -- 172.21.15.37:0/4098820288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331406ede0 msgr2=0x7f331406f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:49.868 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f3319c0c700 1 --2- 172.21.15.37:0/4098820288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331406ede0 0x7f331406f220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f330c009f20 tx=0x7f330c009840 comp rx=0 tx=0).stop 2023-10-06T04:38:49.868 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f3319c0c700 1 -- 172.21.15.37:0/4098820288 shutdown_connections 2023-10-06T04:38:49.868 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f3319c0c700 1 --2- 172.21.15.37:0/4098820288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331406ede0 0x7f331406f220 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:49.868 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f3319c0c700 1 --2- 172.21.15.37:0/4098820288 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3314155830 0x7f3314156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:49.868 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f3319c0c700 1 -- 172.21.15.37:0/4098820288 >> 172.21.15.37:0/4098820288 conn(0x7f331406a710 msgr2=0x7f331406ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:49.868 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f3319c0c700 1 -- 172.21.15.37:0/4098820288 shutdown_connections 2023-10-06T04:38:49.868 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f3319c0c700 1 -- 172.21.15.37:0/4098820288 wait complete. 2023-10-06T04:38:49.872 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f3319c0c700 1 Processor -- start 2023-10-06T04:38:49.872 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.861+0000 7f3319c0c700 1 -- start start 2023-10-06T04:38:49.872 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3319c0c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331406be90 0x7f3314168920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:49.872 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3319c0c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f331406ede0 0x7f331414d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:49.872 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3319c0c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3314155830 0x7f3314149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:49.872 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3319c0c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331414ee30 con 0x7f331406be90 2023-10-06T04:38:49.872 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3319c0c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331414e1b0 con 0x7f3314155830 2023-10-06T04:38:49.872 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3319c0c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331414e490 con 0x7f331406ede0 2023-10-06T04:38:49.872 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3318c0a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331406be90 0x7f3314168920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:49.873 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3318c0a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331406be90 0x7f3314168920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45206/0 (socket says 172.21.15.37:45206) 2023-10-06T04:38:49.873 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3318c0a700 1 -- 172.21.15.37:0/620486000 learned_addr learned my addr 172.21.15.37:0/620486000 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:38:49.873 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3313fff700 1 --2- 172.21.15.37:0/620486000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f331406ede0 0x7f331414d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:49.873 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f331940b700 1 --2- 172.21.15.37:0/620486000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3314155830 0x7f3314149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:49.873 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3313fff700 1 -- 172.21.15.37:0/620486000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3314155830 msgr2=0x7f3314149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:49.873 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3313fff700 1 --2- 172.21.15.37:0/620486000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3314155830 0x7f3314149980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:49.873 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3313fff700 1 -- 172.21.15.37:0/620486000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331406be90 msgr2=0x7f3314168920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:49.873 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3313fff700 1 --2- 172.21.15.37:0/620486000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331406be90 0x7f3314168920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:49.873 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3313fff700 1 -- 172.21.15.37:0/620486000 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c009ae0 con 0x7f331406ede0 2023-10-06T04:38:49.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3318c0a700 1 --2- 172.21.15.37:0/620486000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331406be90 0x7f3314168920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:38:49.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3313fff700 1 --2- 172.21.15.37:0/620486000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f331406ede0 0x7f331414d6f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f330000c590 tx=0x7f3300007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:49.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3310ff9700 1 -- 172.21.15.37:0/620486000 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300011590 con 0x7f331406ede0 2023-10-06T04:38:49.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3310ff9700 1 -- 172.21.15.37:0/620486000 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3300011710 con 0x7f331406ede0 2023-10-06T04:38:49.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3319c0c700 1 -- 172.21.15.37:0/620486000 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331414e770 con 0x7f331406ede0 2023-10-06T04:38:49.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3310ff9700 1 -- 172.21.15.37:0/620486000 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300011ad0 con 0x7f331406ede0 2023-10-06T04:38:49.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3319c0c700 1 -- 172.21.15.37:0/620486000 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3314168e60 con 0x7f331406ede0 2023-10-06T04:38:49.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3310ff9700 1 -- 172.21.15.37:0/620486000 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f330001c6c0 con 0x7f331406ede0 2023-10-06T04:38:49.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.865+0000 7f3310ff9700 1 -- 172.21.15.37:0/620486000 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f3300012b00 con 0x7f331406ede0 2023-10-06T04:38:49.875 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.869+0000 7f3319c0c700 1 -- 172.21.15.37:0/620486000 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331404be00 con 0x7f331406ede0 2023-10-06T04:38:49.878 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.873+0000 7f3310ff9700 1 -- 172.21.15.37:0/620486000 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3300017070 con 0x7f331406ede0 2023-10-06T04:38:49.916 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:49.909+0000 7f3720383000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:38:49.942 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.937+0000 7f3319c0c700 1 -- 172.21.15.37:0/620486000 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f331404b5c0 con 0x7f331406ede0 2023-10-06T04:38:49.943 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.937+0000 7f3310ff9700 1 -- 172.21.15.37:0/620486000 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f330001c970 con 0x7f331406ede0 2023-10-06T04:38:49.943 INFO:teuthology.misc.health.smithi037.stdout: 2023-10-06T04:38:49.943 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:38:48.712730+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:38:49.944 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:49.939+0000 7f8fc08f9000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:38:49.945 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.941+0000 7f3319c0c700 1 -- 172.21.15.37:0/620486000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f331406ede0 msgr2=0x7f331414d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:49.945 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.941+0000 7f3319c0c700 1 --2- 172.21.15.37:0/620486000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f331406ede0 0x7f331414d6f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f330000c590 tx=0x7f3300007ec0 comp rx=0 tx=0).stop 2023-10-06T04:38:49.945 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.941+0000 7f3319c0c700 1 -- 172.21.15.37:0/620486000 shutdown_connections 2023-10-06T04:38:49.945 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.941+0000 7f3319c0c700 1 --2- 172.21.15.37:0/620486000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3314155830 0x7f3314149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:49.945 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.941+0000 7f3319c0c700 1 --2- 172.21.15.37:0/620486000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f331406ede0 0x7f331414d6f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:49.946 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.941+0000 7f3319c0c700 1 --2- 172.21.15.37:0/620486000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331406be90 0x7f3314168920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:49.946 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.941+0000 7f3319c0c700 1 -- 172.21.15.37:0/620486000 >> 172.21.15.37:0/620486000 conn(0x7f331406a710 msgr2=0x7f331414fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:49.946 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.941+0000 7f3319c0c700 1 -- 172.21.15.37:0/620486000 shutdown_connections 2023-10-06T04:38:49.946 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:49.941+0000 7f3319c0c700 1 -- 172.21.15.37:0/620486000 wait complete. 2023-10-06T04:38:49.960 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T04:38:49.977 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:49.973+0000 7f3720383000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:38:50.001 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:49.995+0000 7f8fc08f9000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:38:50.044 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:50.037+0000 7f3720383000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:38:50.061 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:50.055+0000 7f8fc08f9000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:38:50.205 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:50.201+0000 7f3720383000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:38:50.219 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:50.215+0000 7f8fc08f9000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:38:50.275 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:50.269+0000 7f3720383000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:38:50.285 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:50.279+0000 7f8fc08f9000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:38:50.989 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:50.983+0000 7f8fc08f9000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:38:51.000 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:38:50.993+0000 7f3720383000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:38:52.040 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:52.035+0000 7f8fa99f1700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T04:38:52.040 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:38:52.035+0000 7f8fa99f1700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T04:38:52.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T04:38:52.749+0000 7fa08cebb3c0 -1 osd.1 0 log_to_monitors true 2023-10-06T04:38:52.924 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T04:38:52.919+0000 7fca5aafd3c0 -1 osd.6 0 log_to_monitors true 2023-10-06T04:38:52.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-10-06T04:38:52.925+0000 7fe996c4b3c0 -1 osd.2 0 log_to_monitors true 2023-10-06T04:38:52.957 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T04:38:52.951+0000 7f2d11a853c0 -1 osd.5 0 log_to_monitors true 2023-10-06T04:38:53.120 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T04:38:53.115+0000 7fba43dc43c0 -1 osd.4 0 log_to_monitors true 2023-10-06T04:38:53.176 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T04:38:53.169+0000 7f316cc983c0 -1 osd.0 0 log_to_monitors true 2023-10-06T04:38:53.204 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-10-06T04:38:53.197+0000 7fc2054c23c0 -1 osd.3 0 log_to_monitors true 2023-10-06T04:38:53.254 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T04:38:53.247+0000 7f5f589993c0 -1 osd.7 0 log_to_monitors true 2023-10-06T04:38:55.533 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T04:38:55.527+0000 7f2d0d225700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T04:38:55.555 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T04:38:55.551+0000 7f2d05fc9700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:38:55.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-10-06T04:38:55.665+0000 7fe9923eb700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T04:38:55.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-10-06T04:38:55.685+0000 7fe98b18f700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:38:55.717 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T04:38:55.711+0000 7fca5629d700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T04:38:55.736 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T04:38:55.731+0000 7fca4f041700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:38:55.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T04:38:55.881+0000 7fa08865b700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T04:38:55.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T04:38:55.893+0000 7fa0813ff700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:38:56.504 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T04:38:56.499+0000 7fba3f564700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T04:38:56.510 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T04:38:56.503+0000 7fba38308700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:38:56.512 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T04:38:56.507+0000 7f5f54139700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T04:38:56.517 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T04:38:56.511+0000 7f5f4cedd700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:38:56.554 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-10-06T04:38:56.549+0000 7fc200c62700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T04:38:56.560 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T04:38:56.553+0000 7f3168438700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T04:38:56.565 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-10-06T04:38:56.561+0000 7fc1f9a06700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:38:56.567 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T04:38:56.561+0000 7f31611dc700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:38:56.767 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:38:56.871 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.865+0000 7f4a7f018700 1 Processor -- start 2023-10-06T04:38:56.871 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.865+0000 7f4a7f018700 1 -- start start 2023-10-06T04:38:56.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4a78069e80 0x7f4a780c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:56.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7806b000 con 0x7f4a7806e4c0 2023-10-06T04:38:56.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7806b490 con 0x7f4a78158de0 2023-10-06T04:38:56.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7806a3f0 con 0x7f4a78069e80 2023-10-06T04:38:56.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7d815700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4a7806e4c0 0x7f4a780c6820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55094/0 (socket says 172.21.15.37:55094) 2023-10-06T04:38:56.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7d815700 1 -- 172.21.15.37:0/1398371007 learned_addr learned my addr 172.21.15.37:0/1398371007 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:38:56.874 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7e817700 1 --2- 172.21.15.37:0/1398371007 >> v2:172.21.15.37:3300/0 conn(0x7f4a78069e80 0x7f4a780c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:56.875 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7d014700 1 -- 172.21.15.37:0/1398371007 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943216348 0 0) 0x7f4a7806b000 con 0x7f4a7806e4c0 2023-10-06T04:38:56.875 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7d014700 1 -- 172.21.15.37:0/1398371007 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a64003570 con 0x7f4a7806e4c0 2023-10-06T04:38:56.875 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7e817700 1 -- 172.21.15.37:0/1398371007 >> v1:172.21.15.83:6789/0 conn(0x7f4a78158de0 legacy=0x7f4a7806ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:56.875 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7e817700 1 -- 172.21.15.37:0/1398371007 >> v1:172.21.15.37:6789/0 conn(0x7f4a7806e4c0 legacy=0x7f4a780c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:56.875 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7e817700 1 -- 172.21.15.37:0/1398371007 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7806a6d0 con 0x7f4a78069e80 2023-10-06T04:38:56.875 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7e817700 1 --2- 172.21.15.37:0/1398371007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a78069e80 0x7f4a780c6f30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009e60 tx=0x7f4a70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b54edb1bc53c48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:56.875 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7d014700 1 -- 172.21.15.37:0/1398371007 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000e070 con 0x7f4a78069e80 2023-10-06T04:38:56.875 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7d014700 1 -- 172.21.15.37:0/1398371007 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7000bb60 con 0x7f4a78069e80 2023-10-06T04:38:56.875 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7d014700 1 -- 172.21.15.37:0/1398371007 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70012430 con 0x7f4a78069e80 2023-10-06T04:38:56.876 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 -- 172.21.15.37:0/1398371007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a78069e80 msgr2=0x7f4a780c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:56.876 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 --2- 172.21.15.37:0/1398371007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a78069e80 0x7f4a780c6f30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009e60 tx=0x7f4a70009780 comp rx=0 tx=0).stop 2023-10-06T04:38:56.876 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 -- 172.21.15.37:0/1398371007 shutdown_connections 2023-10-06T04:38:56.876 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 --2- 172.21.15.37:0/1398371007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a78069e80 0x7f4a780c6f30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:56.876 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 -- 172.21.15.37:0/1398371007 >> 172.21.15.37:0/1398371007 conn(0x7f4a780687a0 msgr2=0x7f4a780cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:56.876 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 -- 172.21.15.37:0/1398371007 shutdown_connections 2023-10-06T04:38:56.877 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 -- 172.21.15.37:0/1398371007 wait complete. 2023-10-06T04:38:56.877 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 Processor -- start 2023-10-06T04:38:56.878 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.869+0000 7f4a7f018700 1 -- start start 2023-10-06T04:38:56.878 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7f018700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a78069e80 0x7f4a780af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:56.878 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7f018700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a7806e4c0 0x7f4a780c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:56.878 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7f018700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a78158de0 0x7f4a780c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:56.878 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7f018700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7814c8c0 con 0x7f4a78069e80 2023-10-06T04:38:56.878 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7f018700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78169ae0 con 0x7f4a7806e4c0 2023-10-06T04:38:56.878 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7f018700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78159520 con 0x7f4a78158de0 2023-10-06T04:38:56.878 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7e016700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a78069e80 0x7f4a780af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:56.878 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7e016700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a78069e80 0x7f4a780af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45260/0 (socket says 172.21.15.37:45260) 2023-10-06T04:38:56.878 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7e016700 1 -- 172.21.15.37:0/4253670165 learned_addr learned my addr 172.21.15.37:0/4253670165 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:38:56.879 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7d815700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a7806e4c0 0x7f4a780c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:56.879 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7e817700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a78158de0 0x7f4a780c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:56.880 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7e016700 1 -- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a78158de0 msgr2=0x7f4a780c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:56.880 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7e016700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a78158de0 0x7f4a780c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:56.880 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7e016700 1 -- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a7806e4c0 msgr2=0x7f4a780c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:56.880 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7e016700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a7806e4c0 0x7f4a780c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:56.880 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7e016700 1 -- 172.21.15.37:0/4253670165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a70009a20 con 0x7f4a78069e80 2023-10-06T04:38:56.880 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7e817700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a78158de0 0x7f4a780c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:56.880 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7e016700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a78069e80 0x7f4a780af760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800c510 tx=0x7f4a6800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:56.880 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a6e7fc700 1 -- 172.21.15.37:0/4253670165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68011590 con 0x7f4a78069e80 2023-10-06T04:38:56.880 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a6e7fc700 1 -- 172.21.15.37:0/4253670165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a68011710 con 0x7f4a78069e80 2023-10-06T04:38:56.881 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7f018700 1 -- 172.21.15.37:0/4253670165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a780b0000 con 0x7f4a78069e80 2023-10-06T04:38:56.881 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a6e7fc700 1 -- 172.21.15.37:0/4253670165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68011ad0 con 0x7f4a78069e80 2023-10-06T04:38:56.881 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.873+0000 7f4a7f018700 1 -- 172.21.15.37:0/4253670165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a780b05c0 con 0x7f4a78069e80 2023-10-06T04:38:56.881 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.877+0000 7f4a7f018700 1 -- 172.21.15.37:0/4253670165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7804be00 con 0x7f4a78069e80 2023-10-06T04:38:56.881 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.877+0000 7f4a6e7fc700 1 -- 172.21.15.37:0/4253670165 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 79903+0+0 (secure 0 0 0) 0x7f4a6801b3b0 con 0x7f4a78069e80 2023-10-06T04:38:56.882 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.877+0000 7f4a6e7fc700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4a5c0604c0 0x7f4a5c062970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:56.883 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.877+0000 7f4a6e7fc700 1 -- 172.21.15.37:0/4253670165 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3907+0+0 (secure 0 0 0) 0x7f4a6807b3d0 con 0x7f4a78069e80 2023-10-06T04:38:56.883 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.877+0000 7f4a7d815700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4a5c0604c0 0x7f4a5c062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:56.883 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.877+0000 7f4a7d815700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4a5c0604c0 0x7f4a5c062970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a780c71d0 tx=0x7f4a74009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:56.891 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:56.885+0000 7f4a6e7fc700 1 -- 172.21.15.37:0/4253670165 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4a6804c1a0 con 0x7f4a78069e80 2023-10-06T04:38:57.056 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.049+0000 7f4a7f018700 1 -- 172.21.15.37:0/4253670165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a7806a9b0 con 0x7f4a78069e80 2023-10-06T04:38:57.089 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a6e7fc700 1 -- 172.21.15.37:0/4253670165 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9520 (secure 0 0 0) 0x7f4a6804f7c0 con 0x7f4a78069e80 2023-10-06T04:38:57.089 INFO:teuthology.misc.health.smithi037.stdout: 2023-10-06T04:38:57.090 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":14,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:38:56.544897+0000","last_up_change":"2023-10-06T04:38:56.544897+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:38:57.092 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a7f018700 1 -- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4a5c0604c0 msgr2=0x7f4a5c062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:57.092 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a7f018700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4a5c0604c0 0x7f4a5c062970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a780c71d0 tx=0x7f4a74009040 comp rx=0 tx=0).stop 2023-10-06T04:38:57.092 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a7f018700 1 -- 172.21.15.37:0/4253670165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a78069e80 msgr2=0x7f4a780af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:57.092 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a7f018700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a78069e80 0x7f4a780af760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800c510 tx=0x7f4a6800c820 comp rx=0 tx=0).stop 2023-10-06T04:38:57.092 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a7f018700 1 -- 172.21.15.37:0/4253670165 shutdown_connections 2023-10-06T04:38:57.092 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a7f018700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4a5c0604c0 0x7f4a5c062970 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:57.092 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a7f018700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a7806e4c0 0x7f4a780c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:57.093 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a7f018700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a78158de0 0x7f4a780c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:57.093 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a7f018700 1 --2- 172.21.15.37:0/4253670165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a78069e80 0x7f4a780af760 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:57.093 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a7f018700 1 -- 172.21.15.37:0/4253670165 >> 172.21.15.37:0/4253670165 conn(0x7f4a780687a0 msgr2=0x7f4a7806eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:57.093 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a7f018700 1 -- 172.21.15.37:0/4253670165 shutdown_connections 2023-10-06T04:38:57.093 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:38:57.085+0000 7f4a7f018700 1 -- 172.21.15.37:0/4253670165 wait complete. 2023-10-06T04:38:57.103 DEBUG:teuthology.misc:6 of 8 OSDs are up 2023-10-06T04:39:03.909 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:04.012 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.005+0000 7f0dd712b700 1 Processor -- start 2023-10-06T04:39:04.013 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd712b700 1 -- start start 2023-10-06T04:39:04.018 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd712b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0dd01589f0 0x7f0dd0159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.018 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd712b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0dd0158dc0 0x7f0dd00cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.018 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd712b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd00d03a0 0x7f0dd00cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.018 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd712b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd015d620 con 0x7f0dd0158dc0 2023-10-06T04:39:04.018 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd712b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd00d07e0 con 0x7f0dd01589f0 2023-10-06T04:39:04.019 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd712b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd015c730 con 0x7f0dd00d03a0 2023-10-06T04:39:04.019 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd5928700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0dd0158dc0 0x7f0dd00cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.019 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd5928700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0dd0158dc0 0x7f0dd00cfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57694/0 (socket says 172.21.15.37:57694) 2023-10-06T04:39:04.019 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd5928700 1 -- 172.21.15.37:0/693895135 learned_addr learned my addr 172.21.15.37:0/693895135 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:04.019 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd6129700 1 --2- 172.21.15.37:0/693895135 >> v2:172.21.15.83:3300/0 conn(0x7f0dd01589f0 0x7f0dd0159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.019 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd692a700 1 --2- 172.21.15.37:0/693895135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd00d03a0 0x7f0dd00cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.019 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd5928700 1 -- 172.21.15.37:0/693895135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd00d03a0 msgr2=0x7f0dd00cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:04.020 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd5928700 1 --2- 172.21.15.37:0/693895135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd00d03a0 0x7f0dd00cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.020 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd5928700 1 -- 172.21.15.37:0/693895135 >> v2:172.21.15.83:3300/0 conn(0x7f0dd01589f0 msgr2=0x7f0dd0159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:04.020 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd5928700 1 --2- 172.21.15.37:0/693895135 >> v2:172.21.15.83:3300/0 conn(0x7f0dd01589f0 0x7f0dd0159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.020 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd5928700 1 -- 172.21.15.37:0/693895135 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd015ca10 con 0x7f0dd0158dc0 2023-10-06T04:39:04.020 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd5928700 1 --2- 172.21.15.37:0/693895135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd0158dc0 0x7f0dd00cfe60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00d0ab0 tx=0x7f0dc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424fb59474f68365 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.020 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd5127700 1 -- 172.21.15.37:0/693895135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000b640 con 0x7f0dd0158dc0 2023-10-06T04:39:04.020 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd5127700 1 -- 172.21.15.37:0/693895135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000b7a0 con 0x7f0dd0158dc0 2023-10-06T04:39:04.020 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.009+0000 7f0dd5127700 1 -- 172.21.15.37:0/693895135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000bb60 con 0x7f0dd0158dc0 2023-10-06T04:39:04.021 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.013+0000 7f0dd712b700 1 -- 172.21.15.37:0/693895135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd0158dc0 msgr2=0x7f0dd00cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.021 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.013+0000 7f0dd712b700 1 --2- 172.21.15.37:0/693895135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd0158dc0 0x7f0dd00cfe60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00d0ab0 tx=0x7f0dc0009250 comp rx=0 tx=0).stop 2023-10-06T04:39:04.021 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.013+0000 7f0dd712b700 1 -- 172.21.15.37:0/693895135 shutdown_connections 2023-10-06T04:39:04.021 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.013+0000 7f0dd712b700 1 --2- 172.21.15.37:0/693895135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd00d03a0 0x7f0dd00cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.022 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.013+0000 7f0dd712b700 1 --2- 172.21.15.37:0/693895135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd0158dc0 0x7f0dd00cfe60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.022 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.013+0000 7f0dd712b700 1 --2- 172.21.15.37:0/693895135 >> v2:172.21.15.83:3300/0 conn(0x7f0dd01589f0 0x7f0dd0159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.022 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.013+0000 7f0dd712b700 1 -- 172.21.15.37:0/693895135 >> 172.21.15.37:0/693895135 conn(0x7f0dd00667b0 msgr2=0x7f0dd0066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.022 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.013+0000 7f0dd712b700 1 -- 172.21.15.37:0/693895135 shutdown_connections 2023-10-06T04:39:04.022 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.013+0000 7f0dd712b700 1 -- 172.21.15.37:0/693895135 wait complete. 2023-10-06T04:39:04.025 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.013+0000 7f0dd712b700 1 Processor -- start 2023-10-06T04:39:04.025 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.013+0000 7f0dd712b700 1 -- start start 2023-10-06T04:39:04.025 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd712b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd00d03a0 0x7f0dd00c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.025 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd712b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dd01589f0 0x7f0dd00cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.025 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd712b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd00c70c0 0x7f0dd0147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.025 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd712b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00c9d10 con 0x7f0dd00c70c0 2023-10-06T04:39:04.025 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd712b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd016c900 con 0x7f0dd01589f0 2023-10-06T04:39:04.026 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd712b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd016cbe0 con 0x7f0dd00d03a0 2023-10-06T04:39:04.026 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd692a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd00c70c0 0x7f0dd0147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.026 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd5928700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dd01589f0 0x7f0dd00cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.026 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd692a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd00c70c0 0x7f0dd0147af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57710/0 (socket says 172.21.15.37:57710) 2023-10-06T04:39:04.026 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd692a700 1 -- 172.21.15.37:0/1159706533 learned_addr learned my addr 172.21.15.37:0/1159706533 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:04.026 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd6129700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd00d03a0 0x7f0dd00c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.026 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd692a700 1 -- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd00d03a0 msgr2=0x7f0dd00c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.026 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd692a700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd00d03a0 0x7f0dd00c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.026 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd692a700 1 -- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dd01589f0 msgr2=0x7f0dd00cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.027 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd692a700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dd01589f0 0x7f0dd00cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.027 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd692a700 1 -- 172.21.15.37:0/1159706533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00094f0 con 0x7f0dd00c70c0 2023-10-06T04:39:04.027 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd5928700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dd01589f0 0x7f0dd00cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:04.027 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd692a700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd00c70c0 0x7f0dd0147af0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009e90 tx=0x7f0dc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.027 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dc67fc700 1 -- 172.21.15.37:0/1159706533 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc800cb70 con 0x7f0dd00c70c0 2023-10-06T04:39:04.027 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dc67fc700 1 -- 172.21.15.37:0/1159706533 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc800f040 con 0x7f0dd00c70c0 2023-10-06T04:39:04.027 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd712b700 1 -- 172.21.15.37:0/1159706533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd016cec0 con 0x7f0dd00c70c0 2023-10-06T04:39:04.028 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dc67fc700 1 -- 172.21.15.37:0/1159706533 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8014480 con 0x7f0dd00c70c0 2023-10-06T04:39:04.028 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.017+0000 7f0dd712b700 1 -- 172.21.15.37:0/1159706533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd016d480 con 0x7f0dd00c70c0 2023-10-06T04:39:04.028 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.021+0000 7f0dd712b700 1 -- 172.21.15.37:0/1159706533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd00b4930 con 0x7f0dd00c70c0 2023-10-06T04:39:04.029 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.021+0000 7f0dc67fc700 1 -- 172.21.15.37:0/1159706533 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0dc8014830 con 0x7f0dd00c70c0 2023-10-06T04:39:04.030 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.021+0000 7f0dc67fc700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0db4060550 0x7f0db4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.030 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.021+0000 7f0dc67fc700 1 -- 172.21.15.37:0/1159706533 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0dc807ce90 con 0x7f0dd00c70c0 2023-10-06T04:39:04.030 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.021+0000 7f0dd6129700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0db4060550 0x7f0db4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.030 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.021+0000 7f0dd6129700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0db4060550 0x7f0db4062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009d20 tx=0x7f0dcc0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.033 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.029+0000 7f0dc67fc700 1 -- 172.21.15.37:0/1159706533 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0dd00b4930 con 0x7f0dd00c70c0 2023-10-06T04:39:04.196 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.189+0000 7f0dd712b700 1 -- 172.21.15.37:0/1159706533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dd00b4930 con 0x7f0dd00c70c0 2023-10-06T04:39:04.198 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.193+0000 7f0dc67fc700 1 -- 172.21.15.37:0/1159706533 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f0dd00b4930 con 0x7f0dd00c70c0 2023-10-06T04:39:04.198 INFO:teuthology.misc.health.smithi037.stdout: 2023-10-06T04:39:04.198 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":17,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:38:59.568647+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:04.200 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.193+0000 7f0dd712b700 1 -- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0db4060550 msgr2=0x7f0db4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.200 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.193+0000 7f0dd712b700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0db4060550 0x7f0db4062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009d20 tx=0x7f0dcc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.200 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.193+0000 7f0dd712b700 1 -- 172.21.15.37:0/1159706533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd00c70c0 msgr2=0x7f0dd0147af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.201 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.193+0000 7f0dd712b700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd00c70c0 0x7f0dd0147af0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009e90 tx=0x7f0dc800b040 comp rx=0 tx=0).stop 2023-10-06T04:39:04.201 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.193+0000 7f0dd712b700 1 -- 172.21.15.37:0/1159706533 shutdown_connections 2023-10-06T04:39:04.201 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.193+0000 7f0dd712b700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0db4060550 0x7f0db4062a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.201 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.193+0000 7f0dd712b700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dd01589f0 0x7f0dd00cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.201 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.193+0000 7f0dd712b700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd00c70c0 0x7f0dd0147af0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.201 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.193+0000 7f0dd712b700 1 --2- 172.21.15.37:0/1159706533 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd00d03a0 0x7f0dd00c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.201 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.193+0000 7f0dd712b700 1 -- 172.21.15.37:0/1159706533 >> 172.21.15.37:0/1159706533 conn(0x7f0dd00667b0 msgr2=0x7f0dd01570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.201 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.193+0000 7f0dd712b700 1 -- 172.21.15.37:0/1159706533 shutdown_connections 2023-10-06T04:39:04.201 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:39:04.197+0000 7f0dd712b700 1 -- 172.21.15.37:0/1159706533 wait complete. 2023-10-06T04:39:04.210 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T04:39:04.210 INFO:tasks.ceph:Creating RBD pool 2023-10-06T04:39:04.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T04:39:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.317+0000 7fea2756e700 1 Processor -- start 2023-10-06T04:39:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.317+0000 7fea2756e700 1 -- start start 2023-10-06T04:39:04.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.317+0000 7fea2756e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fea200ccf30 0x7fea200adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.317+0000 7fea2756e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200c97f0 con 0x7fea200c8f00 2023-10-06T04:39:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.317+0000 7fea2756e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200ac500 con 0x7fea200c8b30 2023-10-06T04:39:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.317+0000 7fea2756e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea200ad110 con 0x7fea200ccf30 2023-10-06T04:39:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.317+0000 7fea26d6d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fea200c8f00 0x7fea200c9c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42832/0 (socket says 172.21.15.37:42832) 2023-10-06T04:39:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.317+0000 7fea26d6d700 1 -- 172.21.15.37:0/1997692273 learned_addr learned my addr 172.21.15.37:0/1997692273 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.317+0000 7fea25d6b700 1 --2- 172.21.15.37:0/1997692273 >> v2:172.21.15.83:3300/0 conn(0x7fea200ccf30 0x7fea200adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.317+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752504002 0 0) 0x7fea200c97f0 con 0x7fea200c8f00 2023-10-06T04:39:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.317+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea0c003570 con 0x7fea200c8f00 2023-10-06T04:39:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1944538255 0 0) 0x7fea0c003570 con 0x7fea200c8f00 2023-10-06T04:39:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 >> v2:172.21.15.83:3300/0 conn(0x7fea200ccf30 msgr2=0x7fea200adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 --2- 172.21.15.37:0/1997692273 >> v2:172.21.15.83:3300/0 conn(0x7fea200ccf30 0x7fea200adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 >> v1:172.21.15.83:6789/0 conn(0x7fea200c8b30 legacy=0x7fea200cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea200ac7e0 con 0x7fea200c8f00 2023-10-06T04:39:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7fea180017f0 con 0x7fea200c8f00 2023-10-06T04:39:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 >> v1:172.21.15.37:6789/0 conn(0x7fea200c8f00 legacy=0x7fea200c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 --2- 172.21.15.37:0/1997692273 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0c003a60 0x7fea0c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 --2- 172.21.15.37:0/1997692273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea0c004810 0x7fea0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 --2- 172.21.15.37:0/1997692273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea0c0051c0 0x7fea0c00dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea200ad110 con 0x7fea0c0051c0 2023-10-06T04:39:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c00e2e0 con 0x7fea0c004810 2023-10-06T04:39:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c00e4a0 con 0x7fea0c003a60 2023-10-06T04:39:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea26d6d700 1 --2- 172.21.15.37:0/1997692273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea0c0051c0 0x7fea0c00dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea25d6b700 1 --2- 172.21.15.37:0/1997692273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea0c004810 0x7fea0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2656c700 1 --2- 172.21.15.37:0/1997692273 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0c003a60 0x7fea0c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea26d6d700 1 -- 172.21.15.37:0/1997692273 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0c003a60 msgr2=0x7fea0c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea26d6d700 1 --2- 172.21.15.37:0/1997692273 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0c003a60 0x7fea0c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea26d6d700 1 -- 172.21.15.37:0/1997692273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea0c004810 msgr2=0x7fea0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea26d6d700 1 --2- 172.21.15.37:0/1997692273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea0c004810 0x7fea0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea26d6d700 1 -- 172.21.15.37:0/1997692273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c003570 con 0x7fea0c0051c0 2023-10-06T04:39:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea26d6d700 1 -- 172.21.15.37:0/1997692273 reap_dead start 2023-10-06T04:39:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea26d6d700 1 --2- 172.21.15.37:0/1997692273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea0c0051c0 0x7fea0c00dc70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea1800a930 tx=0x7fea180021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68522f9ab61f8569 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea180070d0 con 0x7fea0c0051c0 2023-10-06T04:39:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea18007230 con 0x7fea0c0051c0 2023-10-06T04:39:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2556a700 1 -- 172.21.15.37:0/1997692273 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea180075d0 con 0x7fea0c0051c0 2023-10-06T04:39:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2756e700 1 -- 172.21.15.37:0/1997692273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea0c0051c0 msgr2=0x7fea0c00dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2756e700 1 --2- 172.21.15.37:0/1997692273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea0c0051c0 0x7fea0c00dc70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea1800a930 tx=0x7fea180021d0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2756e700 1 -- 172.21.15.37:0/1997692273 shutdown_connections 2023-10-06T04:39:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2756e700 1 --2- 172.21.15.37:0/1997692273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea0c0051c0 0x7fea0c00dc70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2756e700 1 -- 172.21.15.37:0/1997692273 >> 172.21.15.37:0/1997692273 conn(0x7fea2006e7c0 msgr2=0x7fea2006ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2756e700 1 -- 172.21.15.37:0/1997692273 shutdown_connections 2023-10-06T04:39:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.321+0000 7fea2756e700 1 -- 172.21.15.37:0/1997692273 wait complete. 2023-10-06T04:39:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea2756e700 1 Processor -- start 2023-10-06T04:39:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea2756e700 1 -- start start 2023-10-06T04:39:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea2756e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0c0051c0 0x7fea200a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea2756e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea201433f0 0x7fea20143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea2756e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea200cb5a0 0x7fea200cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea2756e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea200ab7f0 con 0x7fea200cb5a0 2023-10-06T04:39:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea2756e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea200cbf60 con 0x7fea201433f0 2023-10-06T04:39:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea2756e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea201659a0 con 0x7fea0c0051c0 2023-10-06T04:39:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea26d6d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea200cb5a0 0x7fea200cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea25d6b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea201433f0 0x7fea20143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea26d6d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea200cb5a0 0x7fea200cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57718/0 (socket says 172.21.15.37:57718) 2023-10-06T04:39:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea25d6b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea201433f0 0x7fea20143860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:53196/0 (socket says 172.21.15.37:53196) 2023-10-06T04:39:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea26d6d700 1 -- 172.21.15.37:0/2738116244 learned_addr learned my addr 172.21.15.37:0/2738116244 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea2656c700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0c0051c0 0x7fea200a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea25d6b700 1 -- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0c0051c0 msgr2=0x7fea200a78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea25d6b700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0c0051c0 0x7fea200a78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea25d6b700 1 -- 172.21.15.37:0/2738116244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea200cb5a0 msgr2=0x7fea200cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea25d6b700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea200cb5a0 0x7fea200cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea25d6b700 1 -- 172.21.15.37:0/2738116244 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea200a8a60 con 0x7fea201433f0 2023-10-06T04:39:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea26d6d700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea200cb5a0 0x7fea200cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea25d6b700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea201433f0 0x7fea20143860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fea140119f0 tx=0x7fea140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea127fc700 1 -- 172.21.15.37:0/2738116244 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400f790 con 0x7fea201433f0 2023-10-06T04:39:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea127fc700 1 -- 172.21.15.37:0/2738116244 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1400f8f0 con 0x7fea201433f0 2023-10-06T04:39:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea2756e700 1 -- 172.21.15.37:0/2738116244 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea200a81c0 con 0x7fea201433f0 2023-10-06T04:39:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea127fc700 1 -- 172.21.15.37:0/2738116244 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400fc90 con 0x7fea201433f0 2023-10-06T04:39:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.325+0000 7fea2756e700 1 -- 172.21.15.37:0/2738116244 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea200a8780 con 0x7fea201433f0 2023-10-06T04:39:04.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.329+0000 7fea2756e700 1 -- 172.21.15.37:0/2738116244 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea200708a0 con 0x7fea201433f0 2023-10-06T04:39:04.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.329+0000 7fea127fc700 1 -- 172.21.15.37:0/2738116244 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fea14014650 con 0x7fea201433f0 2023-10-06T04:39:04.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.329+0000 7fea127fc700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fea04060550 0x7fea04062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.329+0000 7fea127fc700 1 -- 172.21.15.37:0/2738116244 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fea14018030 con 0x7fea201433f0 2023-10-06T04:39:04.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.329+0000 7fea2656c700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fea04060550 0x7fea04062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.329+0000 7fea2656c700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fea04060550 0x7fea04062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea200cc250 tx=0x7fea1c00c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.337+0000 7fea127fc700 1 -- 172.21.15.37:0/2738116244 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fea1404d610 con 0x7fea201433f0 2023-10-06T04:39:04.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.501+0000 7fea2756e700 1 -- 172.21.15.37:0/2738116244 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fea20165ae0 con 0x7fea201433f0 2023-10-06T04:39:04.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.613+0000 7fea127fc700 1 -- 172.21.15.37:0/2738116244 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7fea14022020 con 0x7fea201433f0 2023-10-06T04:39:04.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.617+0000 7fea2756e700 1 -- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fea04060550 msgr2=0x7fea04062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.617+0000 7fea2756e700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fea04060550 0x7fea04062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea200cc250 tx=0x7fea1c00c040 comp rx=0 tx=0).stop 2023-10-06T04:39:04.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.617+0000 7fea2756e700 1 -- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea201433f0 msgr2=0x7fea20143860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.617+0000 7fea2756e700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea201433f0 0x7fea20143860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fea140119f0 tx=0x7fea140091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.617+0000 7fea2756e700 1 -- 172.21.15.37:0/2738116244 shutdown_connections 2023-10-06T04:39:04.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.617+0000 7fea2756e700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fea04060550 0x7fea04062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.617+0000 7fea2756e700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea201433f0 0x7fea20143860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.617+0000 7fea2756e700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea200cb5a0 0x7fea200cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.617+0000 7fea2756e700 1 --2- 172.21.15.37:0/2738116244 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0c0051c0 0x7fea200a78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.617+0000 7fea2756e700 1 -- 172.21.15.37:0/2738116244 >> 172.21.15.37:0/2738116244 conn(0x7fea2006e7c0 msgr2=0x7fea20068fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.617+0000 7fea2756e700 1 -- 172.21.15.37:0/2738116244 shutdown_connections 2023-10-06T04:39:04.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.617+0000 7fea2756e700 1 -- 172.21.15.37:0/2738116244 wait complete. 2023-10-06T04:39:04.625 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'rbd' created 2023-10-06T04:39:04.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T04:39:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f36065eb700 1 Processor -- start 2023-10-06T04:39:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f36065eb700 1 -- start start 2023-10-06T04:39:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f36065eb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3600158cd0 0x7f36000c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f36065eb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f360015d6f0 0x7f360015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f36065eb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36001590a0 0x7f360015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f36065eb700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360006ee60 con 0x7f360015d6f0 2023-10-06T04:39:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f36065eb700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360006f2f0 con 0x7f3600158cd0 2023-10-06T04:39:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f36065eb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36000ca960 con 0x7f36001590a0 2023-10-06T04:39:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f3604de8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f360015d6f0 0x7f360015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f3604de8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f360015d6f0 0x7f360015cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57730/0 (socket says 172.21.15.37:57730) 2023-10-06T04:39:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f3604de8700 1 -- 172.21.15.37:0/2939175611 learned_addr learned my addr 172.21.15.37:0/2939175611 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f36055e9700 1 --2- 172.21.15.37:0/2939175611 >> v2:172.21.15.83:3300/0 conn(0x7f3600158cd0 0x7f36000c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f3604de8700 1 -- 172.21.15.37:0/2939175611 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36001590a0 msgr2=0x7f360015cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f3605dea700 1 --2- 172.21.15.37:0/2939175611 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36001590a0 0x7f360015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f3604de8700 1 --2- 172.21.15.37:0/2939175611 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36001590a0 0x7f360015cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f3604de8700 1 -- 172.21.15.37:0/2939175611 >> v2:172.21.15.83:3300/0 conn(0x7f3600158cd0 msgr2=0x7f36000c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f3604de8700 1 --2- 172.21.15.37:0/2939175611 >> v2:172.21.15.83:3300/0 conn(0x7f3600158cd0 0x7f36000c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f3604de8700 1 -- 172.21.15.37:0/2939175611 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36000cac40 con 0x7f360015d6f0 2023-10-06T04:39:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f36055e9700 1 --2- 172.21.15.37:0/2939175611 >> v2:172.21.15.83:3300/0 conn(0x7f3600158cd0 0x7f36000c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f3605dea700 1 --2- 172.21.15.37:0/2939175611 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36001590a0 0x7f360015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.745+0000 7f3604de8700 1 --2- 172.21.15.37:0/2939175611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360015d6f0 0x7f360015cab0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f360006daf0 tx=0x7f35f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa1fc5e36f7bc33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f35f7fff700 1 -- 172.21.15.37:0/2939175611 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f000b860 con 0x7f360015d6f0 2023-10-06T04:39:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f35f7fff700 1 -- 172.21.15.37:0/2939175611 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f000b9c0 con 0x7f360015d6f0 2023-10-06T04:39:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f35f7fff700 1 -- 172.21.15.37:0/2939175611 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f000bd60 con 0x7f360015d6f0 2023-10-06T04:39:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f36065eb700 1 -- 172.21.15.37:0/2939175611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360015d6f0 msgr2=0x7f360015cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f36065eb700 1 --2- 172.21.15.37:0/2939175611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360015d6f0 0x7f360015cab0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f360006daf0 tx=0x7f35f0009250 comp rx=0 tx=0).stop 2023-10-06T04:39:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f36065eb700 1 -- 172.21.15.37:0/2939175611 shutdown_connections 2023-10-06T04:39:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f36065eb700 1 --2- 172.21.15.37:0/2939175611 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36001590a0 0x7f360015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f36065eb700 1 --2- 172.21.15.37:0/2939175611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360015d6f0 0x7f360015cab0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f36065eb700 1 --2- 172.21.15.37:0/2939175611 >> v2:172.21.15.83:3300/0 conn(0x7f3600158cd0 0x7f36000c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f36065eb700 1 -- 172.21.15.37:0/2939175611 >> 172.21.15.37:0/2939175611 conn(0x7f36000cc000 msgr2=0x7f36000cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f36065eb700 1 -- 172.21.15.37:0/2939175611 shutdown_connections 2023-10-06T04:39:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f36065eb700 1 -- 172.21.15.37:0/2939175611 wait complete. 2023-10-06T04:39:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f36065eb700 1 Processor -- start 2023-10-06T04:39:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.749+0000 7f36065eb700 1 -- start start 2023-10-06T04:39:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f36065eb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3600158cd0 0x7f3600157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f36065eb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36001590a0 0x7f360014cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f36065eb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36000c4b10 0x7f360006ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f36065eb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36000c6040 con 0x7f36001590a0 2023-10-06T04:39:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f36065eb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3600158330 con 0x7f36000c4b10 2023-10-06T04:39:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f36065eb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3600157540 con 0x7f3600158cd0 2023-10-06T04:39:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f3604de8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36001590a0 0x7f360014cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f3604de8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36001590a0 0x7f360014cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57742/0 (socket says 172.21.15.37:57742) 2023-10-06T04:39:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f3604de8700 1 -- 172.21.15.37:0/961543314 learned_addr learned my addr 172.21.15.37:0/961543314 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f36055e9700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3600158cd0 0x7f3600157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f3605dea700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36000c4b10 0x7f360006ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f3604de8700 1 -- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3600158cd0 msgr2=0x7f3600157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f3604de8700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3600158cd0 0x7f3600157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f3604de8700 1 -- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36000c4b10 msgr2=0x7f360006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f3604de8700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36000c4b10 0x7f360006ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f3604de8700 1 -- 172.21.15.37:0/961543314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f00094f0 con 0x7f36001590a0 2023-10-06T04:39:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f3604de8700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36001590a0 0x7f360014cb80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f35f0006fd0 tx=0x7f35f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f35f57fa700 1 -- 172.21.15.37:0/961543314 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0024440 con 0x7f36001590a0 2023-10-06T04:39:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f35f57fa700 1 -- 172.21.15.37:0/961543314 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f00245e0 con 0x7f36001590a0 2023-10-06T04:39:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f36065eb700 1 -- 172.21.15.37:0/961543314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36000c4fa0 con 0x7f36001590a0 2023-10-06T04:39:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f35f57fa700 1 -- 172.21.15.37:0/961543314 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f00249a0 con 0x7f36001590a0 2023-10-06T04:39:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f36065eb700 1 -- 172.21.15.37:0/961543314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36000c5560 con 0x7f36001590a0 2023-10-06T04:39:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.753+0000 7f36065eb700 1 -- 172.21.15.37:0/961543314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360004be00 con 0x7f36001590a0 2023-10-06T04:39:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.757+0000 7f35f57fa700 1 -- 172.21.15.37:0/961543314 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f35f001a420 con 0x7f36001590a0 2023-10-06T04:39:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.757+0000 7f35f57fa700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f35e4060550 0x7f35e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.757+0000 7f35f57fa700 1 -- 172.21.15.37:0/961543314 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f35f007e350 con 0x7f36001590a0 2023-10-06T04:39:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.757+0000 7f36055e9700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f35e4060550 0x7f35e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.757+0000 7f36055e9700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f35e4060550 0x7f35e4062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f35fc006f00 tx=0x7f35fc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.765+0000 7f35f57fa700 1 -- 172.21.15.37:0/961543314 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f35f004eaa0 con 0x7f36001590a0 2023-10-06T04:39:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:04.917+0000 7f36065eb700 1 -- 172.21.15.37:0/961543314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3600066a50 con 0x7f36001590a0 2023-10-06T04:39:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.617+0000 7f35f57fa700 1 -- 172.21.15.37:0/961543314 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f35f00520c0 con 0x7f36001590a0 2023-10-06T04:39:05.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.621+0000 7f36065eb700 1 -- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f35e4060550 msgr2=0x7f35e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.621+0000 7f36065eb700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f35e4060550 0x7f35e4062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f35fc006f00 tx=0x7f35fc008040 comp rx=0 tx=0).stop 2023-10-06T04:39:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.621+0000 7f36065eb700 1 -- 172.21.15.37:0/961543314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36001590a0 msgr2=0x7f360014cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.621+0000 7f36065eb700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36001590a0 0x7f360014cb80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f35f0006fd0 tx=0x7f35f0017000 comp rx=0 tx=0).stop 2023-10-06T04:39:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.621+0000 7f36065eb700 1 -- 172.21.15.37:0/961543314 shutdown_connections 2023-10-06T04:39:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.621+0000 7f36065eb700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f35e4060550 0x7f35e4062a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.621+0000 7f36065eb700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36000c4b10 0x7f360006ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.621+0000 7f36065eb700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36001590a0 0x7f360014cb80 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f35f0006fd0 tx=0x7f35f0017000 comp rx=0 tx=0).stop 2023-10-06T04:39:05.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.621+0000 7f36065eb700 1 --2- 172.21.15.37:0/961543314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3600158cd0 0x7f3600157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.621+0000 7f36065eb700 1 -- 172.21.15.37:0/961543314 >> 172.21.15.37:0/961543314 conn(0x7f36000cc000 msgr2=0x7f360014da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:05.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.621+0000 7f36065eb700 1 -- 172.21.15.37:0/961543314 shutdown_connections 2023-10-06T04:39:05.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.621+0000 7f36065eb700 1 -- 172.21.15.37:0/961543314 wait complete. 2023-10-06T04:39:05.630 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T04:39:05.641 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T04:39:05.642 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:39:05.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:39:05.645 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:39:05.645 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:39:05.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:39:05.647 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:39:05.647 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:39:05.647 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:39:05.649 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:39:05.649 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:39:05.649 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:39:05.651 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:39:05.651 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T04:39:05.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:05.714 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T04:39:05.719 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T04:39:05.720 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T04:39:05.733 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T04:39:05.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.757+0000 7fb50359e700 1 Processor -- start 2023-10-06T04:39:05.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.757+0000 7fb50359e700 1 -- start start 2023-10-06T04:39:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5041587d0 0x7fb50415d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb504158ba0 0x7fb504067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5040af7f0 con 0x7fb504068230 2023-10-06T04:39:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50415d6d0 con 0x7fb504158ba0 2023-10-06T04:39:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040686b0 con 0x7fb5041587d0 2023-10-06T04:39:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb502d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb504068230 0x7fb5040ae510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42844/0 (socket says 172.21.15.37:42844) 2023-10-06T04:39:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb502d9d700 1 -- 172.21.15.37:0/2564479882 learned_addr learned my addr 172.21.15.37:0/2564479882 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb501d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb504158ba0 0x7fb504067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50259c700 1 --2- 172.21.15.37:0/2564479882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5041587d0 0x7fb50415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50159a700 1 -- 172.21.15.37:0/2564479882 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883235794 0 0) 0x7fb5040af7f0 con 0x7fb504068230 2023-10-06T04:39:05.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50159a700 1 -- 172.21.15.37:0/2564479882 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4ec003570 con 0x7fb504068230 2023-10-06T04:39:05.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb501d9b700 1 -- 172.21.15.37:0/2564479882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5041587d0 msgr2=0x7fb50415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:05.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb501d9b700 1 --2- 172.21.15.37:0/2564479882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5041587d0 0x7fb50415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb501d9b700 1 -- 172.21.15.37:0/2564479882 >> v1:172.21.15.37:6789/0 conn(0x7fb504068230 legacy=0x7fb5040ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb501d9b700 1 -- 172.21.15.37:0/2564479882 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040afad0 con 0x7fb504158ba0 2023-10-06T04:39:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb501d9b700 1 --2- 172.21.15.37:0/2564479882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb504158ba0 0x7fb504067cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80098e0 tx=0x7fb4f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934842888cf384d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50159a700 1 -- 172.21.15.37:0/2564479882 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8011630 con 0x7fb504158ba0 2023-10-06T04:39:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50159a700 1 -- 172.21.15.37:0/2564479882 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f8011790 con 0x7fb504158ba0 2023-10-06T04:39:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50159a700 1 -- 172.21.15.37:0/2564479882 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8011b30 con 0x7fb504158ba0 2023-10-06T04:39:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 -- 172.21.15.37:0/2564479882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb504158ba0 msgr2=0x7fb504067cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 --2- 172.21.15.37:0/2564479882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb504158ba0 0x7fb504067cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80098e0 tx=0x7fb4f80091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 -- 172.21.15.37:0/2564479882 shutdown_connections 2023-10-06T04:39:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 --2- 172.21.15.37:0/2564479882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb504158ba0 0x7fb504067cf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 --2- 172.21.15.37:0/2564479882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5041587d0 0x7fb50415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 -- 172.21.15.37:0/2564479882 >> 172.21.15.37:0/2564479882 conn(0x7fb5040cc5f0 msgr2=0x7fb5040cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:05.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 -- 172.21.15.37:0/2564479882 shutdown_connections 2023-10-06T04:39:05.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.761+0000 7fb50359e700 1 -- 172.21.15.37:0/2564479882 wait complete. 2023-10-06T04:39:05.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb50359e700 1 Processor -- start 2023-10-06T04:39:05.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb50359e700 1 -- start start 2023-10-06T04:39:05.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb50359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb504068230 0x7fb504156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb50359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5041587d0 0x7fb5040c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb50359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb504158ba0 0x7fb5040b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb50359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040c5850 con 0x7fb504158ba0 2023-10-06T04:39:05.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb50359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040c3f90 con 0x7fb504068230 2023-10-06T04:39:05.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb50359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040c5a30 con 0x7fb5041587d0 2023-10-06T04:39:05.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb502d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb504158ba0 0x7fb5040b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb502d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb504158ba0 0x7fb5040b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57778/0 (socket says 172.21.15.37:57778) 2023-10-06T04:39:05.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb502d9d700 1 -- 172.21.15.37:0/4225515228 learned_addr learned my addr 172.21.15.37:0/4225515228 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:05.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb50259c700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb504068230 0x7fb504156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb501d9b700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5041587d0 0x7fb5040c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb502d9d700 1 -- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5041587d0 msgr2=0x7fb5040c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb502d9d700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5041587d0 0x7fb5040c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb502d9d700 1 -- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb504068230 msgr2=0x7fb504156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb502d9d700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb504068230 0x7fb504156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb502d9d700 1 -- 172.21.15.37:0/4225515228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f8009420 con 0x7fb504158ba0 2023-10-06T04:39:05.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb501d9b700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5041587d0 0x7fb5040c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:05.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb502d9d700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb504158ba0 0x7fb5040b1b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc001460 tx=0x7fb4fc001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:05.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb4f27fc700 1 -- 172.21.15.37:0/4225515228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00a950 con 0x7fb504158ba0 2023-10-06T04:39:05.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb4f27fc700 1 -- 172.21.15.37:0/4225515228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc00aab0 con 0x7fb504158ba0 2023-10-06T04:39:05.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb50359e700 1 -- 172.21.15.37:0/4225515228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5040c5cf0 con 0x7fb504158ba0 2023-10-06T04:39:05.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb4f27fc700 1 -- 172.21.15.37:0/4225515228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00ae30 con 0x7fb504158ba0 2023-10-06T04:39:05.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.765+0000 7fb50359e700 1 -- 172.21.15.37:0/4225515228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5040c6330 con 0x7fb504158ba0 2023-10-06T04:39:05.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.769+0000 7fb50359e700 1 -- 172.21.15.37:0/4225515228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5040708a0 con 0x7fb504158ba0 2023-10-06T04:39:05.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.769+0000 7fb4f27fc700 1 -- 172.21.15.37:0/4225515228 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb4fc007300 con 0x7fb504158ba0 2023-10-06T04:39:05.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.769+0000 7fb4f27fc700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb4e4060550 0x7fb4e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.769+0000 7fb4f27fc700 1 -- 172.21.15.37:0/4225515228 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb4fc07cb20 con 0x7fb504158ba0 2023-10-06T04:39:05.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.769+0000 7fb50259c700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb4e4060550 0x7fb4e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.769+0000 7fb50259c700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb4e4060550 0x7fb4e4062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009d40 tx=0x7fb4f4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.773+0000 7fb4f27fc700 1 -- 172.21.15.37:0/4225515228 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb4fc04d250 con 0x7fb504158ba0 2023-10-06T04:39:05.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.937+0000 7fb50359e700 1 -- 172.21.15.37:0/4225515228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5040afdb0 con 0x7fb504158ba0 2023-10-06T04:39:05.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.941+0000 7fb4f27fc700 1 -- 172.21.15.37:0/4225515228 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13612 (secure 0 0 0) 0x7fb4fc050870 con 0x7fb504158ba0 2023-10-06T04:39:05.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:05.945 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:05.608658+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.945+0000 7fb50359e700 1 -- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb4e4060550 msgr2=0x7fb4e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.945+0000 7fb50359e700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb4e4060550 0x7fb4e4062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009d40 tx=0x7fb4f4008040 comp rx=0 tx=0).stop 2023-10-06T04:39:05.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.945+0000 7fb50359e700 1 -- 172.21.15.37:0/4225515228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb504158ba0 msgr2=0x7fb5040b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.945+0000 7fb50359e700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb504158ba0 0x7fb5040b1b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc001460 tx=0x7fb4fc001a40 comp rx=0 tx=0).stop 2023-10-06T04:39:05.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.945+0000 7fb50359e700 1 -- 172.21.15.37:0/4225515228 shutdown_connections 2023-10-06T04:39:05.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.945+0000 7fb50359e700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb4e4060550 0x7fb4e4062a00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.945+0000 7fb50359e700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb504158ba0 0x7fb5040b1b30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.945+0000 7fb50359e700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5041587d0 0x7fb5040c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.945+0000 7fb50359e700 1 --2- 172.21.15.37:0/4225515228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb504068230 0x7fb504156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.945+0000 7fb50359e700 1 -- 172.21.15.37:0/4225515228 >> 172.21.15.37:0/4225515228 conn(0x7fb5040cc5f0 msgr2=0x7fb5040b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:05.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.945+0000 7fb50359e700 1 -- 172.21.15.37:0/4225515228 shutdown_connections 2023-10-06T04:39:05.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:05.945+0000 7fb50359e700 1 -- 172.21.15.37:0/4225515228 wait complete. 2023-10-06T04:39:05.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T04:39:05.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:06.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.073+0000 7fb67a3aa700 1 Processor -- start 2023-10-06T04:39:06.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.073+0000 7fb67a3aa700 1 -- start start 2023-10-06T04:39:06.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb67a3aa700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6740cd140 0x7fb67406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb67a3aa700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6740c28f0 con 0x7fb674156960 2023-10-06T04:39:06.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb67a3aa700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6740c2b90 con 0x7fb674156d30 2023-10-06T04:39:06.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb67a3aa700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67406c390 con 0x7fb6740cd140 2023-10-06T04:39:06.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb679ba9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6740cd140 0x7fb67406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb679ba9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6740cd140 0x7fb67406bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57790/0 (socket says 172.21.15.37:57790) 2023-10-06T04:39:06.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb679ba9700 1 -- 172.21.15.37:0/2025857828 learned_addr learned my addr 172.21.15.37:0/2025857828 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:06.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb6793a8700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb674156960 0x7fb6740cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42860/0 (socket says 172.21.15.37:42860) 2023-10-06T04:39:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb679ba9700 1 -- 172.21.15.37:0/2025857828 >> v1:172.21.15.83:6789/0 conn(0x7fb674156d30 legacy=0x7fb6740c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb679ba9700 1 -- 172.21.15.37:0/2025857828 >> v1:172.21.15.37:6789/0 conn(0x7fb674156960 legacy=0x7fb6740cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb679ba9700 1 -- 172.21.15.37:0/2025857828 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6740c2e70 con 0x7fb6740cd140 2023-10-06T04:39:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb679ba9700 1 --2- 172.21.15.37:0/2025857828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6740cd140 0x7fb67406bd80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009f20 tx=0x7fb66c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3c941f5d4fa255 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb66bfff700 1 -- 172.21.15.37:0/2025857828 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c00e070 con 0x7fb6740cd140 2023-10-06T04:39:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb66bfff700 1 -- 172.21.15.37:0/2025857828 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c00ba80 con 0x7fb6740cd140 2023-10-06T04:39:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb66bfff700 1 -- 172.21.15.37:0/2025857828 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0092e0 con 0x7fb6740cd140 2023-10-06T04:39:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb67a3aa700 1 -- 172.21.15.37:0/2025857828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6740cd140 msgr2=0x7fb67406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb67a3aa700 1 --2- 172.21.15.37:0/2025857828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6740cd140 0x7fb67406bd80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009f20 tx=0x7fb66c009840 comp rx=0 tx=0).stop 2023-10-06T04:39:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb67a3aa700 1 -- 172.21.15.37:0/2025857828 shutdown_connections 2023-10-06T04:39:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb67a3aa700 1 --2- 172.21.15.37:0/2025857828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6740cd140 0x7fb67406bd80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb67a3aa700 1 -- 172.21.15.37:0/2025857828 >> 172.21.15.37:0/2025857828 conn(0x7fb6740667b0 msgr2=0x7fb674066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb67a3aa700 1 -- 172.21.15.37:0/2025857828 shutdown_connections 2023-10-06T04:39:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.077+0000 7fb67a3aa700 1 -- 172.21.15.37:0/2025857828 wait complete. 2023-10-06T04:39:06.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb67a3aa700 1 Processor -- start 2023-10-06T04:39:06.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb67a3aa700 1 -- start start 2023-10-06T04:39:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb67a3aa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6740cd140 0x7fb674097d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb67a3aa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb674156960 0x7fb6740c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb67a3aa700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb674156d30 0x7fb6740c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb67a3aa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67409a240 con 0x7fb6740cd140 2023-10-06T04:39:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb67a3aa700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb674167e00 con 0x7fb674156960 2023-10-06T04:39:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb67a3aa700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb674099910 con 0x7fb674156d30 2023-10-06T04:39:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb6793a8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6740cd140 0x7fb674097d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb6793a8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6740cd140 0x7fb674097d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57796/0 (socket says 172.21.15.37:57796) 2023-10-06T04:39:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb6793a8700 1 -- 172.21.15.37:0/1102067939 learned_addr learned my addr 172.21.15.37:0/1102067939 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:06.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb678ba7700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb674156960 0x7fb6740c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb679ba9700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb674156d30 0x7fb6740c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb6793a8700 1 -- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb674156d30 msgr2=0x7fb6740c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb6793a8700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb674156d30 0x7fb6740c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb6793a8700 1 -- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb674156960 msgr2=0x7fb6740c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb6793a8700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb674156960 0x7fb6740c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb6793a8700 1 -- 172.21.15.37:0/1102067939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c009ae0 con 0x7fb6740cd140 2023-10-06T04:39:06.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb679ba9700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb674156d30 0x7fb6740c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:06.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.081+0000 7fb6793a8700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6740cd140 0x7fb674097d00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb66400c7c0 tx=0x7fb664007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:06.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.085+0000 7fb6697fa700 1 -- 172.21.15.37:0/1102067939 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664001ea0 con 0x7fb6740cd140 2023-10-06T04:39:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.085+0000 7fb6697fa700 1 -- 172.21.15.37:0/1102067939 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6640072e0 con 0x7fb6740cd140 2023-10-06T04:39:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.085+0000 7fb67a3aa700 1 -- 172.21.15.37:0/1102067939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb674099bf0 con 0x7fb6740cd140 2023-10-06T04:39:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.085+0000 7fb6697fa700 1 -- 172.21.15.37:0/1102067939 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664007680 con 0x7fb6740cd140 2023-10-06T04:39:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.085+0000 7fb67a3aa700 1 -- 172.21.15.37:0/1102067939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb674098240 con 0x7fb6740cd140 2023-10-06T04:39:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.085+0000 7fb67a3aa700 1 -- 172.21.15.37:0/1102067939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67409a070 con 0x7fb6740cd140 2023-10-06T04:39:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.085+0000 7fb6697fa700 1 -- 172.21.15.37:0/1102067939 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb664005a00 con 0x7fb6740cd140 2023-10-06T04:39:06.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.085+0000 7fb6697fa700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb658060580 0x7fb658062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.085+0000 7fb6697fa700 1 -- 172.21.15.37:0/1102067939 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb66407b960 con 0x7fb6740cd140 2023-10-06T04:39:06.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.085+0000 7fb678ba7700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb658060580 0x7fb658062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.089+0000 7fb678ba7700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb658060580 0x7fb658062a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb6740c7fc0 tx=0x7fb670007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:06.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.097+0000 7fb6697fa700 1 -- 172.21.15.37:0/1102067939 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb664049be0 con 0x7fb6740cd140 2023-10-06T04:39:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.257+0000 7fb67a3aa700 1 -- 172.21.15.37:0/1102067939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6740708a0 con 0x7fb6740cd140 2023-10-06T04:39:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.257+0000 7fb6697fa700 1 -- 172.21.15.37:0/1102067939 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb66404c0a0 con 0x7fb6740cd140 2023-10-06T04:39:06.264 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:39:06.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.261+0000 7fb67a3aa700 1 -- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb658060580 msgr2=0x7fb658062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.261+0000 7fb67a3aa700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb658060580 0x7fb658062a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb6740c7fc0 tx=0x7fb670007ec0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.261+0000 7fb67a3aa700 1 -- 172.21.15.37:0/1102067939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6740cd140 msgr2=0x7fb674097d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.261+0000 7fb67a3aa700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6740cd140 0x7fb674097d00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb66400c7c0 tx=0x7fb664007ea0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.261+0000 7fb67a3aa700 1 -- 172.21.15.37:0/1102067939 shutdown_connections 2023-10-06T04:39:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.261+0000 7fb67a3aa700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb658060580 0x7fb658062a30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.261+0000 7fb67a3aa700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb674156960 0x7fb6740c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.261+0000 7fb67a3aa700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb674156d30 0x7fb6740c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.261+0000 7fb67a3aa700 1 --2- 172.21.15.37:0/1102067939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6740cd140 0x7fb674097d00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.261+0000 7fb67a3aa700 1 -- 172.21.15.37:0/1102067939 >> 172.21.15.37:0/1102067939 conn(0x7fb6740667b0 msgr2=0x7fb6740ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.261+0000 7fb67a3aa700 1 -- 172.21.15.37:0/1102067939 shutdown_connections 2023-10-06T04:39:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.261+0000 7fb67a3aa700 1 -- 172.21.15.37:0/1102067939 wait complete. 2023-10-06T04:39:06.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:06.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.385+0000 7fa363fff700 1 Processor -- start 2023-10-06T04:39:06.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.385+0000 7fa363fff700 1 -- start start 2023-10-06T04:39:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.385+0000 7fa363fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3640ccf30 0x7fa3640adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.385+0000 7fa363fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa3640c8f00 0x7fa3640c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.385+0000 7fa363fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3640c97f0 con 0x7fa3640c8b30 2023-10-06T04:39:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.385+0000 7fa363fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3640ad110 con 0x7fa3640ccf30 2023-10-06T04:39:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.385+0000 7fa363fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3640ac500 con 0x7fa3640c8f00 2023-10-06T04:39:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.385+0000 7fa3627fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3640ccf30 0x7fa3640adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa3627fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3640ccf30 0x7fa3640adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57798/0 (socket says 172.21.15.37:57798) 2023-10-06T04:39:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa3627fc700 1 -- 172.21.15.37:0/654296730 learned_addr learned my addr 172.21.15.37:0/654296730 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa3637fe700 1 --2- 172.21.15.37:0/654296730 >> v2:172.21.15.83:3300/0 conn(0x7fa3640c8f00 0x7fa3640c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa3627fc700 1 -- 172.21.15.37:0/654296730 >> v2:172.21.15.83:3300/0 conn(0x7fa3640c8f00 msgr2=0x7fa3640c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:06.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa3627fc700 1 --2- 172.21.15.37:0/654296730 >> v2:172.21.15.83:3300/0 conn(0x7fa3640c8f00 0x7fa3640c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa3627fc700 1 -- 172.21.15.37:0/654296730 >> v1:172.21.15.37:6789/0 conn(0x7fa3640c8b30 legacy=0x7fa3640cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa3627fc700 1 -- 172.21.15.37:0/654296730 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3640ac7e0 con 0x7fa3640ccf30 2023-10-06T04:39:06.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa3627fc700 1 --2- 172.21.15.37:0/654296730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3640ccf30 0x7fa3640adeb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0099b0 tx=0x7fa34c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b510b507e382680 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa361ffb700 1 -- 172.21.15.37:0/654296730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00b820 con 0x7fa3640ccf30 2023-10-06T04:39:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa361ffb700 1 -- 172.21.15.37:0/654296730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c00b980 con 0x7fa3640ccf30 2023-10-06T04:39:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa361ffb700 1 -- 172.21.15.37:0/654296730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00bd20 con 0x7fa3640ccf30 2023-10-06T04:39:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa363fff700 1 -- 172.21.15.37:0/654296730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3640ccf30 msgr2=0x7fa3640adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa363fff700 1 --2- 172.21.15.37:0/654296730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3640ccf30 0x7fa3640adeb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0099b0 tx=0x7fa34c009250 comp rx=0 tx=0).stop 2023-10-06T04:39:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa363fff700 1 -- 172.21.15.37:0/654296730 shutdown_connections 2023-10-06T04:39:06.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa363fff700 1 --2- 172.21.15.37:0/654296730 >> v2:172.21.15.83:3300/0 conn(0x7fa3640c8f00 0x7fa3640c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa363fff700 1 --2- 172.21.15.37:0/654296730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3640ccf30 0x7fa3640adeb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa363fff700 1 -- 172.21.15.37:0/654296730 >> 172.21.15.37:0/654296730 conn(0x7fa36406e7c0 msgr2=0x7fa36406ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:06.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa363fff700 1 -- 172.21.15.37:0/654296730 shutdown_connections 2023-10-06T04:39:06.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.389+0000 7fa363fff700 1 -- 172.21.15.37:0/654296730 wait complete. 2023-10-06T04:39:06.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa363fff700 1 Processor -- start 2023-10-06T04:39:06.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa363fff700 1 -- start start 2023-10-06T04:39:06.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa363fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3640c8b30 0x7fa3640a9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa363fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3640c8f00 0x7fa364096460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa363fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3640ccf30 0x7fa364165140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa363fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3640aa800 con 0x7fa3640c8b30 2023-10-06T04:39:06.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa363fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3640969a0 con 0x7fa3640c8f00 2023-10-06T04:39:06.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa363fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3640a9bf0 con 0x7fa3640ccf30 2023-10-06T04:39:06.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa362ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3640c8b30 0x7fa3640a9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa362ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3640c8b30 0x7fa3640a9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57810/0 (socket says 172.21.15.37:57810) 2023-10-06T04:39:06.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa3637fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3640ccf30 0x7fa364165140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa362ffd700 1 -- 172.21.15.37:0/3069777143 learned_addr learned my addr 172.21.15.37:0/3069777143 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:06.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa3627fc700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3640c8f00 0x7fa364096460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa362ffd700 1 -- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3640ccf30 msgr2=0x7fa364165140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa362ffd700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3640ccf30 0x7fa364165140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa362ffd700 1 -- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3640c8f00 msgr2=0x7fa364096460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa362ffd700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3640c8f00 0x7fa364096460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa362ffd700 1 -- 172.21.15.37:0/3069777143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c0094f0 con 0x7fa3640c8b30 2023-10-06T04:39:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa362ffd700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3640c8b30 0x7fa3640a9550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa35400ea00 tx=0x7fa35400c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa35affd700 1 -- 172.21.15.37:0/3069777143 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3540106b0 con 0x7fa3640c8b30 2023-10-06T04:39:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa35affd700 1 -- 172.21.15.37:0/3069777143 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa354010830 con 0x7fa3640c8b30 2023-10-06T04:39:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa363fff700 1 -- 172.21.15.37:0/3069777143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3640a9ed0 con 0x7fa3640c8b30 2023-10-06T04:39:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa35affd700 1 -- 172.21.15.37:0/3069777143 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa354010bf0 con 0x7fa3640c8b30 2023-10-06T04:39:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.393+0000 7fa363fff700 1 -- 172.21.15.37:0/3069777143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3640aa490 con 0x7fa3640c8b30 2023-10-06T04:39:06.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.397+0000 7fa363fff700 1 -- 172.21.15.37:0/3069777143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3640708a0 con 0x7fa3640c8b30 2023-10-06T04:39:06.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.397+0000 7fa35affd700 1 -- 172.21.15.37:0/3069777143 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa354011470 con 0x7fa3640c8b30 2023-10-06T04:39:06.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.397+0000 7fa35affd700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa344060550 0x7fa344062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.397+0000 7fa35affd700 1 -- 172.21.15.37:0/3069777143 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa35407e7b0 con 0x7fa3640c8b30 2023-10-06T04:39:06.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.397+0000 7fa3627fc700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa344060550 0x7fa344062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.401+0000 7fa3627fc700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa344060550 0x7fa344062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0099b0 tx=0x7fa34c017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.409+0000 7fa35affd700 1 -- 172.21.15.37:0/3069777143 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa35404ef90 con 0x7fa3640c8b30 2023-10-06T04:39:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.573+0000 7fa363fff700 1 -- 172.21.15.37:0/3069777143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa3640af210 con 0x7fa3640c8b30 2023-10-06T04:39:06.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.573+0000 7fa35affd700 1 -- 172.21.15.37:0/3069777143 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa3540525b0 con 0x7fa3640c8b30 2023-10-06T04:39:06.579 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:39:06.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.577+0000 7fa363fff700 1 -- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa344060550 msgr2=0x7fa344062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.577+0000 7fa363fff700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa344060550 0x7fa344062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0099b0 tx=0x7fa34c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:06.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.577+0000 7fa363fff700 1 -- 172.21.15.37:0/3069777143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3640c8b30 msgr2=0x7fa3640a9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.577+0000 7fa363fff700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3640c8b30 0x7fa3640a9550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa35400ea00 tx=0x7fa35400c270 comp rx=0 tx=0).stop 2023-10-06T04:39:06.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.577+0000 7fa363fff700 1 -- 172.21.15.37:0/3069777143 shutdown_connections 2023-10-06T04:39:06.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.577+0000 7fa363fff700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa344060550 0x7fa344062a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.577+0000 7fa363fff700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3640c8f00 0x7fa364096460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.577+0000 7fa363fff700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3640ccf30 0x7fa364165140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.577+0000 7fa363fff700 1 --2- 172.21.15.37:0/3069777143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3640c8b30 0x7fa3640a9550 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.577+0000 7fa363fff700 1 -- 172.21.15.37:0/3069777143 >> 172.21.15.37:0/3069777143 conn(0x7fa36406e7c0 msgr2=0x7fa3640c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:06.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.577+0000 7fa363fff700 1 -- 172.21.15.37:0/3069777143 shutdown_connections 2023-10-06T04:39:06.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.577+0000 7fa363fff700 1 -- 172.21.15.37:0/3069777143 wait complete. 2023-10-06T04:39:06.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:06.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.693+0000 7f1e72b86700 1 Processor -- start 2023-10-06T04:39:06.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.693+0000 7f1e72b86700 1 -- start start 2023-10-06T04:39:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e6c0a6610 0x7f1e6c0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1e6c0cb970 0x7f1e6c0a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c0a6f20 con 0x7f1e6c0b1150 2023-10-06T04:39:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0cb2e0 con 0x7f1e6c0a6610 2023-10-06T04:39:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0ca6d0 con 0x7f1e6c0cb970 2023-10-06T04:39:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e71b84700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e6c0a6610 0x7f1e6c0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72385700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1e6c0b1150 0x7f1e6c0b1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42876/0 (socket says 172.21.15.37:42876) 2023-10-06T04:39:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e71b84700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e6c0a6610 0x7f1e6c0ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57826/0 (socket says 172.21.15.37:57826) 2023-10-06T04:39:06.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72385700 1 -- 172.21.15.37:0/2086446051 learned_addr learned my addr 172.21.15.37:0/2086446051 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:06.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e71383700 1 --2- 172.21.15.37:0/2086446051 >> v2:172.21.15.83:3300/0 conn(0x7f1e6c0cb970 0x7f1e6c0a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e71b84700 1 -- 172.21.15.37:0/2086446051 >> v2:172.21.15.83:3300/0 conn(0x7f1e6c0cb970 msgr2=0x7f1e6c0a69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:06.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e71b84700 1 --2- 172.21.15.37:0/2086446051 >> v2:172.21.15.83:3300/0 conn(0x7f1e6c0cb970 0x7f1e6c0a69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e71b84700 1 -- 172.21.15.37:0/2086446051 >> v1:172.21.15.37:6789/0 conn(0x7f1e6c0b1150 legacy=0x7f1e6c0b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e71b84700 1 -- 172.21.15.37:0/2086446051 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0ca9b0 con 0x7f1e6c0a6610 2023-10-06T04:39:06.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e71383700 1 --2- 172.21.15.37:0/2086446051 >> v2:172.21.15.83:3300/0 conn(0x7f1e6c0cb970 0x7f1e6c0a69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:06.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e71b84700 1 --2- 172.21.15.37:0/2086446051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e6c0a6610 0x7f1e6c0ca060 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c070100 tx=0x7f1e680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766617f9f7c99df5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:06.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e70b82700 1 -- 172.21.15.37:0/2086446051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800b6b0 con 0x7f1e6c0a6610 2023-10-06T04:39:06.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e70b82700 1 -- 172.21.15.37:0/2086446051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6800b810 con 0x7f1e6c0a6610 2023-10-06T04:39:06.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e70b82700 1 -- 172.21.15.37:0/2086446051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800bbb0 con 0x7f1e6c0a6610 2023-10-06T04:39:06.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 -- 172.21.15.37:0/2086446051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e6c0a6610 msgr2=0x7f1e6c0ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 --2- 172.21.15.37:0/2086446051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e6c0a6610 0x7f1e6c0ca060 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c070100 tx=0x7f1e680091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 -- 172.21.15.37:0/2086446051 shutdown_connections 2023-10-06T04:39:06.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 --2- 172.21.15.37:0/2086446051 >> v2:172.21.15.83:3300/0 conn(0x7f1e6c0cb970 0x7f1e6c0a69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 --2- 172.21.15.37:0/2086446051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e6c0a6610 0x7f1e6c0ca060 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 -- 172.21.15.37:0/2086446051 >> 172.21.15.37:0/2086446051 conn(0x7f1e6c0ccb50 msgr2=0x7f1e6c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:06.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 -- 172.21.15.37:0/2086446051 shutdown_connections 2023-10-06T04:39:06.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 -- 172.21.15.37:0/2086446051 wait complete. 2023-10-06T04:39:06.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 Processor -- start 2023-10-06T04:39:06.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.697+0000 7f1e72b86700 1 -- start start 2023-10-06T04:39:06.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e72b86700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e6c0a6610 0x7f1e6c142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e72b86700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e6c0b1150 0x7f1e6c158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e72b86700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e6c0cb970 0x7f1e6c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e72b86700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0aef40 con 0x7f1e6c0a6610 2023-10-06T04:39:06.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e72b86700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0af190 con 0x7f1e6c0b1150 2023-10-06T04:39:06.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e72b86700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0af470 con 0x7f1e6c0cb970 2023-10-06T04:39:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e71b84700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e6c0a6610 0x7f1e6c142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e71b84700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e6c0a6610 0x7f1e6c142560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57830/0 (socket says 172.21.15.37:57830) 2023-10-06T04:39:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e71b84700 1 -- 172.21.15.37:0/2211769040 learned_addr learned my addr 172.21.15.37:0/2211769040 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e71383700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e6c0b1150 0x7f1e6c158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e72385700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e6c0cb970 0x7f1e6c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e71b84700 1 -- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e6c0cb970 msgr2=0x7f1e6c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e71b84700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e6c0cb970 0x7f1e6c154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e71b84700 1 -- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e6c0b1150 msgr2=0x7f1e6c158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e71b84700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e6c0b1150 0x7f1e6c158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e71b84700 1 -- 172.21.15.37:0/2211769040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e68009420 con 0x7f1e6c0a6610 2023-10-06T04:39:06.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e71b84700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e6c0a6610 0x7f1e6c142560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c06dbb0 tx=0x7f1e68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e61ffb700 1 -- 172.21.15.37:0/2211769040 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68000d10 con 0x7f1e6c0a6610 2023-10-06T04:39:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e61ffb700 1 -- 172.21.15.37:0/2211769040 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6800bb90 con 0x7f1e6c0a6610 2023-10-06T04:39:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e72b86700 1 -- 172.21.15.37:0/2211769040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c0af750 con 0x7f1e6c0a6610 2023-10-06T04:39:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e61ffb700 1 -- 172.21.15.37:0/2211769040 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68011650 con 0x7f1e6c0a6610 2023-10-06T04:39:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.701+0000 7f1e72b86700 1 -- 172.21.15.37:0/2211769040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c142aa0 con 0x7f1e6c0a6610 2023-10-06T04:39:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.705+0000 7f1e72b86700 1 -- 172.21.15.37:0/2211769040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c0708a0 con 0x7f1e6c0a6610 2023-10-06T04:39:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.705+0000 7f1e61ffb700 1 -- 172.21.15.37:0/2211769040 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1e68011a40 con 0x7f1e6c0a6610 2023-10-06T04:39:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.705+0000 7f1e61ffb700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e50060550 0x7f1e50062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.705+0000 7f1e61ffb700 1 -- 172.21.15.37:0/2211769040 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1e6807d870 con 0x7f1e6c0a6610 2023-10-06T04:39:06.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.705+0000 7f1e71383700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e50060550 0x7f1e50062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.705+0000 7f1e71383700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e50060550 0x7f1e50062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c14f090 tx=0x7f1e5c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.713+0000 7f1e61ffb700 1 -- 172.21.15.37:0/2211769040 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1e6804e0d0 con 0x7f1e6c0a6610 2023-10-06T04:39:06.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.905+0000 7f1e72b86700 1 -- 172.21.15.37:0/2211769040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e6c0cac90 con 0x7f1e6c0a6610 2023-10-06T04:39:06.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.905+0000 7f1e61ffb700 1 -- 172.21.15.37:0/2211769040 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f1e68015de0 con 0x7f1e6c0a6610 2023-10-06T04:39:06.911 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:06.911 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3463038764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3463038764},{"type":"v1","addr":"172.21.15.83:6835","nonce":3463038764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3802233690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3802233690},{"type":"v1","addr":"172.21.15.37:6833","nonce":3802233690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1262727325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1262727325},{"type":"v1","addr":"172.21.15.83:6837","nonce":1262727325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1742476643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1742476643},{"type":"v1","addr":"172.21.15.37:6835","nonce":1742476643}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T04:39:06.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.909+0000 7f1e72b86700 1 -- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e50060550 msgr2=0x7f1e50062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.909+0000 7f1e72b86700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e50060550 0x7f1e50062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c14f090 tx=0x7f1e5c008040 comp rx=0 tx=0).stop 2023-10-06T04:39:06.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.909+0000 7f1e72b86700 1 -- 172.21.15.37:0/2211769040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e6c0a6610 msgr2=0x7f1e6c142560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.909+0000 7f1e72b86700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e6c0a6610 0x7f1e6c142560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c06dbb0 tx=0x7f1e68017000 comp rx=0 tx=0).stop 2023-10-06T04:39:06.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.909+0000 7f1e72b86700 1 -- 172.21.15.37:0/2211769040 shutdown_connections 2023-10-06T04:39:06.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.909+0000 7f1e72b86700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e50060550 0x7f1e50062a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.909+0000 7f1e72b86700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e6c0b1150 0x7f1e6c158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.909+0000 7f1e72b86700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e6c0cb970 0x7f1e6c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.909+0000 7f1e72b86700 1 --2- 172.21.15.37:0/2211769040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e6c0a6610 0x7f1e6c142560 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.909+0000 7f1e72b86700 1 -- 172.21.15.37:0/2211769040 >> 172.21.15.37:0/2211769040 conn(0x7f1e6c0ccb50 msgr2=0x7f1e6c0ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:06.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.909+0000 7f1e72b86700 1 -- 172.21.15.37:0/2211769040 shutdown_connections 2023-10-06T04:39:06.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:06.909+0000 7f1e72b86700 1 -- 172.21.15.37:0/2211769040 wait complete. 2023-10-06T04:39:06.917 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2023-10-06T04:39:06.931 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:07.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2dd76d700 1 Processor -- start 2023-10-06T04:39:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2dd76d700 1 -- start start 2023-10-06T04:39:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2dd76d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2d80b16c0 0x7fa2d80b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2dd76d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d815d3f0 0x7fa2d806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2dd76d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d80b1230 con 0x7fa2d815d020 2023-10-06T04:39:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2dd76d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d8069e10 con 0x7fa2d80b16c0 2023-10-06T04:39:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2dd76d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80b0c00 con 0x7fa2d815d3f0 2023-10-06T04:39:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d67fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2d80b16c0 0x7fa2d80b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d77fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d815d3f0 0x7fa2d806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d6ffd700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fa2d815d020 0x7fa2d80b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:38130/0 (socket says 172.21.15.37:38130) 2023-10-06T04:39:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d6ffd700 1 -- 172.21.15.37:0/3287830249 learned_addr learned my addr 172.21.15.37:0/3287830249 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d67fc700 1 -- 172.21.15.37:0/3287830249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d815d3f0 msgr2=0x7fa2d806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d5ffb700 1 -- 172.21.15.37:0/3287830249 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490102186 0 0) 0x7fa2d80b1230 con 0x7fa2d815d020 2023-10-06T04:39:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d67fc700 1 --2- 172.21.15.37:0/3287830249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d815d3f0 0x7fa2d806d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d67fc700 1 -- 172.21.15.37:0/3287830249 >> v1:172.21.15.83:6789/0 conn(0x7fa2d815d020 legacy=0x7fa2d80b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d67fc700 1 -- 172.21.15.37:0/3287830249 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d80b35a0 con 0x7fa2d80b16c0 2023-10-06T04:39:07.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d67fc700 1 --2- 172.21.15.37:0/3287830249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d80b16c0 0x7fa2d80b0060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009910 tx=0x7fa2cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e0b6eb04929f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:07.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d5ffb700 1 -- 172.21.15.37:0/3287830249 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00b640 con 0x7fa2d80b16c0 2023-10-06T04:39:07.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d5ffb700 1 -- 172.21.15.37:0/3287830249 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc00b7a0 con 0x7fa2d80b16c0 2023-10-06T04:39:07.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.029+0000 7fa2d5ffb700 1 -- 172.21.15.37:0/3287830249 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00bb60 con 0x7fa2d80b16c0 2023-10-06T04:39:07.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 -- 172.21.15.37:0/3287830249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d80b16c0 msgr2=0x7fa2d80b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 --2- 172.21.15.37:0/3287830249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d80b16c0 0x7fa2d80b0060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009910 tx=0x7fa2cc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 -- 172.21.15.37:0/3287830249 shutdown_connections 2023-10-06T04:39:07.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 --2- 172.21.15.37:0/3287830249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d815d3f0 0x7fa2d806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 --2- 172.21.15.37:0/3287830249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d80b16c0 0x7fa2d80b0060 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 -- 172.21.15.37:0/3287830249 >> 172.21.15.37:0/3287830249 conn(0x7fa2d806c430 msgr2=0x7fa2d80af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:07.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 -- 172.21.15.37:0/3287830249 shutdown_connections 2023-10-06T04:39:07.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 -- 172.21.15.37:0/3287830249 wait complete. 2023-10-06T04:39:07.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 Processor -- start 2023-10-06T04:39:07.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 -- start start 2023-10-06T04:39:07.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d80b16c0 0x7fa2d814e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2d815d020 0x7fa2d81512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d815d3f0 0x7fa2d8151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8140ae0 con 0x7fa2d815d3f0 2023-10-06T04:39:07.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d813fed0 con 0x7fa2d815d020 2023-10-06T04:39:07.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2dd76d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d81401b0 con 0x7fa2d80b16c0 2023-10-06T04:39:07.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d815d3f0 0x7fa2d8151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d815d3f0 0x7fa2d8151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57846/0 (socket says 172.21.15.37:57846) 2023-10-06T04:39:07.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d77fe700 1 -- 172.21.15.37:0/1135022785 learned_addr learned my addr 172.21.15.37:0/1135022785 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:07.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d67fc700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2d815d020 0x7fa2d81512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d77fe700 1 -- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d80b16c0 msgr2=0x7fa2d814e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d6ffd700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d80b16c0 0x7fa2d814e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d77fe700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d80b16c0 0x7fa2d814e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d77fe700 1 -- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2d815d020 msgr2=0x7fa2d81512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d77fe700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2d815d020 0x7fa2d81512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d77fe700 1 -- 172.21.15.37:0/1135022785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc009420 con 0x7fa2d815d3f0 2023-10-06T04:39:07.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d67fc700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2d815d020 0x7fa2d81512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:07.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d6ffd700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d80b16c0 0x7fa2d814e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:07.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2d77fe700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d815d3f0 0x7fa2d8151830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009d70 tx=0x7fa2d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:07.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.033+0000 7fa2beffd700 1 -- 172.21.15.37:0/1135022785 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000cb50 con 0x7fa2d815d3f0 2023-10-06T04:39:07.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.037+0000 7fa2beffd700 1 -- 172.21.15.37:0/1135022785 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d000f040 con 0x7fa2d815d3f0 2023-10-06T04:39:07.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.037+0000 7fa2dd76d700 1 -- 172.21.15.37:0/1135022785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d8140490 con 0x7fa2d815d3f0 2023-10-06T04:39:07.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.037+0000 7fa2beffd700 1 -- 172.21.15.37:0/1135022785 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0014480 con 0x7fa2d815d3f0 2023-10-06T04:39:07.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.037+0000 7fa2dd76d700 1 -- 172.21.15.37:0/1135022785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d814ec60 con 0x7fa2d815d3f0 2023-10-06T04:39:07.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.037+0000 7fa2dd76d700 1 -- 172.21.15.37:0/1135022785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d80b20e0 con 0x7fa2d815d3f0 2023-10-06T04:39:07.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.037+0000 7fa2beffd700 1 -- 172.21.15.37:0/1135022785 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa2d0014830 con 0x7fa2d815d3f0 2023-10-06T04:39:07.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.037+0000 7fa2beffd700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2c4060550 0x7fa2c4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.037+0000 7fa2beffd700 1 -- 172.21.15.37:0/1135022785 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa2d007d270 con 0x7fa2d815d3f0 2023-10-06T04:39:07.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.037+0000 7fa2d6ffd700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2c4060550 0x7fa2c4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.041+0000 7fa2d6ffd700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2c4060550 0x7fa2c4062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8001840 tx=0x7fa2c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:07.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.045+0000 7fa2beffd700 1 -- 172.21.15.37:0/1135022785 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa2d80b20e0 con 0x7fa2d815d3f0 2023-10-06T04:39:07.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.213+0000 7fa2dd76d700 1 -- 172.21.15.37:0/1135022785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2d80b20e0 con 0x7fa2d815d3f0 2023-10-06T04:39:07.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.213+0000 7fa2beffd700 1 -- 172.21.15.37:0/1135022785 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13599 (secure 0 0 0) 0x7fa2d80b20e0 con 0x7fa2d815d3f0 2023-10-06T04:39:07.219 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:07.219 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:06.622115+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:07.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.217+0000 7fa2dd76d700 1 -- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2c4060550 msgr2=0x7fa2c4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.217+0000 7fa2dd76d700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2c4060550 0x7fa2c4062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8001840 tx=0x7fa2c8009040 comp rx=0 tx=0).stop 2023-10-06T04:39:07.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.217+0000 7fa2dd76d700 1 -- 172.21.15.37:0/1135022785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d815d3f0 msgr2=0x7fa2d8151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.217+0000 7fa2dd76d700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d815d3f0 0x7fa2d8151830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009d70 tx=0x7fa2d000b040 comp rx=0 tx=0).stop 2023-10-06T04:39:07.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.217+0000 7fa2dd76d700 1 -- 172.21.15.37:0/1135022785 shutdown_connections 2023-10-06T04:39:07.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.217+0000 7fa2dd76d700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2c4060550 0x7fa2c4062a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.217+0000 7fa2dd76d700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2d815d020 0x7fa2d81512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.217+0000 7fa2dd76d700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d815d3f0 0x7fa2d8151830 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.217+0000 7fa2dd76d700 1 --2- 172.21.15.37:0/1135022785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d80b16c0 0x7fa2d814e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.217+0000 7fa2dd76d700 1 -- 172.21.15.37:0/1135022785 >> 172.21.15.37:0/1135022785 conn(0x7fa2d806c430 msgr2=0x7fa2d81599b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:07.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.217+0000 7fa2dd76d700 1 -- 172.21.15.37:0/1135022785 shutdown_connections 2023-10-06T04:39:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.217+0000 7fa2dd76d700 1 -- 172.21.15.37:0/1135022785 wait complete. 2023-10-06T04:39:07.234 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T04:39:07.234 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:07.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.341+0000 7faece8bb700 1 Processor -- start 2023-10-06T04:39:07.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.341+0000 7faece8bb700 1 -- start start 2023-10-06T04:39:07.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faec8068270 0x7faec80cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8159a70 0x7faec80cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec815d150 con 0x7faec8068640 2023-10-06T04:39:07.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec815a330 con 0x7faec8068270 2023-10-06T04:39:07.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec80c7260 con 0x7faec8159a70 2023-10-06T04:39:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faecce58700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8159a70 0x7faec80cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faec7fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faec8068270 0x7faec80cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faec77fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7faec8068640 0x7faec8159360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:38136/0 (socket says 172.21.15.37:38136) 2023-10-06T04:39:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faec7fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faec8068270 0x7faec80cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:53318/0 (socket says 172.21.15.37:53318) 2023-10-06T04:39:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faec77fe700 1 -- 172.21.15.37:0/3724815656 learned_addr learned my addr 172.21.15.37:0/3724815656 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faec6ffd700 1 -- 172.21.15.37:0/3724815656 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314095751 0 0) 0x7faec815d150 con 0x7faec8068640 2023-10-06T04:39:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faec6ffd700 1 -- 172.21.15.37:0/3724815656 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb0003570 con 0x7faec8068640 2023-10-06T04:39:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faecce58700 1 -- 172.21.15.37:0/3724815656 >> v2:172.21.15.83:3300/0 conn(0x7faec8068270 msgr2=0x7faec80cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faecce58700 1 --2- 172.21.15.37:0/3724815656 >> v2:172.21.15.83:3300/0 conn(0x7faec8068270 0x7faec80cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faecce58700 1 -- 172.21.15.37:0/3724815656 >> v1:172.21.15.83:6789/0 conn(0x7faec8068640 legacy=0x7faec8159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faecce58700 1 -- 172.21.15.37:0/3724815656 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec815a050 con 0x7faec8159a70 2023-10-06T04:39:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faec7fff700 1 --2- 172.21.15.37:0/3724815656 >> v2:172.21.15.83:3300/0 conn(0x7faec8068270 0x7faec80cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faecce58700 1 --2- 172.21.15.37:0/3724815656 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8159a70 0x7faec80cb190 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faec0009e60 tx=0x7faec0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85add68f990dc8a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faec6ffd700 1 -- 172.21.15.37:0/3724815656 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec000e070 con 0x7faec8159a70 2023-10-06T04:39:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faec6ffd700 1 -- 172.21.15.37:0/3724815656 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec000bb40 con 0x7faec8159a70 2023-10-06T04:39:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faec6ffd700 1 -- 172.21.15.37:0/3724815656 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0012430 con 0x7faec8159a70 2023-10-06T04:39:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 -- 172.21.15.37:0/3724815656 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8159a70 msgr2=0x7faec80cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 --2- 172.21.15.37:0/3724815656 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8159a70 0x7faec80cb190 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faec0009e60 tx=0x7faec0009780 comp rx=0 tx=0).stop 2023-10-06T04:39:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 -- 172.21.15.37:0/3724815656 shutdown_connections 2023-10-06T04:39:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 --2- 172.21.15.37:0/3724815656 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8159a70 0x7faec80cb190 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 --2- 172.21.15.37:0/3724815656 >> v2:172.21.15.83:3300/0 conn(0x7faec8068270 0x7faec80cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 -- 172.21.15.37:0/3724815656 >> 172.21.15.37:0/3724815656 conn(0x7faec80698d0 msgr2=0x7faec80cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:07.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 -- 172.21.15.37:0/3724815656 shutdown_connections 2023-10-06T04:39:07.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.345+0000 7faece8bb700 1 -- 172.21.15.37:0/3724815656 wait complete. 2023-10-06T04:39:07.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faece8bb700 1 Processor -- start 2023-10-06T04:39:07.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faece8bb700 1 -- start start 2023-10-06T04:39:07.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faece8bb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec8068270 0x7faec80c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faece8bb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8068640 0x7faec81495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faece8bb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec8159a70 0x7faec815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faece8bb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80c6440 con 0x7faec8068270 2023-10-06T04:39:07.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faece8bb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80c4a10 con 0x7faec8159a70 2023-10-06T04:39:07.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faece8bb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec80c80f0 con 0x7faec8068640 2023-10-06T04:39:07.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faec7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec8068270 0x7faec80c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faec7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec8068270 0x7faec80c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57856/0 (socket says 172.21.15.37:57856) 2023-10-06T04:39:07.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faec7fff700 1 -- 172.21.15.37:0/2915796200 learned_addr learned my addr 172.21.15.37:0/2915796200 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:07.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faec77fe700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8068640 0x7faec81495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.349+0000 7faecce58700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec8159a70 0x7faec815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faec7fff700 1 -- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8068640 msgr2=0x7faec81495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faec7fff700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8068640 0x7faec81495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faec7fff700 1 -- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec8159a70 msgr2=0x7faec815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faec7fff700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec8159a70 0x7faec815b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faec7fff700 1 -- 172.21.15.37:0/2915796200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc009420 con 0x7faec8068270 2023-10-06T04:39:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faec77fe700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8068640 0x7faec81495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faecce58700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec8159a70 0x7faec815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faec7fff700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec8068270 0x7faec80c44d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faebc00ec80 tx=0x7faebc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faeaffff700 1 -- 172.21.15.37:0/2915796200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00c850 con 0x7faec8068270 2023-10-06T04:39:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faeaffff700 1 -- 172.21.15.37:0/2915796200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc00c9b0 con 0x7faec8068270 2023-10-06T04:39:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faece8bb700 1 -- 172.21.15.37:0/2915796200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec0009a20 con 0x7faec8068270 2023-10-06T04:39:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faeaffff700 1 -- 172.21.15.37:0/2915796200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00cd30 con 0x7faec8068270 2023-10-06T04:39:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faece8bb700 1 -- 172.21.15.37:0/2915796200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec80c5b10 con 0x7faec8068270 2023-10-06T04:39:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faece8bb700 1 -- 172.21.15.37:0/2915796200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec8070ee0 con 0x7faec8068270 2023-10-06T04:39:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.353+0000 7faeaffff700 1 -- 172.21.15.37:0/2915796200 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faebc013680 con 0x7faec8068270 2023-10-06T04:39:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.357+0000 7faeaffff700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faeb4060550 0x7faeb4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.357+0000 7faeaffff700 1 -- 172.21.15.37:0/2915796200 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7faebc07c9c0 con 0x7faec8068270 2023-10-06T04:39:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.357+0000 7faec77fe700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faeb4060550 0x7faeb4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.357+0000 7faec77fe700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faeb4060550 0x7faeb4062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faec80af090 tx=0x7faeb8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:07.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.365+0000 7faeaffff700 1 -- 172.21.15.37:0/2915796200 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faebc050c30 con 0x7faec8068270 2023-10-06T04:39:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.525+0000 7faece8bb700 1 -- 172.21.15.37:0/2915796200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faec814ba90 con 0x7faec8068270 2023-10-06T04:39:07.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.525+0000 7faeaffff700 1 -- 172.21.15.37:0/2915796200 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7faebc0507c0 con 0x7faec8068270 2023-10-06T04:39:07.531 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:39:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.529+0000 7faece8bb700 1 -- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faeb4060550 msgr2=0x7faeb4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.529+0000 7faece8bb700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faeb4060550 0x7faeb4062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faec80af090 tx=0x7faeb8009040 comp rx=0 tx=0).stop 2023-10-06T04:39:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.529+0000 7faece8bb700 1 -- 172.21.15.37:0/2915796200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec8068270 msgr2=0x7faec80c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.529+0000 7faece8bb700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec8068270 0x7faec80c44d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faebc00ec80 tx=0x7faebc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.529+0000 7faece8bb700 1 -- 172.21.15.37:0/2915796200 shutdown_connections 2023-10-06T04:39:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.529+0000 7faece8bb700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faeb4060550 0x7faeb4062a00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.529+0000 7faece8bb700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec8159a70 0x7faec815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.529+0000 7faece8bb700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8068640 0x7faec81495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.529+0000 7faece8bb700 1 --2- 172.21.15.37:0/2915796200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec8068270 0x7faec80c44d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.529+0000 7faece8bb700 1 -- 172.21.15.37:0/2915796200 >> 172.21.15.37:0/2915796200 conn(0x7faec80698d0 msgr2=0x7faec80c2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:07.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.529+0000 7faece8bb700 1 -- 172.21.15.37:0/2915796200 shutdown_connections 2023-10-06T04:39:07.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.529+0000 7faece8bb700 1 -- 172.21.15.37:0/2915796200 wait complete. 2023-10-06T04:39:07.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:07.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.653+0000 7f6202ae1700 1 Processor -- start 2023-10-06T04:39:07.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.653+0000 7f6202ae1700 1 -- start start 2023-10-06T04:39:07.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f6202ae1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f61fc0b48f0 0x7f61fc163c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f6202ae1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61fc0b5a60 con 0x7f61fc153400 2023-10-06T04:39:07.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f6202ae1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61fc159950 con 0x7f61fc069b40 2023-10-06T04:39:07.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f6202ae1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61fc15a680 con 0x7f61fc0b48f0 2023-10-06T04:39:07.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f620087d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f61fc153400 0x7f61fc069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42888/0 (socket says 172.21.15.37:42888) 2023-10-06T04:39:07.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f620087d700 1 -- 172.21.15.37:0/4184752367 learned_addr learned my addr 172.21.15.37:0/4184752367 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:07.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f620107e700 1 --2- 172.21.15.37:0/4184752367 >> v2:172.21.15.83:3300/0 conn(0x7f61fc0b48f0 0x7f61fc163c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f61fb7fe700 1 -- 172.21.15.37:0/4184752367 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132512001 0 0) 0x7f61fc0b5a60 con 0x7f61fc153400 2023-10-06T04:39:07.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f61fb7fe700 1 -- 172.21.15.37:0/4184752367 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e8003570 con 0x7f61fc153400 2023-10-06T04:39:07.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f620107e700 1 -- 172.21.15.37:0/4184752367 >> v1:172.21.15.83:6789/0 conn(0x7f61fc069b40 legacy=0x7f61fc0b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f620107e700 1 -- 172.21.15.37:0/4184752367 >> v1:172.21.15.37:6789/0 conn(0x7f61fc153400 legacy=0x7f61fc069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f620107e700 1 -- 172.21.15.37:0/4184752367 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61fc0b4e50 con 0x7f61fc0b48f0 2023-10-06T04:39:07.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f620107e700 1 --2- 172.21.15.37:0/4184752367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61fc0b48f0 0x7f61fc163c90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009e60 tx=0x7f61f4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faf61a0afa7afbbd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:07.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f61fb7fe700 1 -- 172.21.15.37:0/4184752367 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f400e070 con 0x7f61fc0b48f0 2023-10-06T04:39:07.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f61fb7fe700 1 -- 172.21.15.37:0/4184752367 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f400bb60 con 0x7f61fc0b48f0 2023-10-06T04:39:07.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f61fb7fe700 1 -- 172.21.15.37:0/4184752367 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4012430 con 0x7f61fc0b48f0 2023-10-06T04:39:07.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f6202ae1700 1 -- 172.21.15.37:0/4184752367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61fc0b48f0 msgr2=0x7f61fc163c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f6202ae1700 1 --2- 172.21.15.37:0/4184752367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61fc0b48f0 0x7f61fc163c90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009e60 tx=0x7f61f4009780 comp rx=0 tx=0).stop 2023-10-06T04:39:07.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f6202ae1700 1 -- 172.21.15.37:0/4184752367 shutdown_connections 2023-10-06T04:39:07.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f6202ae1700 1 --2- 172.21.15.37:0/4184752367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61fc0b48f0 0x7f61fc163c90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.657+0000 7f6202ae1700 1 -- 172.21.15.37:0/4184752367 >> 172.21.15.37:0/4184752367 conn(0x7f61fc067cf0 msgr2=0x7f61fc0680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:07.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f6202ae1700 1 -- 172.21.15.37:0/4184752367 shutdown_connections 2023-10-06T04:39:07.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f6202ae1700 1 -- 172.21.15.37:0/4184752367 wait complete. 2023-10-06T04:39:07.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f6202ae1700 1 Processor -- start 2023-10-06T04:39:07.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f6202ae1700 1 -- start start 2023-10-06T04:39:07.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f6202ae1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61fc069b40 0x7f61fc13c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f6202ae1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61fc0b48f0 0x7f61fc153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f6202ae1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61fc153400 0x7f61fc141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f6202ae1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc13d4b0 con 0x7f61fc153400 2023-10-06T04:39:07.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f6202ae1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc154170 con 0x7f61fc0b48f0 2023-10-06T04:39:07.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f6202ae1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc13c8a0 con 0x7f61fc069b40 2023-10-06T04:39:07.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f620107e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61fc153400 0x7f61fc141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f620087d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61fc069b40 0x7f61fc13c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f620087d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61fc069b40 0x7f61fc13c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:46498/0 (socket says 172.21.15.37:46498) 2023-10-06T04:39:07.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f61fbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61fc0b48f0 0x7f61fc153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f620087d700 1 -- 172.21.15.37:0/3928000019 learned_addr learned my addr 172.21.15.37:0/3928000019 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:07.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.661+0000 7f620107e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61fc153400 0x7f61fc141660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57872/0 (socket says 172.21.15.37:57872) 2023-10-06T04:39:07.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f620087d700 1 -- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61fc0b48f0 msgr2=0x7f61fc153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f620087d700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61fc0b48f0 0x7f61fc153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f620087d700 1 -- 172.21.15.37:0/3928000019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61fc153400 msgr2=0x7f61fc141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f620087d700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61fc153400 0x7f61fc141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f620087d700 1 -- 172.21.15.37:0/3928000019 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f4009a20 con 0x7f61fc069b40 2023-10-06T04:39:07.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f61fbfff700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61fc0b48f0 0x7f61fc153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:07.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f620107e700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61fc153400 0x7f61fc141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:07.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f620087d700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61fc069b40 0x7f61fc13c1c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00c5c0 tx=0x7f61ec007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:07.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f61f8ff9700 1 -- 172.21.15.37:0/3928000019 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec005b30 con 0x7f61fc069b40 2023-10-06T04:39:07.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f6202ae1700 1 -- 172.21.15.37:0/3928000019 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61fc13cb80 con 0x7f61fc069b40 2023-10-06T04:39:07.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f6202ae1700 1 -- 172.21.15.37:0/3928000019 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61fc13d140 con 0x7f61fc069b40 2023-10-06T04:39:07.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f61f8ff9700 1 -- 172.21.15.37:0/3928000019 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec005cb0 con 0x7f61fc069b40 2023-10-06T04:39:07.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f61f8ff9700 1 -- 172.21.15.37:0/3928000019 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec007320 con 0x7f61fc069b40 2023-10-06T04:39:07.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f6202ae1700 1 -- 172.21.15.37:0/3928000019 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e00052b0 con 0x7f61fc069b40 2023-10-06T04:39:07.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f61f8ff9700 1 -- 172.21.15.37:0/3928000019 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f61ec01b3b0 con 0x7f61fc069b40 2023-10-06T04:39:07.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.665+0000 7f61f8ff9700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f61dc060550 0x7f61dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.669+0000 7f61f8ff9700 1 -- 172.21.15.37:0/3928000019 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f61ec07bab0 con 0x7f61fc069b40 2023-10-06T04:39:07.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.669+0000 7f61fbfff700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f61dc060550 0x7f61dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.669+0000 7f61fbfff700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f61dc060550 0x7f61dc062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f61fc15d150 tx=0x7f61e4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:07.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.677+0000 7f61f8ff9700 1 -- 172.21.15.37:0/3928000019 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f61ec04c1f0 con 0x7f61fc069b40 2023-10-06T04:39:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.841+0000 7f6202ae1700 1 -- 172.21.15.37:0/3928000019 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f61e0005ae0 con 0x7f61fc069b40 2023-10-06T04:39:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.845+0000 7f61f8ff9700 1 -- 172.21.15.37:0/3928000019 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f61ec0170a0 con 0x7f61fc069b40 2023-10-06T04:39:07.849 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:39:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.845+0000 7f6202ae1700 1 -- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f61dc060550 msgr2=0x7f61dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.845+0000 7f6202ae1700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f61dc060550 0x7f61dc062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f61fc15d150 tx=0x7f61e4009040 comp rx=0 tx=0).stop 2023-10-06T04:39:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.845+0000 7f6202ae1700 1 -- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61fc069b40 msgr2=0x7f61fc13c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.845+0000 7f6202ae1700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61fc069b40 0x7f61fc13c1c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00c5c0 tx=0x7f61ec007e00 comp rx=0 tx=0).stop 2023-10-06T04:39:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.849+0000 7f6202ae1700 1 -- 172.21.15.37:0/3928000019 shutdown_connections 2023-10-06T04:39:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.849+0000 7f6202ae1700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f61dc060550 0x7f61dc062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.849+0000 7f6202ae1700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61fc0b48f0 0x7f61fc153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.849+0000 7f6202ae1700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61fc153400 0x7f61fc141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.849+0000 7f6202ae1700 1 --2- 172.21.15.37:0/3928000019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61fc069b40 0x7f61fc13c1c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.849+0000 7f6202ae1700 1 -- 172.21.15.37:0/3928000019 >> 172.21.15.37:0/3928000019 conn(0x7f61fc067cf0 msgr2=0x7f61fc0ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:07.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.849+0000 7f6202ae1700 1 -- 172.21.15.37:0/3928000019 shutdown_connections 2023-10-06T04:39:07.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.849+0000 7f6202ae1700 1 -- 172.21.15.37:0/3928000019 wait complete. 2023-10-06T04:39:07.869 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:39:07.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.973+0000 7f253271e700 1 Processor -- start 2023-10-06T04:39:07.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.973+0000 7f253271e700 1 -- start start 2023-10-06T04:39:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.973+0000 7f253271e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f252c1587d0 0x7f252c15d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.973+0000 7f253271e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f252c068400 0x7f252c0ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.973+0000 7f253271e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252c0af7f0 con 0x7f252c158ba0 2023-10-06T04:39:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.973+0000 7f253271e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252c15d6d0 con 0x7f252c068400 2023-10-06T04:39:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.973+0000 7f253271e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252c0afad0 con 0x7f252c1587d0 2023-10-06T04:39:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.973+0000 7f2531f1d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f252c068400 0x7f252c0ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.973+0000 7f2531f1d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f252c068400 0x7f252c0ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57874/0 (socket says 172.21.15.37:57874) 2023-10-06T04:39:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.973+0000 7f2531f1d700 1 -- 172.21.15.37:0/1073074050 learned_addr learned my addr 172.21.15.37:0/1073074050 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.973+0000 7f253171c700 1 --2- 172.21.15.37:0/1073074050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f252c1587d0 0x7f252c15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f2531f1d700 1 -- 172.21.15.37:0/1073074050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f252c1587d0 msgr2=0x7f252c15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f2531f1d700 1 --2- 172.21.15.37:0/1073074050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f252c1587d0 0x7f252c15d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f2531f1d700 1 -- 172.21.15.37:0/1073074050 >> v1:172.21.15.83:6789/0 conn(0x7f252c158ba0 legacy=0x7f252c067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f2531f1d700 1 -- 172.21.15.37:0/1073074050 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c0afdb0 con 0x7f252c068400 2023-10-06T04:39:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f253171c700 1 --2- 172.21.15.37:0/1073074050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f252c1587d0 0x7f252c15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f2531f1d700 1 --2- 172.21.15.37:0/1073074050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f252c068400 0x7f252c0ae510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2524009f20 tx=0x7f2524009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ae0a6bfda7a381 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f2523fff700 1 -- 172.21.15.37:0/1073074050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252400e070 con 0x7f252c068400 2023-10-06T04:39:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f2523fff700 1 -- 172.21.15.37:0/1073074050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252400ba80 con 0x7f252c068400 2023-10-06T04:39:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f2523fff700 1 -- 172.21.15.37:0/1073074050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25240092e0 con 0x7f252c068400 2023-10-06T04:39:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f253271e700 1 -- 172.21.15.37:0/1073074050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f252c068400 msgr2=0x7f252c0ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f253271e700 1 --2- 172.21.15.37:0/1073074050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f252c068400 0x7f252c0ae510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2524009f20 tx=0x7f2524009840 comp rx=0 tx=0).stop 2023-10-06T04:39:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f253271e700 1 -- 172.21.15.37:0/1073074050 shutdown_connections 2023-10-06T04:39:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f253271e700 1 --2- 172.21.15.37:0/1073074050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f252c068400 0x7f252c0ae510 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f253271e700 1 --2- 172.21.15.37:0/1073074050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f252c1587d0 0x7f252c15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f253271e700 1 -- 172.21.15.37:0/1073074050 >> 172.21.15.37:0/1073074050 conn(0x7f252c0cc5f0 msgr2=0x7f252c0cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f253271e700 1 -- 172.21.15.37:0/1073074050 shutdown_connections 2023-10-06T04:39:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f253271e700 1 -- 172.21.15.37:0/1073074050 wait complete. 2023-10-06T04:39:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f253271e700 1 Processor -- start 2023-10-06T04:39:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.977+0000 7f253271e700 1 -- start start 2023-10-06T04:39:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f253271e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f252c068400 0x7f252c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f253271e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f252c1587d0 0x7f252c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f253271e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f252c158ba0 0x7f252c155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f253271e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c0ceb60 con 0x7f252c1587d0 2023-10-06T04:39:07.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f253271e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c168b40 con 0x7f252c068400 2023-10-06T04:39:07.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f253271e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252c0ced70 con 0x7f252c158ba0 2023-10-06T04:39:07.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f2530f1b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f252c1587d0 0x7f252c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f2530f1b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f252c1587d0 0x7f252c0c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57878/0 (socket says 172.21.15.37:57878) 2023-10-06T04:39:07.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f2530f1b700 1 -- 172.21.15.37:0/3770438541 learned_addr learned my addr 172.21.15.37:0/3770438541 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:07.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f253171c700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f252c068400 0x7f252c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f2531f1d700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f252c158ba0 0x7f252c155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f2530f1b700 1 -- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f252c158ba0 msgr2=0x7f252c155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f2530f1b700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f252c158ba0 0x7f252c155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f2530f1b700 1 -- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f252c068400 msgr2=0x7f252c1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f2530f1b700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f252c068400 0x7f252c1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f2530f1b700 1 -- 172.21.15.37:0/3770438541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2524009ae0 con 0x7f252c1587d0 2023-10-06T04:39:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f253171c700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f252c068400 0x7f252c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f2531f1d700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f252c158ba0 0x7f252c155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f2530f1b700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f252c1587d0 0x7f252c0c6b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f252800c590 tx=0x7f252800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f25217fa700 1 -- 172.21.15.37:0/3770438541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528011590 con 0x7f252c1587d0 2023-10-06T04:39:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f25217fa700 1 -- 172.21.15.37:0/3770438541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25280116f0 con 0x7f252c1587d0 2023-10-06T04:39:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f253271e700 1 -- 172.21.15.37:0/3770438541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252c16caf0 con 0x7f252c1587d0 2023-10-06T04:39:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f25217fa700 1 -- 172.21.15.37:0/3770438541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528011ab0 con 0x7f252c1587d0 2023-10-06T04:39:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f253271e700 1 -- 172.21.15.37:0/3770438541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252c1557a0 con 0x7f252c1587d0 2023-10-06T04:39:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.981+0000 7f253271e700 1 -- 172.21.15.37:0/3770438541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252c16c920 con 0x7f252c1587d0 2023-10-06T04:39:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.985+0000 7f25217fa700 1 -- 172.21.15.37:0/3770438541 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f252801b3b0 con 0x7f252c1587d0 2023-10-06T04:39:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.985+0000 7f25217fa700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2510060550 0x7f2510062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.985+0000 7f25217fa700 1 -- 172.21.15.37:0/3770438541 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f252807bb50 con 0x7f252c1587d0 2023-10-06T04:39:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.985+0000 7f253171c700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2510060550 0x7f2510062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.985+0000 7f253171c700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2510060550 0x7f2510062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f252c0af720 tx=0x7f251c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:07.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:07.993+0000 7f25217fa700 1 -- 172.21.15.37:0/3770438541 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f252804c330 con 0x7f252c1587d0 2023-10-06T04:39:08.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.157+0000 7f253271e700 1 -- 172.21.15.37:0/3770438541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f252c168cb0 con 0x7f252c1587d0 2023-10-06T04:39:08.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.157+0000 7f25217fa700 1 -- 172.21.15.37:0/3770438541 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f2528017020 con 0x7f252c1587d0 2023-10-06T04:39:08.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:08.162 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-10-06T04:39:08.162 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:39:08.162 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-10-06T04:39:08.162 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-10-06T04:39:08.162 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:08.162 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:39:08.162 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-10-06T04:39:08.163 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-10-06T04:39:08.163 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:39:08.163 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-10-06T04:39:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.157+0000 7f253271e700 1 -- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2510060550 msgr2=0x7f2510062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.157+0000 7f253271e700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2510060550 0x7f2510062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f252c0af720 tx=0x7f251c008040 comp rx=0 tx=0).stop 2023-10-06T04:39:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.157+0000 7f253271e700 1 -- 172.21.15.37:0/3770438541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f252c1587d0 msgr2=0x7f252c0c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.157+0000 7f253271e700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f252c1587d0 0x7f252c0c6b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f252800c590 tx=0x7f252800c950 comp rx=0 tx=0).stop 2023-10-06T04:39:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.161+0000 7f253271e700 1 -- 172.21.15.37:0/3770438541 shutdown_connections 2023-10-06T04:39:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.161+0000 7f253271e700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2510060550 0x7f2510062a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.161+0000 7f253271e700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f252c158ba0 0x7f252c155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.161+0000 7f253271e700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f252c1587d0 0x7f252c0c6b90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.161+0000 7f253271e700 1 --2- 172.21.15.37:0/3770438541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f252c068400 0x7f252c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.161+0000 7f253271e700 1 -- 172.21.15.37:0/3770438541 >> 172.21.15.37:0/3770438541 conn(0x7f252c0cc5f0 msgr2=0x7f252c157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.161+0000 7f253271e700 1 -- 172.21.15.37:0/3770438541 shutdown_connections 2023-10-06T04:39:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.161+0000 7f253271e700 1 -- 172.21.15.37:0/3770438541 wait complete. 2023-10-06T04:39:08.176 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:39:08.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:39:08.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.281+0000 7fe418d3f700 1 Processor -- start 2023-10-06T04:39:08.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.281+0000 7fe418d3f700 1 -- start start 2023-10-06T04:39:08.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe418d3f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe414158cd0 0x7fe4140c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe418d3f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe41415d6f0 0x7fe41415cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe418d3f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe4141590a0 0x7fe41415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe418d3f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41406ee60 con 0x7fe414158cd0 2023-10-06T04:39:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe418d3f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41406f2f0 con 0x7fe4141590a0 2023-10-06T04:39:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe418d3f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140ca960 con 0x7fe41415d6f0 2023-10-06T04:39:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe4137fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe414158cd0 0x7fe4140c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe4137fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe414158cd0 0x7fe4140c9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57880/0 (socket says 172.21.15.37:57880) 2023-10-06T04:39:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe4137fe700 1 -- 172.21.15.37:0/3110159560 learned_addr learned my addr 172.21.15.37:0/3110159560 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe413fff700 1 --2- 172.21.15.37:0/3110159560 >> v2:172.21.15.83:3300/0 conn(0x7fe4141590a0 0x7fe41415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe412ffd700 1 --2- 172.21.15.37:0/3110159560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe41415d6f0 0x7fe41415cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe4137fe700 1 -- 172.21.15.37:0/3110159560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe41415d6f0 msgr2=0x7fe41415cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe4137fe700 1 --2- 172.21.15.37:0/3110159560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe41415d6f0 0x7fe41415cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe4137fe700 1 -- 172.21.15.37:0/3110159560 >> v2:172.21.15.83:3300/0 conn(0x7fe4141590a0 msgr2=0x7fe41415cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe4137fe700 1 --2- 172.21.15.37:0/3110159560 >> v2:172.21.15.83:3300/0 conn(0x7fe4141590a0 0x7fe41415cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe4137fe700 1 -- 172.21.15.37:0/3110159560 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140cac40 con 0x7fe414158cd0 2023-10-06T04:39:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe4137fe700 1 --2- 172.21.15.37:0/3110159560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe414158cd0 0x7fe4140c9bd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe4140699c0 tx=0x7fe404009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd48ec5a4836725 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe4127fc700 1 -- 172.21.15.37:0/3110159560 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40400b640 con 0x7fe414158cd0 2023-10-06T04:39:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe4127fc700 1 -- 172.21.15.37:0/3110159560 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40400b7a0 con 0x7fe414158cd0 2023-10-06T04:39:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe4127fc700 1 -- 172.21.15.37:0/3110159560 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40400bb60 con 0x7fe414158cd0 2023-10-06T04:39:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe418d3f700 1 -- 172.21.15.37:0/3110159560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe414158cd0 msgr2=0x7fe4140c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.285+0000 7fe418d3f700 1 --2- 172.21.15.37:0/3110159560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe414158cd0 0x7fe4140c9bd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe4140699c0 tx=0x7fe404009250 comp rx=0 tx=0).stop 2023-10-06T04:39:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 -- 172.21.15.37:0/3110159560 shutdown_connections 2023-10-06T04:39:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 --2- 172.21.15.37:0/3110159560 >> v2:172.21.15.83:3300/0 conn(0x7fe4141590a0 0x7fe41415cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 --2- 172.21.15.37:0/3110159560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe41415d6f0 0x7fe41415cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 --2- 172.21.15.37:0/3110159560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe414158cd0 0x7fe4140c9bd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 -- 172.21.15.37:0/3110159560 >> 172.21.15.37:0/3110159560 conn(0x7fe4140cc000 msgr2=0x7fe4140cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 -- 172.21.15.37:0/3110159560 shutdown_connections 2023-10-06T04:39:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 -- 172.21.15.37:0/3110159560 wait complete. 2023-10-06T04:39:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 Processor -- start 2023-10-06T04:39:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 -- start start 2023-10-06T04:39:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe414158cd0 0x7fe41414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4141590a0 0x7fe414142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414157670 0x7fe4140c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe414143040 con 0x7fe4141590a0 2023-10-06T04:39:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41415b720 con 0x7fe414157670 2023-10-06T04:39:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe414157b10 con 0x7fe414158cd0 2023-10-06T04:39:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe412ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4141590a0 0x7fe414142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe4137fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe414158cd0 0x7fe41414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe413fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414157670 0x7fe4140c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe4137fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe414158cd0 0x7fe41414fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:46538/0 (socket says 172.21.15.37:46538) 2023-10-06T04:39:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe4137fe700 1 -- 172.21.15.37:0/3985105932 learned_addr learned my addr 172.21.15.37:0/3985105932 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe413fff700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414157670 0x7fe4140c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:53392/0 (socket says 172.21.15.37:53392) 2023-10-06T04:39:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe413fff700 1 -- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe414158cd0 msgr2=0x7fe41414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe413fff700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe414158cd0 0x7fe41414fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe413fff700 1 -- 172.21.15.37:0/3985105932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4141590a0 msgr2=0x7fe414142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe413fff700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4141590a0 0x7fe414142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe413fff700 1 -- 172.21.15.37:0/3985105932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4040094f0 con 0x7fe414157670 2023-10-06T04:39:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe4137fe700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe414158cd0 0x7fe41414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe412ffd700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4141590a0 0x7fe414142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe413fff700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414157670 0x7fe4140c68c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009e50 tx=0x7fe40c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe3fb7fe700 1 -- 172.21.15.37:0/3985105932 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00caa0 con 0x7fe414157670 2023-10-06T04:39:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe3fb7fe700 1 -- 172.21.15.37:0/3985105932 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c00f040 con 0x7fe414157670 2023-10-06T04:39:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe418d3f700 1 -- 172.21.15.37:0/3985105932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41415b9a0 con 0x7fe414157670 2023-10-06T04:39:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.289+0000 7fe3fb7fe700 1 -- 172.21.15.37:0/3985105932 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00ce50 con 0x7fe414157670 2023-10-06T04:39:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.293+0000 7fe418d3f700 1 -- 172.21.15.37:0/3985105932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41415bf60 con 0x7fe414157670 2023-10-06T04:39:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.293+0000 7fe418d3f700 1 -- 172.21.15.37:0/3985105932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41404be00 con 0x7fe414157670 2023-10-06T04:39:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.293+0000 7fe3fb7fe700 1 -- 172.21.15.37:0/3985105932 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe40c014690 con 0x7fe414157670 2023-10-06T04:39:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.293+0000 7fe3fb7fe700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe400060550 0x7fe400062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.293+0000 7fe3fb7fe700 1 -- 172.21.15.37:0/3985105932 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe40c07d210 con 0x7fe414157670 2023-10-06T04:39:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.293+0000 7fe4137fe700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe400060550 0x7fe400062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.297+0000 7fe4137fe700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe400060550 0x7fe400062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe404003080 tx=0x7fe404017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:08.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.305+0000 7fe3fb7fe700 1 -- 172.21.15.37:0/3985105932 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe40c051480 con 0x7fe414157670 2023-10-06T04:39:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.469+0000 7fe418d3f700 1 -- 172.21.15.37:0/3985105932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe414066a50 con 0x7fe414157670 2023-10-06T04:39:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.745+0000 7fe3fb7fe700 1 -- 172.21.15.37:0/3985105932 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe40c051010 con 0x7fe414157670 2023-10-06T04:39:08.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.753+0000 7fe418d3f700 1 -- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe400060550 msgr2=0x7fe400062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:08.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.753+0000 7fe418d3f700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe400060550 0x7fe400062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe404003080 tx=0x7fe404017000 comp rx=0 tx=0).stop 2023-10-06T04:39:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.753+0000 7fe418d3f700 1 -- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414157670 msgr2=0x7fe4140c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.753+0000 7fe418d3f700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414157670 0x7fe4140c68c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009e50 tx=0x7fe40c00b040 comp rx=0 tx=0).stop 2023-10-06T04:39:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.753+0000 7fe418d3f700 1 -- 172.21.15.37:0/3985105932 shutdown_connections 2023-10-06T04:39:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.753+0000 7fe418d3f700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe400060550 0x7fe400062a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.753+0000 7fe418d3f700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414157670 0x7fe4140c68c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.753+0000 7fe418d3f700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4141590a0 0x7fe414142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.753+0000 7fe418d3f700 1 --2- 172.21.15.37:0/3985105932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe414158cd0 0x7fe41414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.753+0000 7fe418d3f700 1 -- 172.21.15.37:0/3985105932 >> 172.21.15.37:0/3985105932 conn(0x7fe4140cc000 msgr2=0x7fe41415ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.753+0000 7fe418d3f700 1 -- 172.21.15.37:0/3985105932 shutdown_connections 2023-10-06T04:39:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.753+0000 7fe418d3f700 1 -- 172.21.15.37:0/3985105932 wait complete. 2023-10-06T04:39:08.761 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-10-06T04:39:08.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-06T04:39:08.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.877+0000 7f7fc10b2700 1 Processor -- start 2023-10-06T04:39:08.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fc10b2700 1 -- start start 2023-10-06T04:39:08.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fc10b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fbc0aac00 0x7f7fbc15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fc10b2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7fbc15adb0 0x7f7fbc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fc10b2700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fbc0cc170 con 0x7f7fbc156bb0 2023-10-06T04:39:08.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fc10b2700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fbc0acfc0 con 0x7f7fbc15adb0 2023-10-06T04:39:08.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fc10b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0c99b0 con 0x7f7fbc0aac00 2023-10-06T04:39:08.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fbb59e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7fbc15adb0 0x7f7fbc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fbad9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7fbc156bb0 0x7f7fbc0c8cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42890/0 (socket says 172.21.15.37:42890) 2023-10-06T04:39:08.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fbad9d700 1 -- 172.21.15.37:0/1751191627 learned_addr learned my addr 172.21.15.37:0/1751191627 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:08.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fb3fff700 1 --2- 172.21.15.37:0/1751191627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fbc0aac00 0x7f7fbc15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fbb59e700 1 -- 172.21.15.37:0/1751191627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fbc0aac00 msgr2=0x7f7fbc15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:08.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fbb59e700 1 --2- 172.21.15.37:0/1751191627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fbc0aac00 0x7f7fbc15a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fbb59e700 1 -- 172.21.15.37:0/1751191627 >> v1:172.21.15.37:6789/0 conn(0x7f7fbc156bb0 legacy=0x7f7fbc0c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:08.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fbb59e700 1 -- 172.21.15.37:0/1751191627 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc0cb840 con 0x7f7fbc15adb0 2023-10-06T04:39:08.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fb3fff700 1 --2- 172.21.15.37:0/1751191627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fbc0aac00 0x7f7fbc15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fbb59e700 1 --2- 172.21.15.37:0/1751191627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fbc15adb0 0x7f7fbc0cc600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009e60 tx=0x7f7fb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467a38ab6a5572f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fba59c700 1 -- 172.21.15.37:0/1751191627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb400e070 con 0x7f7fbc15adb0 2023-10-06T04:39:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fba59c700 1 -- 172.21.15.37:0/1751191627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb400bc30 con 0x7f7fbc15adb0 2023-10-06T04:39:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fba59c700 1 -- 172.21.15.37:0/1751191627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4012430 con 0x7f7fbc15adb0 2023-10-06T04:39:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fc10b2700 1 -- 172.21.15.37:0/1751191627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fbc15adb0 msgr2=0x7f7fbc0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fc10b2700 1 --2- 172.21.15.37:0/1751191627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fbc15adb0 0x7f7fbc0cc600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009e60 tx=0x7f7fb4009780 comp rx=0 tx=0).stop 2023-10-06T04:39:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fc10b2700 1 -- 172.21.15.37:0/1751191627 shutdown_connections 2023-10-06T04:39:08.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fc10b2700 1 --2- 172.21.15.37:0/1751191627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fbc15adb0 0x7f7fbc0cc600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.881+0000 7f7fc10b2700 1 --2- 172.21.15.37:0/1751191627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fbc0aac00 0x7f7fbc15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.885+0000 7f7fc10b2700 1 -- 172.21.15.37:0/1751191627 >> 172.21.15.37:0/1751191627 conn(0x7f7fbc0870c0 msgr2=0x7f7fbc066f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:08.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.885+0000 7f7fc10b2700 1 -- 172.21.15.37:0/1751191627 shutdown_connections 2023-10-06T04:39:08.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.885+0000 7f7fc10b2700 1 -- 172.21.15.37:0/1751191627 wait complete. 2023-10-06T04:39:08.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.885+0000 7f7fc10b2700 1 Processor -- start 2023-10-06T04:39:08.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.885+0000 7f7fc10b2700 1 -- start start 2023-10-06T04:39:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fc10b2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fbc0aac00 0x7f7fbc0c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fc10b2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fbc156bb0 0x7f7fbc155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fc10b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fbc15adb0 0x7f7fbc0ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fc10b2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc156190 con 0x7f7fbc156bb0 2023-10-06T04:39:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fc10b2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0b0d50 con 0x7f7fbc0aac00 2023-10-06T04:39:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fc10b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0b1890 con 0x7f7fbc15adb0 2023-10-06T04:39:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fb3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fbc156bb0 0x7f7fbc155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fb3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fbc156bb0 0x7f7fbc155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57906/0 (socket says 172.21.15.37:57906) 2023-10-06T04:39:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fb3fff700 1 -- 172.21.15.37:0/500193843 learned_addr learned my addr 172.21.15.37:0/500193843 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fbad9d700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fbc0aac00 0x7f7fbc0c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fbb59e700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fbc15adb0 0x7f7fbc0ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fb3fff700 1 -- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fbc15adb0 msgr2=0x7f7fbc0ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fb3fff700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fbc15adb0 0x7f7fbc0ab0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fb3fff700 1 -- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fbc0aac00 msgr2=0x7f7fbc0c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fb3fff700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fbc0aac00 0x7f7fbc0c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fb3fff700 1 -- 172.21.15.37:0/500193843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4009a20 con 0x7f7fbc156bb0 2023-10-06T04:39:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fb3fff700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fbc156bb0 0x7f7fbc155c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400e8d0 tx=0x7f7fa4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fb2ffd700 1 -- 172.21.15.37:0/500193843 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4013410 con 0x7f7fbc156bb0 2023-10-06T04:39:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fb2ffd700 1 -- 172.21.15.37:0/500193843 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa4013570 con 0x7f7fbc156bb0 2023-10-06T04:39:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fc10b2700 1 -- 172.21.15.37:0/500193843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fbc0b0f60 con 0x7f7fbc156bb0 2023-10-06T04:39:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fb2ffd700 1 -- 172.21.15.37:0/500193843 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4013910 con 0x7f7fbc156bb0 2023-10-06T04:39:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.889+0000 7f7fc10b2700 1 -- 172.21.15.37:0/500193843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fbc0b1520 con 0x7f7fbc156bb0 2023-10-06T04:39:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.893+0000 7f7fc10b2700 1 -- 172.21.15.37:0/500193843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fbc0b1a40 con 0x7f7fbc156bb0 2023-10-06T04:39:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.893+0000 7f7fb2ffd700 1 -- 172.21.15.37:0/500193843 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7fa4013d00 con 0x7f7fbc156bb0 2023-10-06T04:39:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.893+0000 7f7fb2ffd700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7fa0060550 0x7f7fa0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.893+0000 7f7fb2ffd700 1 -- 172.21.15.37:0/500193843 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f7fa407c460 con 0x7f7fbc156bb0 2023-10-06T04:39:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.893+0000 7f7fbad9d700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7fa0060550 0x7f7fa0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.893+0000 7f7fbad9d700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7fa0060550 0x7f7fa0062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc06d8e0 tx=0x7f7fac009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:08.897+0000 7f7fb2ffd700 1 -- 172.21.15.37:0/500193843 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7fbc0b1a40 con 0x7f7fbc156bb0 2023-10-06T04:39:09.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.061+0000 7f7fc10b2700 1 -- 172.21.15.37:0/500193843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f7fbc0b1a00 con 0x7f7fbc156bb0 2023-10-06T04:39:09.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.749+0000 7f7fb2ffd700 1 -- 172.21.15.37:0/500193843 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7fa404cad0 con 0x7f7fbc156bb0 2023-10-06T04:39:09.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.773+0000 7f7fc10b2700 1 -- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7fa0060550 msgr2=0x7f7fa0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:09.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.773+0000 7f7fc10b2700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7fa0060550 0x7f7fa0062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc06d8e0 tx=0x7f7fac009040 comp rx=0 tx=0).stop 2023-10-06T04:39:09.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.773+0000 7f7fc10b2700 1 -- 172.21.15.37:0/500193843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fbc156bb0 msgr2=0x7f7fbc155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:09.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.773+0000 7f7fc10b2700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fbc156bb0 0x7f7fbc155c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400e8d0 tx=0x7f7fa4008040 comp rx=0 tx=0).stop 2023-10-06T04:39:09.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.773+0000 7f7fc10b2700 1 -- 172.21.15.37:0/500193843 shutdown_connections 2023-10-06T04:39:09.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.773+0000 7f7fc10b2700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7fa0060550 0x7f7fa0062a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:09.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.773+0000 7f7fc10b2700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fbc15adb0 0x7f7fbc0ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:09.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.773+0000 7f7fc10b2700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fbc156bb0 0x7f7fbc155c50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:09.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.773+0000 7f7fc10b2700 1 --2- 172.21.15.37:0/500193843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fbc0aac00 0x7f7fbc0c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:09.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.773+0000 7f7fc10b2700 1 -- 172.21.15.37:0/500193843 >> 172.21.15.37:0/500193843 conn(0x7f7fbc0870c0 msgr2=0x7f7fbc066f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.773+0000 7f7fc10b2700 1 -- 172.21.15.37:0/500193843 shutdown_connections 2023-10-06T04:39:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.773+0000 7f7fc10b2700 1 -- 172.21.15.37:0/500193843 wait complete. 2023-10-06T04:39:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-10-06T04:39:09.791 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:39:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4bff2700 1 Processor -- start 2023-10-06T04:39:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4bff2700 1 -- start start 2023-10-06T04:39:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4bff2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5c44153400 0x7f5c44069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4bff2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c441537d0 0x7f5c44069970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4bff2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c440b41e0 0x7f5c440b4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4bff2700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4415a680 con 0x7f5c441537d0 2023-10-06T04:39:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4bff2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c440b5a60 con 0x7f5c44153400 2023-10-06T04:39:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4bff2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c440b4b80 con 0x7f5c440b41e0 2023-10-06T04:39:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4958d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c441537d0 0x7f5c44069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4958d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c441537d0 0x7f5c44069970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60262/0 (socket says 172.21.15.37:60262) 2023-10-06T04:39:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4958d700 1 -- 172.21.15.37:0/2142425059 learned_addr learned my addr 172.21.15.37:0/2142425059 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4a58f700 1 --2- 172.21.15.37:0/2142425059 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c440b41e0 0x7f5c440b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c49d8e700 1 --2- 172.21.15.37:0/2142425059 >> v2:172.21.15.83:3300/0 conn(0x7f5c44153400 0x7f5c44069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4958d700 1 -- 172.21.15.37:0/2142425059 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c440b41e0 msgr2=0x7f5c440b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4958d700 1 --2- 172.21.15.37:0/2142425059 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c440b41e0 0x7f5c440b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4958d700 1 -- 172.21.15.37:0/2142425059 >> v2:172.21.15.83:3300/0 conn(0x7f5c44153400 msgr2=0x7f5c44069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4958d700 1 --2- 172.21.15.37:0/2142425059 >> v2:172.21.15.83:3300/0 conn(0x7f5c44153400 0x7f5c44069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4958d700 1 -- 172.21.15.37:0/2142425059 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44159950 con 0x7f5c441537d0 2023-10-06T04:39:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.897+0000 7f5c4958d700 1 --2- 172.21.15.37:0/2142425059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c441537d0 0x7f5c44069970 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c44088150 tx=0x7f5c34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5130151e92b61031 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c48d8c700 1 -- 172.21.15.37:0/2142425059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34009e70 con 0x7f5c441537d0 2023-10-06T04:39:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c48d8c700 1 -- 172.21.15.37:0/2142425059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3400b860 con 0x7f5c441537d0 2023-10-06T04:39:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c48d8c700 1 -- 172.21.15.37:0/2142425059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3400bc00 con 0x7f5c441537d0 2023-10-06T04:39:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c4bff2700 1 -- 172.21.15.37:0/2142425059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c441537d0 msgr2=0x7f5c44069970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c4bff2700 1 --2- 172.21.15.37:0/2142425059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c441537d0 0x7f5c44069970 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c44088150 tx=0x7f5c34009250 comp rx=0 tx=0).stop 2023-10-06T04:39:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c4bff2700 1 -- 172.21.15.37:0/2142425059 shutdown_connections 2023-10-06T04:39:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c4bff2700 1 --2- 172.21.15.37:0/2142425059 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c440b41e0 0x7f5c440b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c4bff2700 1 --2- 172.21.15.37:0/2142425059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c441537d0 0x7f5c44069970 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c4bff2700 1 --2- 172.21.15.37:0/2142425059 >> v2:172.21.15.83:3300/0 conn(0x7f5c44153400 0x7f5c44069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c4bff2700 1 -- 172.21.15.37:0/2142425059 >> 172.21.15.37:0/2142425059 conn(0x7f5c44067cf0 msgr2=0x7f5c440680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:09.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c4bff2700 1 -- 172.21.15.37:0/2142425059 shutdown_connections 2023-10-06T04:39:09.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c4bff2700 1 -- 172.21.15.37:0/2142425059 wait complete. 2023-10-06T04:39:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c4bff2700 1 Processor -- start 2023-10-06T04:39:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.901+0000 7f5c4bff2700 1 -- start start 2023-10-06T04:39:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4bff2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440b41e0 0x7f5c4415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4bff2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c44153400 0x7f5c4415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4bff2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c441537d0 0x7f5c4415c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4bff2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c44158f10 con 0x7f5c440b41e0 2023-10-06T04:39:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4bff2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4413f3d0 con 0x7f5c441537d0 2023-10-06T04:39:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4bff2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4413e7c0 con 0x7f5c44153400 2023-10-06T04:39:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c49d8e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440b41e0 0x7f5c4415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c49d8e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440b41e0 0x7f5c4415d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60272/0 (socket says 172.21.15.37:60272) 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c49d8e700 1 -- 172.21.15.37:0/3408684329 learned_addr learned my addr 172.21.15.37:0/3408684329 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4958d700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c44153400 0x7f5c4415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4a58f700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c441537d0 0x7f5c4415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4958d700 1 -- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c441537d0 msgr2=0x7f5c4415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4958d700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c441537d0 0x7f5c4415c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4958d700 1 -- 172.21.15.37:0/3408684329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440b41e0 msgr2=0x7f5c4415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4958d700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440b41e0 0x7f5c4415d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4958d700 1 -- 172.21.15.37:0/3408684329 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340094f0 con 0x7f5c44153400 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c49d8e700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440b41e0 0x7f5c4415d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4958d700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c44153400 0x7f5c4415c3d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5c44089270 tx=0x7f5c34017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c39ffb700 1 -- 172.21.15.37:0/3408684329 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3400bbe0 con 0x7f5c44153400 2023-10-06T04:39:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c39ffb700 1 -- 172.21.15.37:0/3408684329 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34000c90 con 0x7f5c44153400 2023-10-06T04:39:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4bff2700 1 -- 172.21.15.37:0/3408684329 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4413eaa0 con 0x7f5c44153400 2023-10-06T04:39:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c39ffb700 1 -- 172.21.15.37:0/3408684329 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34025670 con 0x7f5c44153400 2023-10-06T04:39:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.905+0000 7f5c4bff2700 1 -- 172.21.15.37:0/3408684329 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4413f060 con 0x7f5c44153400 2023-10-06T04:39:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.909+0000 7f5c4bff2700 1 -- 172.21.15.37:0/3408684329 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4413f560 con 0x7f5c44153400 2023-10-06T04:39:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.909+0000 7f5c39ffb700 1 -- 172.21.15.37:0/3408684329 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5c3402e440 con 0x7f5c44153400 2023-10-06T04:39:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.909+0000 7f5c39ffb700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5c28060550 0x7f5c28062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.909+0000 7f5c39ffb700 1 -- 172.21.15.37:0/3408684329 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f5c3407e400 con 0x7f5c44153400 2023-10-06T04:39:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.909+0000 7f5c49d8e700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5c28060550 0x7f5c28062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.913+0000 7f5c49d8e700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5c28060550 0x7f5c28062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5c40006fd0 tx=0x7f5c40008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:09.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:09.921+0000 7f5c39ffb700 1 -- 172.21.15.37:0/3408684329 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5c3404e8f0 con 0x7f5c44153400 2023-10-06T04:39:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.121+0000 7f5c4bff2700 1 -- 172.21.15.37:0/3408684329 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5c44070ee0 con 0x7f5c44153400 2023-10-06T04:39:10.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.777+0000 7f5c39ffb700 1 -- 172.21.15.37:0/3408684329 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5c34051f10 con 0x7f5c44153400 2023-10-06T04:39:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.781+0000 7f5c4bff2700 1 -- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5c28060550 msgr2=0x7f5c28062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.781+0000 7f5c4bff2700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5c28060550 0x7f5c28062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5c40006fd0 tx=0x7f5c40008040 comp rx=0 tx=0).stop 2023-10-06T04:39:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.781+0000 7f5c4bff2700 1 -- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c44153400 msgr2=0x7f5c4415c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.781+0000 7f5c4bff2700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c44153400 0x7f5c4415c3d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5c44089270 tx=0x7f5c34017000 comp rx=0 tx=0).stop 2023-10-06T04:39:10.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.781+0000 7f5c4bff2700 1 -- 172.21.15.37:0/3408684329 shutdown_connections 2023-10-06T04:39:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.781+0000 7f5c4bff2700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5c28060550 0x7f5c28062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.781+0000 7f5c4bff2700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c441537d0 0x7f5c4415c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.781+0000 7f5c4bff2700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c44153400 0x7f5c4415c3d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.781+0000 7f5c4bff2700 1 --2- 172.21.15.37:0/3408684329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440b41e0 0x7f5c4415d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.781+0000 7f5c4bff2700 1 -- 172.21.15.37:0/3408684329 >> 172.21.15.37:0/3408684329 conn(0x7f5c44067cf0 msgr2=0x7f5c441525c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.785+0000 7f5c4bff2700 1 -- 172.21.15.37:0/3408684329 shutdown_connections 2023-10-06T04:39:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.785+0000 7f5c4bff2700 1 -- 172.21.15.37:0/3408684329 wait complete. 2023-10-06T04:39:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T04:39:10.816 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-06T04:39:10.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-06T04:39:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb9044700 1 Processor -- start 2023-10-06T04:39:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb9044700 1 -- start start 2023-10-06T04:39:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb9044700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cb4159fd0 0x7f2cb40afe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb9044700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb40b0450 con 0x7f2cb40ccc70 2023-10-06T04:39:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb9044700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb415d290 con 0x7f2cb4158bf0 2023-10-06T04:39:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb9044700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb415d720 con 0x7f2cb4159fd0 2023-10-06T04:39:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cab7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2cb40ccc70 0x7f2cb40af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54930/0 (socket says 172.21.15.37:54930) 2023-10-06T04:39:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cab7fe700 1 -- 172.21.15.37:0/3177144289 learned_addr learned my addr 172.21.15.37:0/3177144289 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb8843700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cb4159fd0 0x7f2cb40afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:10.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169867528 0 0) 0x7f2c9c001110 con 0x7f2cb40ccc70 2023-10-06T04:39:10.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca0003570 con 0x7f2cb40ccc70 2023-10-06T04:39:10.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832872458 0 0) 0x7f2cb415d290 con 0x7f2cb4158bf0 2023-10-06T04:39:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c9c001110 con 0x7f2cb4158bf0 2023-10-06T04:39:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3894147501 0 0) 0x7f2ca0003570 con 0x7f2cb40ccc70 2023-10-06T04:39:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cb4159fd0 msgr2=0x7f2cb40afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cb4159fd0 0x7f2cb40afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 >> v1:172.21.15.83:6789/0 conn(0x7f2cb4158bf0 legacy=0x7f2cb40cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb415c960 con 0x7f2cb40ccc70 2023-10-06T04:39:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f2c9c001600 con 0x7f2cb40ccc70 2023-10-06T04:39:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 >> v1:172.21.15.37:6789/0 conn(0x7f2cb40ccc70 legacy=0x7f2cb40af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ca0003c20 0x7f2ca0003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca0004810 0x7f2ca0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00051c0 0x7f2ca000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb415d720 con 0x7f2ca00051c0 2023-10-06T04:39:10.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca000bfd0 con 0x7f2ca0004810 2023-10-06T04:39:10.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca000c190 con 0x7f2ca0003c20 2023-10-06T04:39:10.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cab7fe700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca0004810 0x7f2ca0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:10.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.921+0000 7f2cb8843700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00051c0 0x7f2ca000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:10.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cb3fff700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ca0003c20 0x7f2ca0003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:10.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cab7fe700 1 -- 172.21.15.37:0/3177144289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ca0003c20 msgr2=0x7f2ca0003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:10.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cab7fe700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ca0003c20 0x7f2ca0003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:10.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cab7fe700 1 -- 172.21.15.37:0/3177144289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00051c0 msgr2=0x7f2ca000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:10.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cab7fe700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00051c0 0x7f2ca000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:10.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cab7fe700 1 -- 172.21.15.37:0/3177144289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0003570 con 0x7f2ca0004810 2023-10-06T04:39:10.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cb8843700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00051c0 0x7f2ca000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:10.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cab7fe700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca0004810 0x7f2ca0004c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40cd070 tx=0x7f2c9c007940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9b3415828449ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:10.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c00cbf0 con 0x7f2ca0004810 2023-10-06T04:39:10.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c00cd50 con 0x7f2ca0004810 2023-10-06T04:39:10.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cb37fe700 1 -- 172.21.15.37:0/3177144289 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c005b70 con 0x7f2ca0004810 2023-10-06T04:39:10.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cb9044700 1 -- 172.21.15.37:0/3177144289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca0004810 msgr2=0x7f2ca0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:10.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cb9044700 1 --2- 172.21.15.37:0/3177144289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca0004810 0x7f2ca0004c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40cd070 tx=0x7f2c9c007940 comp rx=0 tx=0).stop 2023-10-06T04:39:10.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cb8843700 1 -- 172.21.15.37:0/3177144289 reap_dead start 2023-10-06T04:39:10.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cb9044700 1 -- 172.21.15.37:0/3177144289 shutdown_connections 2023-10-06T04:39:10.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cb9044700 1 -- 172.21.15.37:0/3177144289 >> 172.21.15.37:0/3177144289 conn(0x7f2cb4067cf0 msgr2=0x7f2cb40680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:10.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cb9044700 1 -- 172.21.15.37:0/3177144289 shutdown_connections 2023-10-06T04:39:10.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.925+0000 7f2cb9044700 1 -- 172.21.15.37:0/3177144289 wait complete. 2023-10-06T04:39:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cb9044700 1 Processor -- start 2023-10-06T04:39:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cb9044700 1 -- start start 2023-10-06T04:39:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cb9044700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca0004810 0x7f2cb40c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cb9044700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cb415b0f0 0x7f2cb4146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cb9044700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb40c9f60 0x7f2cb40ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cb9044700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40ca900 con 0x7f2cb40c9f60 2023-10-06T04:39:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cb9044700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40c7f40 con 0x7f2ca0004810 2023-10-06T04:39:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cb9044700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40c8220 con 0x7f2cb415b0f0 2023-10-06T04:39:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cb8843700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb40c9f60 0x7f2cb40ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cb8843700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb40c9f60 0x7f2cb40ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60284/0 (socket says 172.21.15.37:60284) 2023-10-06T04:39:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cb8843700 1 -- 172.21.15.37:0/4044009776 learned_addr learned my addr 172.21.15.37:0/4044009776 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cab7fe700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cb415b0f0 0x7f2cb4146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.929+0000 7f2cb3fff700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca0004810 0x7f2cb40c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb8843700 1 -- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cb415b0f0 msgr2=0x7f2cb4146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb8843700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cb415b0f0 0x7f2cb4146e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:10.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb8843700 1 -- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca0004810 msgr2=0x7f2cb40c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:10.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb8843700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca0004810 0x7f2cb40c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:10.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb8843700 1 -- 172.21.15.37:0/4044009776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb415b8b0 con 0x7f2cb40c9f60 2023-10-06T04:39:10.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb8843700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb40c9f60 0x7f2cb40ca3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4088ee0 tx=0x7f2cac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:10.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb0ff9700 1 -- 172.21.15.37:0/4044009776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac00e050 con 0x7f2cb40c9f60 2023-10-06T04:39:10.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb0ff9700 1 -- 172.21.15.37:0/4044009776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac00f040 con 0x7f2cb40c9f60 2023-10-06T04:39:10.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb9044700 1 -- 172.21.15.37:0/4044009776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb415bb90 con 0x7f2cb40c9f60 2023-10-06T04:39:10.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb0ff9700 1 -- 172.21.15.37:0/4044009776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac010d40 con 0x7f2cb40c9f60 2023-10-06T04:39:10.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb9044700 1 -- 172.21.15.37:0/4044009776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb415b560 con 0x7f2cb40c9f60 2023-10-06T04:39:10.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb9044700 1 -- 172.21.15.37:0/4044009776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb40c83d0 con 0x7f2cb40c9f60 2023-10-06T04:39:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.933+0000 7f2cb0ff9700 1 -- 172.21.15.37:0/4044009776 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2cac003020 con 0x7f2cb40c9f60 2023-10-06T04:39:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.937+0000 7f2cb0ff9700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2c94060550 0x7f2c94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.937+0000 7f2cb0ff9700 1 -- 172.21.15.37:0/4044009776 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2cac07cc00 con 0x7f2cb40c9f60 2023-10-06T04:39:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.937+0000 7f2cb3fff700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2c94060550 0x7f2c94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.937+0000 7f2cb3fff700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2c94060550 0x7f2c94062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4003a60 tx=0x7f2ca4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:10.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:10.941+0000 7f2cb0ff9700 1 -- 172.21.15.37:0/4044009776 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2cb40c83d0 con 0x7f2cb40c9f60 2023-10-06T04:39:11.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.113+0000 7f2cb9044700 1 -- 172.21.15.37:0/4044009776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f2cb40c8390 con 0x7f2cb40c9f60 2023-10-06T04:39:11.748 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-10-06T04:39:11.745+0000 7f47a0927700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:39:11.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.777+0000 7f2cb0ff9700 1 -- 172.21.15.37:0/4044009776 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7f2cac083080 con 0x7f2cb40c9f60 2023-10-06T04:39:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.781+0000 7f2cb9044700 1 -- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2c94060550 msgr2=0x7f2c94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.781+0000 7f2cb9044700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2c94060550 0x7f2c94062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4003a60 tx=0x7f2ca4009040 comp rx=0 tx=0).stop 2023-10-06T04:39:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.781+0000 7f2cb9044700 1 -- 172.21.15.37:0/4044009776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb40c9f60 msgr2=0x7f2cb40ca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.781+0000 7f2cb9044700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb40c9f60 0x7f2cb40ca3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4088ee0 tx=0x7f2cac00b040 comp rx=0 tx=0).stop 2023-10-06T04:39:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.781+0000 7f2cb9044700 1 -- 172.21.15.37:0/4044009776 shutdown_connections 2023-10-06T04:39:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.781+0000 7f2cb9044700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2c94060550 0x7f2c94062a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.781+0000 7f2cb9044700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb40c9f60 0x7f2cb40ca3c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.781+0000 7f2cb9044700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cb415b0f0 0x7f2cb4146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.781+0000 7f2cb9044700 1 --2- 172.21.15.37:0/4044009776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca0004810 0x7f2cb40c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.781+0000 7f2cb9044700 1 -- 172.21.15.37:0/4044009776 >> 172.21.15.37:0/4044009776 conn(0x7f2cb4067cf0 msgr2=0x7f2cb4157f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.781+0000 7f2cb9044700 1 -- 172.21.15.37:0/4044009776 shutdown_connections 2023-10-06T04:39:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.781+0000 7f2cb9044700 1 -- 172.21.15.37:0/4044009776 wait complete. 2023-10-06T04:39:11.800 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:39:11.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.913+0000 7f7299fc5700 1 Processor -- start 2023-10-06T04:39:11.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.913+0000 7f7299fc5700 1 -- start start 2023-10-06T04:39:11.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7294158850 0x7f729415d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:11.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72940b1910 0x7f72940b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:11.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729415cee0 con 0x7f729415a3a0 2023-10-06T04:39:11.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7294159de0 con 0x7f72940b1910 2023-10-06T04:39:11.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729415a0c0 con 0x7f7294158850 2023-10-06T04:39:11.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7293fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72940b1910 0x7f72940b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:11.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7293fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72940b1910 0x7f72940b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60288/0 (socket says 172.21.15.37:60288) 2023-10-06T04:39:11.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7293fff700 1 -- 172.21.15.37:0/908689550 learned_addr learned my addr 172.21.15.37:0/908689550 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:11.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7298fc3700 1 --2- 172.21.15.37:0/908689550 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7294158850 0x7f729415d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7293fff700 1 -- 172.21.15.37:0/908689550 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7294158850 msgr2=0x7f729415d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7293fff700 1 --2- 172.21.15.37:0/908689550 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7294158850 0x7f729415d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7293fff700 1 -- 172.21.15.37:0/908689550 >> v1:172.21.15.83:6789/0 conn(0x7f729415a3a0 legacy=0x7f729415a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7293fff700 1 -- 172.21.15.37:0/908689550 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729415c890 con 0x7f72940b1910 2023-10-06T04:39:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7298fc3700 1 --2- 172.21.15.37:0/908689550 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7294158850 0x7f729415d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7293fff700 1 --2- 172.21.15.37:0/908689550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72940b1910 0x7f72940b1d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f72840099b0 tx=0x7f7284009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f81a70854093c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f72937fe700 1 -- 172.21.15.37:0/908689550 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728400b860 con 0x7f72940b1910 2023-10-06T04:39:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f72937fe700 1 -- 172.21.15.37:0/908689550 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728400b9c0 con 0x7f72940b1910 2023-10-06T04:39:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f72937fe700 1 -- 172.21.15.37:0/908689550 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728400bd60 con 0x7f72940b1910 2023-10-06T04:39:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 -- 172.21.15.37:0/908689550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72940b1910 msgr2=0x7f72940b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 --2- 172.21.15.37:0/908689550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72940b1910 0x7f72940b1d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f72840099b0 tx=0x7f7284009250 comp rx=0 tx=0).stop 2023-10-06T04:39:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 -- 172.21.15.37:0/908689550 shutdown_connections 2023-10-06T04:39:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 --2- 172.21.15.37:0/908689550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72940b1910 0x7f72940b1d40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 --2- 172.21.15.37:0/908689550 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7294158850 0x7f729415d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 -- 172.21.15.37:0/908689550 >> 172.21.15.37:0/908689550 conn(0x7f7294067cf0 msgr2=0x7f72940680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 -- 172.21.15.37:0/908689550 shutdown_connections 2023-10-06T04:39:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.917+0000 7f7299fc5700 1 -- 172.21.15.37:0/908689550 wait complete. 2023-10-06T04:39:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7299fc5700 1 Processor -- start 2023-10-06T04:39:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7299fc5700 1 -- start start 2023-10-06T04:39:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7299fc5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72940b1910 0x7f729416a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7299fc5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7294158850 0x7f72940cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7299fc5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729415a3a0 0x7f72940cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7299fc5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7294155a50 con 0x7f72940b1910 2023-10-06T04:39:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7299fc5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7294169260 con 0x7f729415a3a0 2023-10-06T04:39:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7299fc5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72940c6ff0 con 0x7f7294158850 2023-10-06T04:39:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7298fc3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72940b1910 0x7f729416a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7298fc3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72940b1910 0x7f729416a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60304/0 (socket says 172.21.15.37:60304) 2023-10-06T04:39:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7293fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7294158850 0x7f72940cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7298fc3700 1 -- 172.21.15.37:0/4157944511 learned_addr learned my addr 172.21.15.37:0/4157944511 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f72997c4700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729415a3a0 0x7f72940cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:11.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7298fc3700 1 -- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7294158850 msgr2=0x7f72940cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:11.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7298fc3700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7294158850 0x7f72940cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:11.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7298fc3700 1 -- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729415a3a0 msgr2=0x7f72940cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:11.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7298fc3700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729415a3a0 0x7f72940cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:11.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7298fc3700 1 -- 172.21.15.37:0/4157944511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72840094f0 con 0x7f72940b1910 2023-10-06T04:39:11.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.921+0000 7f7298fc3700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72940b1910 0x7f729416a430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f728800e8d0 tx=0x7f7288008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:11.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.925+0000 7f7290ff9700 1 -- 172.21.15.37:0/4157944511 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288013410 con 0x7f72940b1910 2023-10-06T04:39:11.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.925+0000 7f7290ff9700 1 -- 172.21.15.37:0/4157944511 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7288013570 con 0x7f72940b1910 2023-10-06T04:39:11.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.925+0000 7f7299fc5700 1 -- 172.21.15.37:0/4157944511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72940c72d0 con 0x7f72940b1910 2023-10-06T04:39:11.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.925+0000 7f7290ff9700 1 -- 172.21.15.37:0/4157944511 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288013910 con 0x7f72940b1910 2023-10-06T04:39:11.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.925+0000 7f7299fc5700 1 -- 172.21.15.37:0/4157944511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72940c7890 con 0x7f72940b1910 2023-10-06T04:39:11.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.925+0000 7f7299fc5700 1 -- 172.21.15.37:0/4157944511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7294070ee0 con 0x7f72940b1910 2023-10-06T04:39:11.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.925+0000 7f7290ff9700 1 -- 172.21.15.37:0/4157944511 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7288013d00 con 0x7f72940b1910 2023-10-06T04:39:11.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.929+0000 7f7290ff9700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7280060550 0x7f7280062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:11.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.929+0000 7f7290ff9700 1 -- 172.21.15.37:0/4157944511 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6284+0+0 (secure 0 0 0) 0x7f728807c720 con 0x7f72940b1910 2023-10-06T04:39:11.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.929+0000 7f7293fff700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7280060550 0x7f7280062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.929+0000 7f7293fff700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7280060550 0x7f7280062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72840099b0 tx=0x7f7284017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:11.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:11.933+0000 7f7290ff9700 1 -- 172.21.15.37:0/4157944511 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f728804cad0 con 0x7f72940b1910 2023-10-06T04:39:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:12.097+0000 7f7299fc5700 1 -- 172.21.15.37:0/4157944511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f729415cb70 con 0x7f72940b1910 2023-10-06T04:39:12.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:39:12.796 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:39:13.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.833+0000 7f7290ff9700 1 -- 172.21.15.37:0/4157944511 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7f72880500f0 con 0x7f72940b1910 2023-10-06T04:39:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.849+0000 7f7299fc5700 1 -- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7280060550 msgr2=0x7f7280062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.849+0000 7f7299fc5700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7280060550 0x7f7280062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72840099b0 tx=0x7f7284017000 comp rx=0 tx=0).stop 2023-10-06T04:39:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.849+0000 7f7299fc5700 1 -- 172.21.15.37:0/4157944511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72940b1910 msgr2=0x7f729416a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.849+0000 7f7299fc5700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72940b1910 0x7f729416a430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f728800e8d0 tx=0x7f7288008040 comp rx=0 tx=0).stop 2023-10-06T04:39:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.849+0000 7f7299fc5700 1 -- 172.21.15.37:0/4157944511 shutdown_connections 2023-10-06T04:39:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.849+0000 7f7299fc5700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7280060550 0x7f7280062a00 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72840099b0 tx=0x7f7284017000 comp rx=0 tx=0).stop 2023-10-06T04:39:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.849+0000 7f7299fc5700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729415a3a0 0x7f72940cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.849+0000 7f7299fc5700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7294158850 0x7f72940cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.849+0000 7f7299fc5700 1 --2- 172.21.15.37:0/4157944511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72940b1910 0x7f729416a430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.849+0000 7f7299fc5700 1 -- 172.21.15.37:0/4157944511 >> 172.21.15.37:0/4157944511 conn(0x7f7294067cf0 msgr2=0x7f729415bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.849+0000 7f7299fc5700 1 -- 172.21.15.37:0/4157944511 shutdown_connections 2023-10-06T04:39:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.849+0000 7f7299fc5700 1 -- 172.21.15.37:0/4157944511 wait complete. 2023-10-06T04:39:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' created 2023-10-06T04:39:13.866 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-06T04:39:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.969+0000 7fba08c24700 1 Processor -- start 2023-10-06T04:39:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.969+0000 7fba08c24700 1 -- start start 2023-10-06T04:39:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fba04159f90 0x7fba040af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba040cc6c0 0x7fba040ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba040af730 con 0x7fba040aed30 2023-10-06T04:39:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0415d920 con 0x7fba040cc6c0 2023-10-06T04:39:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba040cd080 con 0x7fba04159f90 2023-10-06T04:39:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba02d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba040cc6c0 0x7fba040ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba0259c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fba040aed30 0x7fba040cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54932/0 (socket says 172.21.15.37:54932) 2023-10-06T04:39:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba0259c700 1 -- 172.21.15.37:0/3279934755 learned_addr learned my addr 172.21.15.37:0/3279934755 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba01d9b700 1 --2- 172.21.15.37:0/3279934755 >> v2:172.21.15.83:3300/0 conn(0x7fba04159f90 0x7fba040af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba0159a700 1 -- 172.21.15.37:0/3279934755 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612504257 0 0) 0x7fba040af730 con 0x7fba040aed30 2023-10-06T04:39:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba0159a700 1 -- 172.21.15.37:0/3279934755 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9ec003570 con 0x7fba040aed30 2023-10-06T04:39:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba02d9d700 1 -- 172.21.15.37:0/3279934755 >> v2:172.21.15.83:3300/0 conn(0x7fba04159f90 msgr2=0x7fba040af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba02d9d700 1 --2- 172.21.15.37:0/3279934755 >> v2:172.21.15.83:3300/0 conn(0x7fba04159f90 0x7fba040af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba02d9d700 1 -- 172.21.15.37:0/3279934755 >> v1:172.21.15.37:6789/0 conn(0x7fba040aed30 legacy=0x7fba040cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba02d9d700 1 -- 172.21.15.37:0/3279934755 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0415c910 con 0x7fba040cc6c0 2023-10-06T04:39:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba02d9d700 1 --2- 172.21.15.37:0/3279934755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040cc6c0 0x7fba040ccb40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba040cc5f0 tx=0x7fb9fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae7485720e113a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba0159a700 1 -- 172.21.15.37:0/3279934755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00e070 con 0x7fba040cc6c0 2023-10-06T04:39:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba0159a700 1 -- 172.21.15.37:0/3279934755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00bab0 con 0x7fba040cc6c0 2023-10-06T04:39:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba0159a700 1 -- 172.21.15.37:0/3279934755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00be30 con 0x7fba040cc6c0 2023-10-06T04:39:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 -- 172.21.15.37:0/3279934755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040cc6c0 msgr2=0x7fba040ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 --2- 172.21.15.37:0/3279934755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040cc6c0 0x7fba040ccb40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba040cc5f0 tx=0x7fb9fc009780 comp rx=0 tx=0).stop 2023-10-06T04:39:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 -- 172.21.15.37:0/3279934755 shutdown_connections 2023-10-06T04:39:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 --2- 172.21.15.37:0/3279934755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040cc6c0 0x7fba040ccb40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 --2- 172.21.15.37:0/3279934755 >> v2:172.21.15.83:3300/0 conn(0x7fba04159f90 0x7fba040af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 -- 172.21.15.37:0/3279934755 >> 172.21.15.37:0/3279934755 conn(0x7fba04067cf0 msgr2=0x7fba040680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 -- 172.21.15.37:0/3279934755 shutdown_connections 2023-10-06T04:39:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.973+0000 7fba08c24700 1 -- 172.21.15.37:0/3279934755 wait complete. 2023-10-06T04:39:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.977+0000 7fba08c24700 1 Processor -- start 2023-10-06T04:39:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.977+0000 7fba08c24700 1 -- start start 2023-10-06T04:39:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba08c24700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba040aed30 0x7fba040c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba08c24700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba040cc6c0 0x7fba040b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba08c24700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba04159f90 0x7fba040c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba08c24700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba040c9c60 con 0x7fba04159f90 2023-10-06T04:39:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba08c24700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba040c72f0 con 0x7fba040cc6c0 2023-10-06T04:39:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba08c24700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba040b52e0 con 0x7fba040aed30 2023-10-06T04:39:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba02d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba04159f90 0x7fba040c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba02d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba04159f90 0x7fba040c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60320/0 (socket says 172.21.15.37:60320) 2023-10-06T04:39:13.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba02d9d700 1 -- 172.21.15.37:0/2139715212 learned_addr learned my addr 172.21.15.37:0/2139715212 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:13.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba0259c700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba040aed30 0x7fba040c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba01d9b700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba040cc6c0 0x7fba040b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba02d9d700 1 -- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba040aed30 msgr2=0x7fba040c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba02d9d700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba040aed30 0x7fba040c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba02d9d700 1 -- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba040cc6c0 msgr2=0x7fba040b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba02d9d700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba040cc6c0 0x7fba040b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba02d9d700 1 -- 172.21.15.37:0/2139715212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc009a20 con 0x7fba04159f90 2023-10-06T04:39:13.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba02d9d700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba04159f90 0x7fba040c8780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba04088e00 tx=0x7fb9fc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:13.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fb9f27fc700 1 -- 172.21.15.37:0/2139715212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc012dd0 con 0x7fba04159f90 2023-10-06T04:39:13.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fb9f27fc700 1 -- 172.21.15.37:0/2139715212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc027470 con 0x7fba04159f90 2023-10-06T04:39:13.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba08c24700 1 -- 172.21.15.37:0/2139715212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba040ca0f0 con 0x7fba04159f90 2023-10-06T04:39:13.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fb9f27fc700 1 -- 172.21.15.37:0/2139715212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc027830 con 0x7fba04159f90 2023-10-06T04:39:13.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba08c24700 1 -- 172.21.15.37:0/2139715212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba040c9610 con 0x7fba04159f90 2023-10-06T04:39:13.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.981+0000 7fba08c24700 1 -- 172.21.15.37:0/2139715212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0404be00 con 0x7fba04159f90 2023-10-06T04:39:13.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.985+0000 7fb9f27fc700 1 -- 172.21.15.37:0/2139715212 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb9fc024070 con 0x7fba04159f90 2023-10-06T04:39:13.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.985+0000 7fb9f27fc700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb9e4060550 0x7fb9e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.985+0000 7fb9f27fc700 1 -- 172.21.15.37:0/2139715212 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fb9fc07f600 con 0x7fba04159f90 2023-10-06T04:39:13.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.985+0000 7fba0259c700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb9e4060550 0x7fb9e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.985+0000 7fba0259c700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb9e4060550 0x7fb9e4062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4000c00 tx=0x7fb9f4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:14.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:13.997+0000 7fb9f27fc700 1 -- 172.21.15.37:0/2139715212 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb9fc04f720 con 0x7fba04159f90 2023-10-06T04:39:14.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.161+0000 7fba08c24700 1 -- 172.21.15.37:0/2139715212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fba040cda10 con 0x7fba04159f90 2023-10-06T04:39:14.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.837+0000 7fb9f27fc700 1 -- 172.21.15.37:0/2139715212 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb9fc052d40 con 0x7fba04159f90 2023-10-06T04:39:14.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.865+0000 7fba08c24700 1 -- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb9e4060550 msgr2=0x7fb9e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:14.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.865+0000 7fba08c24700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb9e4060550 0x7fb9e4062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4000c00 tx=0x7fb9f4009040 comp rx=0 tx=0).stop 2023-10-06T04:39:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.865+0000 7fba08c24700 1 -- 172.21.15.37:0/2139715212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba04159f90 msgr2=0x7fba040c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.865+0000 7fba08c24700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba04159f90 0x7fba040c8780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba04088e00 tx=0x7fb9fc019000 comp rx=0 tx=0).stop 2023-10-06T04:39:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.865+0000 7fba08c24700 1 -- 172.21.15.37:0/2139715212 shutdown_connections 2023-10-06T04:39:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.865+0000 7fba08c24700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb9e4060550 0x7fb9e4062a00 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4000c00 tx=0x7fb9f4009040 comp rx=0 tx=0).stop 2023-10-06T04:39:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.865+0000 7fba08c24700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba040cc6c0 0x7fba040b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.865+0000 7fba08c24700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba04159f90 0x7fba040c8780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.865+0000 7fba08c24700 1 --2- 172.21.15.37:0/2139715212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba040aed30 0x7fba040c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.865+0000 7fba08c24700 1 -- 172.21.15.37:0/2139715212 >> 172.21.15.37:0/2139715212 conn(0x7fba04067cf0 msgr2=0x7fba0415bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:14.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.873+0000 7fba08c24700 1 -- 172.21.15.37:0/2139715212 shutdown_connections 2023-10-06T04:39:14.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.873+0000 7fba08c24700 1 -- 172.21.15.37:0/2139715212 wait complete. 2023-10-06T04:39:14.878 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 5 allow_ec_overwrites to true 2023-10-06T04:39:14.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-06T04:39:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.989+0000 7f0558f62700 1 Processor -- start 2023-10-06T04:39:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.989+0000 7f0558f62700 1 -- start start 2023-10-06T04:39:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.989+0000 7f0558f62700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0554155b70 0x7f055406b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.989+0000 7f0558f62700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055406b180 con 0x7f0554155f40 2023-10-06T04:39:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.989+0000 7f0558f62700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540cb920 con 0x7f05540c7da0 2023-10-06T04:39:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.989+0000 7f0558f62700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0554156390 con 0x7f0554155b70 2023-10-06T04:39:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.989+0000 7f0551d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0554155f40 0x7f05540cb210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54944/0 (socket says 172.21.15.37:54944) 2023-10-06T04:39:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.989+0000 7f0551d9b700 1 -- 172.21.15.37:0/1447077773 learned_addr learned my addr 172.21.15.37:0/1447077773 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f055259c700 1 --2- 172.21.15.37:0/1447077773 >> v2:172.21.15.83:3300/0 conn(0x7f0554155b70 0x7f055406b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f055159a700 1 -- 172.21.15.37:0/1447077773 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950019802 0 0) 0x7f055406b180 con 0x7f0554155f40 2023-10-06T04:39:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f055159a700 1 -- 172.21.15.37:0/1447077773 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0540003570 con 0x7f0554155f40 2023-10-06T04:39:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f055259c700 1 -- 172.21.15.37:0/1447077773 >> v1:172.21.15.83:6789/0 conn(0x7f05540c7da0 legacy=0x7f05540c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f055259c700 1 -- 172.21.15.37:0/1447077773 >> v1:172.21.15.37:6789/0 conn(0x7f0554155f40 legacy=0x7f05540cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f055259c700 1 -- 172.21.15.37:0/1447077773 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055406aba0 con 0x7f0554155b70 2023-10-06T04:39:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f055259c700 1 --2- 172.21.15.37:0/1447077773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0554155b70 0x7f055406b610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f05440098e0 tx=0x7f05440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fdc8d77f226a534 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f055159a700 1 -- 172.21.15.37:0/1447077773 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054400b640 con 0x7f0554155b70 2023-10-06T04:39:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f055159a700 1 -- 172.21.15.37:0/1447077773 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054400b7a0 con 0x7f0554155b70 2023-10-06T04:39:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f055159a700 1 -- 172.21.15.37:0/1447077773 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054400bb20 con 0x7f0554155b70 2023-10-06T04:39:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f0558f62700 1 -- 172.21.15.37:0/1447077773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0554155b70 msgr2=0x7f055406b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f0558f62700 1 --2- 172.21.15.37:0/1447077773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0554155b70 0x7f055406b610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f05440098e0 tx=0x7f05440091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f0558f62700 1 -- 172.21.15.37:0/1447077773 shutdown_connections 2023-10-06T04:39:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f0558f62700 1 --2- 172.21.15.37:0/1447077773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0554155b70 0x7f055406b610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f0558f62700 1 -- 172.21.15.37:0/1447077773 >> 172.21.15.37:0/1447077773 conn(0x7f05540cc180 msgr2=0x7f05540cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f0558f62700 1 -- 172.21.15.37:0/1447077773 shutdown_connections 2023-10-06T04:39:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.993+0000 7f0558f62700 1 -- 172.21.15.37:0/1447077773 wait complete. 2023-10-06T04:39:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0558f62700 1 Processor -- start 2023-10-06T04:39:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0558f62700 1 -- start start 2023-10-06T04:39:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0558f62700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05540c7da0 0x7f05540c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0558f62700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0554155b70 0x7f05540aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0558f62700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554155f40 0x7f0554168750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0558f62700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05541654b0 con 0x7f0554155f40 2023-10-06T04:39:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0558f62700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05541692c0 con 0x7f05540c7da0 2023-10-06T04:39:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0558f62700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05541695a0 con 0x7f0554155b70 2023-10-06T04:39:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0552d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554155f40 0x7f0554168750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0552d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554155f40 0x7f0554168750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60334/0 (socket says 172.21.15.37:60334) 2023-10-06T04:39:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0552d9d700 1 -- 172.21.15.37:0/1282643909 learned_addr learned my addr 172.21.15.37:0/1282643909 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f055259c700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05540c7da0 0x7f05540c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0551d9b700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0554155b70 0x7f05540aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0552d9d700 1 -- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0554155b70 msgr2=0x7f05540aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0552d9d700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0554155b70 0x7f05540aba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0552d9d700 1 -- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05540c7da0 msgr2=0x7f05540c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0552d9d700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05540c7da0 0x7f05540c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0552d9d700 1 -- 172.21.15.37:0/1282643909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0544009420 con 0x7f0554155f40 2023-10-06T04:39:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0552d9d700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554155f40 0x7f0554168750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c8e0 tx=0x7f054c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f054a7fc700 1 -- 172.21.15.37:0/1282643909 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c012630 con 0x7f0554155f40 2023-10-06T04:39:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f054a7fc700 1 -- 172.21.15.37:0/1282643909 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c012790 con 0x7f0554155f40 2023-10-06T04:39:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0558f62700 1 -- 172.21.15.37:0/1282643909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05540c36e0 con 0x7f0554155f40 2023-10-06T04:39:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f054a7fc700 1 -- 172.21.15.37:0/1282643909 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c012b50 con 0x7f0554155f40 2023-10-06T04:39:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:14.997+0000 7f0558f62700 1 -- 172.21.15.37:0/1282643909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05540c3ca0 con 0x7f0554155f40 2023-10-06T04:39:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.001+0000 7f054a7fc700 1 -- 172.21.15.37:0/1282643909 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f054c00a3b0 con 0x7f0554155f40 2023-10-06T04:39:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.001+0000 7f0558f62700 1 -- 172.21.15.37:0/1282643909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05540c3ec0 con 0x7f0554155f40 2023-10-06T04:39:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.001+0000 7f054a7fc700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0534060550 0x7f0534062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:15.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.001+0000 7f054a7fc700 1 -- 172.21.15.37:0/1282643909 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f054c07ceb0 con 0x7f0554155f40 2023-10-06T04:39:15.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.001+0000 7f055259c700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0534060550 0x7f0534062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:15.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.001+0000 7f055259c700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0534060550 0x7f0534062a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05440091e0 tx=0x7f0544017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:15.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.009+0000 7f054a7fc700 1 -- 172.21.15.37:0/1282643909 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f054c050aa0 con 0x7f0554155f40 2023-10-06T04:39:15.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.205+0000 7f0558f62700 1 -- 172.21.15.37:0/1282643909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f0554070ee0 con 0x7f0554155f40 2023-10-06T04:39:15.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f054a7fc700 1 -- 172.21.15.37:0/1282643909 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f054c050630 con 0x7f0554155f40 2023-10-06T04:39:15.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f0558f62700 1 -- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0534060550 msgr2=0x7f0534062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f0558f62700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0534060550 0x7f0534062a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05440091e0 tx=0x7f0544017000 comp rx=0 tx=0).stop 2023-10-06T04:39:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f0558f62700 1 -- 172.21.15.37:0/1282643909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554155f40 msgr2=0x7f0554168750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f0558f62700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554155f40 0x7f0554168750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c8e0 tx=0x7f054c001710 comp rx=0 tx=0).stop 2023-10-06T04:39:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f0558f62700 1 -- 172.21.15.37:0/1282643909 shutdown_connections 2023-10-06T04:39:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f0558f62700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0534060550 0x7f0534062a00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f0558f62700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554155f40 0x7f0554168750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f0558f62700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0554155b70 0x7f05540aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f0558f62700 1 --2- 172.21.15.37:0/1282643909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05540c7da0 0x7f05540c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f0558f62700 1 -- 172.21.15.37:0/1282643909 >> 172.21.15.37:0/1282643909 conn(0x7f05540cc180 msgr2=0x7f0554154ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f0558f62700 1 -- 172.21.15.37:0/1282643909 shutdown_connections 2023-10-06T04:39:15.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.873+0000 7f0558f62700 1 -- 172.21.15.37:0/1282643909 wait complete. 2023-10-06T04:39:15.881 INFO:teuthology.orchestra.run.smithi037.stderr:added data pool 5 to fsmap 2023-10-06T04:39:15.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f0663b02700 1 Processor -- start 2023-10-06T04:39:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f0663b02700 1 -- start start 2023-10-06T04:39:16.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f0663b02700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f065c1531e0 0x7f065c1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f0663b02700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f065c15cbd0 0x7f065c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f0663b02700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c153af0 con 0x7f065c0cc870 2023-10-06T04:39:16.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f0663b02700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c0cd400 con 0x7f065c1531e0 2023-10-06T04:39:16.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f0663b02700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c15b1e0 con 0x7f065c15cbd0 2023-10-06T04:39:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066209f700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f065c0cc870 0x7f065c0cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54960/0 (socket says 172.21.15.37:54960) 2023-10-06T04:39:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066209f700 1 -- 172.21.15.37:0/1356208115 learned_addr learned my addr 172.21.15.37:0/1356208115 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066109d700 1 --2- 172.21.15.37:0/1356208115 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f065c15cbd0 0x7f065c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066189e700 1 --2- 172.21.15.37:0/1356208115 >> v2:172.21.15.83:3300/0 conn(0x7f065c1531e0 0x7f065c1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066089c700 1 -- 172.21.15.37:0/1356208115 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307189473 0 0) 0x7f065c153af0 con 0x7f065c0cc870 2023-10-06T04:39:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066089c700 1 -- 172.21.15.37:0/1356208115 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0644003570 con 0x7f065c0cc870 2023-10-06T04:39:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066109d700 1 -- 172.21.15.37:0/1356208115 >> v2:172.21.15.83:3300/0 conn(0x7f065c1531e0 msgr2=0x7f065c1535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066109d700 1 --2- 172.21.15.37:0/1356208115 >> v2:172.21.15.83:3300/0 conn(0x7f065c1531e0 0x7f065c1535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066109d700 1 -- 172.21.15.37:0/1356208115 >> v1:172.21.15.37:6789/0 conn(0x7f065c0cc870 legacy=0x7f065c0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066109d700 1 -- 172.21.15.37:0/1356208115 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c15d580 con 0x7f065c15cbd0 2023-10-06T04:39:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066109d700 1 --2- 172.21.15.37:0/1356208115 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f065c15cbd0 0x7f065c15d040 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f06580098e0 tx=0x7f06580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f036edf18ba724d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066089c700 1 -- 172.21.15.37:0/1356208115 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658011630 con 0x7f065c15cbd0 2023-10-06T04:39:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066089c700 1 -- 172.21.15.37:0/1356208115 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0658011790 con 0x7f065c15cbd0 2023-10-06T04:39:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:15.997+0000 7f066089c700 1 -- 172.21.15.37:0/1356208115 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658011b10 con 0x7f065c15cbd0 2023-10-06T04:39:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.001+0000 7f0663b02700 1 -- 172.21.15.37:0/1356208115 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f065c15cbd0 msgr2=0x7f065c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.001+0000 7f0663b02700 1 --2- 172.21.15.37:0/1356208115 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f065c15cbd0 0x7f065c15d040 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f06580098e0 tx=0x7f06580091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.001+0000 7f0663b02700 1 -- 172.21.15.37:0/1356208115 shutdown_connections 2023-10-06T04:39:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.001+0000 7f0663b02700 1 --2- 172.21.15.37:0/1356208115 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f065c15cbd0 0x7f065c15d040 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.001+0000 7f0663b02700 1 --2- 172.21.15.37:0/1356208115 >> v2:172.21.15.83:3300/0 conn(0x7f065c1531e0 0x7f065c1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.001+0000 7f0663b02700 1 -- 172.21.15.37:0/1356208115 >> 172.21.15.37:0/1356208115 conn(0x7f065c087ab0 msgr2=0x7f065c067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.001+0000 7f0663b02700 1 -- 172.21.15.37:0/1356208115 shutdown_connections 2023-10-06T04:39:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.001+0000 7f0663b02700 1 -- 172.21.15.37:0/1356208115 wait complete. 2023-10-06T04:39:16.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.001+0000 7f0663b02700 1 Processor -- start 2023-10-06T04:39:16.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f0663b02700 1 -- start start 2023-10-06T04:39:16.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f0663b02700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f065c1531e0 0x7f065c0b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f0663b02700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f065c15cbd0 0x7f065c16a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f0663b02700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f065c16a570 0x7f065c169520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f0663b02700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0c9310 con 0x7f065c15cbd0 2023-10-06T04:39:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f0663b02700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0b3a00 con 0x7f065c16a570 2023-10-06T04:39:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f0663b02700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c169090 con 0x7f065c1531e0 2023-10-06T04:39:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f066109d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f065c15cbd0 0x7f065c16a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f066109d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f065c15cbd0 0x7f065c16a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60342/0 (socket says 172.21.15.37:60342) 2023-10-06T04:39:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f066109d700 1 -- 172.21.15.37:0/2548811911 learned_addr learned my addr 172.21.15.37:0/2548811911 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f066189e700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f065c1531e0 0x7f065c0b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f066209f700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f065c16a570 0x7f065c169520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f066109d700 1 -- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f065c1531e0 msgr2=0x7f065c0b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f066109d700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f065c1531e0 0x7f065c0b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f066109d700 1 -- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f065c16a570 msgr2=0x7f065c169520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f066109d700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f065c16a570 0x7f065c169520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f066109d700 1 -- 172.21.15.37:0/2548811911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0658009420 con 0x7f065c15cbd0 2023-10-06T04:39:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f066109d700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f065c15cbd0 0x7f065c16a030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0658009ed0 tx=0x7f0658017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f0651ffb700 1 -- 172.21.15.37:0/2548811911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658011900 con 0x7f065c15cbd0 2023-10-06T04:39:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f0651ffb700 1 -- 172.21.15.37:0/2548811911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0658011a80 con 0x7f065c15cbd0 2023-10-06T04:39:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f0663b02700 1 -- 172.21.15.37:0/2548811911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c0b3160 con 0x7f065c15cbd0 2023-10-06T04:39:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f0651ffb700 1 -- 172.21.15.37:0/2548811911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065801a680 con 0x7f065c15cbd0 2023-10-06T04:39:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.005+0000 7f0663b02700 1 -- 172.21.15.37:0/2548811911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c0b3720 con 0x7f065c15cbd0 2023-10-06T04:39:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.009+0000 7f0663b02700 1 -- 172.21.15.37:0/2548811911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c169200 con 0x7f065c15cbd0 2023-10-06T04:39:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.009+0000 7f0651ffb700 1 -- 172.21.15.37:0/2548811911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f065801aa70 con 0x7f065c15cbd0 2023-10-06T04:39:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.009+0000 7f0651ffb700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0648060580 0x7f0648062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.009+0000 7f0651ffb700 1 -- 172.21.15.37:0/2548811911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f065807ed40 con 0x7f065c15cbd0 2023-10-06T04:39:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.009+0000 7f066189e700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0648060580 0x7f0648062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.009+0000 7f066189e700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0648060580 0x7f0648062a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f064c009db0 tx=0x7f064c0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.017+0000 7f0651ffb700 1 -- 172.21.15.37:0/2548811911 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f065804eec0 con 0x7f065c15cbd0 2023-10-06T04:39:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.213+0000 7f0663b02700 1 -- 172.21.15.37:0/2548811911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f065c070ee0 con 0x7f065c15cbd0 2023-10-06T04:39:16.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.217+0000 7f0651ffb700 1 -- 172.21.15.37:0/2548811911 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f06580524e0 con 0x7f065c15cbd0 2023-10-06T04:39:16.221 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:16.221 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3463038764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3463038764},{"type":"v1","addr":"172.21.15.83:6835","nonce":3463038764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3802233690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3802233690},{"type":"v1","addr":"172.21.15.37:6833","nonce":3802233690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1262727325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1262727325},{"type":"v1","addr":"172.21.15.83:6837","nonce":1262727325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:10.126951+0000","modified":"2023-10-06T04:39:15.855990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1742476643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1742476643},{"type":"v1","addr":"172.21.15.37:6835","nonce":1742476643}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T04:39:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.221+0000 7f0663b02700 1 -- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0648060580 msgr2=0x7f0648062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.221+0000 7f0663b02700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0648060580 0x7f0648062a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f064c009db0 tx=0x7f064c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.221+0000 7f0663b02700 1 -- 172.21.15.37:0/2548811911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f065c15cbd0 msgr2=0x7f065c16a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.221+0000 7f0663b02700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f065c15cbd0 0x7f065c16a030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0658009ed0 tx=0x7f0658017000 comp rx=0 tx=0).stop 2023-10-06T04:39:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.221+0000 7f0663b02700 1 -- 172.21.15.37:0/2548811911 shutdown_connections 2023-10-06T04:39:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.221+0000 7f0663b02700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0648060580 0x7f0648062a30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.221+0000 7f0663b02700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f065c16a570 0x7f065c169520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.221+0000 7f0663b02700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f065c15cbd0 0x7f065c16a030 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.221+0000 7f0663b02700 1 --2- 172.21.15.37:0/2548811911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f065c1531e0 0x7f065c0b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.221+0000 7f0663b02700 1 -- 172.21.15.37:0/2548811911 >> 172.21.15.37:0/2548811911 conn(0x7f065c0cc870 msgr2=0x7f065c1589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.221+0000 7f0663b02700 1 -- 172.21.15.37:0/2548811911 shutdown_connections 2023-10-06T04:39:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.221+0000 7f0663b02700 1 -- 172.21.15.37:0/2548811911 wait complete. 2023-10-06T04:39:16.227 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2023-10-06T04:39:16.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:16.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.341+0000 7fe4ba5b5700 1 Processor -- start 2023-10-06T04:39:16.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.341+0000 7fe4ba5b5700 1 -- start start 2023-10-06T04:39:16.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4ba5b5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4b415c240 0x7fe4b40ab940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4ba5b5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b40acd30 con 0x7fe4b40667b0 2023-10-06T04:39:16.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4ba5b5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b40abe80 con 0x7fe4b40b1a30 2023-10-06T04:39:16.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4ba5b5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b40ac120 con 0x7fe4b415c240 2023-10-06T04:39:16.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4b95b3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4b415c240 0x7fe4b40ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4b8db2700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe4b40667b0 0x7fe4b40b1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54962/0 (socket says 172.21.15.37:54962) 2023-10-06T04:39:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4b8db2700 1 -- 172.21.15.37:0/2135816135 learned_addr learned my addr 172.21.15.37:0/2135816135 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4b95b3700 1 -- 172.21.15.37:0/2135816135 >> v1:172.21.15.83:6789/0 conn(0x7fe4b40b1a30 legacy=0x7fe4b40ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4b95b3700 1 -- 172.21.15.37:0/2135816135 >> v1:172.21.15.37:6789/0 conn(0x7fe4b40667b0 legacy=0x7fe4b40b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4abfff700 1 -- 172.21.15.37:0/2135816135 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258860829 0 0) 0x7fe4b40abe80 con 0x7fe4b40b1a30 2023-10-06T04:39:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4b95b3700 1 -- 172.21.15.37:0/2135816135 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b40ac400 con 0x7fe4b415c240 2023-10-06T04:39:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4b95b3700 1 --2- 172.21.15.37:0/2135816135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4b415c240 0x7fe4b40ab940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00098e0 tx=0x7fe4b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715c2d7aefee1b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4abfff700 1 -- 172.21.15.37:0/2135816135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0009e80 con 0x7fe4b415c240 2023-10-06T04:39:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4abfff700 1 -- 172.21.15.37:0/2135816135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b000b760 con 0x7fe4b415c240 2023-10-06T04:39:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4abfff700 1 -- 172.21.15.37:0/2135816135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b000bae0 con 0x7fe4b415c240 2023-10-06T04:39:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2135816135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4b415c240 msgr2=0x7fe4b40ab940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4ba5b5700 1 --2- 172.21.15.37:0/2135816135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4b415c240 0x7fe4b40ab940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00098e0 tx=0x7fe4b00091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2135816135 shutdown_connections 2023-10-06T04:39:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4ba5b5700 1 --2- 172.21.15.37:0/2135816135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4b415c240 0x7fe4b40ab940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2135816135 >> 172.21.15.37:0/2135816135 conn(0x7fe4b40ccb50 msgr2=0x7fe4b406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2135816135 shutdown_connections 2023-10-06T04:39:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.345+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2135816135 wait complete. 2023-10-06T04:39:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4ba5b5700 1 Processor -- start 2023-10-06T04:39:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4ba5b5700 1 -- start start 2023-10-06T04:39:16.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4ba5b5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4b40667b0 0x7fe4b40c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4ba5b5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe4b40b1a30 0x7fe4b41699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4ba5b5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4b415c240 0x7fe4b4159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4ba5b5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4169ee0 con 0x7fe4b415c240 2023-10-06T04:39:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4ba5b5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b415a490 con 0x7fe4b40667b0 2023-10-06T04:39:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4ba5b5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b40c3990 con 0x7fe4b40b1a30 2023-10-06T04:39:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4b9db4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4b415c240 0x7fe4b4159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4b9db4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4b415c240 0x7fe4b4159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60372/0 (socket says 172.21.15.37:60372) 2023-10-06T04:39:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4b9db4700 1 -- 172.21.15.37:0/2748719727 learned_addr learned my addr 172.21.15.37:0/2748719727 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4b95b3700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4b40667b0 0x7fe4b40c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4b8db2700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe4b40b1a30 0x7fe4b41699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4b9db4700 1 -- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe4b40b1a30 msgr2=0x7fe4b41699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4b9db4700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe4b40b1a30 0x7fe4b41699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4b9db4700 1 -- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4b40667b0 msgr2=0x7fe4b40c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4b9db4700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4b40667b0 0x7fe4b40c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4b9db4700 1 -- 172.21.15.37:0/2748719727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b0009420 con 0x7fe4b415c240 2023-10-06T04:39:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4b95b3700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4b40667b0 0x7fe4b40c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.349+0000 7fe4b9db4700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4b415c240 0x7fe4b4159f50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00cb60 tx=0x7fe4ac001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.353+0000 7fe4a97fa700 1 -- 172.21.15.37:0/2748719727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00a7b0 con 0x7fe4b415c240 2023-10-06T04:39:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.353+0000 7fe4a97fa700 1 -- 172.21.15.37:0/2748719727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac00a930 con 0x7fe4b415c240 2023-10-06T04:39:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.353+0000 7fe4a97fa700 1 -- 172.21.15.37:0/2748719727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00acf0 con 0x7fe4b415c240 2023-10-06T04:39:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.353+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2748719727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b40c3c70 con 0x7fe4b415c240 2023-10-06T04:39:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.353+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2748719727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b40c56c0 con 0x7fe4b415c240 2023-10-06T04:39:16.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.353+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2748719727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b40708a0 con 0x7fe4b415c240 2023-10-06T04:39:16.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.353+0000 7fe4a97fa700 1 -- 172.21.15.37:0/2748719727 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe4ac012630 con 0x7fe4b415c240 2023-10-06T04:39:16.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.353+0000 7fe4a97fa700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe498060550 0x7fe498062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.353+0000 7fe4a97fa700 1 -- 172.21.15.37:0/2748719727 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe4ac07d000 con 0x7fe4b415c240 2023-10-06T04:39:16.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.353+0000 7fe4b95b3700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe498060550 0x7fe498062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.353+0000 7fe4b95b3700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe498060550 0x7fe498062a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00030c0 tx=0x7fe4b0016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.361+0000 7fe4a97fa700 1 -- 172.21.15.37:0/2748719727 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe4ac04d1a0 con 0x7fe4b415c240 2023-10-06T04:39:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.525+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2748719727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4b40ac6e0 con 0x7fe4b415c240 2023-10-06T04:39:16.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.525+0000 7fe4a97fa700 1 -- 172.21.15.37:0/2748719727 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fe4ac0507c0 con 0x7fe4b415c240 2023-10-06T04:39:16.532 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:16.533 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:15.209829+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.529+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe498060550 msgr2=0x7fe498062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.529+0000 7fe4ba5b5700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe498060550 0x7fe498062a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00030c0 tx=0x7fe4b0016000 comp rx=0 tx=0).stop 2023-10-06T04:39:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.529+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2748719727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4b415c240 msgr2=0x7fe4b4159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.529+0000 7fe4ba5b5700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4b415c240 0x7fe4b4159f50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00cb60 tx=0x7fe4ac001770 comp rx=0 tx=0).stop 2023-10-06T04:39:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.529+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2748719727 shutdown_connections 2023-10-06T04:39:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.529+0000 7fe4ba5b5700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe498060550 0x7fe498062a00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.529+0000 7fe4ba5b5700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4b415c240 0x7fe4b4159f50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.529+0000 7fe4ba5b5700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe4b40b1a30 0x7fe4b41699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.529+0000 7fe4ba5b5700 1 --2- 172.21.15.37:0/2748719727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4b40667b0 0x7fe4b40c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.529+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2748719727 >> 172.21.15.37:0/2748719727 conn(0x7fe4b40ccb50 msgr2=0x7fe4b415b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.529+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2748719727 shutdown_connections 2023-10-06T04:39:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.529+0000 7fe4ba5b5700 1 -- 172.21.15.37:0/2748719727 wait complete. 2023-10-06T04:39:16.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:16.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.645+0000 7f70dbfff700 1 Processor -- start 2023-10-06T04:39:16.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.645+0000 7f70dbfff700 1 -- start start 2023-10-06T04:39:16.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.645+0000 7f70dbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70dc0ace50 0x7f70dc0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.645+0000 7f70dbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f70dc0c8f30 0x7f70dc06ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.645+0000 7f70dbfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70dc0ce4c0 con 0x7f70dc06d3c0 2023-10-06T04:39:16.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70dbfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70dc06d840 con 0x7f70dc0c8f30 2023-10-06T04:39:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70dbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0c4040 con 0x7f70dc0ace50 2023-10-06T04:39:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70daffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70dc0ace50 0x7f70dc0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70da7fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f70dc0c8f30 0x7f70dc06ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70daffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70dc0ace50 0x7f70dc0c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:53080/0 (socket says 172.21.15.37:53080) 2023-10-06T04:39:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70daffd700 1 -- 172.21.15.37:0/114468448 learned_addr learned my addr 172.21.15.37:0/114468448 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70daffd700 1 -- 172.21.15.37:0/114468448 >> v2:172.21.15.83:3300/0 conn(0x7f70dc0c8f30 msgr2=0x7f70dc06ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70daffd700 1 --2- 172.21.15.37:0/114468448 >> v2:172.21.15.83:3300/0 conn(0x7f70dc0c8f30 0x7f70dc06ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70daffd700 1 -- 172.21.15.37:0/114468448 >> v1:172.21.15.83:6789/0 conn(0x7f70dc06d3c0 legacy=0x7f70dc15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70daffd700 1 -- 172.21.15.37:0/114468448 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc1570e0 con 0x7f70dc0ace50 2023-10-06T04:39:16.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70daffd700 1 --2- 172.21.15.37:0/114468448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70dc0ace50 0x7f70dc0c89f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009f20 tx=0x7f70cc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee3a055d8d882c06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70d9ffb700 1 -- 172.21.15.37:0/114468448 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00e070 con 0x7f70dc0ace50 2023-10-06T04:39:16.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70d9ffb700 1 -- 172.21.15.37:0/114468448 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc00ba60 con 0x7f70dc0ace50 2023-10-06T04:39:16.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70d9ffb700 1 -- 172.21.15.37:0/114468448 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0092e0 con 0x7f70dc0ace50 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70dbfff700 1 -- 172.21.15.37:0/114468448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70dc0ace50 msgr2=0x7f70dc0c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70dbfff700 1 --2- 172.21.15.37:0/114468448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70dc0ace50 0x7f70dc0c89f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009f20 tx=0x7f70cc009840 comp rx=0 tx=0).stop 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70dbfff700 1 -- 172.21.15.37:0/114468448 shutdown_connections 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70dbfff700 1 --2- 172.21.15.37:0/114468448 >> v2:172.21.15.83:3300/0 conn(0x7f70dc0c8f30 0x7f70dc06ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70dbfff700 1 --2- 172.21.15.37:0/114468448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70dc0ace50 0x7f70dc0c89f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70dbfff700 1 -- 172.21.15.37:0/114468448 >> 172.21.15.37:0/114468448 conn(0x7f70dc06c330 msgr2=0x7f70dc0cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70dbfff700 1 -- 172.21.15.37:0/114468448 shutdown_connections 2023-10-06T04:39:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70dbfff700 1 -- 172.21.15.37:0/114468448 wait complete. 2023-10-06T04:39:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70dbfff700 1 Processor -- start 2023-10-06T04:39:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.649+0000 7f70dbfff700 1 -- start start 2023-10-06T04:39:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70dbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70dc06d3c0 0x7f70dc145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70dbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70dc0ace50 0x7f70dc0a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70dbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70dc0c8f30 0x7f70dc0af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70dbfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc069030 con 0x7f70dc0ace50 2023-10-06T04:39:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70dbfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0ac440 con 0x7f70dc06d3c0 2023-10-06T04:39:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70dbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc1559f0 con 0x7f70dc0c8f30 2023-10-06T04:39:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70da7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70dc0ace50 0x7f70dc0a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70daffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70dc06d3c0 0x7f70dc145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70db7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70dc0c8f30 0x7f70dc0af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70daffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70dc06d3c0 0x7f70dc145e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:42056/0 (socket says 172.21.15.37:42056) 2023-10-06T04:39:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70daffd700 1 -- 172.21.15.37:0/1571437282 learned_addr learned my addr 172.21.15.37:0/1571437282 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70da7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70dc0ace50 0x7f70dc0a8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60378/0 (socket says 172.21.15.37:60378) 2023-10-06T04:39:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70daffd700 1 -- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70dc0c8f30 msgr2=0x7f70dc0af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70daffd700 1 --2- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70dc0c8f30 0x7f70dc0af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70daffd700 1 -- 172.21.15.37:0/1571437282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70dc0ace50 msgr2=0x7f70dc0a8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70daffd700 1 --2- 172.21.15.37:0/1571437282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70dc0ace50 0x7f70dc0a8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70daffd700 1 -- 172.21.15.37:0/1571437282 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc009ae0 con 0x7f70dc06d3c0 2023-10-06T04:39:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70daffd700 1 --2- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70dc06d3c0 0x7f70dc145e30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009430 tx=0x7f70cc018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70d2ffd700 1 -- 172.21.15.37:0/1571437282 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc007170 con 0x7f70dc06d3c0 2023-10-06T04:39:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70d2ffd700 1 -- 172.21.15.37:0/1571437282 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc008a00 con 0x7f70dc06d3c0 2023-10-06T04:39:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70dbfff700 1 -- 172.21.15.37:0/1571437282 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc0abba0 con 0x7f70dc06d3c0 2023-10-06T04:39:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70d2ffd700 1 -- 172.21.15.37:0/1571437282 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc008da0 con 0x7f70dc06d3c0 2023-10-06T04:39:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.653+0000 7f70dbfff700 1 -- 172.21.15.37:0/1571437282 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70dc0ac160 con 0x7f70dc06d3c0 2023-10-06T04:39:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.657+0000 7f70dbfff700 1 -- 172.21.15.37:0/1571437282 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70dc068e00 con 0x7f70dc06d3c0 2023-10-06T04:39:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.657+0000 7f70d2ffd700 1 -- 172.21.15.37:0/1571437282 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f70cc003040 con 0x7f70dc06d3c0 2023-10-06T04:39:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.657+0000 7f70d2ffd700 1 --2- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f70bc060580 0x7f70bc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.657+0000 7f70d2ffd700 1 -- 172.21.15.37:0/1571437282 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f70cc07ea90 con 0x7f70dc06d3c0 2023-10-06T04:39:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.657+0000 7f70da7fc700 1 --2- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f70bc060580 0x7f70bc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.657+0000 7f70da7fc700 1 --2- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f70bc060580 0x7f70bc062a30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0c7550 tx=0x7f70c40091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.665+0000 7f70d2ffd700 1 -- 172.21.15.37:0/1571437282 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f70dc068e00 con 0x7f70dc06d3c0 2023-10-06T04:39:16.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.829+0000 7f70dbfff700 1 -- 172.21.15.37:0/1571437282 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70dc068e00 con 0x7f70dc06d3c0 2023-10-06T04:39:16.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.833+0000 7f70d2ffd700 1 -- 172.21.15.37:0/1571437282 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f70dc068e00 con 0x7f70dc06d3c0 2023-10-06T04:39:16.837 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:16.837 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:15.209829+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:16.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.837+0000 7f70dbfff700 1 -- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f70bc060580 msgr2=0x7f70bc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.837+0000 7f70dbfff700 1 --2- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f70bc060580 0x7f70bc062a30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0c7550 tx=0x7f70c40091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.837+0000 7f70dbfff700 1 -- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70dc06d3c0 msgr2=0x7f70dc145e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.837+0000 7f70dbfff700 1 --2- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70dc06d3c0 0x7f70dc145e30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009430 tx=0x7f70cc018000 comp rx=0 tx=0).stop 2023-10-06T04:39:16.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.837+0000 7f70dbfff700 1 -- 172.21.15.37:0/1571437282 shutdown_connections 2023-10-06T04:39:16.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.837+0000 7f70dbfff700 1 --2- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f70bc060580 0x7f70bc062a30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.837+0000 7f70dbfff700 1 --2- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70dc0c8f30 0x7f70dc0af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.837+0000 7f70dbfff700 1 --2- 172.21.15.37:0/1571437282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70dc0ace50 0x7f70dc0a8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.837+0000 7f70dbfff700 1 --2- 172.21.15.37:0/1571437282 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70dc06d3c0 0x7f70dc145e30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.837+0000 7f70dbfff700 1 -- 172.21.15.37:0/1571437282 >> 172.21.15.37:0/1571437282 conn(0x7f70dc06c330 msgr2=0x7f70dc156410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:16.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.837+0000 7f70dbfff700 1 -- 172.21.15.37:0/1571437282 shutdown_connections 2023-10-06T04:39:16.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.837+0000 7f70dbfff700 1 -- 172.21.15.37:0/1571437282 wait complete. 2023-10-06T04:39:16.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:16.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.977+0000 7f4abcb31700 1 Processor -- start 2023-10-06T04:39:16.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.977+0000 7f4abcb31700 1 -- start start 2023-10-06T04:39:16.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4abcb31700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4ab8155470 0x7f4ab80afce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4abcb31700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4ab80b0220 0x7f4ab80aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4abcb31700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80adff0 con 0x7f4ab81550a0 2023-10-06T04:39:16.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4abcb31700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab80ab500 con 0x7f4ab8155470 2023-10-06T04:39:16.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4abcb31700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab80b0640 con 0x7f4ab80b0220 2023-10-06T04:39:16.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4ab77fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4ab81550a0 0x7f4ab80ae480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54966/0 (socket says 172.21.15.37:54966) 2023-10-06T04:39:16.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4ab77fe700 1 -- 172.21.15.37:0/65020958 learned_addr learned my addr 172.21.15.37:0/65020958 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:16.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4aaffff700 1 --2- 172.21.15.37:0/65020958 >> v2:172.21.15.37:3300/0 conn(0x7f4ab8155470 0x7f4ab80afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4ab7fff700 1 --2- 172.21.15.37:0/65020958 >> v2:172.21.15.83:3300/0 conn(0x7f4ab80b0220 0x7f4ab80aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4ab6ffd700 1 -- 172.21.15.37:0/65020958 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962590567 0 0) 0x7f4ab80adff0 con 0x7f4ab81550a0 2023-10-06T04:39:16.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4ab6ffd700 1 -- 172.21.15.37:0/65020958 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa4003570 con 0x7f4ab81550a0 2023-10-06T04:39:16.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4aaffff700 1 -- 172.21.15.37:0/65020958 >> v2:172.21.15.83:3300/0 conn(0x7f4ab80b0220 msgr2=0x7f4ab80aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:16.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4aaffff700 1 --2- 172.21.15.37:0/65020958 >> v2:172.21.15.83:3300/0 conn(0x7f4ab80b0220 0x7f4ab80aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4aaffff700 1 -- 172.21.15.37:0/65020958 >> v1:172.21.15.37:6789/0 conn(0x7f4ab81550a0 legacy=0x7f4ab80ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4ab6ffd700 1 -- 172.21.15.37:0/65020958 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1204201367 0 0) 0x7f4aa4003570 con 0x7f4ab81550a0 2023-10-06T04:39:16.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4aaffff700 1 -- 172.21.15.37:0/65020958 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80afa50 con 0x7f4ab8155470 2023-10-06T04:39:16.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4aaffff700 1 --2- 172.21.15.37:0/65020958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab8155470 0x7f4ab80afce0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ab81558c0 tx=0x7f4aa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e84c6ee046b169 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4ab6ffd700 1 -- 172.21.15.37:0/65020958 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8001470 con 0x7f4ab8155470 2023-10-06T04:39:16.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4ab6ffd700 1 -- 172.21.15.37:0/65020958 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0011420 con 0x7f4ab8155470 2023-10-06T04:39:16.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.981+0000 7f4ab6ffd700 1 -- 172.21.15.37:0/65020958 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa00117c0 con 0x7f4ab8155470 2023-10-06T04:39:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 -- 172.21.15.37:0/65020958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab8155470 msgr2=0x7f4ab80afce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 --2- 172.21.15.37:0/65020958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab8155470 0x7f4ab80afce0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ab81558c0 tx=0x7f4aa00091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 -- 172.21.15.37:0/65020958 shutdown_connections 2023-10-06T04:39:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 --2- 172.21.15.37:0/65020958 >> v2:172.21.15.83:3300/0 conn(0x7f4ab80b0220 0x7f4ab80aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 --2- 172.21.15.37:0/65020958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab8155470 0x7f4ab80afce0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 -- 172.21.15.37:0/65020958 >> 172.21.15.37:0/65020958 conn(0x7f4ab80ccb50 msgr2=0x7f4ab806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 -- 172.21.15.37:0/65020958 shutdown_connections 2023-10-06T04:39:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 -- 172.21.15.37:0/65020958 wait complete. 2023-10-06T04:39:16.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 Processor -- start 2023-10-06T04:39:16.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 -- start start 2023-10-06T04:39:16.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab80b0220 0x7f4ab814b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ab81550a0 0x7f4ab80a8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ab8155470 0x7f4ab80a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80a92e0 con 0x7f4ab80b0220 2023-10-06T04:39:16.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8166be0 con 0x7f4ab81550a0 2023-10-06T04:39:16.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4abcb31700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8167bb0 con 0x7f4ab8155470 2023-10-06T04:39:16.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4ab77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab80b0220 0x7f4ab814b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4ab77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab80b0220 0x7f4ab814b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60390/0 (socket says 172.21.15.37:60390) 2023-10-06T04:39:16.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4ab77fe700 1 -- 172.21.15.37:0/206481703 learned_addr learned my addr 172.21.15.37:0/206481703 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:16.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4aaffff700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ab81550a0 0x7f4ab80a8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.985+0000 7f4ab7fff700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ab8155470 0x7f4ab80a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4ab77fe700 1 -- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ab8155470 msgr2=0x7f4ab80a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4ab77fe700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ab8155470 0x7f4ab80a8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4ab77fe700 1 -- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ab81550a0 msgr2=0x7f4ab80a8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4ab77fe700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ab81550a0 0x7f4ab80a8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4ab77fe700 1 -- 172.21.15.37:0/206481703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa0009420 con 0x7f4ab80b0220 2023-10-06T04:39:16.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4ab7fff700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ab8155470 0x7f4ab80a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:16.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4ab77fe700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab80b0220 0x7f4ab814b3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800cbc0 tx=0x7f4aa8001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4aaf7fe700 1 -- 172.21.15.37:0/206481703 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8007360 con 0x7f4ab80b0220 2023-10-06T04:39:16.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4aaf7fe700 1 -- 172.21.15.37:0/206481703 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa80074e0 con 0x7f4ab80b0220 2023-10-06T04:39:16.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4abcb31700 1 -- 172.21.15.37:0/206481703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab80aab50 con 0x7f4ab80b0220 2023-10-06T04:39:16.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4aaf7fe700 1 -- 172.21.15.37:0/206481703 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8004830 con 0x7f4ab80b0220 2023-10-06T04:39:16.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4abcb31700 1 -- 172.21.15.37:0/206481703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab81673b0 con 0x7f4ab80b0220 2023-10-06T04:39:16.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4abcb31700 1 -- 172.21.15.37:0/206481703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab8166f00 con 0x7f4ab80b0220 2023-10-06T04:39:16.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4aaf7fe700 1 -- 172.21.15.37:0/206481703 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4aa8004ba0 con 0x7f4ab80b0220 2023-10-06T04:39:16.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4aaf7fe700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4a98060580 0x7f4a98062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4aaf7fe700 1 -- 172.21.15.37:0/206481703 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4aa807c3c0 con 0x7f4ab80b0220 2023-10-06T04:39:16.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.989+0000 7f4aaffff700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4a98060580 0x7f4a98062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:16.993+0000 7f4aaffff700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4a98060580 0x7f4a98062a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4ab81558c0 tx=0x7f4aa0016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.001+0000 7f4aaf7fe700 1 -- 172.21.15.37:0/206481703 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4aa804c5e0 con 0x7f4ab80b0220 2023-10-06T04:39:17.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.197+0000 7f4abcb31700 1 -- 172.21.15.37:0/206481703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ab80708a0 con 0x7f4ab80b0220 2023-10-06T04:39:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.201+0000 7f4aaf7fe700 1 -- 172.21.15.37:0/206481703 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f4aa804fc00 con 0x7f4ab80b0220 2023-10-06T04:39:17.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:17.205 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3463038764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3463038764},{"type":"v1","addr":"172.21.15.83:6835","nonce":3463038764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3802233690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3802233690},{"type":"v1","addr":"172.21.15.37:6833","nonce":3802233690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1262727325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1262727325},{"type":"v1","addr":"172.21.15.83:6837","nonce":1262727325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:10.126951+0000","modified":"2023-10-06T04:39:15.855990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1742476643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1742476643},{"type":"v1","addr":"172.21.15.37:6835","nonce":1742476643}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T04:39:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.205+0000 7f4abcb31700 1 -- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4a98060580 msgr2=0x7f4a98062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.205+0000 7f4abcb31700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4a98060580 0x7f4a98062a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4ab81558c0 tx=0x7f4aa0016000 comp rx=0 tx=0).stop 2023-10-06T04:39:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.205+0000 7f4abcb31700 1 -- 172.21.15.37:0/206481703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab80b0220 msgr2=0x7f4ab814b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.205+0000 7f4abcb31700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab80b0220 0x7f4ab814b3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800cbc0 tx=0x7f4aa8001b50 comp rx=0 tx=0).stop 2023-10-06T04:39:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.205+0000 7f4abcb31700 1 -- 172.21.15.37:0/206481703 shutdown_connections 2023-10-06T04:39:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.205+0000 7f4abcb31700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4a98060580 0x7f4a98062a30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.205+0000 7f4abcb31700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ab81550a0 0x7f4ab80a8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.205+0000 7f4abcb31700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ab8155470 0x7f4ab80a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.205+0000 7f4abcb31700 1 --2- 172.21.15.37:0/206481703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab80b0220 0x7f4ab814b3f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.205+0000 7f4abcb31700 1 -- 172.21.15.37:0/206481703 >> 172.21.15.37:0/206481703 conn(0x7f4ab80ccb50 msgr2=0x7f4ab80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.205+0000 7f4abcb31700 1 -- 172.21.15.37:0/206481703 shutdown_connections 2023-10-06T04:39:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.205+0000 7f4abcb31700 1 -- 172.21.15.37:0/206481703 wait complete. 2023-10-06T04:39:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2023-10-06T04:39:17.226 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.329+0000 7f0ac8906700 1 Processor -- start 2023-10-06T04:39:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.329+0000 7f0ac8906700 1 -- start start 2023-10-06T04:39:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ac4068400 0x7f0ac415d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ac4158ba0 0x7f0ac40ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac40af7f0 con 0x7f0ac41587d0 2023-10-06T04:39:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac415d6d0 con 0x7f0ac4158ba0 2023-10-06T04:39:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac40afad0 con 0x7f0ac4068400 2023-10-06T04:39:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ac4158ba0 0x7f0ac40ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ac4158ba0 0x7f0ac40ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60398/0 (socket says 172.21.15.37:60398) 2023-10-06T04:39:17.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac3fff700 1 -- 172.21.15.37:0/920716476 learned_addr learned my addr 172.21.15.37:0/920716476 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:17.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0abbfff700 1 --2- 172.21.15.37:0/920716476 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ac4068400 0x7f0ac415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac3fff700 1 -- 172.21.15.37:0/920716476 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ac4068400 msgr2=0x7f0ac415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac3fff700 1 --2- 172.21.15.37:0/920716476 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ac4068400 0x7f0ac415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac3fff700 1 -- 172.21.15.37:0/920716476 >> v1:172.21.15.83:6789/0 conn(0x7f0ac41587d0 legacy=0x7f0ac4067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac3fff700 1 -- 172.21.15.37:0/920716476 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac40afdb0 con 0x7f0ac4158ba0 2023-10-06T04:39:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac3fff700 1 --2- 172.21.15.37:0/920716476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4158ba0 0x7f0ac40ae510 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009f20 tx=0x7f0abc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36ce9eef934a781 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac2ffd700 1 -- 172.21.15.37:0/920716476 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00e070 con 0x7f0ac4158ba0 2023-10-06T04:39:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac2ffd700 1 -- 172.21.15.37:0/920716476 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc00b9d0 con 0x7f0ac4158ba0 2023-10-06T04:39:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac2ffd700 1 -- 172.21.15.37:0/920716476 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0092e0 con 0x7f0ac4158ba0 2023-10-06T04:39:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 -- 172.21.15.37:0/920716476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4158ba0 msgr2=0x7f0ac40ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 --2- 172.21.15.37:0/920716476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4158ba0 0x7f0ac40ae510 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009f20 tx=0x7f0abc009840 comp rx=0 tx=0).stop 2023-10-06T04:39:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 -- 172.21.15.37:0/920716476 shutdown_connections 2023-10-06T04:39:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 --2- 172.21.15.37:0/920716476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4158ba0 0x7f0ac40ae510 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 --2- 172.21.15.37:0/920716476 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ac4068400 0x7f0ac415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 -- 172.21.15.37:0/920716476 >> 172.21.15.37:0/920716476 conn(0x7f0ac40cc5f0 msgr2=0x7f0ac40cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 -- 172.21.15.37:0/920716476 shutdown_connections 2023-10-06T04:39:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.333+0000 7f0ac8906700 1 -- 172.21.15.37:0/920716476 wait complete. 2023-10-06T04:39:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac8906700 1 Processor -- start 2023-10-06T04:39:17.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac8906700 1 -- start start 2023-10-06T04:39:17.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac8906700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ac4068400 0x7f0ac40c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac8906700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ac41587d0 0x7f0ac41698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac8906700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4158ba0 0x7f0ac40cf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac8906700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4169de0 con 0x7f0ac4158ba0 2023-10-06T04:39:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac8906700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac40cd6b0 con 0x7f0ac4068400 2023-10-06T04:39:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac8906700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac40cd990 con 0x7f0ac41587d0 2023-10-06T04:39:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4158ba0 0x7f0ac40cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4158ba0 0x7f0ac40cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60408/0 (socket says 172.21.15.37:60408) 2023-10-06T04:39:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac3fff700 1 -- 172.21.15.37:0/347429315 learned_addr learned my addr 172.21.15.37:0/347429315 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0abbfff700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ac41587d0 0x7f0ac41698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac37fe700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ac4068400 0x7f0ac40c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac3fff700 1 -- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ac41587d0 msgr2=0x7f0ac41698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac3fff700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ac41587d0 0x7f0ac41698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac3fff700 1 -- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ac4068400 msgr2=0x7f0ac40c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac3fff700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ac4068400 0x7f0ac40c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac3fff700 1 -- 172.21.15.37:0/347429315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc009ae0 con 0x7f0ac4158ba0 2023-10-06T04:39:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac3fff700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4158ba0 0x7f0ac40cf540 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00b610 tx=0x7f0abc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0abb7fe700 1 -- 172.21.15.37:0/347429315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc008c30 con 0x7f0ac4158ba0 2023-10-06T04:39:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac8906700 1 -- 172.21.15.37:0/347429315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac40cdc70 con 0x7f0ac4158ba0 2023-10-06T04:39:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0abb7fe700 1 -- 172.21.15.37:0/347429315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc008d90 con 0x7f0ac4158ba0 2023-10-06T04:39:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.337+0000 7f0ac8906700 1 -- 172.21.15.37:0/347429315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac40ce230 con 0x7f0ac4158ba0 2023-10-06T04:39:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.341+0000 7f0abb7fe700 1 -- 172.21.15.37:0/347429315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc026670 con 0x7f0ac4158ba0 2023-10-06T04:39:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.341+0000 7f0ac8906700 1 -- 172.21.15.37:0/347429315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac40708a0 con 0x7f0ac4158ba0 2023-10-06T04:39:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.341+0000 7f0abb7fe700 1 -- 172.21.15.37:0/347429315 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0abc003040 con 0x7f0ac4158ba0 2023-10-06T04:39:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.341+0000 7f0abb7fe700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0aa4060550 0x7f0aa4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.341+0000 7f0abb7fe700 1 -- 172.21.15.37:0/347429315 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0abc07e4c0 con 0x7f0ac4158ba0 2023-10-06T04:39:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.341+0000 7f0ac37fe700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0aa4060550 0x7f0aa4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.341+0000 7f0ac37fe700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0aa4060550 0x7f0aa4062a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4003860 tx=0x7f0ab4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.353+0000 7f0abb7fe700 1 -- 172.21.15.37:0/347429315 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0abc04e5c0 con 0x7f0ac4158ba0 2023-10-06T04:39:17.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.513+0000 7f0ac8906700 1 -- 172.21.15.37:0/347429315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ac40b0090 con 0x7f0ac4158ba0 2023-10-06T04:39:17.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.513+0000 7f0abb7fe700 1 -- 172.21.15.37:0/347429315 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f0abc051be0 con 0x7f0ac4158ba0 2023-10-06T04:39:17.520 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:17.520 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:15.209829+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:17.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.517+0000 7f0ac8906700 1 -- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0aa4060550 msgr2=0x7f0aa4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.517+0000 7f0ac8906700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0aa4060550 0x7f0aa4062a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4003860 tx=0x7f0ab4009040 comp rx=0 tx=0).stop 2023-10-06T04:39:17.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.517+0000 7f0ac8906700 1 -- 172.21.15.37:0/347429315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4158ba0 msgr2=0x7f0ac40cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.517+0000 7f0ac8906700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4158ba0 0x7f0ac40cf540 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00b610 tx=0x7f0abc018000 comp rx=0 tx=0).stop 2023-10-06T04:39:17.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.517+0000 7f0ac8906700 1 -- 172.21.15.37:0/347429315 shutdown_connections 2023-10-06T04:39:17.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.517+0000 7f0ac8906700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0aa4060550 0x7f0aa4062a00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.517+0000 7f0ac8906700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4158ba0 0x7f0ac40cf540 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.517+0000 7f0ac8906700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ac41587d0 0x7f0ac41698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.517+0000 7f0ac8906700 1 --2- 172.21.15.37:0/347429315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ac4068400 0x7f0ac40c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.517+0000 7f0ac8906700 1 -- 172.21.15.37:0/347429315 >> 172.21.15.37:0/347429315 conn(0x7f0ac40cc5f0 msgr2=0x7f0ac415b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:17.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.517+0000 7f0ac8906700 1 -- 172.21.15.37:0/347429315 shutdown_connections 2023-10-06T04:39:17.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:17.517+0000 7f0ac8906700 1 -- 172.21.15.37:0/347429315 wait complete. 2023-10-06T04:39:17.937 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:39:10.126951+0000', 'modified': '2023-10-06T04:39:15.855990+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/1742476643', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 1742476643}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 1742476643}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T04:39:17.937 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:39:17.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T04:39:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923ffff700 1 Processor -- start 2023-10-06T04:39:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923ffff700 1 -- start start 2023-10-06T04:39:18.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f92400a6b90 0x7f92400acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92400ae730 0x7f92400af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923ffff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92400af490 con 0x7f92400ad090 2023-10-06T04:39:18.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923ffff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92400a6f60 con 0x7f92400ae730 2023-10-06T04:39:18.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923ffff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92401560b0 con 0x7f92400a6b90 2023-10-06T04:39:18.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92400ae730 0x7f92400af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92400ae730 0x7f92400af920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60420/0 (socket says 172.21.15.37:60420) 2023-10-06T04:39:18.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923e7fc700 1 -- 172.21.15.37:0/3263680556 learned_addr learned my addr 172.21.15.37:0/3263680556 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:18.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923effd700 1 --2- 172.21.15.37:0/3263680556 >> v2:172.21.15.83:3300/0 conn(0x7f92400a6b90 0x7f92400acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923e7fc700 1 -- 172.21.15.37:0/3263680556 >> v2:172.21.15.83:3300/0 conn(0x7f92400a6b90 msgr2=0x7f92400acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:18.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923e7fc700 1 --2- 172.21.15.37:0/3263680556 >> v2:172.21.15.83:3300/0 conn(0x7f92400a6b90 0x7f92400acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923e7fc700 1 -- 172.21.15.37:0/3263680556 >> v1:172.21.15.83:6789/0 conn(0x7f92400ad090 legacy=0x7f92400b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:18.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923e7fc700 1 -- 172.21.15.37:0/3263680556 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240156f20 con 0x7f92400ae730 2023-10-06T04:39:18.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923e7fc700 1 --2- 172.21.15.37:0/3263680556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92400ae730 0x7f92400af920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9240067b00 tx=0x7f9228009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b199a694f8ed2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923dffb700 1 -- 172.21.15.37:0/3263680556 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922800e070 con 0x7f92400ae730 2023-10-06T04:39:18.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923dffb700 1 -- 172.21.15.37:0/3263680556 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922800ba10 con 0x7f92400ae730 2023-10-06T04:39:18.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923dffb700 1 -- 172.21.15.37:0/3263680556 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280092e0 con 0x7f92400ae730 2023-10-06T04:39:18.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923ffff700 1 -- 172.21.15.37:0/3263680556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92400ae730 msgr2=0x7f92400af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.053+0000 7f923ffff700 1 --2- 172.21.15.37:0/3263680556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92400ae730 0x7f92400af920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9240067b00 tx=0x7f9228009840 comp rx=0 tx=0).stop 2023-10-06T04:39:18.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 -- 172.21.15.37:0/3263680556 shutdown_connections 2023-10-06T04:39:18.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 --2- 172.21.15.37:0/3263680556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92400ae730 0x7f92400af920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 --2- 172.21.15.37:0/3263680556 >> v2:172.21.15.83:3300/0 conn(0x7f92400a6b90 0x7f92400acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 -- 172.21.15.37:0/3263680556 >> 172.21.15.37:0/3263680556 conn(0x7f92400ccb50 msgr2=0x7f924006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:18.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 -- 172.21.15.37:0/3263680556 shutdown_connections 2023-10-06T04:39:18.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 -- 172.21.15.37:0/3263680556 wait complete. 2023-10-06T04:39:18.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 Processor -- start 2023-10-06T04:39:18.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 -- start start 2023-10-06T04:39:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92400a6b90 0x7f9240096d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92400ad090 0x7f9240154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92400ae730 0x7f9240158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400999a0 con 0x7f92400ad090 2023-10-06T04:39:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9240097240 con 0x7f92400ae730 2023-10-06T04:39:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923ffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9240096520 con 0x7f92400a6b90 2023-10-06T04:39:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92400ad090 0x7f9240154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92400ad090 0x7f9240154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60428/0 (socket says 172.21.15.37:60428) 2023-10-06T04:39:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.057+0000 7f923e7fc700 1 -- 172.21.15.37:0/3798486106 learned_addr learned my addr 172.21.15.37:0/3798486106 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f923effd700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92400a6b90 0x7f9240096d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f923f7fe700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92400ae730 0x7f9240158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f923e7fc700 1 -- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92400a6b90 msgr2=0x7f9240096d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f923e7fc700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92400a6b90 0x7f9240096d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f923e7fc700 1 -- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92400ae730 msgr2=0x7f9240158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f923e7fc700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92400ae730 0x7f9240158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f923e7fc700 1 -- 172.21.15.37:0/3798486106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9228009ae0 con 0x7f92400ad090 2023-10-06T04:39:18.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f923f7fe700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92400ae730 0x7f9240158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:18.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f923e7fc700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92400ad090 0x7f9240154bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9228009fd0 tx=0x7f9228017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f9236ffd700 1 -- 172.21.15.37:0/3798486106 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228007190 con 0x7f92400ad090 2023-10-06T04:39:18.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f9236ffd700 1 -- 172.21.15.37:0/3798486106 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9228012850 con 0x7f92400ad090 2023-10-06T04:39:18.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f923ffff700 1 -- 172.21.15.37:0/3798486106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9240095bf0 con 0x7f92400ad090 2023-10-06T04:39:18.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f9236ffd700 1 -- 172.21.15.37:0/3798486106 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228012c30 con 0x7f92400ad090 2023-10-06T04:39:18.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.061+0000 7f923ffff700 1 -- 172.21.15.37:0/3798486106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92400961b0 con 0x7f92400ad090 2023-10-06T04:39:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.065+0000 7f9236ffd700 1 -- 172.21.15.37:0/3798486106 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f922801d420 con 0x7f92400ad090 2023-10-06T04:39:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.065+0000 7f9236ffd700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9220060580 0x7f9220062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.065+0000 7f9236ffd700 1 -- 172.21.15.37:0/3798486106 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f922807e010 con 0x7f92400ad090 2023-10-06T04:39:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.065+0000 7f923effd700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9220060580 0x7f9220062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.065+0000 7f923effd700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9220060580 0x7f9220062a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9238006fd0 tx=0x7f9238009450 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.065+0000 7f9247976740 1 Processor -- start 2023-10-06T04:39:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.065+0000 7f9247976740 1 -- start start 2023-10-06T04:39:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 0x1cc6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a49710 0x1cc6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a94790 0x1cc70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bf4f30 con 0x1a49ae0 2023-10-06T04:39:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bf0ed0 con 0x1a94790 2023-10-06T04:39:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bb70b0 con 0x1a49710 2023-10-06T04:39:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f923effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 0x1cc6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f923effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 0x1cc6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60438/0 (socket says 172.21.15.37:60438) 2023-10-06T04:39:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f923effd700 1 -- 172.21.15.37:0/1473571508 learned_addr learned my addr 172.21.15.37:0/1473571508 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f923e7fc700 1 --2- 172.21.15.37:0/1473571508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a49710 0x1cc6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f923f7fe700 1 --2- 172.21.15.37:0/1473571508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a94790 0x1cc70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f923effd700 1 -- 172.21.15.37:0/1473571508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a49710 msgr2=0x1cc6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f923effd700 1 --2- 172.21.15.37:0/1473571508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a49710 0x1cc6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f923effd700 1 -- 172.21.15.37:0/1473571508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a94790 msgr2=0x1cc70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f923effd700 1 --2- 172.21.15.37:0/1473571508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a94790 0x1cc70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f923effd700 1 -- 172.21.15.37:0/1473571508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a959e0 con 0x1a49ae0 2023-10-06T04:39:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f923e7fc700 1 --2- 172.21.15.37:0/1473571508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a49710 0x1cc6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f923effd700 1 --2- 172.21.15.37:0/1473571508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 0x1cc6630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9238012dd0 tx=0x7f9238019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37662f2b4de5ca4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f921ffff700 1 -- 172.21.15.37:0/1473571508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238012eb0 con 0x1a49ae0 2023-10-06T04:39:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f921ffff700 1 -- 172.21.15.37:0/1473571508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9238015c70 con 0x1a49ae0 2023-10-06T04:39:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f921ffff700 1 -- 172.21.15.37:0/1473571508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238015e00 con 0x1a49ae0 2023-10-06T04:39:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 -- 172.21.15.37:0/1473571508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 msgr2=0x1cc6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 --2- 172.21.15.37:0/1473571508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 0x1cc6630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9238012dd0 tx=0x7f9238019000 comp rx=0 tx=0).stop 2023-10-06T04:39:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 -- 172.21.15.37:0/1473571508 shutdown_connections 2023-10-06T04:39:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 --2- 172.21.15.37:0/1473571508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a94790 0x1cc70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 --2- 172.21.15.37:0/1473571508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a49710 0x1cc6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 --2- 172.21.15.37:0/1473571508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 0x1cc6630 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.069+0000 7f9247976740 1 -- 172.21.15.37:0/1473571508 >> 172.21.15.37:0/1473571508 conn(0x1a49eb0 msgr2=0x1c83060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f9247976740 1 -- 172.21.15.37:0/1473571508 shutdown_connections 2023-10-06T04:39:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f9247976740 1 -- 172.21.15.37:0/1473571508 wait complete. 2023-10-06T04:39:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f9247976740 1 -- start start 2023-10-06T04:39:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f9247976740 1 Processor -- start 2023-10-06T04:39:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f9247976740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49710 0x1ccac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f9247976740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 0x1ccb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f9247976740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 0x1c80c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f9247976740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bb6d50 con 0x1a49ae0 2023-10-06T04:39:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f9247976740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b8f970 con 0x1a49710 2023-10-06T04:39:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f9247976740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b2d430 con 0x1a94790 2023-10-06T04:39:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f9247976740 10 client.0 _ll_register_callbacks cb 0x1b93b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:39:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f923e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 0x1ccb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f923e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 0x1ccb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60444/0 (socket says 172.21.15.37:60444) 2023-10-06T04:39:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f923e7fc700 1 -- 172.21.15.37:0/3845120428 learned_addr learned my addr 172.21.15.37:0/3845120428 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f923effd700 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49710 0x1ccac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f923f7fe700 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 0x1c80c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f923e7fc700 1 -- 172.21.15.37:0/3845120428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 msgr2=0x1c80c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f923e7fc700 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 0x1c80c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f923e7fc700 1 -- 172.21.15.37:0/3845120428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49710 msgr2=0x1ccac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f923e7fc700 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49710 0x1ccac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.073+0000 7f923e7fc700 1 -- 172.21.15.37:0/3845120428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923800e040 con 0x1a49ae0 2023-10-06T04:39:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f923e7fc700 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 0x1ccb180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9228015040 tx=0x7f922801f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597b4168701ac417 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f921d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:39:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f921d7fa700 1 -- 172.21.15.37:0/3845120428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228058e50 con 0x1a49ae0 2023-10-06T04:39:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f921d7fa700 1 -- 172.21.15.37:0/3845120428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9228055e40 con 0x1a49ae0 2023-10-06T04:39:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 -- 172.21.15.37:0/3845120428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b8fcc0 con 0x1a49ae0 2023-10-06T04:39:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f921d7fa700 1 -- 172.21.15.37:0/3845120428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92280670d0 con 0x1a49ae0 2023-10-06T04:39:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 10 client.4449 fetch_fsmap learned FSMap version 6 2023-10-06T04:39:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 -- 172.21.15.37:0/3845120428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1bbf370 con 0x1a49ae0 2023-10-06T04:39:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f921d7fa700 1 -- 172.21.15.37:0/3845120428 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1b8fcc0 con 0x1a49ae0 2023-10-06T04:39:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f921d7fa700 1 -- 172.21.15.37:0/3845120428 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 6) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f922806d020 con 0x1a49ae0 2023-10-06T04:39:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 10 client.4449 fetch_fsmap finished waiting for FSMap version 6 2023-10-06T04:39:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 10 client.4449 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:39:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 20 client.4449 populate_metadata read hostname 'smithi037' 2023-10-06T04:39:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x1c82290 0x1cd5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 4 client.4449 mds_command: new command op to 4294 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:39:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 -- 172.21.15.37:0/3845120428 --> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b933e0 con 0x1c82290 2023-10-06T04:39:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f923effd700 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x1c82290 0x1cd5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f923effd700 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x1c82290 0x1cd5de0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a056d6d9c90e1907 server_cookie=2732fcc6ec179208 in_seq=0 out_seq=0 2023-10-06T04:39:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f921d7fa700 10 client.4449 ms_handle_connect on v2:172.21.15.37:6834/1742476643 2023-10-06T04:39:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f921d7fa700 1 -- 172.21.15.37:0/3845120428 <== mds.0 v2:172.21.15.37:6834/1742476643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1b933e0 con 0x1c82290 2023-10-06T04:39:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f921d7fa700 10 client.4449 handle_command_reply: tid=0 2023-10-06T04:39:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 client.4449 shutdown 2023-10-06T04:39:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 -- 172.21.15.37:0/3845120428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 msgr2=0x1ccb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 0x1ccb180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9228015040 tx=0x7f922801f040 comp rx=0 tx=0).stop 2023-10-06T04:39:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 -- 172.21.15.37:0/3845120428 shutdown_connections 2023-10-06T04:39:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x1c82290 0x1cd5de0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 0x1c80c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f921d7fa700 0 client.4449 ms_handle_reset on v2:172.21.15.37:6834/1742476643 2023-10-06T04:39:18.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49ae0 0x1ccb180 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 --2- 172.21.15.37:0/3845120428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49710 0x1ccac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 -- 172.21.15.37:0/3845120428 >> 172.21.15.37:0/3845120428 conn(0x1a49eb0 msgr2=0x1caa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:18.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 -- 172.21.15.37:0/3845120428 shutdown_connections 2023-10-06T04:39:18.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 1 -- 172.21.15.37:0/3845120428 wait complete. 2023-10-06T04:39:18.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.077+0000 7f9247976740 20 client.4449 trim_cache size 0 max 16384 2023-10-06T04:39:18.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.097+0000 7f9247976740 1 Processor -- start 2023-10-06T04:39:18.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.097+0000 7f9247976740 1 -- start start 2023-10-06T04:39:18.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.097+0000 7f9247976740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 0x1cfe840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.097+0000 7f9247976740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49ae0 0x1cfed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.097+0000 7f9247976740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 0x1cff2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.097+0000 7f9247976740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bee890 con 0x1a49710 2023-10-06T04:39:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.097+0000 7f9247976740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b9fe00 con 0x1a49ae0 2023-10-06T04:39:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.097+0000 7f9247976740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bf06e0 con 0x1a94790 2023-10-06T04:39:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.097+0000 7f923effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 0x1cfe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.097+0000 7f923effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 0x1cfe840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60456/0 (socket says 172.21.15.37:60456) 2023-10-06T04:39:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.097+0000 7f923effd700 1 -- 172.21.15.37:0/3984060582 learned_addr learned my addr 172.21.15.37:0/3984060582 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923e7fc700 1 --2- 172.21.15.37:0/3984060582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49ae0 0x1cfed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923f7fe700 1 --2- 172.21.15.37:0/3984060582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 0x1cff2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923effd700 1 -- 172.21.15.37:0/3984060582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 msgr2=0x1cff2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:18.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923effd700 1 --2- 172.21.15.37:0/3984060582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 0x1cff2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923effd700 1 -- 172.21.15.37:0/3984060582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49ae0 msgr2=0x1cfed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:18.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923effd700 1 --2- 172.21.15.37:0/3984060582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49ae0 0x1cfed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923effd700 1 -- 172.21.15.37:0/3984060582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92401594a0 con 0x1a49710 2023-10-06T04:39:18.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923effd700 1 --2- 172.21.15.37:0/3984060582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 0x1cfe840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9238025040 tx=0x7f923801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1d112c4a311be1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9234ff9700 1 -- 172.21.15.37:0/3984060582 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238032040 con 0x1a49710 2023-10-06T04:39:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9234ff9700 1 -- 172.21.15.37:0/3984060582 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9238015e70 con 0x1a49710 2023-10-06T04:39:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9234ff9700 1 -- 172.21.15.37:0/3984060582 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92380090c0 con 0x1a49710 2023-10-06T04:39:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 -- 172.21.15.37:0/3984060582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 msgr2=0x1cfe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 --2- 172.21.15.37:0/3984060582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 0x1cfe840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9238025040 tx=0x7f923801c000 comp rx=0 tx=0).stop 2023-10-06T04:39:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 -- 172.21.15.37:0/3984060582 shutdown_connections 2023-10-06T04:39:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 --2- 172.21.15.37:0/3984060582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49ae0 0x1cfed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 --2- 172.21.15.37:0/3984060582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 0x1cff2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 --2- 172.21.15.37:0/3984060582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 0x1cfe840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 -- 172.21.15.37:0/3984060582 >> 172.21.15.37:0/3984060582 conn(0x1a49eb0 msgr2=0x1cc9650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 -- 172.21.15.37:0/3984060582 shutdown_connections 2023-10-06T04:39:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 -- 172.21.15.37:0/3984060582 wait complete. 2023-10-06T04:39:18.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 -- start start 2023-10-06T04:39:18.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 Processor -- start 2023-10-06T04:39:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 0x1cd7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49ae0 0x1d19010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 0x1d19550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x1baf870 con 0x1a49710 2023-10-06T04:39:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b9a510 con 0x1a49ae0 2023-10-06T04:39:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bf7290 con 0x1a94790 2023-10-06T04:39:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f9247976740 10 client.0 _ll_register_callbacks cb 0x1bbc110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:39:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 0x1cd7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 0x1cd7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60460/0 (socket says 172.21.15.37:60460) 2023-10-06T04:39:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923effd700 1 -- 172.21.15.37:0/2947553944 learned_addr learned my addr 172.21.15.37:0/2947553944 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923f7fe700 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 0x1d19550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.101+0000 7f923e7fc700 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49ae0 0x1d19010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f923effd700 1 -- 172.21.15.37:0/2947553944 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 msgr2=0x1d19550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f923effd700 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 0x1d19550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f923effd700 1 -- 172.21.15.37:0/2947553944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49ae0 msgr2=0x1d19010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f923effd700 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49ae0 0x1d19010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f923effd700 1 -- 172.21.15.37:0/2947553944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1a959e0 con 0x1a49710 2023-10-06T04:39:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f921d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:39:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f923effd700 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 0x1cd7880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9238025040 tx=0x7f923802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c3a804c78b88b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f921d7fa700 1 -- 172.21.15.37:0/2947553944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238032040 con 0x1a49710 2023-10-06T04:39:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f921d7fa700 1 -- 172.21.15.37:0/2947553944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f92380090c0 con 0x1a49710 2023-10-06T04:39:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 -- 172.21.15.37:0/2947553944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9238015c70 con 0x1a49710 2023-10-06T04:39:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f921d7fa700 1 -- 172.21.15.37:0/2947553944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9238005c10 con 0x1a49710 2023-10-06T04:39:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 10 client.4455 fetch_fsmap learned FSMap version 6 2023-10-06T04:39:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 -- 172.21.15.37:0/2947553944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1ba5d80 con 0x1a49710 2023-10-06T04:39:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f921d7fa700 1 -- 172.21.15.37:0/2947553944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9238015c70 con 0x1a49710 2023-10-06T04:39:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f921d7fa700 1 -- 172.21.15.37:0/2947553944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 6) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f923803f030 con 0x1a49710 2023-10-06T04:39:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 10 client.4455 fetch_fsmap finished waiting for FSMap version 6 2023-10-06T04:39:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 10 client.4455 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:39:18.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 20 client.4455 populate_metadata read hostname 'smithi037' 2023-10-06T04:39:18.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x1c82290 0x1d19a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 4 client.4455 mds_command: new command op to 4294 tid=0[{"prefix": "status"}] 2023-10-06T04:39:18.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 -- 172.21.15.37:0/2947553944 --> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1bc5410 con 0x1c82290 2023-10-06T04:39:18.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f923e7fc700 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x1c82290 0x1d19a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f921d7fa700 10 client.4455 ms_handle_connect on v2:172.21.15.37:6834/1742476643 2023-10-06T04:39:18.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f923e7fc700 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x1c82290 0x1d19a90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a824fd568857382b server_cookie=ca522f2289e3e93 in_seq=0 out_seq=0 2023-10-06T04:39:18.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f921d7fa700 1 -- 172.21.15.37:0/2947553944 <== mds.0 v2:172.21.15.37:6834/1742476643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x1bc5410 con 0x1c82290 2023-10-06T04:39:18.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f921d7fa700 10 client.4455 handle_command_reply: tid=0 2023-10-06T04:39:18.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 client.4455 shutdown 2023-10-06T04:39:18.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 -- 172.21.15.37:0/2947553944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 msgr2=0x1cd7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 0x1cd7880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9238025040 tx=0x7f923802e000 comp rx=0 tx=0).stop 2023-10-06T04:39:18.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 -- 172.21.15.37:0/2947553944 shutdown_connections 2023-10-06T04:39:18.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1a49ae0 0x1d19010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x1c82290 0x1d19a90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1a94790 0x1d19550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f921d7fa700 0 client.4455 ms_handle_reset on v2:172.21.15.37:6834/1742476643 2023-10-06T04:39:18.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 --2- 172.21.15.37:0/2947553944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a49710 0x1cd7880 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 -- 172.21.15.37:0/2947553944 >> 172.21.15.37:0/2947553944 conn(0x1a49eb0 msgr2=0x1c82660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:18.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 -- 172.21.15.37:0/2947553944 shutdown_connections 2023-10-06T04:39:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.105+0000 7f9247976740 1 -- 172.21.15.37:0/2947553944 wait complete. 2023-10-06T04:39:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f9247976740 20 client.4455 trim_cache size 0 max 16384 2023-10-06T04:39:18.119 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:39:18.119 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "77bb67cc-15eb-432c-9ac1-b724f40102d2", 2023-10-06T04:39:18.119 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T04:39:18.119 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4294, 2023-10-06T04:39:18.119 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T04:39:18.119 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T04:39:18.119 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T04:39:18.120 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 7.3393480540000002, 2023-10-06T04:39:18.120 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 6, 2023-10-06T04:39:18.120 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 28, 2023-10-06T04:39:18.120 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 28, 2023-10-06T04:39:18.120 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 12.376075541000001 2023-10-06T04:39:18.120 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f923ffff700 1 -- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9220060580 msgr2=0x7f9220062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f923ffff700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9220060580 0x7f9220062a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9238006fd0 tx=0x7f9238009450 comp rx=0 tx=0).stop 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f923ffff700 1 -- 172.21.15.37:0/3798486106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92400ad090 msgr2=0x7f9240154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f923ffff700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92400ad090 0x7f9240154bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9228009fd0 tx=0x7f9228017000 comp rx=0 tx=0).stop 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f923ffff700 1 -- 172.21.15.37:0/3798486106 shutdown_connections 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f923ffff700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9220060580 0x7f9220062a30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f923ffff700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92400ae730 0x7f9240158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f923ffff700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92400ad090 0x7f9240154bf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f923ffff700 1 --2- 172.21.15.37:0/3798486106 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92400a6b90 0x7f9240096d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f923ffff700 1 -- 172.21.15.37:0/3798486106 >> 172.21.15.37:0/3798486106 conn(0x7f92400ccb50 msgr2=0x7f924006bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:18.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f923ffff700 1 -- 172.21.15.37:0/3798486106 shutdown_connections 2023-10-06T04:39:18.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.109+0000 7f923ffff700 1 -- 172.21.15.37:0/3798486106 wait complete. 2023-10-06T04:39:18.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:39:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc6fdc700 1 Processor -- start 2023-10-06T04:39:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc6fdc700 1 -- start start 2023-10-06T04:39:18.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc6fdc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cc00af570 0x7f1cc006cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc6fdc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cc00aff50 0x7f1cc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc6fdc700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc00c89e0 con 0x7f1cc00af1a0 2023-10-06T04:39:18.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc6fdc700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00c83c0 con 0x7f1cc00aff50 2023-10-06T04:39:18.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc6fdc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00cc690 con 0x7f1cc00af570 2023-10-06T04:39:18.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc67db700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cc00aff50 0x7f1cc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc5fda700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1cc00af1a0 0x7f1cc00ad430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54972/0 (socket says 172.21.15.37:54972) 2023-10-06T04:39:18.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc5fda700 1 -- 172.21.15.37:0/1125582303 learned_addr learned my addr 172.21.15.37:0/1125582303 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:18.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc57d9700 1 --2- 172.21.15.37:0/1125582303 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cc00af570 0x7f1cc006cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc67db700 1 -- 172.21.15.37:0/1125582303 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cc00af570 msgr2=0x7f1cc006cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:18.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc67db700 1 --2- 172.21.15.37:0/1125582303 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cc00af570 0x7f1cc006cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc67db700 1 -- 172.21.15.37:0/1125582303 >> v1:172.21.15.37:6789/0 conn(0x7f1cc00af1a0 legacy=0x7f1cc00ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.241+0000 7f1cc67db700 1 -- 172.21.15.37:0/1125582303 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc01572a0 con 0x7f1cc00aff50 2023-10-06T04:39:18.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc67db700 1 --2- 172.21.15.37:0/1125582303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc00aff50 0x7f1cc006d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009e60 tx=0x7f1cb8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55a0d9400fd6ffe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc4fd8700 1 -- 172.21.15.37:0/1125582303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800e070 con 0x7f1cc00aff50 2023-10-06T04:39:18.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc4fd8700 1 -- 172.21.15.37:0/1125582303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb800bb60 con 0x7f1cc00aff50 2023-10-06T04:39:18.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc4fd8700 1 -- 172.21.15.37:0/1125582303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8012430 con 0x7f1cc00aff50 2023-10-06T04:39:18.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/1125582303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc00aff50 msgr2=0x7f1cc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 --2- 172.21.15.37:0/1125582303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc00aff50 0x7f1cc006d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009e60 tx=0x7f1cb8009780 comp rx=0 tx=0).stop 2023-10-06T04:39:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/1125582303 shutdown_connections 2023-10-06T04:39:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 --2- 172.21.15.37:0/1125582303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc00aff50 0x7f1cc006d330 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 --2- 172.21.15.37:0/1125582303 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cc00af570 0x7f1cc006cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/1125582303 >> 172.21.15.37:0/1125582303 conn(0x7f1cc006c2d0 msgr2=0x7f1cc00cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/1125582303 shutdown_connections 2023-10-06T04:39:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/1125582303 wait complete. 2023-10-06T04:39:18.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 Processor -- start 2023-10-06T04:39:18.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 -- start start 2023-10-06T04:39:18.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc00af1a0 0x7f1cc00b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cc00af570 0x7f1cc0169380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc00aff50 0x7f1cc01540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc016a3e0 con 0x7f1cc00aff50 2023-10-06T04:39:18.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc01698c0 con 0x7f1cc00af1a0 2023-10-06T04:39:18.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc6fdc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0169b40 con 0x7f1cc00af570 2023-10-06T04:39:18.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc67db700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc00aff50 0x7f1cc01540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc67db700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc00aff50 0x7f1cc01540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60472/0 (socket says 172.21.15.37:60472) 2023-10-06T04:39:18.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.245+0000 7f1cc67db700 1 -- 172.21.15.37:0/963203434 learned_addr learned my addr 172.21.15.37:0/963203434 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:18.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cc5fda700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc00af1a0 0x7f1cc00b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cc57d9700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cc00af570 0x7f1cc0169380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cc67db700 1 -- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cc00af570 msgr2=0x7f1cc0169380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cc67db700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cc00af570 0x7f1cc0169380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cc67db700 1 -- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc00af1a0 msgr2=0x7f1cc00b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cc67db700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc00af1a0 0x7f1cc00b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cc67db700 1 -- 172.21.15.37:0/963203434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8009a20 con 0x7f1cc00aff50 2023-10-06T04:39:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cc57d9700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cc00af570 0x7f1cc0169380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cc67db700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc00aff50 0x7f1cc01540b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006b4f0 tx=0x7f1cb8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cb5ffb700 1 -- 172.21.15.37:0/963203434 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8012e50 con 0x7f1cc00aff50 2023-10-06T04:39:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cb5ffb700 1 -- 172.21.15.37:0/963203434 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb801d630 con 0x7f1cc00aff50 2023-10-06T04:39:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/963203434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc0169e20 con 0x7f1cc00aff50 2023-10-06T04:39:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cb5ffb700 1 -- 172.21.15.37:0/963203434 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb801d9f0 con 0x7f1cc00aff50 2023-10-06T04:39:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/963203434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc0068fa0 con 0x7f1cc00aff50 2023-10-06T04:39:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.249+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/963203434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc00691f0 con 0x7f1cc00aff50 2023-10-06T04:39:18.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.253+0000 7f1cb5ffb700 1 -- 172.21.15.37:0/963203434 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1cb8024070 con 0x7f1cc00aff50 2023-10-06T04:39:18.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.253+0000 7f1cb5ffb700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1ca4060550 0x7f1ca4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.253+0000 7f1cb5ffb700 1 -- 172.21.15.37:0/963203434 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1cb807f420 con 0x7f1cc00aff50 2023-10-06T04:39:18.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.253+0000 7f1cc5fda700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1ca4060550 0x7f1ca4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.253+0000 7f1cc5fda700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1ca4060550 0x7f1ca4062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00b1970 tx=0x7f1cbc007eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.257+0000 7f1cb5ffb700 1 -- 172.21.15.37:0/963203434 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1cb804f5c0 con 0x7f1cc00aff50 2023-10-06T04:39:18.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.453+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/963203434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1cc00708a0 con 0x7f1cc00aff50 2023-10-06T04:39:18.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.453+0000 7f1cb5ffb700 1 -- 172.21.15.37:0/963203434 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1cb8052be0 con 0x7f1cc00aff50 2023-10-06T04:39:18.459 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:39:18.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.457+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1ca4060550 msgr2=0x7f1ca4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.457+0000 7f1cc6fdc700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1ca4060550 0x7f1ca4062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00b1970 tx=0x7f1cbc007eb0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.457+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/963203434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc00aff50 msgr2=0x7f1cc01540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.457+0000 7f1cc6fdc700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc00aff50 0x7f1cc01540b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006b4f0 tx=0x7f1cb8019000 comp rx=0 tx=0).stop 2023-10-06T04:39:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.457+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/963203434 shutdown_connections 2023-10-06T04:39:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.457+0000 7f1cc6fdc700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1ca4060550 0x7f1ca4062a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.457+0000 7f1cc6fdc700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc00aff50 0x7f1cc01540b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.457+0000 7f1cc6fdc700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cc00af570 0x7f1cc0169380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.457+0000 7f1cc6fdc700 1 --2- 172.21.15.37:0/963203434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc00af1a0 0x7f1cc00b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.457+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/963203434 >> 172.21.15.37:0/963203434 conn(0x7f1cc006c2d0 msgr2=0x7f1cc00c2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.457+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/963203434 shutdown_connections 2023-10-06T04:39:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:18.457+0000 7f1cc6fdc700 1 -- 172.21.15.37:0/963203434 wait complete. 2023-10-06T04:39:18.474 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T04:39:18.474 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:39:18.474 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T04:39:18.474 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-06T04:39:18.474 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:39:18.474 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T04:39:18.474 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:39:18.474 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:39:18.474 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T04:39:18.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:18.475 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T04:39:18.480 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:18.480 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:18.480 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:18.480 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:18.480 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:18.480 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:18.480 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:18.480 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:18.481 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:39:18.481 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:18.481 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T04:39:18.481 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42589sec preferred_lft 42589sec 2023-10-06T04:39:18.481 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T04:39:18.481 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:18.481 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:18.481 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:18.481 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:18.481 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:18.481 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T04:39:18.482 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:e0:81:f4:d2 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:18.482 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T04:39:18.482 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:18.482 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:39:18.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:18.482 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:18.482 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:18.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:39:18.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2023-10-06T04:39:18.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2023-10-06T04:39:18.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:39:18.483 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:18.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:18.568 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:39:18.579 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T04:39:18.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:18.580 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T04:39:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T04:39:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:39:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T04:39:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T04:39:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T04:39:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:39:18.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:18.620 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:18.620 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:18.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:39:18.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:39:18.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:39:18.620 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:18.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:18.702 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:39:18.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:18.709 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-10-06T04:39:18.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:18.717 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:18.717 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:18.717 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T04:39:18.717 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-06T04:39:18.717 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:18.793 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-06T04:39:18.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:18.793 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:18.793 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:18.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-06T04:39:18.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:39:18.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-06T04:39:18.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-06T04:39:18.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-06T04:39:18.794 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:18.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:18.871 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:18.871 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:18.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T04:39:18.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:39:18.871 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:18.901 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-06T04:39:18.901 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:18.902 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:39:18.906 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T04:39:18.906 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:18.906 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:39:18.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:39:18.924 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:18.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:18.935 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:18.935 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:18.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:18.936 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:39:18.942 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T04:39:18.942 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-06T04:39:18.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:39:19.003 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:19.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:19.013 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:19.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:19.014 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:39:19.077 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:2023-10-06T04:39:19.073+0000 7f294961a380 -1 init, newargv = 0x55742a9d63d0 newargc=15 2023-10-06T04:39:19.077 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[38838]: starting ceph client 2023-10-06T04:39:19.090 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[38838]: starting fuse 2023-10-06T04:39:20.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:39:20.182 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:20.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:20.197 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:20.198 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:20.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:20.199 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:39:20.205 INFO:teuthology.orchestra.run.smithi037.stdout:52 2023-10-06T04:39:20.205 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T04:39:20.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:39:20.206 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T04:39:20.206 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T04:39:20.206 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T04:39:20.206 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T04:39:20.206 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:39:20.206 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T04:39:20.206 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-06T04:39:20.206 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T04:39:20.206 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-06T04:39:20.206 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:39:20.206 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:39:20.207 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.admin")) 2023-10-06T04:39:20.208 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T04:39:20.332 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.admin.38838.asok 2023-10-06T04:39:20.517 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.38838.asok 2023-10-06T04:39:20.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:20.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.38838.asok status 2023-10-06T04:39:20.609 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:39:20.609 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T04:39:20.609 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T04:39:20.609 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T04:39:20.609 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "admin", 2023-10-06T04:39:20.609 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T04:39:20.610 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-06T04:39:20.610 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "38838", 2023-10-06T04:39:20.610 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T04:39:20.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:20.610 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T04:39:20.610 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T04:39:20.610 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4470, 2023-10-06T04:39:20.610 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T04:39:20.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T04:39:20.610 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T04:39:20.610 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 4470 2023-10-06T04:39:20.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 202777491 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 202777491 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.4470 192.168.0.1:0/202777491", 2023-10-06T04:39:20.611 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/202777491", 2023-10-06T04:39:20.612 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T04:39:20.612 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 6, 2023-10-06T04:39:20.612 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 28, 2023-10-06T04:39:20.612 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T04:39:20.612 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T04:39:20.612 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T04:39:20.612 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:39:20.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:20.618 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T04:39:20.619 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:39:20.626 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T04:39:20.627 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:39:20.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:20.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:39:20.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:20.638 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-06T04:39:20.687 INFO:teuthology.orchestra.run.smithi037.stdout:# file: . 2023-10-06T04:39:20.687 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-06T04:39:20.688 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:20.688 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T04:39:20.689 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:39:20.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:39:20.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[38838]: fuse finished with error 0 and tester_r 0 2023-10-06T04:39:20.711 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T04:39:26.813 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:39:26.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:26.813 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-06T04:39:26.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:26.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33d61c9700 1 Processor -- start 2023-10-06T04:39:26.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33d61c9700 1 -- start start 2023-10-06T04:39:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33d61c9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f33d00cc120 0x7f33d006e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33d61c9700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d006dd70 con 0x7f33d00cbd50 2023-10-06T04:39:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33d61c9700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d006eba0 con 0x7f33d006e740 2023-10-06T04:39:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33d61c9700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d00add50 con 0x7f33d00cc120 2023-10-06T04:39:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33cf7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f33d00cbd50 0x7f33d00c9820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42522/0 (socket says 172.21.15.37:42522) 2023-10-06T04:39:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33cf7fe700 1 -- 172.21.15.37:0/2404490582 learned_addr learned my addr 172.21.15.37:0/2404490582 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33ceffd700 1 --2- 172.21.15.37:0/2404490582 >> v2:172.21.15.83:3300/0 conn(0x7f33d00cc120 0x7f33d006e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33ce7fc700 1 -- 172.21.15.37:0/2404490582 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109286902 0 0) 0x7f33d006dd70 con 0x7f33d00cbd50 2023-10-06T04:39:26.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33ce7fc700 1 -- 172.21.15.37:0/2404490582 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33b8003570 con 0x7f33d00cbd50 2023-10-06T04:39:26.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33ceffd700 1 -- 172.21.15.37:0/2404490582 >> v1:172.21.15.83:6789/0 conn(0x7f33d006e740 legacy=0x7f33d015cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33ceffd700 1 -- 172.21.15.37:0/2404490582 >> v1:172.21.15.37:6789/0 conn(0x7f33d00cbd50 legacy=0x7f33d00c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33ceffd700 1 -- 172.21.15.37:0/2404490582 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00ae030 con 0x7f33d00cc120 2023-10-06T04:39:26.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33ceffd700 1 --2- 172.21.15.37:0/2404490582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d00cc120 0x7f33d006e200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33c40098e0 tx=0x7f33c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f895a2bf6d8cdafa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:26.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33ce7fc700 1 -- 172.21.15.37:0/2404490582 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c400b640 con 0x7f33d00cc120 2023-10-06T04:39:26.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33ce7fc700 1 -- 172.21.15.37:0/2404490582 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c400b7a0 con 0x7f33d00cc120 2023-10-06T04:39:26.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.937+0000 7f33ce7fc700 1 -- 172.21.15.37:0/2404490582 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c400bb40 con 0x7f33d00cc120 2023-10-06T04:39:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.941+0000 7f33d61c9700 1 -- 172.21.15.37:0/2404490582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d00cc120 msgr2=0x7f33d006e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.941+0000 7f33d61c9700 1 --2- 172.21.15.37:0/2404490582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d00cc120 0x7f33d006e200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33c40098e0 tx=0x7f33c40091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.941+0000 7f33d61c9700 1 -- 172.21.15.37:0/2404490582 shutdown_connections 2023-10-06T04:39:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.941+0000 7f33d61c9700 1 --2- 172.21.15.37:0/2404490582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d00cc120 0x7f33d006e200 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.941+0000 7f33d61c9700 1 -- 172.21.15.37:0/2404490582 >> 172.21.15.37:0/2404490582 conn(0x7f33d00667b0 msgr2=0x7f33d0066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.941+0000 7f33d61c9700 1 -- 172.21.15.37:0/2404490582 shutdown_connections 2023-10-06T04:39:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.941+0000 7f33d61c9700 1 -- 172.21.15.37:0/2404490582 wait complete. 2023-10-06T04:39:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.941+0000 7f33d61c9700 1 Processor -- start 2023-10-06T04:39:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33d61c9700 1 -- start start 2023-10-06T04:39:26.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33d61c9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006e740 0x7f33d014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33d61c9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33d00cbd50 0x7f33d015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33d61c9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d00cc120 0x7f33d015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33d61c9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0170cb0 con 0x7f33d00cc120 2023-10-06T04:39:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33d61c9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0170f50 con 0x7f33d006e740 2023-10-06T04:39:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33d61c9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0171230 con 0x7f33d00cbd50 2023-10-06T04:39:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33cf7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006e740 0x7f33d014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33cffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d00cc120 0x7f33d015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33cf7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006e740 0x7f33d014dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:56248/0 (socket says 172.21.15.37:56248) 2023-10-06T04:39:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33cf7fe700 1 -- 172.21.15.37:0/748523575 learned_addr learned my addr 172.21.15.37:0/748523575 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33ceffd700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33d00cbd50 0x7f33d015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33cf7fe700 1 -- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33d00cbd50 msgr2=0x7f33d015a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33cf7fe700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33d00cbd50 0x7f33d015a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33cf7fe700 1 -- 172.21.15.37:0/748523575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d00cc120 msgr2=0x7f33d015ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33cf7fe700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d00cc120 0x7f33d015ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33cf7fe700 1 -- 172.21.15.37:0/748523575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c4009420 con 0x7f33d006e740 2023-10-06T04:39:26.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33cffff700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d00cc120 0x7f33d015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:26.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33cf7fe700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006e740 0x7f33d014dff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f33c000c7c0 tx=0x7f33c0007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33b77fe700 1 -- 172.21.15.37:0/748523575 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0005cd0 con 0x7f33d006e740 2023-10-06T04:39:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33b77fe700 1 -- 172.21.15.37:0/748523575 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c0005e30 con 0x7f33d006e740 2023-10-06T04:39:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33d61c9700 1 -- 172.21.15.37:0/748523575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d0171510 con 0x7f33d006e740 2023-10-06T04:39:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.945+0000 7f33b77fe700 1 -- 172.21.15.37:0/748523575 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0007320 con 0x7f33d006e740 2023-10-06T04:39:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.949+0000 7f33d61c9700 1 -- 172.21.15.37:0/748523575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d0171a30 con 0x7f33d006e740 2023-10-06T04:39:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.949+0000 7f33d61c9700 1 -- 172.21.15.37:0/748523575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d0171750 con 0x7f33d006e740 2023-10-06T04:39:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.949+0000 7f33b77fe700 1 -- 172.21.15.37:0/748523575 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f33c001b3b0 con 0x7f33d006e740 2023-10-06T04:39:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.949+0000 7f33b77fe700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f33bc060550 0x7f33bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.949+0000 7f33b77fe700 1 -- 172.21.15.37:0/748523575 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f33c007c330 con 0x7f33d006e740 2023-10-06T04:39:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.949+0000 7f33ceffd700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f33bc060550 0x7f33bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.953+0000 7f33ceffd700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f33bc060550 0x7f33bc062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f33c40093f0 tx=0x7f33c4017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:26.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:26.961+0000 7f33b77fe700 1 -- 172.21.15.37:0/748523575 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f33c004c430 con 0x7f33d006e740 2023-10-06T04:39:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.125+0000 7f33d61c9700 1 -- 172.21.15.37:0/748523575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33d0171090 con 0x7f33d006e740 2023-10-06T04:39:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.125+0000 7f33b77fe700 1 -- 172.21.15.37:0/748523575 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f33d0171090 con 0x7f33d006e740 2023-10-06T04:39:27.133 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:27.133 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:15.209829+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.129+0000 7f33d61c9700 1 -- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f33bc060550 msgr2=0x7f33bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.129+0000 7f33d61c9700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f33bc060550 0x7f33bc062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f33c40093f0 tx=0x7f33c4017000 comp rx=0 tx=0).stop 2023-10-06T04:39:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.129+0000 7f33d61c9700 1 -- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006e740 msgr2=0x7f33d014dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.129+0000 7f33d61c9700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006e740 0x7f33d014dff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f33c000c7c0 tx=0x7f33c0007e00 comp rx=0 tx=0).stop 2023-10-06T04:39:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.129+0000 7f33d61c9700 1 -- 172.21.15.37:0/748523575 shutdown_connections 2023-10-06T04:39:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.129+0000 7f33d61c9700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f33bc060550 0x7f33bc062a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.129+0000 7f33d61c9700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d00cc120 0x7f33d015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.129+0000 7f33d61c9700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33d00cbd50 0x7f33d015a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.129+0000 7f33d61c9700 1 --2- 172.21.15.37:0/748523575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006e740 0x7f33d014dff0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.129+0000 7f33d61c9700 1 -- 172.21.15.37:0/748523575 >> 172.21.15.37:0/748523575 conn(0x7f33d00667b0 msgr2=0x7f33d00cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.129+0000 7f33d61c9700 1 -- 172.21.15.37:0/748523575 shutdown_connections 2023-10-06T04:39:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.129+0000 7f33d61c9700 1 -- 172.21.15.37:0/748523575 wait complete. 2023-10-06T04:39:27.148 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:27.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.249+0000 7f2c4e4a6700 1 Processor -- start 2023-10-06T04:39:27.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.249+0000 7f2c4e4a6700 1 -- start start 2023-10-06T04:39:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2c48158e10 0x7f2c480cc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c480c88f0 0x7f2c48067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c480c16f0 con 0x7f2c481591e0 2023-10-06T04:39:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c480c8de0 con 0x7f2c48158e10 2023-10-06T04:39:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480ca490 con 0x7f2c480c88f0 2023-10-06T04:39:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4cca3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c480c88f0 0x7f2c48067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4d4a4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2c48158e10 0x7f2c480cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4dca5700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f2c481591e0 0x7f2c480c6f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:58678/0 (socket says 172.21.15.37:58678) 2023-10-06T04:39:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4cca3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c480c88f0 0x7f2c48067cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:44598/0 (socket says 172.21.15.37:44598) 2023-10-06T04:39:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4dca5700 1 -- 172.21.15.37:0/1839222214 learned_addr learned my addr 172.21.15.37:0/1839222214 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:27.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4cca3700 1 -- 172.21.15.37:0/1839222214 >> v2:172.21.15.83:3300/0 conn(0x7f2c48158e10 msgr2=0x7f2c480cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4cca3700 1 --2- 172.21.15.37:0/1839222214 >> v2:172.21.15.83:3300/0 conn(0x7f2c48158e10 0x7f2c480cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4cca3700 1 -- 172.21.15.37:0/1839222214 >> v1:172.21.15.83:6789/0 conn(0x7f2c481591e0 legacy=0x7f2c480c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4cca3700 1 -- 172.21.15.37:0/1839222214 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480ca770 con 0x7f2c480c88f0 2023-10-06T04:39:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c3ffff700 1 -- 172.21.15.37:0/1839222214 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324172605 0 0) 0x7f2c480c16f0 con 0x7f2c481591e0 2023-10-06T04:39:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4cca3700 1 --2- 172.21.15.37:0/1839222214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c480c88f0 0x7f2c48067cf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009e60 tx=0x7f2c44009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04174d791b9627d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c3ffff700 1 -- 172.21.15.37:0/1839222214 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4400e070 con 0x7f2c480c88f0 2023-10-06T04:39:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c3ffff700 1 -- 172.21.15.37:0/1839222214 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4400bb60 con 0x7f2c480c88f0 2023-10-06T04:39:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c3ffff700 1 -- 172.21.15.37:0/1839222214 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44012430 con 0x7f2c480c88f0 2023-10-06T04:39:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/1839222214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c480c88f0 msgr2=0x7f2c48067cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 --2- 172.21.15.37:0/1839222214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c480c88f0 0x7f2c48067cf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009e60 tx=0x7f2c44009780 comp rx=0 tx=0).stop 2023-10-06T04:39:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/1839222214 shutdown_connections 2023-10-06T04:39:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 --2- 172.21.15.37:0/1839222214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c480c88f0 0x7f2c48067cf0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 --2- 172.21.15.37:0/1839222214 >> v2:172.21.15.83:3300/0 conn(0x7f2c48158e10 0x7f2c480cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/1839222214 >> 172.21.15.37:0/1839222214 conn(0x7f2c480695e0 msgr2=0x7f2c480cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/1839222214 shutdown_connections 2023-10-06T04:39:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.253+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/1839222214 wait complete. 2023-10-06T04:39:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4e4a6700 1 Processor -- start 2023-10-06T04:39:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4e4a6700 1 -- start start 2023-10-06T04:39:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4e4a6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c480c88f0 0x7f2c4813adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4e4a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c48158e10 0x7f2c4813b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4e4a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c481591e0 0x7f2c4813bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4e4a6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4814e150 con 0x7f2c481591e0 2023-10-06T04:39:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4e4a6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4813c350 con 0x7f2c480c88f0 2023-10-06T04:39:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4e4a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4813c630 con 0x7f2c48158e10 2023-10-06T04:39:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4dca5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c481591e0 0x7f2c4813bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4dca5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c481591e0 0x7f2c4813bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59400/0 (socket says 172.21.15.37:59400) 2023-10-06T04:39:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4dca5700 1 -- 172.21.15.37:0/89505252 learned_addr learned my addr 172.21.15.37:0/89505252 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4cca3700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c48158e10 0x7f2c4813b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4d4a4700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c480c88f0 0x7f2c4813adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4dca5700 1 -- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c48158e10 msgr2=0x7f2c4813b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4dca5700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c48158e10 0x7f2c4813b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4dca5700 1 -- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c480c88f0 msgr2=0x7f2c4813adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4dca5700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c480c88f0 0x7f2c4813adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4dca5700 1 -- 172.21.15.37:0/89505252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c44009a20 con 0x7f2c481591e0 2023-10-06T04:39:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4dca5700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c481591e0 0x7f2c4813bcb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000c500 tx=0x7f2c40007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c3d7fa700 1 -- 172.21.15.37:0/89505252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40005b30 con 0x7f2c481591e0 2023-10-06T04:39:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c3d7fa700 1 -- 172.21.15.37:0/89505252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c40005c90 con 0x7f2c481591e0 2023-10-06T04:39:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c3d7fa700 1 -- 172.21.15.37:0/89505252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40007320 con 0x7f2c481591e0 2023-10-06T04:39:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/89505252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4813c910 con 0x7f2c481591e0 2023-10-06T04:39:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.257+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/89505252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4813ced0 con 0x7f2c481591e0 2023-10-06T04:39:27.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.261+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/89505252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4813d0c0 con 0x7f2c481591e0 2023-10-06T04:39:27.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.261+0000 7f2c3d7fa700 1 -- 172.21.15.37:0/89505252 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2c4001b3b0 con 0x7f2c481591e0 2023-10-06T04:39:27.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.261+0000 7f2c3d7fa700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2c2c060550 0x7f2c2c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.261+0000 7f2c3d7fa700 1 -- 172.21.15.37:0/89505252 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2c4007c0a0 con 0x7f2c481591e0 2023-10-06T04:39:27.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.261+0000 7f2c4d4a4700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2c2c060550 0x7f2c2c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.265+0000 7f2c4d4a4700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2c2c060550 0x7f2c2c062a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009db0 tx=0x7f2c380091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.269+0000 7f2c3d7fa700 1 -- 172.21.15.37:0/89505252 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2c4004c1a0 con 0x7f2c481591e0 2023-10-06T04:39:27.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.433+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/89505252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c480708a0 con 0x7f2c481591e0 2023-10-06T04:39:27.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.437+0000 7f2c3d7fa700 1 -- 172.21.15.37:0/89505252 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f2c4004f7c0 con 0x7f2c481591e0 2023-10-06T04:39:27.443 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:27.443 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:15.209829+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.437+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2c2c060550 msgr2=0x7f2c2c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.437+0000 7f2c4e4a6700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2c2c060550 0x7f2c2c062a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009db0 tx=0x7f2c380091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.437+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/89505252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c481591e0 msgr2=0x7f2c4813bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.437+0000 7f2c4e4a6700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c481591e0 0x7f2c4813bcb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000c500 tx=0x7f2c40007f60 comp rx=0 tx=0).stop 2023-10-06T04:39:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.437+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/89505252 shutdown_connections 2023-10-06T04:39:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.437+0000 7f2c4e4a6700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2c2c060550 0x7f2c2c062a00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.437+0000 7f2c4e4a6700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c481591e0 0x7f2c4813bcb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.437+0000 7f2c4e4a6700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c48158e10 0x7f2c4813b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.437+0000 7f2c4e4a6700 1 --2- 172.21.15.37:0/89505252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c480c88f0 0x7f2c4813adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.441+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/89505252 >> 172.21.15.37:0/89505252 conn(0x7f2c480695e0 msgr2=0x7f2c48158010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.441+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/89505252 shutdown_connections 2023-10-06T04:39:27.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.441+0000 7f2c4e4a6700 1 -- 172.21.15.37:0/89505252 wait complete. 2023-10-06T04:39:27.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:39:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.565+0000 7ff2eaf5b700 1 Processor -- start 2023-10-06T04:39:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.565+0000 7ff2eaf5b700 1 -- start start 2023-10-06T04:39:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.565+0000 7ff2eaf5b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e415a440 0x7ff2e406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.565+0000 7ff2eaf5b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e415ae50 con 0x7ff2e406e190 2023-10-06T04:39:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.565+0000 7ff2eaf5b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e4068760 con 0x7ff2e406f140 2023-10-06T04:39:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.565+0000 7ff2eaf5b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40ad370 con 0x7ff2e415a440 2023-10-06T04:39:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.565+0000 7ff2e9f59700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff2e406e190 0x7ff2e415b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42526/0 (socket says 172.21.15.37:42526) 2023-10-06T04:39:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.565+0000 7ff2e9f59700 1 -- 172.21.15.37:0/4189181909 learned_addr learned my addr 172.21.15.37:0/4189181909 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.565+0000 7ff2ea75a700 1 --2- 172.21.15.37:0/4189181909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e415a440 0x7ff2e406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.565+0000 7ff2e8f57700 1 -- 172.21.15.37:0/4189181909 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065147 0 0) 0x7ff2e415ae50 con 0x7ff2e406e190 2023-10-06T04:39:27.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.565+0000 7ff2e8f57700 1 -- 172.21.15.37:0/4189181909 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d0003570 con 0x7ff2e406e190 2023-10-06T04:39:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2ea75a700 1 -- 172.21.15.37:0/4189181909 >> v1:172.21.15.83:6789/0 conn(0x7ff2e406f140 legacy=0x7ff2e4159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2ea75a700 1 -- 172.21.15.37:0/4189181909 >> v1:172.21.15.37:6789/0 conn(0x7ff2e406e190 legacy=0x7ff2e415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2ea75a700 1 -- 172.21.15.37:0/4189181909 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4068a40 con 0x7ff2e415a440 2023-10-06T04:39:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2ea75a700 1 --2- 172.21.15.37:0/4189181909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e415a440 0x7ff2e406e560 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009e90 tx=0x7ff2dc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44092fcc5e1e815a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2e8f57700 1 -- 172.21.15.37:0/4189181909 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc00e070 con 0x7ff2e415a440 2023-10-06T04:39:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2e8f57700 1 -- 172.21.15.37:0/4189181909 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc00bc80 con 0x7ff2e415a440 2023-10-06T04:39:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2e8f57700 1 -- 172.21.15.37:0/4189181909 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc012430 con 0x7ff2e415a440 2023-10-06T04:39:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/4189181909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e415a440 msgr2=0x7ff2e406e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2eaf5b700 1 --2- 172.21.15.37:0/4189181909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e415a440 0x7ff2e406e560 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009e90 tx=0x7ff2dc009780 comp rx=0 tx=0).stop 2023-10-06T04:39:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/4189181909 shutdown_connections 2023-10-06T04:39:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2eaf5b700 1 --2- 172.21.15.37:0/4189181909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e415a440 0x7ff2e406e560 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/4189181909 >> 172.21.15.37:0/4189181909 conn(0x7ff2e40c9570 msgr2=0x7ff2e4067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/4189181909 shutdown_connections 2023-10-06T04:39:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/4189181909 wait complete. 2023-10-06T04:39:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2eaf5b700 1 Processor -- start 2023-10-06T04:39:27.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.569+0000 7ff2eaf5b700 1 -- start start 2023-10-06T04:39:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2eaf5b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e406e190 0x7ff2e4169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2eaf5b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2e406f140 0x7ff2e416a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2eaf5b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e415a440 0x7ff2e40b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2eaf5b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40b1770 con 0x7ff2e415a440 2023-10-06T04:39:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2eaf5b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4167de0 con 0x7ff2e406f140 2023-10-06T04:39:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2eaf5b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e41680c0 con 0x7ff2e406e190 2023-10-06T04:39:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2ea75a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e415a440 0x7ff2e40b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2ea75a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e415a440 0x7ff2e40b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59408/0 (socket says 172.21.15.37:59408) 2023-10-06T04:39:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2ea75a700 1 -- 172.21.15.37:0/2230605855 learned_addr learned my addr 172.21.15.37:0/2230605855 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2e9f59700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e406e190 0x7ff2e4169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2e9758700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2e406f140 0x7ff2e416a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2ea75a700 1 -- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e406e190 msgr2=0x7ff2e4169fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2ea75a700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e406e190 0x7ff2e4169fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2ea75a700 1 -- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2e406f140 msgr2=0x7ff2e416a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2ea75a700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2e406f140 0x7ff2e416a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2ea75a700 1 -- 172.21.15.37:0/2230605855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc009a20 con 0x7ff2e415a440 2023-10-06T04:39:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2ea75a700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e415a440 0x7ff2e40b0a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc013000 tx=0x7ff2dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2d9ffb700 1 -- 172.21.15.37:0/2230605855 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc01b420 con 0x7ff2e415a440 2023-10-06T04:39:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2d9ffb700 1 -- 172.21.15.37:0/2230605855 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc01b5a0 con 0x7ff2e415a440 2023-10-06T04:39:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/2230605855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e41683a0 con 0x7ff2e415a440 2023-10-06T04:39:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2d9ffb700 1 -- 172.21.15.37:0/2230605855 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc01b960 con 0x7ff2e415a440 2023-10-06T04:39:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.573+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/2230605855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e40b0f50 con 0x7ff2e415a440 2023-10-06T04:39:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.577+0000 7ff2d9ffb700 1 -- 172.21.15.37:0/2230605855 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff2dc01c400 con 0x7ff2e415a440 2023-10-06T04:39:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.577+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/2230605855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e4168590 con 0x7ff2e415a440 2023-10-06T04:39:27.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.577+0000 7ff2d9ffb700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff2c8060550 0x7ff2c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.577+0000 7ff2d9ffb700 1 -- 172.21.15.37:0/2230605855 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff2dc07e9c0 con 0x7ff2e415a440 2023-10-06T04:39:27.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.577+0000 7ff2e9f59700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff2c8060550 0x7ff2c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.577+0000 7ff2e9f59700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff2c8060550 0x7ff2c8062a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4007fd0 tx=0x7ff2d4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.585+0000 7ff2d9ffb700 1 -- 172.21.15.37:0/2230605855 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff2dc04eb60 con 0x7ff2e415a440 2023-10-06T04:39:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:27.785+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/2230605855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff2e40708a0 con 0x7ff2e415a440 2023-10-06T04:39:28.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.669+0000 7ff2d9ffb700 1 -- 172.21.15.37:0/2230605855 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff2dc052180 con 0x7ff2e415a440 2023-10-06T04:39:28.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.673+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff2c8060550 msgr2=0x7ff2c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.673+0000 7ff2eaf5b700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff2c8060550 0x7ff2c8062a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4007fd0 tx=0x7ff2d4009040 comp rx=0 tx=0).stop 2023-10-06T04:39:28.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.673+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/2230605855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e415a440 msgr2=0x7ff2e40b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.673+0000 7ff2eaf5b700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e415a440 0x7ff2e40b0a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc013000 tx=0x7ff2dc019000 comp rx=0 tx=0).stop 2023-10-06T04:39:28.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.673+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/2230605855 shutdown_connections 2023-10-06T04:39:28.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.673+0000 7ff2eaf5b700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff2c8060550 0x7ff2c8062a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.673+0000 7ff2eaf5b700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2e406f140 0x7ff2e416a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.673+0000 7ff2eaf5b700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e415a440 0x7ff2e40b0a10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.673+0000 7ff2eaf5b700 1 --2- 172.21.15.37:0/2230605855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e406e190 0x7ff2e4169fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.673+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/2230605855 >> 172.21.15.37:0/2230605855 conn(0x7ff2e40c9570 msgr2=0x7ff2e406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:28.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.673+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/2230605855 shutdown_connections 2023-10-06T04:39:28.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.673+0000 7ff2eaf5b700 1 -- 172.21.15.37:0/2230605855 wait complete. 2023-10-06T04:39:28.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:39:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.809+0000 7f4dbfc32700 1 Processor -- start 2023-10-06T04:39:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.809+0000 7f4dbfc32700 1 -- start start 2023-10-06T04:39:28.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbfc32700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4db8069b40 0x7f4db80b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:28.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbfc32700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db80b5a60 con 0x7f4db8153400 2023-10-06T04:39:28.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbfc32700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db8159950 con 0x7f4db81537d0 2023-10-06T04:39:28.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbfc32700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db815a680 con 0x7f4db8069b40 2023-10-06T04:39:28.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbd9ce700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4db8153400 0x7f4db8069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42538/0 (socket says 172.21.15.37:42538) 2023-10-06T04:39:28.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbd9ce700 1 -- 172.21.15.37:0/1394433596 learned_addr learned my addr 172.21.15.37:0/1394433596 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:28.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbd1cd700 1 --2- 172.21.15.37:0/1394433596 >> v2:172.21.15.83:3300/0 conn(0x7f4db8069b40 0x7f4db80b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:28.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbc9cc700 1 -- 172.21.15.37:0/1394433596 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731579593 0 0) 0x7f4db80b5a60 con 0x7f4db8153400 2023-10-06T04:39:28.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbc9cc700 1 -- 172.21.15.37:0/1394433596 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4da4003570 con 0x7f4db8153400 2023-10-06T04:39:28.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbc9cc700 1 -- 172.21.15.37:0/1394433596 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359106152 0 0) 0x7f4db8159950 con 0x7f4db81537d0 2023-10-06T04:39:28.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbc9cc700 1 -- 172.21.15.37:0/1394433596 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4db80b5a60 con 0x7f4db81537d0 2023-10-06T04:39:28.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbd1cd700 1 -- 172.21.15.37:0/1394433596 >> v1:172.21.15.83:6789/0 conn(0x7f4db81537d0 legacy=0x7f4db8162c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbd1cd700 1 -- 172.21.15.37:0/1394433596 >> v1:172.21.15.37:6789/0 conn(0x7f4db8153400 legacy=0x7f4db8069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbd1cd700 1 -- 172.21.15.37:0/1394433596 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db80b4e50 con 0x7f4db8069b40 2023-10-06T04:39:28.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbd1cd700 1 --2- 172.21.15.37:0/1394433596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4db8069b40 0x7f4db80b41e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0098e0 tx=0x7f4dac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78621f45025f5e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:28.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbc9cc700 1 -- 172.21.15.37:0/1394433596 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac011630 con 0x7f4db8069b40 2023-10-06T04:39:28.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbc9cc700 1 -- 172.21.15.37:0/1394433596 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac011790 con 0x7f4db8069b40 2023-10-06T04:39:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbc9cc700 1 -- 172.21.15.37:0/1394433596 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac011b10 con 0x7f4db8069b40 2023-10-06T04:39:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbfc32700 1 -- 172.21.15.37:0/1394433596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4db8069b40 msgr2=0x7f4db80b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbfc32700 1 --2- 172.21.15.37:0/1394433596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4db8069b40 0x7f4db80b41e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0098e0 tx=0x7f4dac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbfc32700 1 -- 172.21.15.37:0/1394433596 shutdown_connections 2023-10-06T04:39:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbfc32700 1 --2- 172.21.15.37:0/1394433596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4db8069b40 0x7f4db80b41e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbfc32700 1 -- 172.21.15.37:0/1394433596 >> 172.21.15.37:0/1394433596 conn(0x7f4db8067cf0 msgr2=0x7f4db80680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbfc32700 1 -- 172.21.15.37:0/1394433596 shutdown_connections 2023-10-06T04:39:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.813+0000 7f4dbfc32700 1 -- 172.21.15.37:0/1394433596 wait complete. 2023-10-06T04:39:28.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbfc32700 1 Processor -- start 2023-10-06T04:39:28.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbfc32700 1 -- start start 2023-10-06T04:39:28.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbfc32700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4db8069b40 0x7f4db814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbfc32700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db8153400 0x7f4db816c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbfc32700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4db81537d0 0x7f4db814cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbfc32700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db816cc10 con 0x7f4db8153400 2023-10-06T04:39:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbfc32700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db814a610 con 0x7f4db8069b40 2023-10-06T04:39:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbfc32700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db814a8f0 con 0x7f4db81537d0 2023-10-06T04:39:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbd1cd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db8153400 0x7f4db816c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbd1cd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db8153400 0x7f4db816c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59414/0 (socket says 172.21.15.37:59414) 2023-10-06T04:39:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbd1cd700 1 -- 172.21.15.37:0/587337324 learned_addr learned my addr 172.21.15.37:0/587337324 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbe1cf700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4db81537d0 0x7f4db814cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbd9ce700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4db8069b40 0x7f4db814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbd1cd700 1 -- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4db81537d0 msgr2=0x7f4db814cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbd1cd700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4db81537d0 0x7f4db814cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbd1cd700 1 -- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4db8069b40 msgr2=0x7f4db814fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbd1cd700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4db8069b40 0x7f4db814fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbd1cd700 1 -- 172.21.15.37:0/587337324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac009420 con 0x7f4db8153400 2023-10-06T04:39:28.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbe1cf700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4db81537d0 0x7f4db814cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:28.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbd1cd700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db8153400 0x7f4db816c6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4db8088880 tx=0x7f4dac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:28.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4da9ffb700 1 -- 172.21.15.37:0/587337324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac011900 con 0x7f4db8153400 2023-10-06T04:39:28.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4da9ffb700 1 -- 172.21.15.37:0/587337324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac011a60 con 0x7f4db8153400 2023-10-06T04:39:28.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbfc32700 1 -- 172.21.15.37:0/587337324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db816ce40 con 0x7f4db8153400 2023-10-06T04:39:28.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4da9ffb700 1 -- 172.21.15.37:0/587337324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac01a680 con 0x7f4db8153400 2023-10-06T04:39:28.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.817+0000 7f4dbfc32700 1 -- 172.21.15.37:0/587337324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db816d400 con 0x7f4db8153400 2023-10-06T04:39:28.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.821+0000 7f4dbfc32700 1 -- 172.21.15.37:0/587337324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db814aa60 con 0x7f4db8153400 2023-10-06T04:39:28.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.821+0000 7f4da9ffb700 1 -- 172.21.15.37:0/587337324 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4dac006c70 con 0x7f4db8153400 2023-10-06T04:39:28.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.821+0000 7f4da9ffb700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d9c060550 0x7f4d9c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:28.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.821+0000 7f4da9ffb700 1 -- 172.21.15.37:0/587337324 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4dac07e6d0 con 0x7f4db8153400 2023-10-06T04:39:28.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.821+0000 7f4dbd9ce700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d9c060550 0x7f4d9c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:28.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.825+0000 7f4dbd9ce700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d9c060550 0x7f4d9c062a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4db4007fd0 tx=0x7f4db4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:28.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:28.829+0000 7f4da9ffb700 1 -- 172.21.15.37:0/587337324 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4dac04e870 con 0x7f4db8153400 2023-10-06T04:39:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.025+0000 7f4dbfc32700 1 -- 172.21.15.37:0/587337324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4db8070ee0 con 0x7f4db8153400 2023-10-06T04:39:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.681+0000 7f4da9ffb700 1 -- 172.21.15.37:0/587337324 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4dac051e90 con 0x7f4db8153400 2023-10-06T04:39:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.681+0000 7f4dbfc32700 1 -- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d9c060550 msgr2=0x7f4d9c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.681+0000 7f4dbfc32700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d9c060550 0x7f4d9c062a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4db4007fd0 tx=0x7f4db4009040 comp rx=0 tx=0).stop 2023-10-06T04:39:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.681+0000 7f4dbfc32700 1 -- 172.21.15.37:0/587337324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db8153400 msgr2=0x7f4db816c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.681+0000 7f4dbfc32700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db8153400 0x7f4db816c6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4db8088880 tx=0x7f4dac017000 comp rx=0 tx=0).stop 2023-10-06T04:39:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.685+0000 7f4dbfc32700 1 -- 172.21.15.37:0/587337324 shutdown_connections 2023-10-06T04:39:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.685+0000 7f4dbfc32700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d9c060550 0x7f4d9c062a00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.685+0000 7f4dbfc32700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4db81537d0 0x7f4db814cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.685+0000 7f4dbfc32700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db8153400 0x7f4db816c6d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.685+0000 7f4dbfc32700 1 --2- 172.21.15.37:0/587337324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4db8069b40 0x7f4db814fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.685+0000 7f4dbfc32700 1 -- 172.21.15.37:0/587337324 >> 172.21.15.37:0/587337324 conn(0x7f4db8067cf0 msgr2=0x7f4db80cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.685+0000 7f4dbfc32700 1 -- 172.21.15.37:0/587337324 shutdown_connections 2023-10-06T04:39:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.685+0000 7f4dbfc32700 1 -- 172.21.15.37:0/587337324 wait complete. 2023-10-06T04:39:29.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdcbe33700 1 Processor -- start 2023-10-06T04:39:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdcbe33700 1 -- start start 2023-10-06T04:39:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdcbe33700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdc40aba80 0x7efdc40c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdcbe33700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efdc40c9b30 0x7efdc41560d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdcbe33700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc415a1b0 con 0x7efdc40c8ae0 2023-10-06T04:39:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdcbe33700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc40c8f30 con 0x7efdc40c9b30 2023-10-06T04:39:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdcbe33700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4159880 con 0x7efdc40aba80 2023-10-06T04:39:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdc93ce700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efdc40c8ae0 0x7efdc40c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36534/0 (socket says 172.21.15.37:36534) 2023-10-06T04:39:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdc93ce700 1 -- 172.21.15.37:0/1270372398 learned_addr learned my addr 172.21.15.37:0/1270372398 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdc9bcf700 1 --2- 172.21.15.37:0/1270372398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdc40aba80 0x7efdc40c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdca3d0700 1 --2- 172.21.15.37:0/1270372398 >> v2:172.21.15.83:3300/0 conn(0x7efdc40c9b30 0x7efdc41560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdc9bcf700 1 -- 172.21.15.37:0/1270372398 >> v2:172.21.15.83:3300/0 conn(0x7efdc40c9b30 msgr2=0x7efdc41560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdc9bcf700 1 --2- 172.21.15.37:0/1270372398 >> v2:172.21.15.83:3300/0 conn(0x7efdc40c9b30 0x7efdc41560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdc8bcd700 1 -- 172.21.15.37:0/1270372398 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050932230 0 0) 0x7efdc415a1b0 con 0x7efdc40c8ae0 2023-10-06T04:39:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdc9bcf700 1 -- 172.21.15.37:0/1270372398 >> v1:172.21.15.37:6789/0 conn(0x7efdc40c8ae0 legacy=0x7efdc40c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdc9bcf700 1 -- 172.21.15.37:0/1270372398 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc4159b60 con 0x7efdc40aba80 2023-10-06T04:39:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdc9bcf700 1 --2- 172.21.15.37:0/1270372398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdc40aba80 0x7efdc40c85a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efdc00098e0 tx=0x7efdc00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dfb4936211b224 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdc8bcd700 1 -- 172.21.15.37:0/1270372398 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000b640 con 0x7efdc40aba80 2023-10-06T04:39:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdc8bcd700 1 -- 172.21.15.37:0/1270372398 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc000b7a0 con 0x7efdc40aba80 2023-10-06T04:39:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.809+0000 7efdc8bcd700 1 -- 172.21.15.37:0/1270372398 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000bb40 con 0x7efdc40aba80 2023-10-06T04:39:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.813+0000 7efdcbe33700 1 -- 172.21.15.37:0/1270372398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdc40aba80 msgr2=0x7efdc40c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.813+0000 7efdcbe33700 1 --2- 172.21.15.37:0/1270372398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdc40aba80 0x7efdc40c85a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efdc00098e0 tx=0x7efdc00091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.813+0000 7efdcbe33700 1 -- 172.21.15.37:0/1270372398 shutdown_connections 2023-10-06T04:39:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.813+0000 7efdcbe33700 1 --2- 172.21.15.37:0/1270372398 >> v2:172.21.15.83:3300/0 conn(0x7efdc40c9b30 0x7efdc41560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.813+0000 7efdcbe33700 1 --2- 172.21.15.37:0/1270372398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdc40aba80 0x7efdc40c85a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.813+0000 7efdcbe33700 1 -- 172.21.15.37:0/1270372398 >> 172.21.15.37:0/1270372398 conn(0x7efdc4068e00 msgr2=0x7efdc4069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.813+0000 7efdcbe33700 1 -- 172.21.15.37:0/1270372398 shutdown_connections 2023-10-06T04:39:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.813+0000 7efdcbe33700 1 -- 172.21.15.37:0/1270372398 wait complete. 2023-10-06T04:39:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.813+0000 7efdcbe33700 1 Processor -- start 2023-10-06T04:39:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.813+0000 7efdcbe33700 1 -- start start 2023-10-06T04:39:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdcbe33700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdc40aba80 0x7efdc40b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdcbe33700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc40c8ae0 0x7efdc4154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdcbe33700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdc40c9b30 0x7efdc4169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdcbe33700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4157c90 con 0x7efdc40c8ae0 2023-10-06T04:39:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdcbe33700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4169fc0 con 0x7efdc40c9b30 2023-10-06T04:39:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdcbe33700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40b1390 con 0x7efdc40aba80 2023-10-06T04:39:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdc93ce700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc40c8ae0 0x7efdc4154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdc9bcf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdc40aba80 0x7efdc40b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdc93ce700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc40c8ae0 0x7efdc4154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36498/0 (socket says 172.21.15.37:36498) 2023-10-06T04:39:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdc93ce700 1 -- 172.21.15.37:0/2586826447 learned_addr learned my addr 172.21.15.37:0/2586826447 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdca3d0700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdc40c9b30 0x7efdc4169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdc93ce700 1 -- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdc40aba80 msgr2=0x7efdc40b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdc93ce700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdc40aba80 0x7efdc40b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdc93ce700 1 -- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdc40c9b30 msgr2=0x7efdc4169a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdc93ce700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdc40c9b30 0x7efdc4169a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdc93ce700 1 -- 172.21.15.37:0/2586826447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0009420 con 0x7efdc40c8ae0 2023-10-06T04:39:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdc93ce700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc40c8ae0 0x7efdc4154140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efdb400c7e0 tx=0x7efdb4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdb9ffb700 1 -- 172.21.15.37:0/2586826447 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4005b30 con 0x7efdc40c8ae0 2023-10-06T04:39:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdb9ffb700 1 -- 172.21.15.37:0/2586826447 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb4005c90 con 0x7efdc40c8ae0 2023-10-06T04:39:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdcbe33700 1 -- 172.21.15.37:0/2586826447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc40b1670 con 0x7efdc40c8ae0 2023-10-06T04:39:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdb9ffb700 1 -- 172.21.15.37:0/2586826447 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4007300 con 0x7efdc40c8ae0 2023-10-06T04:39:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.817+0000 7efdcbe33700 1 -- 172.21.15.37:0/2586826447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc40b1c30 con 0x7efdc40c8ae0 2023-10-06T04:39:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.821+0000 7efdcbe33700 1 -- 172.21.15.37:0/2586826447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc4070ee0 con 0x7efdc40c8ae0 2023-10-06T04:39:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.821+0000 7efdb9ffb700 1 -- 172.21.15.37:0/2586826447 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efdb401b3b0 con 0x7efdc40c8ae0 2023-10-06T04:39:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.821+0000 7efdb9ffb700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efda8060550 0x7efda8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.821+0000 7efdb9ffb700 1 -- 172.21.15.37:0/2586826447 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efdb407c0e0 con 0x7efdc40c8ae0 2023-10-06T04:39:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.821+0000 7efdc9bcf700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efda8060550 0x7efda8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.821+0000 7efdc9bcf700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efda8060550 0x7efda8062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efdc00093f0 tx=0x7efdc0017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:29.825+0000 7efdb9ffb700 1 -- 172.21.15.37:0/2586826447 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efdb404c280 con 0x7efdc40c8ae0 2023-10-06T04:39:30.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.025+0000 7efdcbe33700 1 -- 172.21.15.37:0/2586826447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdc4159e40 con 0x7efdc40c8ae0 2023-10-06T04:39:30.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdb9ffb700 1 -- 172.21.15.37:0/2586826447 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7efdb4001d60 con 0x7efdc40c8ae0 2023-10-06T04:39:30.033 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:30.033 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3463038764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3463038764},{"type":"v1","addr":"172.21.15.83:6835","nonce":3463038764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3802233690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3802233690},{"type":"v1","addr":"172.21.15.37:6833","nonce":3802233690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1262727325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1262727325},{"type":"v1","addr":"172.21.15.83:6837","nonce":1262727325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:10.126951+0000","modified":"2023-10-06T04:39:29.669009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1742476643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1742476643},{"type":"v1","addr":"172.21.15.37:6835","nonce":1742476643}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:39:30.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdcbe33700 1 -- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efda8060550 msgr2=0x7efda8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdcbe33700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efda8060550 0x7efda8062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efdc00093f0 tx=0x7efdc0017000 comp rx=0 tx=0).stop 2023-10-06T04:39:30.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdcbe33700 1 -- 172.21.15.37:0/2586826447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc40c8ae0 msgr2=0x7efdc4154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdcbe33700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc40c8ae0 0x7efdc4154140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efdb400c7e0 tx=0x7efdb4007df0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdcbe33700 1 -- 172.21.15.37:0/2586826447 shutdown_connections 2023-10-06T04:39:30.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdcbe33700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efda8060550 0x7efda8062a00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdcbe33700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdc40c9b30 0x7efdc4169a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdcbe33700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc40c8ae0 0x7efdc4154140 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdcbe33700 1 --2- 172.21.15.37:0/2586826447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdc40aba80 0x7efdc40b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdcbe33700 1 -- 172.21.15.37:0/2586826447 >> 172.21.15.37:0/2586826447 conn(0x7efdc4068e00 msgr2=0x7efdc40aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:30.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdcbe33700 1 -- 172.21.15.37:0/2586826447 shutdown_connections 2023-10-06T04:39:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.029+0000 7efdcbe33700 1 -- 172.21.15.37:0/2586826447 wait complete. 2023-10-06T04:39:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:39:30.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:30.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b1a460700 1 Processor -- start 2023-10-06T04:39:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b1a460700 1 -- start start 2023-10-06T04:39:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b1a460700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b141501d0 0x7f8b141575b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b1a460700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b140cc2e0 0x7f8b140ca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b1a460700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b140c9750 con 0x7f8b14157af0 2023-10-06T04:39:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b1a460700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b140c9ff0 con 0x7f8b141501d0 2023-10-06T04:39:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b1a460700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1415a7f0 con 0x7f8b140cc2e0 2023-10-06T04:39:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b13fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b141501d0 0x7f8b141575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b13fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b141501d0 0x7f8b141575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36510/0 (socket says 172.21.15.37:36510) 2023-10-06T04:39:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b13fff700 1 -- 172.21.15.37:0/392440435 learned_addr learned my addr 172.21.15.37:0/392440435 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b189fd700 1 --2- 172.21.15.37:0/392440435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b140cc2e0 0x7f8b140ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b13fff700 1 -- 172.21.15.37:0/392440435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b140cc2e0 msgr2=0x7f8b140ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b137fe700 1 -- 172.21.15.37:0/392440435 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717598598 0 0) 0x7f8b140c9750 con 0x7f8b14157af0 2023-10-06T04:39:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b13fff700 1 --2- 172.21.15.37:0/392440435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b140cc2e0 0x7f8b140ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b13fff700 1 -- 172.21.15.37:0/392440435 >> v1:172.21.15.83:6789/0 conn(0x7f8b14157af0 legacy=0x7f8b140cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b13fff700 1 -- 172.21.15.37:0/392440435 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b140c99a0 con 0x7f8b141501d0 2023-10-06T04:39:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.145+0000 7f8b189fd700 1 --2- 172.21.15.37:0/392440435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b140cc2e0 0x7f8b140ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b13fff700 1 --2- 172.21.15.37:0/392440435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b141501d0 0x7f8b141575b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8b040099b0 tx=0x7f8b04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677aa4e82bd81573 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b137fe700 1 -- 172.21.15.37:0/392440435 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04009ea0 con 0x7f8b141501d0 2023-10-06T04:39:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b137fe700 1 -- 172.21.15.37:0/392440435 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0400b860 con 0x7f8b141501d0 2023-10-06T04:39:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b137fe700 1 -- 172.21.15.37:0/392440435 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400bc00 con 0x7f8b141501d0 2023-10-06T04:39:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b1a460700 1 -- 172.21.15.37:0/392440435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b141501d0 msgr2=0x7f8b141575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b1a460700 1 --2- 172.21.15.37:0/392440435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b141501d0 0x7f8b141575b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8b040099b0 tx=0x7f8b04009250 comp rx=0 tx=0).stop 2023-10-06T04:39:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b1a460700 1 -- 172.21.15.37:0/392440435 shutdown_connections 2023-10-06T04:39:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b1a460700 1 --2- 172.21.15.37:0/392440435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b140cc2e0 0x7f8b140ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b1a460700 1 --2- 172.21.15.37:0/392440435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b141501d0 0x7f8b141575b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b1a460700 1 -- 172.21.15.37:0/392440435 >> 172.21.15.37:0/392440435 conn(0x7f8b140667b0 msgr2=0x7f8b14066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b1a460700 1 -- 172.21.15.37:0/392440435 shutdown_connections 2023-10-06T04:39:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b1a460700 1 -- 172.21.15.37:0/392440435 wait complete. 2023-10-06T04:39:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b1a460700 1 Processor -- start 2023-10-06T04:39:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.149+0000 7f8b1a460700 1 -- start start 2023-10-06T04:39:30.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b1a460700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b140cc2e0 0x7f8b141474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b1a460700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b141501d0 0x7f8b141540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b1a460700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b14157af0 0x7f8b1414a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b1a460700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14155490 con 0x7f8b141501d0 2023-10-06T04:39:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b1a460700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14147a10 con 0x7f8b14157af0 2023-10-06T04:39:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b1a460700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1414a1b0 con 0x7f8b140cc2e0 2023-10-06T04:39:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b0bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b141501d0 0x7f8b141540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b0bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b141501d0 0x7f8b141540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36518/0 (socket says 172.21.15.37:36518) 2023-10-06T04:39:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b0bfff700 1 -- 172.21.15.37:0/1759483499 learned_addr learned my addr 172.21.15.37:0/1759483499 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b13fff700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b140cc2e0 0x7f8b141474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b189fd700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b14157af0 0x7f8b1414a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b0bfff700 1 -- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b140cc2e0 msgr2=0x7f8b141474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b0bfff700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b140cc2e0 0x7f8b141474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b0bfff700 1 -- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b14157af0 msgr2=0x7f8b1414a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b0bfff700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b14157af0 0x7f8b1414a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b0bfff700 1 -- 172.21.15.37:0/1759483499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c009a20 con 0x7f8b141501d0 2023-10-06T04:39:30.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b189fd700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b14157af0 0x7f8b1414a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:30.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b13fff700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b140cc2e0 0x7f8b141474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:30.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b0bfff700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b141501d0 0x7f8b141540a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00c530 tx=0x7f8afc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b10ff9700 1 -- 172.21.15.37:0/1759483499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc011590 con 0x7f8b141501d0 2023-10-06T04:39:30.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b10ff9700 1 -- 172.21.15.37:0/1759483499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc011710 con 0x7f8b141501d0 2023-10-06T04:39:30.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b1a460700 1 -- 172.21.15.37:0/1759483499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b040094f0 con 0x7f8b141501d0 2023-10-06T04:39:30.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b10ff9700 1 -- 172.21.15.37:0/1759483499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc011ad0 con 0x7f8b141501d0 2023-10-06T04:39:30.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.153+0000 7f8b1a460700 1 -- 172.21.15.37:0/1759483499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b14154af0 con 0x7f8b141501d0 2023-10-06T04:39:30.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.157+0000 7f8b1a460700 1 -- 172.21.15.37:0/1759483499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b14070ee0 con 0x7f8b141501d0 2023-10-06T04:39:30.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.157+0000 7f8b10ff9700 1 -- 172.21.15.37:0/1759483499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8afc01b3b0 con 0x7f8b141501d0 2023-10-06T04:39:30.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.157+0000 7f8b10ff9700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8af4060550 0x7f8af4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.157+0000 7f8b10ff9700 1 -- 172.21.15.37:0/1759483499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8afc07c1a0 con 0x7f8b141501d0 2023-10-06T04:39:30.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.157+0000 7f8b13fff700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8af4060550 0x7f8af4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.157+0000 7f8b13fff700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8af4060550 0x7f8af4062a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b040099b0 tx=0x7f8b04017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.165+0000 7f8b10ff9700 1 -- 172.21.15.37:0/1759483499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8afc04c340 con 0x7f8b141501d0 2023-10-06T04:39:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.329+0000 7f8b1a460700 1 -- 172.21.15.37:0/1759483499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b140c9c80 con 0x7f8b141501d0 2023-10-06T04:39:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.329+0000 7f8b10ff9700 1 -- 172.21.15.37:0/1759483499 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f8afc04f960 con 0x7f8b141501d0 2023-10-06T04:39:30.335 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:30.335 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:15.209829+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.333+0000 7f8b1a460700 1 -- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8af4060550 msgr2=0x7f8af4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.333+0000 7f8b1a460700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8af4060550 0x7f8af4062a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b040099b0 tx=0x7f8b04017000 comp rx=0 tx=0).stop 2023-10-06T04:39:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.333+0000 7f8b1a460700 1 -- 172.21.15.37:0/1759483499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b141501d0 msgr2=0x7f8b141540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.333+0000 7f8b1a460700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b141501d0 0x7f8b141540a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00c530 tx=0x7f8afc00c8f0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.333+0000 7f8b1a460700 1 -- 172.21.15.37:0/1759483499 shutdown_connections 2023-10-06T04:39:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.333+0000 7f8b1a460700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8af4060550 0x7f8af4062a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.333+0000 7f8b1a460700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b14157af0 0x7f8b1414a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.333+0000 7f8b1a460700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b141501d0 0x7f8b141540a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.333+0000 7f8b1a460700 1 --2- 172.21.15.37:0/1759483499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b140cc2e0 0x7f8b141474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.333+0000 7f8b1a460700 1 -- 172.21.15.37:0/1759483499 >> 172.21.15.37:0/1759483499 conn(0x7f8b140667b0 msgr2=0x7f8b14159970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.333+0000 7f8b1a460700 1 -- 172.21.15.37:0/1759483499 shutdown_connections 2023-10-06T04:39:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.333+0000 7f8b1a460700 1 -- 172.21.15.37:0/1759483499 wait complete. 2023-10-06T04:39:30.349 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:39:30.349 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:39:30.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9927462700 1 Processor -- start 2023-10-06T04:39:30.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9927462700 1 -- start start 2023-10-06T04:39:30.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9927462700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f992015d2d0 0x7f992015e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9927462700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992015f380 con 0x7f992015cf00 2023-10-06T04:39:30.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9927462700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99200b1c90 con 0x7f99200af5b0 2023-10-06T04:39:30.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9927462700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992015ed30 con 0x7f992015d2d0 2023-10-06T04:39:30.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9926460700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f992015cf00 0x7f99200b1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36550/0 (socket says 172.21.15.37:36550) 2023-10-06T04:39:30.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9926460700 1 -- 172.21.15.37:0/2914668277 learned_addr learned my addr 172.21.15.37:0/2914668277 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:30.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9925c5f700 1 --2- 172.21.15.37:0/2914668277 >> v2:172.21.15.37:3300/0 conn(0x7f992015d2d0 0x7f992015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9925c5f700 1 -- 172.21.15.37:0/2914668277 >> v1:172.21.15.83:6789/0 conn(0x7f99200af5b0 legacy=0x7f99200afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f992545e700 1 -- 172.21.15.37:0/2914668277 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243616027 0 0) 0x7f992015f380 con 0x7f992015cf00 2023-10-06T04:39:30.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9925c5f700 1 -- 172.21.15.37:0/2914668277 >> v1:172.21.15.37:6789/0 conn(0x7f992015cf00 legacy=0x7f99200b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9925c5f700 1 -- 172.21.15.37:0/2914668277 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992015f010 con 0x7f992015d2d0 2023-10-06T04:39:30.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f9925c5f700 1 --2- 172.21.15.37:0/2914668277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992015d2d0 0x7f992015e490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f99100098e0 tx=0x7f99100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646b6b64ff036972 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f992545e700 1 -- 172.21.15.37:0/2914668277 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910009e80 con 0x7f992015d2d0 2023-10-06T04:39:30.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f992545e700 1 -- 172.21.15.37:0/2914668277 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991000b860 con 0x7f992015d2d0 2023-10-06T04:39:30.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.449+0000 7f992545e700 1 -- 172.21.15.37:0/2914668277 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991000bbe0 con 0x7f992015d2d0 2023-10-06T04:39:30.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 -- 172.21.15.37:0/2914668277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992015d2d0 msgr2=0x7f992015e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 --2- 172.21.15.37:0/2914668277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992015d2d0 0x7f992015e490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f99100098e0 tx=0x7f99100091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 -- 172.21.15.37:0/2914668277 shutdown_connections 2023-10-06T04:39:30.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 --2- 172.21.15.37:0/2914668277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992015d2d0 0x7f992015e490 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 -- 172.21.15.37:0/2914668277 >> 172.21.15.37:0/2914668277 conn(0x7f99200ccb50 msgr2=0x7f992006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:30.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 -- 172.21.15.37:0/2914668277 shutdown_connections 2023-10-06T04:39:30.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 -- 172.21.15.37:0/2914668277 wait complete. 2023-10-06T04:39:30.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 Processor -- start 2023-10-06T04:39:30.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 -- start start 2023-10-06T04:39:30.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99200af5b0 0x7f9920155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992015cf00 0x7f992015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f992015d2d0 0x7f992015ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920098180 con 0x7f992015cf00 2023-10-06T04:39:30.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992015c740 con 0x7f992015d2d0 2023-10-06T04:39:30.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9927462700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992015b2c0 con 0x7f99200af5b0 2023-10-06T04:39:30.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9925c5f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992015cf00 0x7f992015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9925c5f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992015cf00 0x7f992015a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36536/0 (socket says 172.21.15.37:36536) 2023-10-06T04:39:30.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9925c5f700 1 -- 172.21.15.37:0/954647113 learned_addr learned my addr 172.21.15.37:0/954647113 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:30.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9926460700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99200af5b0 0x7f9920155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.453+0000 7f9926c61700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f992015d2d0 0x7f992015ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f9925c5f700 1 -- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99200af5b0 msgr2=0x7f9920155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f9925c5f700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99200af5b0 0x7f9920155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f9925c5f700 1 -- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f992015d2d0 msgr2=0x7f992015ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f9925c5f700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f992015d2d0 0x7f992015ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f9925c5f700 1 -- 172.21.15.37:0/954647113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9910009420 con 0x7f992015cf00 2023-10-06T04:39:30.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f9925c5f700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992015cf00 0x7f992015a700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f992015d750 tx=0x7f9910017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f991e7fc700 1 -- 172.21.15.37:0/954647113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991001f070 con 0x7f992015cf00 2023-10-06T04:39:30.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f991e7fc700 1 -- 172.21.15.37:0/954647113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910000bc0 con 0x7f992015cf00 2023-10-06T04:39:30.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f9927462700 1 -- 172.21.15.37:0/954647113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992015b5a0 con 0x7f992015cf00 2023-10-06T04:39:30.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f991e7fc700 1 -- 172.21.15.37:0/954647113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910025420 con 0x7f992015cf00 2023-10-06T04:39:30.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f9927462700 1 -- 172.21.15.37:0/954647113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992015bb60 con 0x7f992015cf00 2023-10-06T04:39:30.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f9927462700 1 -- 172.21.15.37:0/954647113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920097f50 con 0x7f992015cf00 2023-10-06T04:39:30.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f991e7fc700 1 -- 172.21.15.37:0/954647113 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9910023070 con 0x7f992015cf00 2023-10-06T04:39:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f991e7fc700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9900060550 0x7f9900062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.457+0000 7f991e7fc700 1 -- 172.21.15.37:0/954647113 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f991007dff0 con 0x7f992015cf00 2023-10-06T04:39:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.461+0000 7f9926460700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9900060550 0x7f9900062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.461+0000 7f9926460700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9900060550 0x7f9900062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9908002250 tx=0x7f9908001a00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.469+0000 7f991e7fc700 1 -- 172.21.15.37:0/954647113 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9920097f50 con 0x7f992015cf00 2023-10-06T04:39:30.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.625+0000 7f9927462700 1 -- 172.21.15.37:0/954647113 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9920097f50 con 0x7f9900060550 2023-10-06T04:39:30.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.649+0000 7f991e7fc700 1 -- 172.21.15.37:0/954647113 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367179 (secure 0 0 0) 0x7f9920097f50 con 0x7f9900060550 2023-10-06T04:39:30.658 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.653+0000 7f9927462700 1 -- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9900060550 msgr2=0x7f9900062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.653+0000 7f9927462700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9900060550 0x7f9900062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9908002250 tx=0x7f9908001a00 comp rx=0 tx=0).stop 2023-10-06T04:39:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.653+0000 7f9927462700 1 -- 172.21.15.37:0/954647113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992015cf00 msgr2=0x7f992015a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.653+0000 7f9927462700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992015cf00 0x7f992015a700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f992015d750 tx=0x7f9910017000 comp rx=0 tx=0).stop 2023-10-06T04:39:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.657+0000 7f9927462700 1 -- 172.21.15.37:0/954647113 shutdown_connections 2023-10-06T04:39:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.657+0000 7f9927462700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9900060550 0x7f9900062a00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.657+0000 7f9927462700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f992015d2d0 0x7f992015ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.657+0000 7f9927462700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992015cf00 0x7f992015a700 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.657+0000 7f9927462700 1 --2- 172.21.15.37:0/954647113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99200af5b0 0x7f9920155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.657+0000 7f9927462700 1 -- 172.21.15.37:0/954647113 >> 172.21.15.37:0/954647113 conn(0x7f99200ccb50 msgr2=0x7f9920157750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.657+0000 7f9927462700 1 -- 172.21.15.37:0/954647113 shutdown_connections 2023-10-06T04:39:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.657+0000 7f9927462700 1 -- 172.21.15.37:0/954647113 wait complete. 2023-10-06T04:39:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:39:30.676 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-10-06T04:39:29.034544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381832,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592888,"statfs":{"total":773094113280,"available":770655117312,"internally_reserved":0,"allocated":3612672,"data_stored":2166296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005472"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872498+0000","last_change":"2023-10-06T04:39:14.870069+0000","last_active":"2023-10-06T04:39:14.872498+0000","last_peered":"2023-10-06T04:39:14.872498+0000","last_clean":"2023-10-06T04:39:14.872498+0000","last_became_active":"2023-10-06T04:39:14.869576+0000","last_became_peered":"2023-10-06T04:39:14.869576+0000","last_unstale":"2023-10-06T04:39:14.872498+0000","last_undegraded":"2023-10-06T04:39:14.872498+0000","last_fullsized":"2023-10-06T04:39:14.872498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:25.769047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850210+0000","last_change":"2023-10-06T04:39:09.765548+0000","last_active":"2023-10-06T04:39:14.850210+0000","last_peered":"2023-10-06T04:39:14.850210+0000","last_clean":"2023-10-06T04:39:14.850210+0000","last_became_active":"2023-10-06T04:39:09.765140+0000","last_became_peered":"2023-10-06T04:39:09.765140+0000","last_unstale":"2023-10-06T04:39:14.850210+0000","last_undegraded":"2023-10-06T04:39:14.850210+0000","last_fullsized":"2023-10-06T04:39:14.850210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:58.385216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841115+0000","last_change":"2023-10-06T04:39:10.798882+0000","last_active":"2023-10-06T04:39:14.841115+0000","last_peered":"2023-10-06T04:39:14.841115+0000","last_clean":"2023-10-06T04:39:14.841115+0000","last_became_active":"2023-10-06T04:39:10.796380+0000","last_became_peered":"2023-10-06T04:39:10.796380+0000","last_unstale":"2023-10-06T04:39:14.841115+0000","last_undegraded":"2023-10-06T04:39:14.841115+0000","last_fullsized":"2023-10-06T04:39:14.841115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:29.463649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.860905+0000","last_change":"2023-10-06T04:39:14.859612+0000","last_active":"2023-10-06T04:39:14.860905+0000","last_peered":"2023-10-06T04:39:14.860905+0000","last_clean":"2023-10-06T04:39:14.860905+0000","last_became_active":"2023-10-06T04:39:14.859171+0000","last_became_peered":"2023-10-06T04:39:14.859171+0000","last_unstale":"2023-10-06T04:39:14.860905+0000","last_undegraded":"2023-10-06T04:39:14.860905+0000","last_fullsized":"2023-10-06T04:39:14.860905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:08.925413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838625+0000","last_change":"2023-10-06T04:39:09.772959+0000","last_active":"2023-10-06T04:39:14.838625+0000","last_peered":"2023-10-06T04:39:14.838625+0000","last_clean":"2023-10-06T04:39:14.838625+0000","last_became_active":"2023-10-06T04:39:09.772627+0000","last_became_peered":"2023-10-06T04:39:09.772627+0000","last_unstale":"2023-10-06T04:39:14.838625+0000","last_undegraded":"2023-10-06T04:39:14.838625+0000","last_fullsized":"2023-10-06T04:39:14.838625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.246847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837554+0000","last_change":"2023-10-06T04:39:10.799763+0000","last_active":"2023-10-06T04:39:14.837554+0000","last_peered":"2023-10-06T04:39:14.837554+0000","last_clean":"2023-10-06T04:39:14.837554+0000","last_became_active":"2023-10-06T04:39:10.799183+0000","last_became_peered":"2023-10-06T04:39:10.799183+0000","last_unstale":"2023-10-06T04:39:14.837554+0000","last_undegraded":"2023-10-06T04:39:14.837554+0000","last_fullsized":"2023-10-06T04:39:14.837554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:23.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876042+0000","last_change":"2023-10-06T04:39:14.874393+0000","last_active":"2023-10-06T04:39:14.876042+0000","last_peered":"2023-10-06T04:39:14.876042+0000","last_clean":"2023-10-06T04:39:14.876042+0000","last_became_active":"2023-10-06T04:39:14.873970+0000","last_became_peered":"2023-10-06T04:39:14.873970+0000","last_unstale":"2023-10-06T04:39:14.876042+0000","last_undegraded":"2023-10-06T04:39:14.876042+0000","last_fullsized":"2023-10-06T04:39:14.876042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:42.042299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853530+0000","last_change":"2023-10-06T04:39:09.776483+0000","last_active":"2023-10-06T04:39:14.853530+0000","last_peered":"2023-10-06T04:39:14.853530+0000","last_clean":"2023-10-06T04:39:14.853530+0000","last_became_active":"2023-10-06T04:39:09.776194+0000","last_became_peered":"2023-10-06T04:39:09.776194+0000","last_unstale":"2023-10-06T04:39:14.853530+0000","last_undegraded":"2023-10-06T04:39:14.853530+0000","last_fullsized":"2023-10-06T04:39:14.853530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:25.823920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841254+0000","last_change":"2023-10-06T04:39:10.806796+0000","last_active":"2023-10-06T04:39:14.841254+0000","last_peered":"2023-10-06T04:39:14.841254+0000","last_clean":"2023-10-06T04:39:14.841254+0000","last_became_active":"2023-10-06T04:39:10.803473+0000","last_became_peered":"2023-10-06T04:39:10.803473+0000","last_unstale":"2023-10-06T04:39:14.841254+0000","last_undegraded":"2023-10-06T04:39:14.841254+0000","last_fullsized":"2023-10-06T04:39:14.841254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:01.174439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872813+0000","last_change":"2023-10-06T04:39:14.868943+0000","last_active":"2023-10-06T04:39:14.872813+0000","last_peered":"2023-10-06T04:39:14.872813+0000","last_clean":"2023-10-06T04:39:14.872813+0000","last_became_active":"2023-10-06T04:39:14.868312+0000","last_became_peered":"2023-10-06T04:39:14.868312+0000","last_unstale":"2023-10-06T04:39:14.872813+0000","last_undegraded":"2023-10-06T04:39:14.872813+0000","last_fullsized":"2023-10-06T04:39:14.872813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:07.134968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852547+0000","last_change":"2023-10-06T04:39:09.771371+0000","last_active":"2023-10-06T04:39:14.852547+0000","last_peered":"2023-10-06T04:39:14.852547+0000","last_clean":"2023-10-06T04:39:14.852547+0000","last_became_active":"2023-10-06T04:39:09.771102+0000","last_became_peered":"2023-10-06T04:39:09.771102+0000","last_unstale":"2023-10-06T04:39:14.852547+0000","last_undegraded":"2023-10-06T04:39:14.852547+0000","last_fullsized":"2023-10-06T04:39:14.852547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:17.992483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841809+0000","last_change":"2023-10-06T04:39:10.807784+0000","last_active":"2023-10-06T04:39:14.841809+0000","last_peered":"2023-10-06T04:39:14.841809+0000","last_clean":"2023-10-06T04:39:14.841809+0000","last_became_active":"2023-10-06T04:39:10.807517+0000","last_became_peered":"2023-10-06T04:39:10.807517+0000","last_unstale":"2023-10-06T04:39:14.841809+0000","last_undegraded":"2023-10-06T04:39:14.841809+0000","last_fullsized":"2023-10-06T04:39:14.841809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:01.254363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.878158+0000","last_change":"2023-10-06T04:39:14.873431+0000","last_active":"2023-10-06T04:39:14.878158+0000","last_peered":"2023-10-06T04:39:14.878158+0000","last_clean":"2023-10-06T04:39:14.878158+0000","last_became_active":"2023-10-06T04:39:14.873014+0000","last_became_peered":"2023-10-06T04:39:14.873014+0000","last_unstale":"2023-10-06T04:39:14.878158+0000","last_undegraded":"2023-10-06T04:39:14.878158+0000","last_fullsized":"2023-10-06T04:39:14.878158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:13.279378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848648+0000","last_change":"2023-10-06T04:39:09.777180+0000","last_active":"2023-10-06T04:39:14.848648+0000","last_peered":"2023-10-06T04:39:14.848648+0000","last_clean":"2023-10-06T04:39:14.848648+0000","last_became_active":"2023-10-06T04:39:09.776838+0000","last_became_peered":"2023-10-06T04:39:09.776838+0000","last_unstale":"2023-10-06T04:39:14.848648+0000","last_undegraded":"2023-10-06T04:39:14.848648+0000","last_fullsized":"2023-10-06T04:39:14.848648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:10.617248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842412+0000","last_change":"2023-10-06T04:39:10.806300+0000","last_active":"2023-10-06T04:39:14.842412+0000","last_peered":"2023-10-06T04:39:14.842412+0000","last_clean":"2023-10-06T04:39:14.842412+0000","last_became_active":"2023-10-06T04:39:10.800539+0000","last_became_peered":"2023-10-06T04:39:10.800539+0000","last_unstale":"2023-10-06T04:39:14.842412+0000","last_undegraded":"2023-10-06T04:39:14.842412+0000","last_fullsized":"2023-10-06T04:39:14.842412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:26.827588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.867191+0000","last_change":"2023-10-06T04:39:14.863502+0000","last_active":"2023-10-06T04:39:14.867191+0000","last_peered":"2023-10-06T04:39:14.867191+0000","last_clean":"2023-10-06T04:39:14.867191+0000","last_became_active":"2023-10-06T04:39:14.863064+0000","last_became_peered":"2023-10-06T04:39:14.863064+0000","last_unstale":"2023-10-06T04:39:14.867191+0000","last_undegraded":"2023-10-06T04:39:14.867191+0000","last_fullsized":"2023-10-06T04:39:14.867191+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:55.304482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841597+0000","last_change":"2023-10-06T04:39:09.770501+0000","last_active":"2023-10-06T04:39:14.841597+0000","last_peered":"2023-10-06T04:39:14.841597+0000","last_clean":"2023-10-06T04:39:14.841597+0000","last_became_active":"2023-10-06T04:39:09.770199+0000","last_became_peered":"2023-10-06T04:39:09.770199+0000","last_unstale":"2023-10-06T04:39:14.841597+0000","last_undegraded":"2023-10-06T04:39:14.841597+0000","last_fullsized":"2023-10-06T04:39:14.841597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:46.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838286+0000","last_change":"2023-10-06T04:39:10.798539+0000","last_active":"2023-10-06T04:39:14.838286+0000","last_peered":"2023-10-06T04:39:14.838286+0000","last_clean":"2023-10-06T04:39:14.838286+0000","last_became_active":"2023-10-06T04:39:10.798237+0000","last_became_peered":"2023-10-06T04:39:10.798237+0000","last_unstale":"2023-10-06T04:39:14.838286+0000","last_undegraded":"2023-10-06T04:39:14.838286+0000","last_fullsized":"2023-10-06T04:39:14.838286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:10.727863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876193+0000","last_change":"2023-10-06T04:39:14.872340+0000","last_active":"2023-10-06T04:39:14.876193+0000","last_peered":"2023-10-06T04:39:14.876193+0000","last_clean":"2023-10-06T04:39:14.876193+0000","last_became_active":"2023-10-06T04:39:14.871698+0000","last_became_peered":"2023-10-06T04:39:14.871698+0000","last_unstale":"2023-10-06T04:39:14.876193+0000","last_undegraded":"2023-10-06T04:39:14.876193+0000","last_fullsized":"2023-10-06T04:39:14.876193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:21.553198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855800+0000","last_change":"2023-10-06T04:39:09.773699+0000","last_active":"2023-10-06T04:39:14.855800+0000","last_peered":"2023-10-06T04:39:14.855800+0000","last_clean":"2023-10-06T04:39:14.855800+0000","last_became_active":"2023-10-06T04:39:09.773399+0000","last_became_peered":"2023-10-06T04:39:09.773399+0000","last_unstale":"2023-10-06T04:39:14.855800+0000","last_undegraded":"2023-10-06T04:39:14.855800+0000","last_fullsized":"2023-10-06T04:39:14.855800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:25.823920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851512+0000","last_change":"2023-10-06T04:39:10.795142+0000","last_active":"2023-10-06T04:39:14.851512+0000","last_peered":"2023-10-06T04:39:14.851512+0000","last_clean":"2023-10-06T04:39:14.851512+0000","last_became_active":"2023-10-06T04:39:10.794525+0000","last_became_peered":"2023-10-06T04:39:10.794525+0000","last_unstale":"2023-10-06T04:39:14.851512+0000","last_undegraded":"2023-10-06T04:39:14.851512+0000","last_fullsized":"2023-10-06T04:39:14.851512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.875584+0000","last_change":"2023-10-06T04:39:14.869540+0000","last_active":"2023-10-06T04:39:14.875584+0000","last_peered":"2023-10-06T04:39:14.875584+0000","last_clean":"2023-10-06T04:39:14.875584+0000","last_became_active":"2023-10-06T04:39:14.869118+0000","last_became_peered":"2023-10-06T04:39:14.869118+0000","last_unstale":"2023-10-06T04:39:14.875584+0000","last_undegraded":"2023-10-06T04:39:14.875584+0000","last_fullsized":"2023-10-06T04:39:14.875584+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:32.206420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837301+0000","last_change":"2023-10-06T04:39:09.776975+0000","last_active":"2023-10-06T04:39:14.837301+0000","last_peered":"2023-10-06T04:39:14.837301+0000","last_clean":"2023-10-06T04:39:14.837301+0000","last_became_active":"2023-10-06T04:39:09.776600+0000","last_became_peered":"2023-10-06T04:39:09.776600+0000","last_unstale":"2023-10-06T04:39:14.837301+0000","last_undegraded":"2023-10-06T04:39:14.837301+0000","last_fullsized":"2023-10-06T04:39:14.837301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:10.617248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848811+0000","last_change":"2023-10-06T04:39:10.795446+0000","last_active":"2023-10-06T04:39:14.848811+0000","last_peered":"2023-10-06T04:39:14.848811+0000","last_clean":"2023-10-06T04:39:14.848811+0000","last_became_active":"2023-10-06T04:39:10.795269+0000","last_became_peered":"2023-10-06T04:39:10.795269+0000","last_unstale":"2023-10-06T04:39:14.848811+0000","last_undegraded":"2023-10-06T04:39:14.848811+0000","last_fullsized":"2023-10-06T04:39:14.848811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:21.233331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.836827+0000","last_change":"2023-10-06T04:39:10.796045+0000","last_active":"2023-10-06T04:39:14.836827+0000","last_peered":"2023-10-06T04:39:14.836827+0000","last_clean":"2023-10-06T04:39:14.836827+0000","last_became_active":"2023-10-06T04:39:10.795810+0000","last_became_peered":"2023-10-06T04:39:10.795810+0000","last_unstale":"2023-10-06T04:39:14.836827+0000","last_undegraded":"2023-10-06T04:39:14.836827+0000","last_fullsized":"2023-10-06T04:39:14.836827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:01.174439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850318+0000","last_change":"2023-10-06T04:39:09.767108+0000","last_active":"2023-10-06T04:39:14.850318+0000","last_peered":"2023-10-06T04:39:14.850318+0000","last_clean":"2023-10-06T04:39:14.850318+0000","last_became_active":"2023-10-06T04:39:09.765912+0000","last_became_peered":"2023-10-06T04:39:09.765912+0000","last_unstale":"2023-10-06T04:39:14.850318+0000","last_undegraded":"2023-10-06T04:39:14.850318+0000","last_fullsized":"2023-10-06T04:39:14.850318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.246847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.873803+0000","last_change":"2023-10-06T04:39:14.867667+0000","last_active":"2023-10-06T04:39:14.873803+0000","last_peered":"2023-10-06T04:39:14.873803+0000","last_clean":"2023-10-06T04:39:14.873803+0000","last_became_active":"2023-10-06T04:39:14.866987+0000","last_became_peered":"2023-10-06T04:39:14.866987+0000","last_unstale":"2023-10-06T04:39:14.873803+0000","last_undegraded":"2023-10-06T04:39:14.873803+0000","last_fullsized":"2023-10-06T04:39:14.873803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837163+0000","last_change":"2023-10-06T04:39:10.800091+0000","last_active":"2023-10-06T04:39:14.837163+0000","last_peered":"2023-10-06T04:39:14.837163+0000","last_clean":"2023-10-06T04:39:14.837163+0000","last_became_active":"2023-10-06T04:39:10.799013+0000","last_became_peered":"2023-10-06T04:39:10.799013+0000","last_unstale":"2023-10-06T04:39:14.837163+0000","last_undegraded":"2023-10-06T04:39:14.837163+0000","last_fullsized":"2023-10-06T04:39:14.837163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:12.187845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.854203+0000","last_change":"2023-10-06T04:39:09.765938+0000","last_active":"2023-10-06T04:39:14.854203+0000","last_peered":"2023-10-06T04:39:14.854203+0000","last_clean":"2023-10-06T04:39:14.854203+0000","last_became_active":"2023-10-06T04:39:09.765605+0000","last_became_peered":"2023-10-06T04:39:09.765605+0000","last_unstale":"2023-10-06T04:39:14.854203+0000","last_undegraded":"2023-10-06T04:39:14.854203+0000","last_fullsized":"2023-10-06T04:39:14.854203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:29.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876139+0000","last_change":"2023-10-06T04:39:14.874600+0000","last_active":"2023-10-06T04:39:14.876139+0000","last_peered":"2023-10-06T04:39:14.876139+0000","last_clean":"2023-10-06T04:39:14.876139+0000","last_became_active":"2023-10-06T04:39:14.874193+0000","last_became_peered":"2023-10-06T04:39:14.874193+0000","last_unstale":"2023-10-06T04:39:14.876139+0000","last_undegraded":"2023-10-06T04:39:14.876139+0000","last_fullsized":"2023-10-06T04:39:14.876139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:32.206420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.859491+0000","last_change":"2023-10-06T04:39:09.779107+0000","last_active":"2023-10-06T04:39:14.859491+0000","last_peered":"2023-10-06T04:39:14.859491+0000","last_clean":"2023-10-06T04:39:14.859491+0000","last_became_active":"2023-10-06T04:39:09.778810+0000","last_became_peered":"2023-10-06T04:39:09.778810+0000","last_unstale":"2023-10-06T04:39:14.859491+0000","last_undegraded":"2023-10-06T04:39:14.859491+0000","last_fullsized":"2023-10-06T04:39:14.859491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:53:29.527825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855898+0000","last_change":"2023-10-06T04:39:10.801962+0000","last_active":"2023-10-06T04:39:14.855898+0000","last_peered":"2023-10-06T04:39:14.855898+0000","last_clean":"2023-10-06T04:39:14.855898+0000","last_became_active":"2023-10-06T04:39:10.801671+0000","last_became_peered":"2023-10-06T04:39:10.801671+0000","last_unstale":"2023-10-06T04:39:14.855898+0000","last_undegraded":"2023-10-06T04:39:14.855898+0000","last_fullsized":"2023-10-06T04:39:14.855898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:22.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.866385+0000","last_change":"2023-10-06T04:39:14.862383+0000","last_active":"2023-10-06T04:39:14.866385+0000","last_peered":"2023-10-06T04:39:14.866385+0000","last_clean":"2023-10-06T04:39:14.866385+0000","last_became_active":"2023-10-06T04:39:14.861956+0000","last_became_peered":"2023-10-06T04:39:14.861956+0000","last_unstale":"2023-10-06T04:39:14.866385+0000","last_undegraded":"2023-10-06T04:39:14.866385+0000","last_fullsized":"2023-10-06T04:39:14.866385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:49.720754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.672346+0000","last_change":"2023-10-06T04:39:09.780007+0000","last_active":"2023-10-06T04:39:20.672346+0000","last_peered":"2023-10-06T04:39:20.672346+0000","last_clean":"2023-10-06T04:39:20.672346+0000","last_became_active":"2023-10-06T04:39:09.779738+0000","last_became_peered":"2023-10-06T04:39:09.779738+0000","last_unstale":"2023-10-06T04:39:20.672346+0000","last_undegraded":"2023-10-06T04:39:20.672346+0000","last_fullsized":"2023-10-06T04:39:20.672346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:10.617248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841824+0000","last_change":"2023-10-06T04:39:10.801723+0000","last_active":"2023-10-06T04:39:14.841824+0000","last_peered":"2023-10-06T04:39:14.841824+0000","last_clean":"2023-10-06T04:39:14.841824+0000","last_became_active":"2023-10-06T04:39:10.796435+0000","last_became_peered":"2023-10-06T04:39:10.796435+0000","last_unstale":"2023-10-06T04:39:14.841824+0000","last_undegraded":"2023-10-06T04:39:14.841824+0000","last_fullsized":"2023-10-06T04:39:14.841824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:59.444958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872388+0000","last_change":"2023-10-06T04:39:14.868717+0000","last_active":"2023-10-06T04:39:14.872388+0000","last_peered":"2023-10-06T04:39:14.872388+0000","last_clean":"2023-10-06T04:39:14.872388+0000","last_became_active":"2023-10-06T04:39:14.868184+0000","last_became_peered":"2023-10-06T04:39:14.868184+0000","last_unstale":"2023-10-06T04:39:14.872388+0000","last_undegraded":"2023-10-06T04:39:14.872388+0000","last_fullsized":"2023-10-06T04:39:14.872388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:45.298495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841634+0000","last_change":"2023-10-06T04:39:10.801737+0000","last_active":"2023-10-06T04:39:14.841634+0000","last_peered":"2023-10-06T04:39:14.841634+0000","last_clean":"2023-10-06T04:39:14.841634+0000","last_became_active":"2023-10-06T04:39:10.798733+0000","last_became_peered":"2023-10-06T04:39:10.798733+0000","last_unstale":"2023-10-06T04:39:14.841634+0000","last_undegraded":"2023-10-06T04:39:14.841634+0000","last_fullsized":"2023-10-06T04:39:14.841634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:33.684956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848907+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:39:14.848907+0000","last_peered":"2023-10-06T04:39:14.848907+0000","last_clean":"2023-10-06T04:39:14.848907+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:39:14.848907+0000","last_undegraded":"2023-10-06T04:39:14.848907+0000","last_fullsized":"2023-10-06T04:39:14.848907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:15.745754+0000","last_change":"2023-10-06T04:39:09.768361+0000","last_active":"2023-10-06T04:39:15.745754+0000","last_peered":"2023-10-06T04:39:15.745754+0000","last_clean":"2023-10-06T04:39:15.745754+0000","last_became_active":"2023-10-06T04:39:09.766351+0000","last_became_peered":"2023-10-06T04:39:09.766351+0000","last_unstale":"2023-10-06T04:39:15.745754+0000","last_undegraded":"2023-10-06T04:39:15.745754+0000","last_fullsized":"2023-10-06T04:39:15.745754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.815387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.866361+0000","last_change":"2023-10-06T04:39:14.862660+0000","last_active":"2023-10-06T04:39:14.866361+0000","last_peered":"2023-10-06T04:39:14.866361+0000","last_clean":"2023-10-06T04:39:14.866361+0000","last_became_active":"2023-10-06T04:39:14.862199+0000","last_became_peered":"2023-10-06T04:39:14.862199+0000","last_unstale":"2023-10-06T04:39:14.866361+0000","last_undegraded":"2023-10-06T04:39:14.866361+0000","last_fullsized":"2023-10-06T04:39:14.866361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:41.103920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837055+0000","last_change":"2023-10-06T04:39:10.793084+0000","last_active":"2023-10-06T04:39:14.837055+0000","last_peered":"2023-10-06T04:39:14.837055+0000","last_clean":"2023-10-06T04:39:14.837055+0000","last_became_active":"2023-10-06T04:39:10.791458+0000","last_became_peered":"2023-10-06T04:39:10.791458+0000","last_unstale":"2023-10-06T04:39:14.837055+0000","last_undegraded":"2023-10-06T04:39:14.837055+0000","last_fullsized":"2023-10-06T04:39:14.837055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856903+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:39:14.856903+0000","last_peered":"2023-10-06T04:39:14.856903+0000","last_clean":"2023-10-06T04:39:14.856903+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:39:14.856903+0000","last_undegraded":"2023-10-06T04:39:14.856903+0000","last_fullsized":"2023-10-06T04:39:14.856903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.839331+0000","last_change":"2023-10-06T04:39:09.773058+0000","last_active":"2023-10-06T04:39:14.839331+0000","last_peered":"2023-10-06T04:39:14.839331+0000","last_clean":"2023-10-06T04:39:14.839331+0000","last_became_active":"2023-10-06T04:39:09.772555+0000","last_became_peered":"2023-10-06T04:39:09.772555+0000","last_unstale":"2023-10-06T04:39:14.839331+0000","last_undegraded":"2023-10-06T04:39:14.839331+0000","last_fullsized":"2023-10-06T04:39:14.839331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:11.332865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.868688+0000","last_change":"2023-10-06T04:39:14.865402+0000","last_active":"2023-10-06T04:39:14.868688+0000","last_peered":"2023-10-06T04:39:14.868688+0000","last_clean":"2023-10-06T04:39:14.868688+0000","last_became_active":"2023-10-06T04:39:14.864905+0000","last_became_peered":"2023-10-06T04:39:14.864905+0000","last_unstale":"2023-10-06T04:39:14.868688+0000","last_undegraded":"2023-10-06T04:39:14.868688+0000","last_fullsized":"2023-10-06T04:39:14.868688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:58.993957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848392+0000","last_change":"2023-10-06T04:39:10.798497+0000","last_active":"2023-10-06T04:39:14.848392+0000","last_peered":"2023-10-06T04:39:14.848392+0000","last_clean":"2023-10-06T04:39:14.848392+0000","last_became_active":"2023-10-06T04:39:10.798125+0000","last_became_peered":"2023-10-06T04:39:10.798125+0000","last_unstale":"2023-10-06T04:39:14.848392+0000","last_undegraded":"2023-10-06T04:39:14.848392+0000","last_fullsized":"2023-10-06T04:39:14.848392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:12.187845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.859837+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:39:14.859837+0000","last_peered":"2023-10-06T04:39:14.859837+0000","last_clean":"2023-10-06T04:39:14.859837+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:39:14.859837+0000","last_undegraded":"2023-10-06T04:39:14.859837+0000","last_fullsized":"2023-10-06T04:39:14.859837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856260+0000","last_change":"2023-10-06T04:39:09.767635+0000","last_active":"2023-10-06T04:39:14.856260+0000","last_peered":"2023-10-06T04:39:14.856260+0000","last_clean":"2023-10-06T04:39:14.856260+0000","last_became_active":"2023-10-06T04:39:09.766515+0000","last_became_peered":"2023-10-06T04:39:09.766515+0000","last_unstale":"2023-10-06T04:39:14.856260+0000","last_undegraded":"2023-10-06T04:39:14.856260+0000","last_fullsized":"2023-10-06T04:39:14.856260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:17.992483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.867777+0000","last_change":"2023-10-06T04:39:14.863791+0000","last_active":"2023-10-06T04:39:14.867777+0000","last_peered":"2023-10-06T04:39:14.867777+0000","last_clean":"2023-10-06T04:39:14.867777+0000","last_became_active":"2023-10-06T04:39:14.863352+0000","last_became_peered":"2023-10-06T04:39:14.863352+0000","last_unstale":"2023-10-06T04:39:14.867777+0000","last_undegraded":"2023-10-06T04:39:14.867777+0000","last_fullsized":"2023-10-06T04:39:14.867777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855895+0000","last_change":"2023-10-06T04:39:10.797542+0000","last_active":"2023-10-06T04:39:14.855895+0000","last_peered":"2023-10-06T04:39:14.855895+0000","last_clean":"2023-10-06T04:39:14.855895+0000","last_became_active":"2023-10-06T04:39:10.797197+0000","last_became_peered":"2023-10-06T04:39:10.797197+0000","last_unstale":"2023-10-06T04:39:14.855895+0000","last_undegraded":"2023-10-06T04:39:14.855895+0000","last_fullsized":"2023-10-06T04:39:14.855895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:19.381736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856440+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:39:14.856440+0000","last_peered":"2023-10-06T04:39:14.856440+0000","last_clean":"2023-10-06T04:39:14.856440+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:39:14.856440+0000","last_undegraded":"2023-10-06T04:39:14.856440+0000","last_fullsized":"2023-10-06T04:39:14.856440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853612+0000","last_change":"2023-10-06T04:39:09.774270+0000","last_active":"2023-10-06T04:39:14.853612+0000","last_peered":"2023-10-06T04:39:14.853612+0000","last_clean":"2023-10-06T04:39:14.853612+0000","last_became_active":"2023-10-06T04:39:09.773928+0000","last_became_peered":"2023-10-06T04:39:09.773928+0000","last_unstale":"2023-10-06T04:39:14.853612+0000","last_undegraded":"2023-10-06T04:39:14.853612+0000","last_fullsized":"2023-10-06T04:39:14.853612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:02.332937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872357+0000","last_change":"2023-10-06T04:39:14.862336+0000","last_active":"2023-10-06T04:39:14.872357+0000","last_peered":"2023-10-06T04:39:14.872357+0000","last_clean":"2023-10-06T04:39:14.872357+0000","last_became_active":"2023-10-06T04:39:14.861912+0000","last_became_peered":"2023-10-06T04:39:14.861912+0000","last_unstale":"2023-10-06T04:39:14.872357+0000","last_undegraded":"2023-10-06T04:39:14.872357+0000","last_fullsized":"2023-10-06T04:39:14.872357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:21.891013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856096+0000","last_change":"2023-10-06T04:39:10.809172+0000","last_active":"2023-10-06T04:39:14.856096+0000","last_peered":"2023-10-06T04:39:14.856096+0000","last_clean":"2023-10-06T04:39:14.856096+0000","last_became_active":"2023-10-06T04:39:10.808897+0000","last_became_peered":"2023-10-06T04:39:10.808897+0000","last_unstale":"2023-10-06T04:39:14.856096+0000","last_undegraded":"2023-10-06T04:39:14.856096+0000","last_fullsized":"2023-10-06T04:39:14.856096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:35.325688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841922+0000","last_change":"2023-10-06T04:39:09.776105+0000","last_active":"2023-10-06T04:39:14.841922+0000","last_peered":"2023-10-06T04:39:14.841922+0000","last_clean":"2023-10-06T04:39:14.841922+0000","last_became_active":"2023-10-06T04:39:09.775817+0000","last_became_peered":"2023-10-06T04:39:09.775817+0000","last_unstale":"2023-10-06T04:39:14.841922+0000","last_undegraded":"2023-10-06T04:39:14.841922+0000","last_fullsized":"2023-10-06T04:39:14.841922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.815387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850247+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:39:14.850247+0000","last_peered":"2023-10-06T04:39:14.850247+0000","last_clean":"2023-10-06T04:39:14.850247+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:39:14.850247+0000","last_undegraded":"2023-10-06T04:39:14.850247+0000","last_fullsized":"2023-10-06T04:39:14.850247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872489+0000","last_change":"2023-10-06T04:39:14.863703+0000","last_active":"2023-10-06T04:39:14.872489+0000","last_peered":"2023-10-06T04:39:14.872489+0000","last_clean":"2023-10-06T04:39:14.872489+0000","last_became_active":"2023-10-06T04:39:14.863109+0000","last_became_peered":"2023-10-06T04:39:14.863109+0000","last_unstale":"2023-10-06T04:39:14.872489+0000","last_undegraded":"2023-10-06T04:39:14.872489+0000","last_fullsized":"2023-10-06T04:39:14.872489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:42.472361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856436+0000","last_change":"2023-10-06T04:39:10.797649+0000","last_active":"2023-10-06T04:39:14.856436+0000","last_peered":"2023-10-06T04:39:14.856436+0000","last_clean":"2023-10-06T04:39:14.856436+0000","last_became_active":"2023-10-06T04:39:10.797361+0000","last_became_peered":"2023-10-06T04:39:10.797361+0000","last_unstale":"2023-10-06T04:39:14.856436+0000","last_undegraded":"2023-10-06T04:39:14.856436+0000","last_fullsized":"2023-10-06T04:39:14.856436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:26.481455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855493+0000","last_change":"2023-10-06T04:39:09.767363+0000","last_active":"2023-10-06T04:39:14.855493+0000","last_peered":"2023-10-06T04:39:14.855493+0000","last_clean":"2023-10-06T04:39:14.855493+0000","last_became_active":"2023-10-06T04:39:09.766080+0000","last_became_peered":"2023-10-06T04:39:09.766080+0000","last_unstale":"2023-10-06T04:39:14.855493+0000","last_undegraded":"2023-10-06T04:39:14.855493+0000","last_fullsized":"2023-10-06T04:39:14.855493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:43.060143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842850+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:39:14.842850+0000","last_peered":"2023-10-06T04:39:14.842850+0000","last_clean":"2023-10-06T04:39:14.842850+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:39:14.842850+0000","last_undegraded":"2023-10-06T04:39:14.842850+0000","last_fullsized":"2023-10-06T04:39:14.842850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.870947+0000","last_change":"2023-10-06T04:39:14.865800+0000","last_active":"2023-10-06T04:39:14.870947+0000","last_peered":"2023-10-06T04:39:14.870947+0000","last_clean":"2023-10-06T04:39:14.870947+0000","last_became_active":"2023-10-06T04:39:14.863915+0000","last_became_peered":"2023-10-06T04:39:14.863915+0000","last_unstale":"2023-10-06T04:39:14.870947+0000","last_undegraded":"2023-10-06T04:39:14.870947+0000","last_fullsized":"2023-10-06T04:39:14.870947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851680+0000","last_change":"2023-10-06T04:39:10.796784+0000","last_active":"2023-10-06T04:39:14.851680+0000","last_peered":"2023-10-06T04:39:14.851680+0000","last_clean":"2023-10-06T04:39:14.851680+0000","last_became_active":"2023-10-06T04:39:10.796340+0000","last_became_peered":"2023-10-06T04:39:10.796340+0000","last_unstale":"2023-10-06T04:39:14.851680+0000","last_undegraded":"2023-10-06T04:39:14.851680+0000","last_fullsized":"2023-10-06T04:39:14.851680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847307+0000","last_change":"2023-10-06T04:39:09.776306+0000","last_active":"2023-10-06T04:39:14.847307+0000","last_peered":"2023-10-06T04:39:14.847307+0000","last_clean":"2023-10-06T04:39:14.847307+0000","last_became_active":"2023-10-06T04:39:09.775920+0000","last_became_peered":"2023-10-06T04:39:09.775920+0000","last_unstale":"2023-10-06T04:39:14.847307+0000","last_undegraded":"2023-10-06T04:39:14.847307+0000","last_fullsized":"2023-10-06T04:39:14.847307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:46.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852352+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:39:14.852352+0000","last_peered":"2023-10-06T04:39:14.852352+0000","last_clean":"2023-10-06T04:39:14.852352+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:39:14.852352+0000","last_undegraded":"2023-10-06T04:39:14.852352+0000","last_fullsized":"2023-10-06T04:39:14.852352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872195+0000","last_change":"2023-10-06T04:39:14.870766+0000","last_active":"2023-10-06T04:39:14.872195+0000","last_peered":"2023-10-06T04:39:14.872195+0000","last_clean":"2023-10-06T04:39:14.872195+0000","last_became_active":"2023-10-06T04:39:14.870293+0000","last_became_peered":"2023-10-06T04:39:14.870293+0000","last_unstale":"2023-10-06T04:39:14.872195+0000","last_undegraded":"2023-10-06T04:39:14.872195+0000","last_fullsized":"2023-10-06T04:39:14.872195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:25.769047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848956+0000","last_change":"2023-10-06T04:39:10.808367+0000","last_active":"2023-10-06T04:39:14.848956+0000","last_peered":"2023-10-06T04:39:14.848956+0000","last_clean":"2023-10-06T04:39:14.848956+0000","last_became_active":"2023-10-06T04:39:10.808087+0000","last_became_peered":"2023-10-06T04:39:10.808087+0000","last_unstale":"2023-10-06T04:39:14.848956+0000","last_undegraded":"2023-10-06T04:39:14.848956+0000","last_fullsized":"2023-10-06T04:39:14.848956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:52.160791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837257+0000","last_change":"2023-10-06T04:39:09.766937+0000","last_active":"2023-10-06T04:39:14.837257+0000","last_peered":"2023-10-06T04:39:14.837257+0000","last_clean":"2023-10-06T04:39:14.837257+0000","last_became_active":"2023-10-06T04:39:09.766577+0000","last_became_peered":"2023-10-06T04:39:09.766577+0000","last_unstale":"2023-10-06T04:39:14.837257+0000","last_undegraded":"2023-10-06T04:39:14.837257+0000","last_fullsized":"2023-10-06T04:39:14.837257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:58.385216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852746+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:39:14.852746+0000","last_peered":"2023-10-06T04:39:14.852746+0000","last_clean":"2023-10-06T04:39:14.852746+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:39:14.852746+0000","last_undegraded":"2023-10-06T04:39:14.852746+0000","last_fullsized":"2023-10-06T04:39:14.852746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852451+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:39:14.852451+0000","last_peered":"2023-10-06T04:39:14.852451+0000","last_clean":"2023-10-06T04:39:14.852451+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:39:14.852451+0000","last_undegraded":"2023-10-06T04:39:14.852451+0000","last_fullsized":"2023-10-06T04:39:14.852451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869388+0000","last_change":"2023-10-06T04:39:14.867879+0000","last_active":"2023-10-06T04:39:14.869388+0000","last_peered":"2023-10-06T04:39:14.869388+0000","last_clean":"2023-10-06T04:39:14.869388+0000","last_became_active":"2023-10-06T04:39:14.866139+0000","last_became_peered":"2023-10-06T04:39:14.866139+0000","last_unstale":"2023-10-06T04:39:14.869388+0000","last_undegraded":"2023-10-06T04:39:14.869388+0000","last_fullsized":"2023-10-06T04:39:14.869388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:43.629206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856342+0000","last_change":"2023-10-06T04:39:10.803484+0000","last_active":"2023-10-06T04:39:14.856342+0000","last_peered":"2023-10-06T04:39:14.856342+0000","last_clean":"2023-10-06T04:39:14.856342+0000","last_became_active":"2023-10-06T04:39:10.803189+0000","last_became_peered":"2023-10-06T04:39:10.803189+0000","last_unstale":"2023-10-06T04:39:14.856342+0000","last_undegraded":"2023-10-06T04:39:14.856342+0000","last_fullsized":"2023-10-06T04:39:14.856342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:48.240785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837543+0000","last_change":"2023-10-06T04:39:09.774774+0000","last_active":"2023-10-06T04:39:14.837543+0000","last_peered":"2023-10-06T04:39:14.837543+0000","last_clean":"2023-10-06T04:39:14.837543+0000","last_became_active":"2023-10-06T04:39:09.772662+0000","last_became_peered":"2023-10-06T04:39:09.772662+0000","last_unstale":"2023-10-06T04:39:14.837543+0000","last_undegraded":"2023-10-06T04:39:14.837543+0000","last_fullsized":"2023-10-06T04:39:14.837543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.815387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.867295+0000","last_change":"2023-10-06T04:39:14.863555+0000","last_active":"2023-10-06T04:39:14.867295+0000","last_peered":"2023-10-06T04:39:14.867295+0000","last_clean":"2023-10-06T04:39:14.867295+0000","last_became_active":"2023-10-06T04:39:14.863126+0000","last_became_peered":"2023-10-06T04:39:14.863126+0000","last_unstale":"2023-10-06T04:39:14.867295+0000","last_undegraded":"2023-10-06T04:39:14.867295+0000","last_fullsized":"2023-10-06T04:39:14.867295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:58.313292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842510+0000","last_change":"2023-10-06T04:39:10.801300+0000","last_active":"2023-10-06T04:39:14.842510+0000","last_peered":"2023-10-06T04:39:14.842510+0000","last_clean":"2023-10-06T04:39:14.842510+0000","last_became_active":"2023-10-06T04:39:10.797999+0000","last_became_peered":"2023-10-06T04:39:10.797999+0000","last_unstale":"2023-10-06T04:39:14.842510+0000","last_undegraded":"2023-10-06T04:39:14.842510+0000","last_fullsized":"2023-10-06T04:39:14.842510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:23.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841749+0000","last_change":"2023-10-06T04:39:09.772680+0000","last_active":"2023-10-06T04:39:14.841749+0000","last_peered":"2023-10-06T04:39:14.841749+0000","last_clean":"2023-10-06T04:39:14.841749+0000","last_became_active":"2023-10-06T04:39:09.770748+0000","last_became_peered":"2023-10-06T04:39:09.770748+0000","last_unstale":"2023-10-06T04:39:14.841749+0000","last_undegraded":"2023-10-06T04:39:14.841749+0000","last_fullsized":"2023-10-06T04:39:14.841749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:08.396735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.866535+0000","last_change":"2023-10-06T04:39:14.863771+0000","last_active":"2023-10-06T04:39:14.866535+0000","last_peered":"2023-10-06T04:39:14.866535+0000","last_clean":"2023-10-06T04:39:14.866535+0000","last_became_active":"2023-10-06T04:39:14.862562+0000","last_became_peered":"2023-10-06T04:39:14.862562+0000","last_unstale":"2023-10-06T04:39:14.866535+0000","last_undegraded":"2023-10-06T04:39:14.866535+0000","last_fullsized":"2023-10-06T04:39:14.866535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:13.279378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842489+0000","last_change":"2023-10-06T04:39:10.801609+0000","last_active":"2023-10-06T04:39:14.842489+0000","last_peered":"2023-10-06T04:39:14.842489+0000","last_clean":"2023-10-06T04:39:14.842489+0000","last_became_active":"2023-10-06T04:39:10.798490+0000","last_became_peered":"2023-10-06T04:39:10.798490+0000","last_unstale":"2023-10-06T04:39:14.842489+0000","last_undegraded":"2023-10-06T04:39:14.842489+0000","last_fullsized":"2023-10-06T04:39:14.842489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:13.365650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847962+0000","last_change":"2023-10-06T04:39:09.776674+0000","last_active":"2023-10-06T04:39:14.847962+0000","last_peered":"2023-10-06T04:39:14.847962+0000","last_clean":"2023-10-06T04:39:14.847962+0000","last_became_active":"2023-10-06T04:39:09.776334+0000","last_became_peered":"2023-10-06T04:39:09.776334+0000","last_unstale":"2023-10-06T04:39:14.847962+0000","last_undegraded":"2023-10-06T04:39:14.847962+0000","last_fullsized":"2023-10-06T04:39:14.847962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:02.883989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.878170+0000","last_change":"2023-10-06T04:39:14.873753+0000","last_active":"2023-10-06T04:39:14.878170+0000","last_peered":"2023-10-06T04:39:14.878170+0000","last_clean":"2023-10-06T04:39:14.878170+0000","last_became_active":"2023-10-06T04:39:14.873034+0000","last_became_peered":"2023-10-06T04:39:14.873034+0000","last_unstale":"2023-10-06T04:39:14.878170+0000","last_undegraded":"2023-10-06T04:39:14.878170+0000","last_fullsized":"2023-10-06T04:39:14.878170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:26.716449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842122+0000","last_change":"2023-10-06T04:39:10.807800+0000","last_active":"2023-10-06T04:39:14.842122+0000","last_peered":"2023-10-06T04:39:14.842122+0000","last_clean":"2023-10-06T04:39:14.842122+0000","last_became_active":"2023-10-06T04:39:10.807550+0000","last_became_peered":"2023-10-06T04:39:10.807550+0000","last_unstale":"2023-10-06T04:39:14.842122+0000","last_undegraded":"2023-10-06T04:39:14.842122+0000","last_fullsized":"2023-10-06T04:39:14.842122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:10.727863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838754+0000","last_change":"2023-10-06T04:39:09.776972+0000","last_active":"2023-10-06T04:39:14.838754+0000","last_peered":"2023-10-06T04:39:14.838754+0000","last_clean":"2023-10-06T04:39:14.838754+0000","last_became_active":"2023-10-06T04:39:09.776582+0000","last_became_peered":"2023-10-06T04:39:09.776582+0000","last_unstale":"2023-10-06T04:39:14.838754+0000","last_undegraded":"2023-10-06T04:39:14.838754+0000","last_fullsized":"2023-10-06T04:39:14.838754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:46.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.870886+0000","last_change":"2023-10-06T04:39:14.866468+0000","last_active":"2023-10-06T04:39:14.870886+0000","last_peered":"2023-10-06T04:39:14.870886+0000","last_clean":"2023-10-06T04:39:14.870886+0000","last_became_active":"2023-10-06T04:39:14.865978+0000","last_became_peered":"2023-10-06T04:39:14.865978+0000","last_unstale":"2023-10-06T04:39:14.870886+0000","last_undegraded":"2023-10-06T04:39:14.870886+0000","last_fullsized":"2023-10-06T04:39:14.870886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:26.328198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847077+0000","last_change":"2023-10-06T04:39:10.795850+0000","last_active":"2023-10-06T04:39:14.847077+0000","last_peered":"2023-10-06T04:39:14.847077+0000","last_clean":"2023-10-06T04:39:14.847077+0000","last_became_active":"2023-10-06T04:39:10.795532+0000","last_became_peered":"2023-10-06T04:39:10.795532+0000","last_unstale":"2023-10-06T04:39:14.847077+0000","last_undegraded":"2023-10-06T04:39:14.847077+0000","last_fullsized":"2023-10-06T04:39:14.847077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852581+0000","last_change":"2023-10-06T04:39:09.778260+0000","last_active":"2023-10-06T04:39:14.852581+0000","last_peered":"2023-10-06T04:39:14.852581+0000","last_clean":"2023-10-06T04:39:14.852581+0000","last_became_active":"2023-10-06T04:39:09.777976+0000","last_became_peered":"2023-10-06T04:39:09.777976+0000","last_unstale":"2023-10-06T04:39:14.852581+0000","last_undegraded":"2023-10-06T04:39:14.852581+0000","last_fullsized":"2023-10-06T04:39:14.852581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:20.229663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.862419+0000","last_change":"2023-10-06T04:39:14.857650+0000","last_active":"2023-10-06T04:39:14.862419+0000","last_peered":"2023-10-06T04:39:14.862419+0000","last_clean":"2023-10-06T04:39:14.862419+0000","last_became_active":"2023-10-06T04:39:14.857219+0000","last_became_peered":"2023-10-06T04:39:14.857219+0000","last_unstale":"2023-10-06T04:39:14.862419+0000","last_undegraded":"2023-10-06T04:39:14.862419+0000","last_fullsized":"2023-10-06T04:39:14.862419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:39.404929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847783+0000","last_change":"2023-10-06T04:39:10.800707+0000","last_active":"2023-10-06T04:39:14.847783+0000","last_peered":"2023-10-06T04:39:14.847783+0000","last_clean":"2023-10-06T04:39:14.847783+0000","last_became_active":"2023-10-06T04:39:10.800342+0000","last_became_peered":"2023-10-06T04:39:10.800342+0000","last_unstale":"2023-10-06T04:39:14.847783+0000","last_undegraded":"2023-10-06T04:39:14.847783+0000","last_fullsized":"2023-10-06T04:39:14.847783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:55.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.859752+0000","last_change":"2023-10-06T04:39:09.769967+0000","last_active":"2023-10-06T04:39:14.859752+0000","last_peered":"2023-10-06T04:39:14.859752+0000","last_clean":"2023-10-06T04:39:14.859752+0000","last_became_active":"2023-10-06T04:39:09.769644+0000","last_became_peered":"2023-10-06T04:39:09.769644+0000","last_unstale":"2023-10-06T04:39:14.859752+0000","last_undegraded":"2023-10-06T04:39:14.859752+0000","last_fullsized":"2023-10-06T04:39:14.859752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:23.492104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.870881+0000","last_change":"2023-10-06T04:39:14.866314+0000","last_active":"2023-10-06T04:39:14.870881+0000","last_peered":"2023-10-06T04:39:14.870881+0000","last_clean":"2023-10-06T04:39:14.870881+0000","last_became_active":"2023-10-06T04:39:14.864322+0000","last_became_peered":"2023-10-06T04:39:14.864322+0000","last_unstale":"2023-10-06T04:39:14.870881+0000","last_undegraded":"2023-10-06T04:39:14.870881+0000","last_fullsized":"2023-10-06T04:39:14.870881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:16.031710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841402+0000","last_change":"2023-10-06T04:39:10.804925+0000","last_active":"2023-10-06T04:39:14.841402+0000","last_peered":"2023-10-06T04:39:14.841402+0000","last_clean":"2023-10-06T04:39:14.841402+0000","last_became_active":"2023-10-06T04:39:10.804608+0000","last_became_peered":"2023-10-06T04:39:10.804608+0000","last_unstale":"2023-10-06T04:39:14.841402+0000","last_undegraded":"2023-10-06T04:39:14.841402+0000","last_fullsized":"2023-10-06T04:39:14.841402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:11.605186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.862470+0000","last_change":"2023-10-06T04:39:09.779200+0000","last_active":"2023-10-06T04:39:14.862470+0000","last_peered":"2023-10-06T04:39:14.862470+0000","last_clean":"2023-10-06T04:39:14.862470+0000","last_became_active":"2023-10-06T04:39:09.778902+0000","last_became_peered":"2023-10-06T04:39:09.778902+0000","last_unstale":"2023-10-06T04:39:14.862470+0000","last_undegraded":"2023-10-06T04:39:14.862470+0000","last_fullsized":"2023-10-06T04:39:14.862470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:43.836062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869506+0000","last_change":"2023-10-06T04:39:14.865345+0000","last_active":"2023-10-06T04:39:14.869506+0000","last_peered":"2023-10-06T04:39:14.869506+0000","last_clean":"2023-10-06T04:39:14.869506+0000","last_became_active":"2023-10-06T04:39:14.864895+0000","last_became_peered":"2023-10-06T04:39:14.864895+0000","last_unstale":"2023-10-06T04:39:14.869506+0000","last_undegraded":"2023-10-06T04:39:14.869506+0000","last_fullsized":"2023-10-06T04:39:14.869506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:04.884267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.846486+0000","last_change":"2023-10-06T04:39:10.798199+0000","last_active":"2023-10-06T04:39:14.846486+0000","last_peered":"2023-10-06T04:39:14.846486+0000","last_clean":"2023-10-06T04:39:14.846486+0000","last_became_active":"2023-10-06T04:39:10.797887+0000","last_became_peered":"2023-10-06T04:39:10.797887+0000","last_unstale":"2023-10-06T04:39:14.846486+0000","last_undegraded":"2023-10-06T04:39:14.846486+0000","last_fullsized":"2023-10-06T04:39:14.846486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:18.751471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.860419+0000","last_change":"2023-10-06T04:39:09.778482+0000","last_active":"2023-10-06T04:39:14.860419+0000","last_peered":"2023-10-06T04:39:14.860419+0000","last_clean":"2023-10-06T04:39:14.860419+0000","last_became_active":"2023-10-06T04:39:09.778203+0000","last_became_peered":"2023-10-06T04:39:09.778203+0000","last_unstale":"2023-10-06T04:39:14.860419+0000","last_undegraded":"2023-10-06T04:39:14.860419+0000","last_fullsized":"2023-10-06T04:39:14.860419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:57.313274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.873841+0000","last_change":"2023-10-06T04:39:14.869414+0000","last_active":"2023-10-06T04:39:14.873841+0000","last_peered":"2023-10-06T04:39:14.873841+0000","last_clean":"2023-10-06T04:39:14.873841+0000","last_became_active":"2023-10-06T04:39:14.866496+0000","last_became_peered":"2023-10-06T04:39:14.866496+0000","last_unstale":"2023-10-06T04:39:14.873841+0000","last_undegraded":"2023-10-06T04:39:14.873841+0000","last_fullsized":"2023-10-06T04:39:14.873841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:21.891013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.863781+0000","last_change":"2023-10-06T04:39:14.862719+0000","last_active":"2023-10-06T04:39:14.863781+0000","last_peered":"2023-10-06T04:39:14.863781+0000","last_clean":"2023-10-06T04:39:14.863781+0000","last_became_active":"2023-10-06T04:39:14.862055+0000","last_became_peered":"2023-10-06T04:39:14.862055+0000","last_unstale":"2023-10-06T04:39:14.863781+0000","last_undegraded":"2023-10-06T04:39:14.863781+0000","last_fullsized":"2023-10-06T04:39:14.863781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:13.176385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847135+0000","last_change":"2023-10-06T04:39:09.765721+0000","last_active":"2023-10-06T04:39:14.847135+0000","last_peered":"2023-10-06T04:39:14.847135+0000","last_clean":"2023-10-06T04:39:14.847135+0000","last_became_active":"2023-10-06T04:39:09.765371+0000","last_became_peered":"2023-10-06T04:39:09.765371+0000","last_unstale":"2023-10-06T04:39:14.847135+0000","last_undegraded":"2023-10-06T04:39:14.847135+0000","last_fullsized":"2023-10-06T04:39:14.847135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:46.555480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.839035+0000","last_change":"2023-10-06T04:39:10.802886+0000","last_active":"2023-10-06T04:39:14.839035+0000","last_peered":"2023-10-06T04:39:14.839035+0000","last_clean":"2023-10-06T04:39:14.839035+0000","last_became_active":"2023-10-06T04:39:10.802550+0000","last_became_peered":"2023-10-06T04:39:10.802550+0000","last_unstale":"2023-10-06T04:39:14.839035+0000","last_undegraded":"2023-10-06T04:39:14.839035+0000","last_fullsized":"2023-10-06T04:39:14.839035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869112+0000","last_change":"2023-10-06T04:39:14.865749+0000","last_active":"2023-10-06T04:39:14.869112+0000","last_peered":"2023-10-06T04:39:14.869112+0000","last_clean":"2023-10-06T04:39:14.869112+0000","last_became_active":"2023-10-06T04:39:14.865283+0000","last_became_peered":"2023-10-06T04:39:14.865283+0000","last_unstale":"2023-10-06T04:39:14.869112+0000","last_undegraded":"2023-10-06T04:39:14.869112+0000","last_fullsized":"2023-10-06T04:39:14.869112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:22.513353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.858777+0000","last_change":"2023-10-06T04:39:09.778439+0000","last_active":"2023-10-06T04:39:14.858777+0000","last_peered":"2023-10-06T04:39:14.858777+0000","last_clean":"2023-10-06T04:39:14.858777+0000","last_became_active":"2023-10-06T04:39:09.778107+0000","last_became_peered":"2023-10-06T04:39:09.778107+0000","last_unstale":"2023-10-06T04:39:14.858777+0000","last_undegraded":"2023-10-06T04:39:14.858777+0000","last_fullsized":"2023-10-06T04:39:14.858777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:14.344401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851798+0000","last_change":"2023-10-06T04:39:10.800973+0000","last_active":"2023-10-06T04:39:14.851798+0000","last_peered":"2023-10-06T04:39:14.851798+0000","last_clean":"2023-10-06T04:39:14.851798+0000","last_became_active":"2023-10-06T04:39:10.800682+0000","last_became_peered":"2023-10-06T04:39:10.800682+0000","last_unstale":"2023-10-06T04:39:14.851798+0000","last_undegraded":"2023-10-06T04:39:14.851798+0000","last_fullsized":"2023-10-06T04:39:14.851798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:10.727863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847077+0000","last_change":"2023-10-06T04:39:09.766574+0000","last_active":"2023-10-06T04:39:14.847077+0000","last_peered":"2023-10-06T04:39:14.847077+0000","last_clean":"2023-10-06T04:39:14.847077+0000","last_became_active":"2023-10-06T04:39:09.765846+0000","last_became_peered":"2023-10-06T04:39:09.765846+0000","last_unstale":"2023-10-06T04:39:14.847077+0000","last_undegraded":"2023-10-06T04:39:14.847077+0000","last_fullsized":"2023-10-06T04:39:14.847077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:11.332865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853442+0000","last_change":"2023-10-06T04:39:10.800587+0000","last_active":"2023-10-06T04:39:14.853442+0000","last_peered":"2023-10-06T04:39:14.853442+0000","last_clean":"2023-10-06T04:39:14.853442+0000","last_became_active":"2023-10-06T04:39:10.798566+0000","last_became_peered":"2023-10-06T04:39:10.798566+0000","last_unstale":"2023-10-06T04:39:14.853442+0000","last_undegraded":"2023-10-06T04:39:14.853442+0000","last_fullsized":"2023-10-06T04:39:14.853442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:22.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869120+0000","last_change":"2023-10-06T04:39:14.865777+0000","last_active":"2023-10-06T04:39:14.869120+0000","last_peered":"2023-10-06T04:39:14.869120+0000","last_clean":"2023-10-06T04:39:14.869120+0000","last_became_active":"2023-10-06T04:39:14.865221+0000","last_became_peered":"2023-10-06T04:39:14.865221+0000","last_unstale":"2023-10-06T04:39:14.869120+0000","last_undegraded":"2023-10-06T04:39:14.869120+0000","last_fullsized":"2023-10-06T04:39:14.869120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:59.144138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851863+0000","last_change":"2023-10-06T04:39:09.779350+0000","last_active":"2023-10-06T04:39:14.851863+0000","last_peered":"2023-10-06T04:39:14.851863+0000","last_clean":"2023-10-06T04:39:14.851863+0000","last_became_active":"2023-10-06T04:39:09.778933+0000","last_became_peered":"2023-10-06T04:39:09.778933+0000","last_unstale":"2023-10-06T04:39:14.851863+0000","last_undegraded":"2023-10-06T04:39:14.851863+0000","last_fullsized":"2023-10-06T04:39:14.851863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:44.185428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838211+0000","last_change":"2023-10-06T04:39:10.803199+0000","last_active":"2023-10-06T04:39:14.838211+0000","last_peered":"2023-10-06T04:39:14.838211+0000","last_clean":"2023-10-06T04:39:14.838211+0000","last_became_active":"2023-10-06T04:39:10.802891+0000","last_became_peered":"2023-10-06T04:39:10.802891+0000","last_unstale":"2023-10-06T04:39:14.838211+0000","last_undegraded":"2023-10-06T04:39:14.838211+0000","last_fullsized":"2023-10-06T04:39:14.838211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876047+0000","last_change":"2023-10-06T04:39:14.874845+0000","last_active":"2023-10-06T04:39:14.876047+0000","last_peered":"2023-10-06T04:39:14.876047+0000","last_clean":"2023-10-06T04:39:14.876047+0000","last_became_active":"2023-10-06T04:39:14.874448+0000","last_became_peered":"2023-10-06T04:39:14.874448+0000","last_unstale":"2023-10-06T04:39:14.876047+0000","last_undegraded":"2023-10-06T04:39:14.876047+0000","last_fullsized":"2023-10-06T04:39:14.876047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:35.411077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847019+0000","last_change":"2023-10-06T04:39:10.796169+0000","last_active":"2023-10-06T04:39:14.847019+0000","last_peered":"2023-10-06T04:39:14.847019+0000","last_clean":"2023-10-06T04:39:14.847019+0000","last_became_active":"2023-10-06T04:39:10.795900+0000","last_became_peered":"2023-10-06T04:39:10.795900+0000","last_unstale":"2023-10-06T04:39:14.847019+0000","last_undegraded":"2023-10-06T04:39:14.847019+0000","last_fullsized":"2023-10-06T04:39:14.847019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:03.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.836968+0000","last_change":"2023-10-06T04:39:10.803152+0000","last_active":"2023-10-06T04:39:14.836968+0000","last_peered":"2023-10-06T04:39:14.836968+0000","last_clean":"2023-10-06T04:39:14.836968+0000","last_became_active":"2023-10-06T04:39:10.802831+0000","last_became_peered":"2023-10-06T04:39:10.802831+0000","last_unstale":"2023-10-06T04:39:14.836968+0000","last_undegraded":"2023-10-06T04:39:14.836968+0000","last_fullsized":"2023-10-06T04:39:14.836968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.405720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841420+0000","last_change":"2023-10-06T04:39:10.801514+0000","last_active":"2023-10-06T04:39:14.841420+0000","last_peered":"2023-10-06T04:39:14.841420+0000","last_clean":"2023-10-06T04:39:14.841420+0000","last_became_active":"2023-10-06T04:39:10.798059+0000","last_became_peered":"2023-10-06T04:39:10.798059+0000","last_unstale":"2023-10-06T04:39:14.841420+0000","last_undegraded":"2023-10-06T04:39:14.841420+0000","last_fullsized":"2023-10-06T04:39:14.841420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838585+0000","last_change":"2023-10-06T04:39:10.799859+0000","last_active":"2023-10-06T04:39:14.838585+0000","last_peered":"2023-10-06T04:39:14.838585+0000","last_clean":"2023-10-06T04:39:14.838585+0000","last_became_active":"2023-10-06T04:39:10.799533+0000","last_became_peered":"2023-10-06T04:39:10.799533+0000","last_unstale":"2023-10-06T04:39:14.838585+0000","last_undegraded":"2023-10-06T04:39:14.838585+0000","last_fullsized":"2023-10-06T04:39:14.838585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:11.209344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856350+0000","last_change":"2023-10-06T04:39:10.795334+0000","last_active":"2023-10-06T04:39:14.856350+0000","last_peered":"2023-10-06T04:39:14.856350+0000","last_clean":"2023-10-06T04:39:14.856350+0000","last_became_active":"2023-10-06T04:39:10.795033+0000","last_became_peered":"2023-10-06T04:39:10.795033+0000","last_unstale":"2023-10-06T04:39:14.856350+0000","last_undegraded":"2023-10-06T04:39:14.856350+0000","last_fullsized":"2023-10-06T04:39:14.856350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:18.751471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853357+0000","last_change":"2023-10-06T04:39:10.799770+0000","last_active":"2023-10-06T04:39:14.853357+0000","last_peered":"2023-10-06T04:39:14.853357+0000","last_clean":"2023-10-06T04:39:14.853357+0000","last_became_active":"2023-10-06T04:39:10.798941+0000","last_became_peered":"2023-10-06T04:39:10.798941+0000","last_unstale":"2023-10-06T04:39:14.853357+0000","last_undegraded":"2023-10-06T04:39:14.853357+0000","last_fullsized":"2023-10-06T04:39:14.853357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:52.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856727+0000","last_change":"2023-10-06T04:39:10.795471+0000","last_active":"2023-10-06T04:39:14.856727+0000","last_peered":"2023-10-06T04:39:14.856727+0000","last_clean":"2023-10-06T04:39:14.856727+0000","last_became_active":"2023-10-06T04:39:10.795120+0000","last_became_peered":"2023-10-06T04:39:10.795120+0000","last_unstale":"2023-10-06T04:39:14.856727+0000","last_undegraded":"2023-10-06T04:39:14.856727+0000","last_fullsized":"2023-10-06T04:39:14.856727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:52.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856227+0000","last_change":"2023-10-06T04:39:10.799379+0000","last_active":"2023-10-06T04:39:14.856227+0000","last_peered":"2023-10-06T04:39:14.856227+0000","last_clean":"2023-10-06T04:39:14.856227+0000","last_became_active":"2023-10-06T04:39:10.799087+0000","last_became_peered":"2023-10-06T04:39:10.799087+0000","last_unstale":"2023-10-06T04:39:14.856227+0000","last_undegraded":"2023-10-06T04:39:14.856227+0000","last_fullsized":"2023-10-06T04:39:14.856227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:38.502648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852196+0000","last_change":"2023-10-06T04:39:10.804696+0000","last_active":"2023-10-06T04:39:14.852196+0000","last_peered":"2023-10-06T04:39:14.852196+0000","last_clean":"2023-10-06T04:39:14.852196+0000","last_became_active":"2023-10-06T04:39:10.804399+0000","last_became_peered":"2023-10-06T04:39:10.804399+0000","last_unstale":"2023-10-06T04:39:14.852196+0000","last_undegraded":"2023-10-06T04:39:14.852196+0000","last_fullsized":"2023-10-06T04:39:14.852196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.836751+0000","last_change":"2023-10-06T04:39:10.799293+0000","last_active":"2023-10-06T04:39:14.836751+0000","last_peered":"2023-10-06T04:39:14.836751+0000","last_clean":"2023-10-06T04:39:14.836751+0000","last_became_active":"2023-10-06T04:39:10.798825+0000","last_became_peered":"2023-10-06T04:39:10.798825+0000","last_unstale":"2023-10-06T04:39:14.836751+0000","last_undegraded":"2023-10-06T04:39:14.836751+0000","last_fullsized":"2023-10-06T04:39:14.836751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.420412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.846972+0000","last_change":"2023-10-06T04:39:10.797145+0000","last_active":"2023-10-06T04:39:14.846972+0000","last_peered":"2023-10-06T04:39:14.846972+0000","last_clean":"2023-10-06T04:39:14.846972+0000","last_became_active":"2023-10-06T04:39:10.796689+0000","last_became_peered":"2023-10-06T04:39:10.796689+0000","last_unstale":"2023-10-06T04:39:14.846972+0000","last_undegraded":"2023-10-06T04:39:14.846972+0000","last_fullsized":"2023-10-06T04:39:14.846972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:11.209344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851753+0000","last_change":"2023-10-06T04:39:10.805749+0000","last_active":"2023-10-06T04:39:14.851753+0000","last_peered":"2023-10-06T04:39:14.851753+0000","last_clean":"2023-10-06T04:39:14.851753+0000","last_became_active":"2023-10-06T04:39:10.804977+0000","last_became_peered":"2023-10-06T04:39:10.804977+0000","last_unstale":"2023-10-06T04:39:14.851753+0000","last_undegraded":"2023-10-06T04:39:14.851753+0000","last_fullsized":"2023-10-06T04:39:14.851753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:23.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841933+0000","last_change":"2023-10-06T04:39:10.794553+0000","last_active":"2023-10-06T04:39:14.841933+0000","last_peered":"2023-10-06T04:39:14.841933+0000","last_clean":"2023-10-06T04:39:14.841933+0000","last_became_active":"2023-10-06T04:39:10.794274+0000","last_became_peered":"2023-10-06T04:39:10.794274+0000","last_unstale":"2023-10-06T04:39:14.841933+0000","last_undegraded":"2023-10-06T04:39:14.841933+0000","last_fullsized":"2023-10-06T04:39:14.841933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:33.941624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842368+0000","last_change":"2023-10-06T04:39:10.800418+0000","last_active":"2023-10-06T04:39:14.842368+0000","last_peered":"2023-10-06T04:39:14.842368+0000","last_clean":"2023-10-06T04:39:14.842368+0000","last_became_active":"2023-10-06T04:39:10.799986+0000","last_became_peered":"2023-10-06T04:39:10.799986+0000","last_unstale":"2023-10-06T04:39:14.842368+0000","last_undegraded":"2023-10-06T04:39:14.842368+0000","last_fullsized":"2023-10-06T04:39:14.842368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:03.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842492+0000","last_change":"2023-10-06T04:39:10.801586+0000","last_active":"2023-10-06T04:39:14.842492+0000","last_peered":"2023-10-06T04:39:14.842492+0000","last_clean":"2023-10-06T04:39:14.842492+0000","last_became_active":"2023-10-06T04:39:10.798761+0000","last_became_peered":"2023-10-06T04:39:10.798761+0000","last_unstale":"2023-10-06T04:39:14.842492+0000","last_undegraded":"2023-10-06T04:39:14.842492+0000","last_fullsized":"2023-10-06T04:39:14.842492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.420412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850097+0000","last_change":"2023-10-06T04:39:10.805013+0000","last_active":"2023-10-06T04:39:14.850097+0000","last_peered":"2023-10-06T04:39:14.850097+0000","last_clean":"2023-10-06T04:39:14.850097+0000","last_became_active":"2023-10-06T04:39:10.804231+0000","last_became_peered":"2023-10-06T04:39:10.804231+0000","last_unstale":"2023-10-06T04:39:14.850097+0000","last_undegraded":"2023-10-06T04:39:14.850097+0000","last_fullsized":"2023-10-06T04:39:14.850097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.405720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.840959+0000","last_change":"2023-10-06T04:39:10.798938+0000","last_active":"2023-10-06T04:39:14.840959+0000","last_peered":"2023-10-06T04:39:14.840959+0000","last_clean":"2023-10-06T04:39:14.840959+0000","last_became_active":"2023-10-06T04:39:10.798178+0000","last_became_peered":"2023-10-06T04:39:10.798178+0000","last_unstale":"2023-10-06T04:39:14.840959+0000","last_undegraded":"2023-10-06T04:39:14.840959+0000","last_fullsized":"2023-10-06T04:39:14.840959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853520+0000","last_change":"2023-10-06T04:39:10.804784+0000","last_active":"2023-10-06T04:39:14.853520+0000","last_peered":"2023-10-06T04:39:14.853520+0000","last_clean":"2023-10-06T04:39:14.853520+0000","last_became_active":"2023-10-06T04:39:10.804072+0000","last_became_peered":"2023-10-06T04:39:10.804072+0000","last_unstale":"2023-10-06T04:39:14.853520+0000","last_undegraded":"2023-10-06T04:39:14.853520+0000","last_fullsized":"2023-10-06T04:39:14.853520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:11.209344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.849546+0000","last_change":"2023-10-06T04:39:10.794908+0000","last_active":"2023-10-06T04:39:14.849546+0000","last_peered":"2023-10-06T04:39:14.849546+0000","last_clean":"2023-10-06T04:39:14.849546+0000","last_became_active":"2023-10-06T04:39:10.794629+0000","last_became_peered":"2023-10-06T04:39:10.794629+0000","last_unstale":"2023-10-06T04:39:14.849546+0000","last_undegraded":"2023-10-06T04:39:14.849546+0000","last_fullsized":"2023-10-06T04:39:14.849546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:02.105244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841856+0000","last_change":"2023-10-06T04:39:10.807415+0000","last_active":"2023-10-06T04:39:14.841856+0000","last_peered":"2023-10-06T04:39:14.841856+0000","last_clean":"2023-10-06T04:39:14.841856+0000","last_became_active":"2023-10-06T04:39:10.807005+0000","last_became_peered":"2023-10-06T04:39:10.807005+0000","last_unstale":"2023-10-06T04:39:14.841856+0000","last_undegraded":"2023-10-06T04:39:14.841856+0000","last_fullsized":"2023-10-06T04:39:14.841856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:30.195878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842269+0000","last_change":"2023-10-06T04:39:10.798512+0000","last_active":"2023-10-06T04:39:14.842269+0000","last_peered":"2023-10-06T04:39:14.842269+0000","last_clean":"2023-10-06T04:39:14.842269+0000","last_became_active":"2023-10-06T04:39:10.798009+0000","last_became_peered":"2023-10-06T04:39:10.798009+0000","last_unstale":"2023-10-06T04:39:14.842269+0000","last_undegraded":"2023-10-06T04:39:14.842269+0000","last_fullsized":"2023-10-06T04:39:14.842269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:55.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842361+0000","last_change":"2023-10-06T04:39:10.807187+0000","last_active":"2023-10-06T04:39:14.842361+0000","last_peered":"2023-10-06T04:39:14.842361+0000","last_clean":"2023-10-06T04:39:14.842361+0000","last_became_active":"2023-10-06T04:39:10.801649+0000","last_became_peered":"2023-10-06T04:39:10.801649+0000","last_unstale":"2023-10-06T04:39:14.842361+0000","last_undegraded":"2023-10-06T04:39:14.842361+0000","last_fullsized":"2023-10-06T04:39:14.842361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:13.704974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.854108+0000","last_change":"2023-10-06T04:39:10.807376+0000","last_active":"2023-10-06T04:39:14.854108+0000","last_peered":"2023-10-06T04:39:14.854108+0000","last_clean":"2023-10-06T04:39:14.854108+0000","last_became_active":"2023-10-06T04:39:10.806927+0000","last_became_peered":"2023-10-06T04:39:10.806927+0000","last_unstale":"2023-10-06T04:39:14.854108+0000","last_undegraded":"2023-10-06T04:39:14.854108+0000","last_fullsized":"2023-10-06T04:39:14.854108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:26.481455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.849970+0000","last_change":"2023-10-06T04:39:10.805215+0000","last_active":"2023-10-06T04:39:14.849970+0000","last_peered":"2023-10-06T04:39:14.849970+0000","last_clean":"2023-10-06T04:39:14.849970+0000","last_became_active":"2023-10-06T04:39:10.804738+0000","last_became_peered":"2023-10-06T04:39:10.804738+0000","last_unstale":"2023-10-06T04:39:14.849970+0000","last_undegraded":"2023-10-06T04:39:14.849970+0000","last_fullsized":"2023-10-06T04:39:14.849970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.420412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.846395+0000","last_change":"2023-10-06T04:39:10.803687+0000","last_active":"2023-10-06T04:39:14.846395+0000","last_peered":"2023-10-06T04:39:14.846395+0000","last_clean":"2023-10-06T04:39:14.846395+0000","last_became_active":"2023-10-06T04:39:10.803340+0000","last_became_peered":"2023-10-06T04:39:10.803340+0000","last_unstale":"2023-10-06T04:39:14.846395+0000","last_undegraded":"2023-10-06T04:39:14.846395+0000","last_fullsized":"2023-10-06T04:39:14.846395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:48.240785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853384+0000","last_change":"2023-10-06T04:39:10.804576+0000","last_active":"2023-10-06T04:39:14.853384+0000","last_peered":"2023-10-06T04:39:14.853384+0000","last_clean":"2023-10-06T04:39:14.853384+0000","last_became_active":"2023-10-06T04:39:10.804020+0000","last_became_peered":"2023-10-06T04:39:10.804020+0000","last_unstale":"2023-10-06T04:39:14.853384+0000","last_undegraded":"2023-10-06T04:39:14.853384+0000","last_fullsized":"2023-10-06T04:39:14.853384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841006+0000","last_change":"2023-10-06T04:39:10.801393+0000","last_active":"2023-10-06T04:39:14.841006+0000","last_peered":"2023-10-06T04:39:14.841006+0000","last_clean":"2023-10-06T04:39:14.841006+0000","last_became_active":"2023-10-06T04:39:10.798538+0000","last_became_peered":"2023-10-06T04:39:10.798538+0000","last_unstale":"2023-10-06T04:39:14.841006+0000","last_undegraded":"2023-10-06T04:39:14.841006+0000","last_fullsized":"2023-10-06T04:39:14.841006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848529+0000","last_change":"2023-10-06T04:39:10.802134+0000","last_active":"2023-10-06T04:39:14.848529+0000","last_peered":"2023-10-06T04:39:14.848529+0000","last_clean":"2023-10-06T04:39:14.848529+0000","last_became_active":"2023-10-06T04:39:10.801808+0000","last_became_peered":"2023-10-06T04:39:10.801808+0000","last_unstale":"2023-10-06T04:39:14.848529+0000","last_undegraded":"2023-10-06T04:39:14.848529+0000","last_fullsized":"2023-10-06T04:39:14.848529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:01.174439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.845825+0000","last_change":"2023-10-06T04:39:10.797709+0000","last_active":"2023-10-06T04:39:14.845825+0000","last_peered":"2023-10-06T04:39:14.845825+0000","last_clean":"2023-10-06T04:39:14.845825+0000","last_became_active":"2023-10-06T04:39:10.796499+0000","last_became_peered":"2023-10-06T04:39:10.796499+0000","last_unstale":"2023-10-06T04:39:14.845825+0000","last_undegraded":"2023-10-06T04:39:14.845825+0000","last_fullsized":"2023-10-06T04:39:14.845825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:30.195878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842462+0000","last_change":"2023-10-06T04:39:10.806884+0000","last_active":"2023-10-06T04:39:14.842462+0000","last_peered":"2023-10-06T04:39:14.842462+0000","last_clean":"2023-10-06T04:39:14.842462+0000","last_became_active":"2023-10-06T04:39:10.798862+0000","last_became_peered":"2023-10-06T04:39:10.798862+0000","last_unstale":"2023-10-06T04:39:14.842462+0000","last_undegraded":"2023-10-06T04:39:14.842462+0000","last_fullsized":"2023-10-06T04:39:14.842462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.344818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853993+0000","last_change":"2023-10-06T04:39:10.799938+0000","last_active":"2023-10-06T04:39:14.853993+0000","last_peered":"2023-10-06T04:39:14.853993+0000","last_clean":"2023-10-06T04:39:14.853993+0000","last_became_active":"2023-10-06T04:39:10.799583+0000","last_became_peered":"2023-10-06T04:39:10.799583+0000","last_unstale":"2023-10-06T04:39:14.853993+0000","last_undegraded":"2023-10-06T04:39:14.853993+0000","last_fullsized":"2023-10-06T04:39:14.853993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:35.325688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.843018+0000","last_change":"2023-10-06T04:39:10.808298+0000","last_active":"2023-10-06T04:39:14.843018+0000","last_peered":"2023-10-06T04:39:14.843018+0000","last_clean":"2023-10-06T04:39:14.843018+0000","last_became_active":"2023-10-06T04:39:10.808027+0000","last_became_peered":"2023-10-06T04:39:10.808027+0000","last_unstale":"2023-10-06T04:39:14.843018+0000","last_undegraded":"2023-10-06T04:39:14.843018+0000","last_fullsized":"2023-10-06T04:39:14.843018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:21.233331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":122164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":892928,"data_stored":712996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":716372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":122074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":122698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":315392,"data_stored":125844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":122074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":122074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:39:30.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:39:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.785+0000 7fa8ba579700 1 Processor -- start 2023-10-06T04:39:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.785+0000 7fa8ba579700 1 -- start start 2023-10-06T04:39:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa8b414dc30 0x7fa8b4067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8b40c7f30 0x7fa8b406be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b40c9fe0 con 0x7fa8b4068230 2023-10-06T04:39:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b40c8f50 con 0x7fa8b414dc30 2023-10-06T04:39:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40686b0 con 0x7fa8b40c7f30 2023-10-06T04:39:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b3fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa8b414dc30 0x7fa8b4067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8abfff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fa8b4068230 0x7fa8b40c7820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:49780/0 (socket says 172.21.15.37:49780) 2023-10-06T04:39:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8abfff700 1 -- 172.21.15.37:0/574051923 learned_addr learned my addr 172.21.15.37:0/574051923 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b8b16700 1 --2- 172.21.15.37:0/574051923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8b40c7f30 0x7fa8b406be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b37fe700 1 -- 172.21.15.37:0/574051923 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047937762 0 0) 0x7fa8b40c9fe0 con 0x7fa8b4068230 2023-10-06T04:39:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b37fe700 1 -- 172.21.15.37:0/574051923 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a0003570 con 0x7fa8b4068230 2023-10-06T04:39:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b8b16700 1 -- 172.21.15.37:0/574051923 >> v2:172.21.15.83:3300/0 conn(0x7fa8b414dc30 msgr2=0x7fa8b4067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b8b16700 1 --2- 172.21.15.37:0/574051923 >> v2:172.21.15.83:3300/0 conn(0x7fa8b414dc30 0x7fa8b4067cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b8b16700 1 -- 172.21.15.37:0/574051923 >> v1:172.21.15.83:6789/0 conn(0x7fa8b4068230 legacy=0x7fa8b40c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b8b16700 1 -- 172.21.15.37:0/574051923 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b40c93d0 con 0x7fa8b40c7f30 2023-10-06T04:39:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b3fff700 1 --2- 172.21.15.37:0/574051923 >> v2:172.21.15.83:3300/0 conn(0x7fa8b414dc30 0x7fa8b4067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b8b16700 1 --2- 172.21.15.37:0/574051923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8b40c7f30 0x7fa8b406be60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009e60 tx=0x7fa8ac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a5fc58901c5877d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b37fe700 1 -- 172.21.15.37:0/574051923 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00e070 con 0x7fa8b40c7f30 2023-10-06T04:39:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b37fe700 1 -- 172.21.15.37:0/574051923 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac00bab0 con 0x7fa8b40c7f30 2023-10-06T04:39:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8b37fe700 1 -- 172.21.15.37:0/574051923 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00be30 con 0x7fa8b40c7f30 2023-10-06T04:39:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 -- 172.21.15.37:0/574051923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8b40c7f30 msgr2=0x7fa8b406be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 --2- 172.21.15.37:0/574051923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8b40c7f30 0x7fa8b406be60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009e60 tx=0x7fa8ac009780 comp rx=0 tx=0).stop 2023-10-06T04:39:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 -- 172.21.15.37:0/574051923 shutdown_connections 2023-10-06T04:39:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 --2- 172.21.15.37:0/574051923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8b40c7f30 0x7fa8b406be60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 --2- 172.21.15.37:0/574051923 >> v2:172.21.15.83:3300/0 conn(0x7fa8b414dc30 0x7fa8b4067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 -- 172.21.15.37:0/574051923 >> 172.21.15.37:0/574051923 conn(0x7fa8b4068e00 msgr2=0x7fa8b4069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 -- 172.21.15.37:0/574051923 shutdown_connections 2023-10-06T04:39:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.789+0000 7fa8ba579700 1 -- 172.21.15.37:0/574051923 wait complete. 2023-10-06T04:39:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8ba579700 1 Processor -- start 2023-10-06T04:39:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8ba579700 1 -- start start 2023-10-06T04:39:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8ba579700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b4068230 0x7fa8b41466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8ba579700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8b40c7f30 0x7fa8b414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8ba579700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8b414dc30 0x7fa8b414c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8ba579700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b4146c10 con 0x7fa8b4068230 2023-10-06T04:39:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8ba579700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b4169460 con 0x7fa8b414dc30 2023-10-06T04:39:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8ba579700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b4169740 con 0x7fa8b40c7f30 2023-10-06T04:39:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b4068230 0x7fa8b41466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b4068230 0x7fa8b41466d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36544/0 (socket says 172.21.15.37:36544) 2023-10-06T04:39:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b3fff700 1 -- 172.21.15.37:0/4153827334 learned_addr learned my addr 172.21.15.37:0/4153827334 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8abfff700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8b40c7f30 0x7fa8b414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b8b16700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8b414dc30 0x7fa8b414c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b3fff700 1 -- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8b40c7f30 msgr2=0x7fa8b414bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b3fff700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8b40c7f30 0x7fa8b414bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b3fff700 1 -- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8b414dc30 msgr2=0x7fa8b414c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b3fff700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8b414dc30 0x7fa8b414c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b3fff700 1 -- 172.21.15.37:0/4153827334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a4009420 con 0x7fa8b4068230 2023-10-06T04:39:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b3fff700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b4068230 0x7fa8b41466d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400ec80 tx=0x7fa8a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b0ff9700 1 -- 172.21.15.37:0/4153827334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400c850 con 0x7fa8b4068230 2023-10-06T04:39:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b0ff9700 1 -- 172.21.15.37:0/4153827334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a400c9b0 con 0x7fa8b4068230 2023-10-06T04:39:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8ba579700 1 -- 172.21.15.37:0/4153827334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac009a20 con 0x7fa8b4068230 2023-10-06T04:39:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.793+0000 7fa8b0ff9700 1 -- 172.21.15.37:0/4153827334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400cd30 con 0x7fa8b4068230 2023-10-06T04:39:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.797+0000 7fa8ba579700 1 -- 172.21.15.37:0/4153827334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b4169d00 con 0x7fa8b4068230 2023-10-06T04:39:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.797+0000 7fa8ba579700 1 -- 172.21.15.37:0/4153827334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b4070ee0 con 0x7fa8b4068230 2023-10-06T04:39:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.797+0000 7fa8b0ff9700 1 -- 172.21.15.37:0/4153827334 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa8a4013680 con 0x7fa8b4068230 2023-10-06T04:39:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.797+0000 7fa8b0ff9700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa894060550 0x7fa894062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.797+0000 7fa8b0ff9700 1 -- 172.21.15.37:0/4153827334 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa8a407cf20 con 0x7fa8b4068230 2023-10-06T04:39:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.797+0000 7fa8abfff700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa894060550 0x7fa894062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.797+0000 7fa8abfff700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa894060550 0x7fa894062a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40b1300 tx=0x7fa89c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.801+0000 7fa8b0ff9700 1 -- 172.21.15.37:0/4153827334 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa8a4050b50 con 0x7fa8b4068230 2023-10-06T04:39:30.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.965+0000 7fa8ba579700 1 -- 172.21.15.37:0/4153827334 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8b40c96b0 con 0x7fa894060550 2023-10-06T04:39:30.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.985+0000 7fa8b0ff9700 1 -- 172.21.15.37:0/4153827334 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367179 (secure 0 0 0) 0x7fa8b40c96b0 con 0x7fa894060550 2023-10-06T04:39:30.994 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.993+0000 7fa8ba579700 1 -- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa894060550 msgr2=0x7fa894062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.993+0000 7fa8ba579700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa894060550 0x7fa894062a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40b1300 tx=0x7fa89c009040 comp rx=0 tx=0).stop 2023-10-06T04:39:30.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.993+0000 7fa8ba579700 1 -- 172.21.15.37:0/4153827334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b4068230 msgr2=0x7fa8b41466d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.993+0000 7fa8ba579700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b4068230 0x7fa8b41466d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400ec80 tx=0x7fa8a40091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.993+0000 7fa8ba579700 1 -- 172.21.15.37:0/4153827334 shutdown_connections 2023-10-06T04:39:30.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.993+0000 7fa8ba579700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa894060550 0x7fa894062a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.993+0000 7fa8ba579700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8b414dc30 0x7fa8b414c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.993+0000 7fa8ba579700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8b40c7f30 0x7fa8b414bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.993+0000 7fa8ba579700 1 --2- 172.21.15.37:0/4153827334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b4068230 0x7fa8b41466d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.993+0000 7fa8ba579700 1 -- 172.21.15.37:0/4153827334 >> 172.21.15.37:0/4153827334 conn(0x7fa8b4068e00 msgr2=0x7fa8b40c2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:30.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.993+0000 7fa8ba579700 1 -- 172.21.15.37:0/4153827334 shutdown_connections 2023-10-06T04:39:30.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:30.993+0000 7fa8ba579700 1 -- 172.21.15.37:0/4153827334 wait complete. 2023-10-06T04:39:31.000 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:39:31.012 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-10-06T04:39:29.034544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381832,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592888,"statfs":{"total":773094113280,"available":770655117312,"internally_reserved":0,"allocated":3612672,"data_stored":2166296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005472"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872498+0000","last_change":"2023-10-06T04:39:14.870069+0000","last_active":"2023-10-06T04:39:14.872498+0000","last_peered":"2023-10-06T04:39:14.872498+0000","last_clean":"2023-10-06T04:39:14.872498+0000","last_became_active":"2023-10-06T04:39:14.869576+0000","last_became_peered":"2023-10-06T04:39:14.869576+0000","last_unstale":"2023-10-06T04:39:14.872498+0000","last_undegraded":"2023-10-06T04:39:14.872498+0000","last_fullsized":"2023-10-06T04:39:14.872498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:25.769047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850210+0000","last_change":"2023-10-06T04:39:09.765548+0000","last_active":"2023-10-06T04:39:14.850210+0000","last_peered":"2023-10-06T04:39:14.850210+0000","last_clean":"2023-10-06T04:39:14.850210+0000","last_became_active":"2023-10-06T04:39:09.765140+0000","last_became_peered":"2023-10-06T04:39:09.765140+0000","last_unstale":"2023-10-06T04:39:14.850210+0000","last_undegraded":"2023-10-06T04:39:14.850210+0000","last_fullsized":"2023-10-06T04:39:14.850210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:58.385216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841115+0000","last_change":"2023-10-06T04:39:10.798882+0000","last_active":"2023-10-06T04:39:14.841115+0000","last_peered":"2023-10-06T04:39:14.841115+0000","last_clean":"2023-10-06T04:39:14.841115+0000","last_became_active":"2023-10-06T04:39:10.796380+0000","last_became_peered":"2023-10-06T04:39:10.796380+0000","last_unstale":"2023-10-06T04:39:14.841115+0000","last_undegraded":"2023-10-06T04:39:14.841115+0000","last_fullsized":"2023-10-06T04:39:14.841115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:29.463649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.860905+0000","last_change":"2023-10-06T04:39:14.859612+0000","last_active":"2023-10-06T04:39:14.860905+0000","last_peered":"2023-10-06T04:39:14.860905+0000","last_clean":"2023-10-06T04:39:14.860905+0000","last_became_active":"2023-10-06T04:39:14.859171+0000","last_became_peered":"2023-10-06T04:39:14.859171+0000","last_unstale":"2023-10-06T04:39:14.860905+0000","last_undegraded":"2023-10-06T04:39:14.860905+0000","last_fullsized":"2023-10-06T04:39:14.860905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:08.925413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838625+0000","last_change":"2023-10-06T04:39:09.772959+0000","last_active":"2023-10-06T04:39:14.838625+0000","last_peered":"2023-10-06T04:39:14.838625+0000","last_clean":"2023-10-06T04:39:14.838625+0000","last_became_active":"2023-10-06T04:39:09.772627+0000","last_became_peered":"2023-10-06T04:39:09.772627+0000","last_unstale":"2023-10-06T04:39:14.838625+0000","last_undegraded":"2023-10-06T04:39:14.838625+0000","last_fullsized":"2023-10-06T04:39:14.838625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.246847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837554+0000","last_change":"2023-10-06T04:39:10.799763+0000","last_active":"2023-10-06T04:39:14.837554+0000","last_peered":"2023-10-06T04:39:14.837554+0000","last_clean":"2023-10-06T04:39:14.837554+0000","last_became_active":"2023-10-06T04:39:10.799183+0000","last_became_peered":"2023-10-06T04:39:10.799183+0000","last_unstale":"2023-10-06T04:39:14.837554+0000","last_undegraded":"2023-10-06T04:39:14.837554+0000","last_fullsized":"2023-10-06T04:39:14.837554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:23.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876042+0000","last_change":"2023-10-06T04:39:14.874393+0000","last_active":"2023-10-06T04:39:14.876042+0000","last_peered":"2023-10-06T04:39:14.876042+0000","last_clean":"2023-10-06T04:39:14.876042+0000","last_became_active":"2023-10-06T04:39:14.873970+0000","last_became_peered":"2023-10-06T04:39:14.873970+0000","last_unstale":"2023-10-06T04:39:14.876042+0000","last_undegraded":"2023-10-06T04:39:14.876042+0000","last_fullsized":"2023-10-06T04:39:14.876042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:42.042299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853530+0000","last_change":"2023-10-06T04:39:09.776483+0000","last_active":"2023-10-06T04:39:14.853530+0000","last_peered":"2023-10-06T04:39:14.853530+0000","last_clean":"2023-10-06T04:39:14.853530+0000","last_became_active":"2023-10-06T04:39:09.776194+0000","last_became_peered":"2023-10-06T04:39:09.776194+0000","last_unstale":"2023-10-06T04:39:14.853530+0000","last_undegraded":"2023-10-06T04:39:14.853530+0000","last_fullsized":"2023-10-06T04:39:14.853530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:25.823920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841254+0000","last_change":"2023-10-06T04:39:10.806796+0000","last_active":"2023-10-06T04:39:14.841254+0000","last_peered":"2023-10-06T04:39:14.841254+0000","last_clean":"2023-10-06T04:39:14.841254+0000","last_became_active":"2023-10-06T04:39:10.803473+0000","last_became_peered":"2023-10-06T04:39:10.803473+0000","last_unstale":"2023-10-06T04:39:14.841254+0000","last_undegraded":"2023-10-06T04:39:14.841254+0000","last_fullsized":"2023-10-06T04:39:14.841254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:01.174439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872813+0000","last_change":"2023-10-06T04:39:14.868943+0000","last_active":"2023-10-06T04:39:14.872813+0000","last_peered":"2023-10-06T04:39:14.872813+0000","last_clean":"2023-10-06T04:39:14.872813+0000","last_became_active":"2023-10-06T04:39:14.868312+0000","last_became_peered":"2023-10-06T04:39:14.868312+0000","last_unstale":"2023-10-06T04:39:14.872813+0000","last_undegraded":"2023-10-06T04:39:14.872813+0000","last_fullsized":"2023-10-06T04:39:14.872813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:07.134968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852547+0000","last_change":"2023-10-06T04:39:09.771371+0000","last_active":"2023-10-06T04:39:14.852547+0000","last_peered":"2023-10-06T04:39:14.852547+0000","last_clean":"2023-10-06T04:39:14.852547+0000","last_became_active":"2023-10-06T04:39:09.771102+0000","last_became_peered":"2023-10-06T04:39:09.771102+0000","last_unstale":"2023-10-06T04:39:14.852547+0000","last_undegraded":"2023-10-06T04:39:14.852547+0000","last_fullsized":"2023-10-06T04:39:14.852547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:17.992483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841809+0000","last_change":"2023-10-06T04:39:10.807784+0000","last_active":"2023-10-06T04:39:14.841809+0000","last_peered":"2023-10-06T04:39:14.841809+0000","last_clean":"2023-10-06T04:39:14.841809+0000","last_became_active":"2023-10-06T04:39:10.807517+0000","last_became_peered":"2023-10-06T04:39:10.807517+0000","last_unstale":"2023-10-06T04:39:14.841809+0000","last_undegraded":"2023-10-06T04:39:14.841809+0000","last_fullsized":"2023-10-06T04:39:14.841809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:01.254363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.878158+0000","last_change":"2023-10-06T04:39:14.873431+0000","last_active":"2023-10-06T04:39:14.878158+0000","last_peered":"2023-10-06T04:39:14.878158+0000","last_clean":"2023-10-06T04:39:14.878158+0000","last_became_active":"2023-10-06T04:39:14.873014+0000","last_became_peered":"2023-10-06T04:39:14.873014+0000","last_unstale":"2023-10-06T04:39:14.878158+0000","last_undegraded":"2023-10-06T04:39:14.878158+0000","last_fullsized":"2023-10-06T04:39:14.878158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:13.279378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848648+0000","last_change":"2023-10-06T04:39:09.777180+0000","last_active":"2023-10-06T04:39:14.848648+0000","last_peered":"2023-10-06T04:39:14.848648+0000","last_clean":"2023-10-06T04:39:14.848648+0000","last_became_active":"2023-10-06T04:39:09.776838+0000","last_became_peered":"2023-10-06T04:39:09.776838+0000","last_unstale":"2023-10-06T04:39:14.848648+0000","last_undegraded":"2023-10-06T04:39:14.848648+0000","last_fullsized":"2023-10-06T04:39:14.848648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:10.617248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842412+0000","last_change":"2023-10-06T04:39:10.806300+0000","last_active":"2023-10-06T04:39:14.842412+0000","last_peered":"2023-10-06T04:39:14.842412+0000","last_clean":"2023-10-06T04:39:14.842412+0000","last_became_active":"2023-10-06T04:39:10.800539+0000","last_became_peered":"2023-10-06T04:39:10.800539+0000","last_unstale":"2023-10-06T04:39:14.842412+0000","last_undegraded":"2023-10-06T04:39:14.842412+0000","last_fullsized":"2023-10-06T04:39:14.842412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:26.827588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.867191+0000","last_change":"2023-10-06T04:39:14.863502+0000","last_active":"2023-10-06T04:39:14.867191+0000","last_peered":"2023-10-06T04:39:14.867191+0000","last_clean":"2023-10-06T04:39:14.867191+0000","last_became_active":"2023-10-06T04:39:14.863064+0000","last_became_peered":"2023-10-06T04:39:14.863064+0000","last_unstale":"2023-10-06T04:39:14.867191+0000","last_undegraded":"2023-10-06T04:39:14.867191+0000","last_fullsized":"2023-10-06T04:39:14.867191+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:55.304482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841597+0000","last_change":"2023-10-06T04:39:09.770501+0000","last_active":"2023-10-06T04:39:14.841597+0000","last_peered":"2023-10-06T04:39:14.841597+0000","last_clean":"2023-10-06T04:39:14.841597+0000","last_became_active":"2023-10-06T04:39:09.770199+0000","last_became_peered":"2023-10-06T04:39:09.770199+0000","last_unstale":"2023-10-06T04:39:14.841597+0000","last_undegraded":"2023-10-06T04:39:14.841597+0000","last_fullsized":"2023-10-06T04:39:14.841597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:46.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838286+0000","last_change":"2023-10-06T04:39:10.798539+0000","last_active":"2023-10-06T04:39:14.838286+0000","last_peered":"2023-10-06T04:39:14.838286+0000","last_clean":"2023-10-06T04:39:14.838286+0000","last_became_active":"2023-10-06T04:39:10.798237+0000","last_became_peered":"2023-10-06T04:39:10.798237+0000","last_unstale":"2023-10-06T04:39:14.838286+0000","last_undegraded":"2023-10-06T04:39:14.838286+0000","last_fullsized":"2023-10-06T04:39:14.838286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:10.727863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876193+0000","last_change":"2023-10-06T04:39:14.872340+0000","last_active":"2023-10-06T04:39:14.876193+0000","last_peered":"2023-10-06T04:39:14.876193+0000","last_clean":"2023-10-06T04:39:14.876193+0000","last_became_active":"2023-10-06T04:39:14.871698+0000","last_became_peered":"2023-10-06T04:39:14.871698+0000","last_unstale":"2023-10-06T04:39:14.876193+0000","last_undegraded":"2023-10-06T04:39:14.876193+0000","last_fullsized":"2023-10-06T04:39:14.876193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:21.553198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855800+0000","last_change":"2023-10-06T04:39:09.773699+0000","last_active":"2023-10-06T04:39:14.855800+0000","last_peered":"2023-10-06T04:39:14.855800+0000","last_clean":"2023-10-06T04:39:14.855800+0000","last_became_active":"2023-10-06T04:39:09.773399+0000","last_became_peered":"2023-10-06T04:39:09.773399+0000","last_unstale":"2023-10-06T04:39:14.855800+0000","last_undegraded":"2023-10-06T04:39:14.855800+0000","last_fullsized":"2023-10-06T04:39:14.855800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:25.823920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851512+0000","last_change":"2023-10-06T04:39:10.795142+0000","last_active":"2023-10-06T04:39:14.851512+0000","last_peered":"2023-10-06T04:39:14.851512+0000","last_clean":"2023-10-06T04:39:14.851512+0000","last_became_active":"2023-10-06T04:39:10.794525+0000","last_became_peered":"2023-10-06T04:39:10.794525+0000","last_unstale":"2023-10-06T04:39:14.851512+0000","last_undegraded":"2023-10-06T04:39:14.851512+0000","last_fullsized":"2023-10-06T04:39:14.851512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.875584+0000","last_change":"2023-10-06T04:39:14.869540+0000","last_active":"2023-10-06T04:39:14.875584+0000","last_peered":"2023-10-06T04:39:14.875584+0000","last_clean":"2023-10-06T04:39:14.875584+0000","last_became_active":"2023-10-06T04:39:14.869118+0000","last_became_peered":"2023-10-06T04:39:14.869118+0000","last_unstale":"2023-10-06T04:39:14.875584+0000","last_undegraded":"2023-10-06T04:39:14.875584+0000","last_fullsized":"2023-10-06T04:39:14.875584+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:32.206420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837301+0000","last_change":"2023-10-06T04:39:09.776975+0000","last_active":"2023-10-06T04:39:14.837301+0000","last_peered":"2023-10-06T04:39:14.837301+0000","last_clean":"2023-10-06T04:39:14.837301+0000","last_became_active":"2023-10-06T04:39:09.776600+0000","last_became_peered":"2023-10-06T04:39:09.776600+0000","last_unstale":"2023-10-06T04:39:14.837301+0000","last_undegraded":"2023-10-06T04:39:14.837301+0000","last_fullsized":"2023-10-06T04:39:14.837301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:10.617248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848811+0000","last_change":"2023-10-06T04:39:10.795446+0000","last_active":"2023-10-06T04:39:14.848811+0000","last_peered":"2023-10-06T04:39:14.848811+0000","last_clean":"2023-10-06T04:39:14.848811+0000","last_became_active":"2023-10-06T04:39:10.795269+0000","last_became_peered":"2023-10-06T04:39:10.795269+0000","last_unstale":"2023-10-06T04:39:14.848811+0000","last_undegraded":"2023-10-06T04:39:14.848811+0000","last_fullsized":"2023-10-06T04:39:14.848811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:21.233331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.836827+0000","last_change":"2023-10-06T04:39:10.796045+0000","last_active":"2023-10-06T04:39:14.836827+0000","last_peered":"2023-10-06T04:39:14.836827+0000","last_clean":"2023-10-06T04:39:14.836827+0000","last_became_active":"2023-10-06T04:39:10.795810+0000","last_became_peered":"2023-10-06T04:39:10.795810+0000","last_unstale":"2023-10-06T04:39:14.836827+0000","last_undegraded":"2023-10-06T04:39:14.836827+0000","last_fullsized":"2023-10-06T04:39:14.836827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:01.174439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850318+0000","last_change":"2023-10-06T04:39:09.767108+0000","last_active":"2023-10-06T04:39:14.850318+0000","last_peered":"2023-10-06T04:39:14.850318+0000","last_clean":"2023-10-06T04:39:14.850318+0000","last_became_active":"2023-10-06T04:39:09.765912+0000","last_became_peered":"2023-10-06T04:39:09.765912+0000","last_unstale":"2023-10-06T04:39:14.850318+0000","last_undegraded":"2023-10-06T04:39:14.850318+0000","last_fullsized":"2023-10-06T04:39:14.850318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.246847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.873803+0000","last_change":"2023-10-06T04:39:14.867667+0000","last_active":"2023-10-06T04:39:14.873803+0000","last_peered":"2023-10-06T04:39:14.873803+0000","last_clean":"2023-10-06T04:39:14.873803+0000","last_became_active":"2023-10-06T04:39:14.866987+0000","last_became_peered":"2023-10-06T04:39:14.866987+0000","last_unstale":"2023-10-06T04:39:14.873803+0000","last_undegraded":"2023-10-06T04:39:14.873803+0000","last_fullsized":"2023-10-06T04:39:14.873803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837163+0000","last_change":"2023-10-06T04:39:10.800091+0000","last_active":"2023-10-06T04:39:14.837163+0000","last_peered":"2023-10-06T04:39:14.837163+0000","last_clean":"2023-10-06T04:39:14.837163+0000","last_became_active":"2023-10-06T04:39:10.799013+0000","last_became_peered":"2023-10-06T04:39:10.799013+0000","last_unstale":"2023-10-06T04:39:14.837163+0000","last_undegraded":"2023-10-06T04:39:14.837163+0000","last_fullsized":"2023-10-06T04:39:14.837163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:12.187845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.854203+0000","last_change":"2023-10-06T04:39:09.765938+0000","last_active":"2023-10-06T04:39:14.854203+0000","last_peered":"2023-10-06T04:39:14.854203+0000","last_clean":"2023-10-06T04:39:14.854203+0000","last_became_active":"2023-10-06T04:39:09.765605+0000","last_became_peered":"2023-10-06T04:39:09.765605+0000","last_unstale":"2023-10-06T04:39:14.854203+0000","last_undegraded":"2023-10-06T04:39:14.854203+0000","last_fullsized":"2023-10-06T04:39:14.854203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:29.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876139+0000","last_change":"2023-10-06T04:39:14.874600+0000","last_active":"2023-10-06T04:39:14.876139+0000","last_peered":"2023-10-06T04:39:14.876139+0000","last_clean":"2023-10-06T04:39:14.876139+0000","last_became_active":"2023-10-06T04:39:14.874193+0000","last_became_peered":"2023-10-06T04:39:14.874193+0000","last_unstale":"2023-10-06T04:39:14.876139+0000","last_undegraded":"2023-10-06T04:39:14.876139+0000","last_fullsized":"2023-10-06T04:39:14.876139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:32.206420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.859491+0000","last_change":"2023-10-06T04:39:09.779107+0000","last_active":"2023-10-06T04:39:14.859491+0000","last_peered":"2023-10-06T04:39:14.859491+0000","last_clean":"2023-10-06T04:39:14.859491+0000","last_became_active":"2023-10-06T04:39:09.778810+0000","last_became_peered":"2023-10-06T04:39:09.778810+0000","last_unstale":"2023-10-06T04:39:14.859491+0000","last_undegraded":"2023-10-06T04:39:14.859491+0000","last_fullsized":"2023-10-06T04:39:14.859491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:53:29.527825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855898+0000","last_change":"2023-10-06T04:39:10.801962+0000","last_active":"2023-10-06T04:39:14.855898+0000","last_peered":"2023-10-06T04:39:14.855898+0000","last_clean":"2023-10-06T04:39:14.855898+0000","last_became_active":"2023-10-06T04:39:10.801671+0000","last_became_peered":"2023-10-06T04:39:10.801671+0000","last_unstale":"2023-10-06T04:39:14.855898+0000","last_undegraded":"2023-10-06T04:39:14.855898+0000","last_fullsized":"2023-10-06T04:39:14.855898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:22.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.866385+0000","last_change":"2023-10-06T04:39:14.862383+0000","last_active":"2023-10-06T04:39:14.866385+0000","last_peered":"2023-10-06T04:39:14.866385+0000","last_clean":"2023-10-06T04:39:14.866385+0000","last_became_active":"2023-10-06T04:39:14.861956+0000","last_became_peered":"2023-10-06T04:39:14.861956+0000","last_unstale":"2023-10-06T04:39:14.866385+0000","last_undegraded":"2023-10-06T04:39:14.866385+0000","last_fullsized":"2023-10-06T04:39:14.866385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:49.720754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.672346+0000","last_change":"2023-10-06T04:39:09.780007+0000","last_active":"2023-10-06T04:39:20.672346+0000","last_peered":"2023-10-06T04:39:20.672346+0000","last_clean":"2023-10-06T04:39:20.672346+0000","last_became_active":"2023-10-06T04:39:09.779738+0000","last_became_peered":"2023-10-06T04:39:09.779738+0000","last_unstale":"2023-10-06T04:39:20.672346+0000","last_undegraded":"2023-10-06T04:39:20.672346+0000","last_fullsized":"2023-10-06T04:39:20.672346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:10.617248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841824+0000","last_change":"2023-10-06T04:39:10.801723+0000","last_active":"2023-10-06T04:39:14.841824+0000","last_peered":"2023-10-06T04:39:14.841824+0000","last_clean":"2023-10-06T04:39:14.841824+0000","last_became_active":"2023-10-06T04:39:10.796435+0000","last_became_peered":"2023-10-06T04:39:10.796435+0000","last_unstale":"2023-10-06T04:39:14.841824+0000","last_undegraded":"2023-10-06T04:39:14.841824+0000","last_fullsized":"2023-10-06T04:39:14.841824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:59.444958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872388+0000","last_change":"2023-10-06T04:39:14.868717+0000","last_active":"2023-10-06T04:39:14.872388+0000","last_peered":"2023-10-06T04:39:14.872388+0000","last_clean":"2023-10-06T04:39:14.872388+0000","last_became_active":"2023-10-06T04:39:14.868184+0000","last_became_peered":"2023-10-06T04:39:14.868184+0000","last_unstale":"2023-10-06T04:39:14.872388+0000","last_undegraded":"2023-10-06T04:39:14.872388+0000","last_fullsized":"2023-10-06T04:39:14.872388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:45.298495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841634+0000","last_change":"2023-10-06T04:39:10.801737+0000","last_active":"2023-10-06T04:39:14.841634+0000","last_peered":"2023-10-06T04:39:14.841634+0000","last_clean":"2023-10-06T04:39:14.841634+0000","last_became_active":"2023-10-06T04:39:10.798733+0000","last_became_peered":"2023-10-06T04:39:10.798733+0000","last_unstale":"2023-10-06T04:39:14.841634+0000","last_undegraded":"2023-10-06T04:39:14.841634+0000","last_fullsized":"2023-10-06T04:39:14.841634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:33.684956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848907+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:39:14.848907+0000","last_peered":"2023-10-06T04:39:14.848907+0000","last_clean":"2023-10-06T04:39:14.848907+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:39:14.848907+0000","last_undegraded":"2023-10-06T04:39:14.848907+0000","last_fullsized":"2023-10-06T04:39:14.848907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:15.745754+0000","last_change":"2023-10-06T04:39:09.768361+0000","last_active":"2023-10-06T04:39:15.745754+0000","last_peered":"2023-10-06T04:39:15.745754+0000","last_clean":"2023-10-06T04:39:15.745754+0000","last_became_active":"2023-10-06T04:39:09.766351+0000","last_became_peered":"2023-10-06T04:39:09.766351+0000","last_unstale":"2023-10-06T04:39:15.745754+0000","last_undegraded":"2023-10-06T04:39:15.745754+0000","last_fullsized":"2023-10-06T04:39:15.745754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.815387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.866361+0000","last_change":"2023-10-06T04:39:14.862660+0000","last_active":"2023-10-06T04:39:14.866361+0000","last_peered":"2023-10-06T04:39:14.866361+0000","last_clean":"2023-10-06T04:39:14.866361+0000","last_became_active":"2023-10-06T04:39:14.862199+0000","last_became_peered":"2023-10-06T04:39:14.862199+0000","last_unstale":"2023-10-06T04:39:14.866361+0000","last_undegraded":"2023-10-06T04:39:14.866361+0000","last_fullsized":"2023-10-06T04:39:14.866361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:41.103920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837055+0000","last_change":"2023-10-06T04:39:10.793084+0000","last_active":"2023-10-06T04:39:14.837055+0000","last_peered":"2023-10-06T04:39:14.837055+0000","last_clean":"2023-10-06T04:39:14.837055+0000","last_became_active":"2023-10-06T04:39:10.791458+0000","last_became_peered":"2023-10-06T04:39:10.791458+0000","last_unstale":"2023-10-06T04:39:14.837055+0000","last_undegraded":"2023-10-06T04:39:14.837055+0000","last_fullsized":"2023-10-06T04:39:14.837055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856903+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:39:14.856903+0000","last_peered":"2023-10-06T04:39:14.856903+0000","last_clean":"2023-10-06T04:39:14.856903+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:39:14.856903+0000","last_undegraded":"2023-10-06T04:39:14.856903+0000","last_fullsized":"2023-10-06T04:39:14.856903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.839331+0000","last_change":"2023-10-06T04:39:09.773058+0000","last_active":"2023-10-06T04:39:14.839331+0000","last_peered":"2023-10-06T04:39:14.839331+0000","last_clean":"2023-10-06T04:39:14.839331+0000","last_became_active":"2023-10-06T04:39:09.772555+0000","last_became_peered":"2023-10-06T04:39:09.772555+0000","last_unstale":"2023-10-06T04:39:14.839331+0000","last_undegraded":"2023-10-06T04:39:14.839331+0000","last_fullsized":"2023-10-06T04:39:14.839331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:11.332865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.868688+0000","last_change":"2023-10-06T04:39:14.865402+0000","last_active":"2023-10-06T04:39:14.868688+0000","last_peered":"2023-10-06T04:39:14.868688+0000","last_clean":"2023-10-06T04:39:14.868688+0000","last_became_active":"2023-10-06T04:39:14.864905+0000","last_became_peered":"2023-10-06T04:39:14.864905+0000","last_unstale":"2023-10-06T04:39:14.868688+0000","last_undegraded":"2023-10-06T04:39:14.868688+0000","last_fullsized":"2023-10-06T04:39:14.868688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:58.993957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848392+0000","last_change":"2023-10-06T04:39:10.798497+0000","last_active":"2023-10-06T04:39:14.848392+0000","last_peered":"2023-10-06T04:39:14.848392+0000","last_clean":"2023-10-06T04:39:14.848392+0000","last_became_active":"2023-10-06T04:39:10.798125+0000","last_became_peered":"2023-10-06T04:39:10.798125+0000","last_unstale":"2023-10-06T04:39:14.848392+0000","last_undegraded":"2023-10-06T04:39:14.848392+0000","last_fullsized":"2023-10-06T04:39:14.848392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:12.187845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.859837+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:39:14.859837+0000","last_peered":"2023-10-06T04:39:14.859837+0000","last_clean":"2023-10-06T04:39:14.859837+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:39:14.859837+0000","last_undegraded":"2023-10-06T04:39:14.859837+0000","last_fullsized":"2023-10-06T04:39:14.859837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856260+0000","last_change":"2023-10-06T04:39:09.767635+0000","last_active":"2023-10-06T04:39:14.856260+0000","last_peered":"2023-10-06T04:39:14.856260+0000","last_clean":"2023-10-06T04:39:14.856260+0000","last_became_active":"2023-10-06T04:39:09.766515+0000","last_became_peered":"2023-10-06T04:39:09.766515+0000","last_unstale":"2023-10-06T04:39:14.856260+0000","last_undegraded":"2023-10-06T04:39:14.856260+0000","last_fullsized":"2023-10-06T04:39:14.856260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:17.992483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.867777+0000","last_change":"2023-10-06T04:39:14.863791+0000","last_active":"2023-10-06T04:39:14.867777+0000","last_peered":"2023-10-06T04:39:14.867777+0000","last_clean":"2023-10-06T04:39:14.867777+0000","last_became_active":"2023-10-06T04:39:14.863352+0000","last_became_peered":"2023-10-06T04:39:14.863352+0000","last_unstale":"2023-10-06T04:39:14.867777+0000","last_undegraded":"2023-10-06T04:39:14.867777+0000","last_fullsized":"2023-10-06T04:39:14.867777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855895+0000","last_change":"2023-10-06T04:39:10.797542+0000","last_active":"2023-10-06T04:39:14.855895+0000","last_peered":"2023-10-06T04:39:14.855895+0000","last_clean":"2023-10-06T04:39:14.855895+0000","last_became_active":"2023-10-06T04:39:10.797197+0000","last_became_peered":"2023-10-06T04:39:10.797197+0000","last_unstale":"2023-10-06T04:39:14.855895+0000","last_undegraded":"2023-10-06T04:39:14.855895+0000","last_fullsized":"2023-10-06T04:39:14.855895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:19.381736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856440+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:39:14.856440+0000","last_peered":"2023-10-06T04:39:14.856440+0000","last_clean":"2023-10-06T04:39:14.856440+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:39:14.856440+0000","last_undegraded":"2023-10-06T04:39:14.856440+0000","last_fullsized":"2023-10-06T04:39:14.856440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853612+0000","last_change":"2023-10-06T04:39:09.774270+0000","last_active":"2023-10-06T04:39:14.853612+0000","last_peered":"2023-10-06T04:39:14.853612+0000","last_clean":"2023-10-06T04:39:14.853612+0000","last_became_active":"2023-10-06T04:39:09.773928+0000","last_became_peered":"2023-10-06T04:39:09.773928+0000","last_unstale":"2023-10-06T04:39:14.853612+0000","last_undegraded":"2023-10-06T04:39:14.853612+0000","last_fullsized":"2023-10-06T04:39:14.853612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:02.332937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872357+0000","last_change":"2023-10-06T04:39:14.862336+0000","last_active":"2023-10-06T04:39:14.872357+0000","last_peered":"2023-10-06T04:39:14.872357+0000","last_clean":"2023-10-06T04:39:14.872357+0000","last_became_active":"2023-10-06T04:39:14.861912+0000","last_became_peered":"2023-10-06T04:39:14.861912+0000","last_unstale":"2023-10-06T04:39:14.872357+0000","last_undegraded":"2023-10-06T04:39:14.872357+0000","last_fullsized":"2023-10-06T04:39:14.872357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:21.891013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856096+0000","last_change":"2023-10-06T04:39:10.809172+0000","last_active":"2023-10-06T04:39:14.856096+0000","last_peered":"2023-10-06T04:39:14.856096+0000","last_clean":"2023-10-06T04:39:14.856096+0000","last_became_active":"2023-10-06T04:39:10.808897+0000","last_became_peered":"2023-10-06T04:39:10.808897+0000","last_unstale":"2023-10-06T04:39:14.856096+0000","last_undegraded":"2023-10-06T04:39:14.856096+0000","last_fullsized":"2023-10-06T04:39:14.856096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:35.325688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841922+0000","last_change":"2023-10-06T04:39:09.776105+0000","last_active":"2023-10-06T04:39:14.841922+0000","last_peered":"2023-10-06T04:39:14.841922+0000","last_clean":"2023-10-06T04:39:14.841922+0000","last_became_active":"2023-10-06T04:39:09.775817+0000","last_became_peered":"2023-10-06T04:39:09.775817+0000","last_unstale":"2023-10-06T04:39:14.841922+0000","last_undegraded":"2023-10-06T04:39:14.841922+0000","last_fullsized":"2023-10-06T04:39:14.841922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.815387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850247+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:39:14.850247+0000","last_peered":"2023-10-06T04:39:14.850247+0000","last_clean":"2023-10-06T04:39:14.850247+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:39:14.850247+0000","last_undegraded":"2023-10-06T04:39:14.850247+0000","last_fullsized":"2023-10-06T04:39:14.850247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872489+0000","last_change":"2023-10-06T04:39:14.863703+0000","last_active":"2023-10-06T04:39:14.872489+0000","last_peered":"2023-10-06T04:39:14.872489+0000","last_clean":"2023-10-06T04:39:14.872489+0000","last_became_active":"2023-10-06T04:39:14.863109+0000","last_became_peered":"2023-10-06T04:39:14.863109+0000","last_unstale":"2023-10-06T04:39:14.872489+0000","last_undegraded":"2023-10-06T04:39:14.872489+0000","last_fullsized":"2023-10-06T04:39:14.872489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:42.472361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856436+0000","last_change":"2023-10-06T04:39:10.797649+0000","last_active":"2023-10-06T04:39:14.856436+0000","last_peered":"2023-10-06T04:39:14.856436+0000","last_clean":"2023-10-06T04:39:14.856436+0000","last_became_active":"2023-10-06T04:39:10.797361+0000","last_became_peered":"2023-10-06T04:39:10.797361+0000","last_unstale":"2023-10-06T04:39:14.856436+0000","last_undegraded":"2023-10-06T04:39:14.856436+0000","last_fullsized":"2023-10-06T04:39:14.856436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:26.481455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855493+0000","last_change":"2023-10-06T04:39:09.767363+0000","last_active":"2023-10-06T04:39:14.855493+0000","last_peered":"2023-10-06T04:39:14.855493+0000","last_clean":"2023-10-06T04:39:14.855493+0000","last_became_active":"2023-10-06T04:39:09.766080+0000","last_became_peered":"2023-10-06T04:39:09.766080+0000","last_unstale":"2023-10-06T04:39:14.855493+0000","last_undegraded":"2023-10-06T04:39:14.855493+0000","last_fullsized":"2023-10-06T04:39:14.855493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:43.060143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842850+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:39:14.842850+0000","last_peered":"2023-10-06T04:39:14.842850+0000","last_clean":"2023-10-06T04:39:14.842850+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:39:14.842850+0000","last_undegraded":"2023-10-06T04:39:14.842850+0000","last_fullsized":"2023-10-06T04:39:14.842850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.870947+0000","last_change":"2023-10-06T04:39:14.865800+0000","last_active":"2023-10-06T04:39:14.870947+0000","last_peered":"2023-10-06T04:39:14.870947+0000","last_clean":"2023-10-06T04:39:14.870947+0000","last_became_active":"2023-10-06T04:39:14.863915+0000","last_became_peered":"2023-10-06T04:39:14.863915+0000","last_unstale":"2023-10-06T04:39:14.870947+0000","last_undegraded":"2023-10-06T04:39:14.870947+0000","last_fullsized":"2023-10-06T04:39:14.870947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851680+0000","last_change":"2023-10-06T04:39:10.796784+0000","last_active":"2023-10-06T04:39:14.851680+0000","last_peered":"2023-10-06T04:39:14.851680+0000","last_clean":"2023-10-06T04:39:14.851680+0000","last_became_active":"2023-10-06T04:39:10.796340+0000","last_became_peered":"2023-10-06T04:39:10.796340+0000","last_unstale":"2023-10-06T04:39:14.851680+0000","last_undegraded":"2023-10-06T04:39:14.851680+0000","last_fullsized":"2023-10-06T04:39:14.851680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847307+0000","last_change":"2023-10-06T04:39:09.776306+0000","last_active":"2023-10-06T04:39:14.847307+0000","last_peered":"2023-10-06T04:39:14.847307+0000","last_clean":"2023-10-06T04:39:14.847307+0000","last_became_active":"2023-10-06T04:39:09.775920+0000","last_became_peered":"2023-10-06T04:39:09.775920+0000","last_unstale":"2023-10-06T04:39:14.847307+0000","last_undegraded":"2023-10-06T04:39:14.847307+0000","last_fullsized":"2023-10-06T04:39:14.847307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:46.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852352+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:39:14.852352+0000","last_peered":"2023-10-06T04:39:14.852352+0000","last_clean":"2023-10-06T04:39:14.852352+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:39:14.852352+0000","last_undegraded":"2023-10-06T04:39:14.852352+0000","last_fullsized":"2023-10-06T04:39:14.852352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872195+0000","last_change":"2023-10-06T04:39:14.870766+0000","last_active":"2023-10-06T04:39:14.872195+0000","last_peered":"2023-10-06T04:39:14.872195+0000","last_clean":"2023-10-06T04:39:14.872195+0000","last_became_active":"2023-10-06T04:39:14.870293+0000","last_became_peered":"2023-10-06T04:39:14.870293+0000","last_unstale":"2023-10-06T04:39:14.872195+0000","last_undegraded":"2023-10-06T04:39:14.872195+0000","last_fullsized":"2023-10-06T04:39:14.872195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:25.769047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848956+0000","last_change":"2023-10-06T04:39:10.808367+0000","last_active":"2023-10-06T04:39:14.848956+0000","last_peered":"2023-10-06T04:39:14.848956+0000","last_clean":"2023-10-06T04:39:14.848956+0000","last_became_active":"2023-10-06T04:39:10.808087+0000","last_became_peered":"2023-10-06T04:39:10.808087+0000","last_unstale":"2023-10-06T04:39:14.848956+0000","last_undegraded":"2023-10-06T04:39:14.848956+0000","last_fullsized":"2023-10-06T04:39:14.848956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:52.160791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837257+0000","last_change":"2023-10-06T04:39:09.766937+0000","last_active":"2023-10-06T04:39:14.837257+0000","last_peered":"2023-10-06T04:39:14.837257+0000","last_clean":"2023-10-06T04:39:14.837257+0000","last_became_active":"2023-10-06T04:39:09.766577+0000","last_became_peered":"2023-10-06T04:39:09.766577+0000","last_unstale":"2023-10-06T04:39:14.837257+0000","last_undegraded":"2023-10-06T04:39:14.837257+0000","last_fullsized":"2023-10-06T04:39:14.837257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:58.385216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852746+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:39:14.852746+0000","last_peered":"2023-10-06T04:39:14.852746+0000","last_clean":"2023-10-06T04:39:14.852746+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:39:14.852746+0000","last_undegraded":"2023-10-06T04:39:14.852746+0000","last_fullsized":"2023-10-06T04:39:14.852746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852451+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:39:14.852451+0000","last_peered":"2023-10-06T04:39:14.852451+0000","last_clean":"2023-10-06T04:39:14.852451+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:39:14.852451+0000","last_undegraded":"2023-10-06T04:39:14.852451+0000","last_fullsized":"2023-10-06T04:39:14.852451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869388+0000","last_change":"2023-10-06T04:39:14.867879+0000","last_active":"2023-10-06T04:39:14.869388+0000","last_peered":"2023-10-06T04:39:14.869388+0000","last_clean":"2023-10-06T04:39:14.869388+0000","last_became_active":"2023-10-06T04:39:14.866139+0000","last_became_peered":"2023-10-06T04:39:14.866139+0000","last_unstale":"2023-10-06T04:39:14.869388+0000","last_undegraded":"2023-10-06T04:39:14.869388+0000","last_fullsized":"2023-10-06T04:39:14.869388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:43.629206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856342+0000","last_change":"2023-10-06T04:39:10.803484+0000","last_active":"2023-10-06T04:39:14.856342+0000","last_peered":"2023-10-06T04:39:14.856342+0000","last_clean":"2023-10-06T04:39:14.856342+0000","last_became_active":"2023-10-06T04:39:10.803189+0000","last_became_peered":"2023-10-06T04:39:10.803189+0000","last_unstale":"2023-10-06T04:39:14.856342+0000","last_undegraded":"2023-10-06T04:39:14.856342+0000","last_fullsized":"2023-10-06T04:39:14.856342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:48.240785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837543+0000","last_change":"2023-10-06T04:39:09.774774+0000","last_active":"2023-10-06T04:39:14.837543+0000","last_peered":"2023-10-06T04:39:14.837543+0000","last_clean":"2023-10-06T04:39:14.837543+0000","last_became_active":"2023-10-06T04:39:09.772662+0000","last_became_peered":"2023-10-06T04:39:09.772662+0000","last_unstale":"2023-10-06T04:39:14.837543+0000","last_undegraded":"2023-10-06T04:39:14.837543+0000","last_fullsized":"2023-10-06T04:39:14.837543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.815387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.867295+0000","last_change":"2023-10-06T04:39:14.863555+0000","last_active":"2023-10-06T04:39:14.867295+0000","last_peered":"2023-10-06T04:39:14.867295+0000","last_clean":"2023-10-06T04:39:14.867295+0000","last_became_active":"2023-10-06T04:39:14.863126+0000","last_became_peered":"2023-10-06T04:39:14.863126+0000","last_unstale":"2023-10-06T04:39:14.867295+0000","last_undegraded":"2023-10-06T04:39:14.867295+0000","last_fullsized":"2023-10-06T04:39:14.867295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:58.313292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842510+0000","last_change":"2023-10-06T04:39:10.801300+0000","last_active":"2023-10-06T04:39:14.842510+0000","last_peered":"2023-10-06T04:39:14.842510+0000","last_clean":"2023-10-06T04:39:14.842510+0000","last_became_active":"2023-10-06T04:39:10.797999+0000","last_became_peered":"2023-10-06T04:39:10.797999+0000","last_unstale":"2023-10-06T04:39:14.842510+0000","last_undegraded":"2023-10-06T04:39:14.842510+0000","last_fullsized":"2023-10-06T04:39:14.842510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:23.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841749+0000","last_change":"2023-10-06T04:39:09.772680+0000","last_active":"2023-10-06T04:39:14.841749+0000","last_peered":"2023-10-06T04:39:14.841749+0000","last_clean":"2023-10-06T04:39:14.841749+0000","last_became_active":"2023-10-06T04:39:09.770748+0000","last_became_peered":"2023-10-06T04:39:09.770748+0000","last_unstale":"2023-10-06T04:39:14.841749+0000","last_undegraded":"2023-10-06T04:39:14.841749+0000","last_fullsized":"2023-10-06T04:39:14.841749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:08.396735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.866535+0000","last_change":"2023-10-06T04:39:14.863771+0000","last_active":"2023-10-06T04:39:14.866535+0000","last_peered":"2023-10-06T04:39:14.866535+0000","last_clean":"2023-10-06T04:39:14.866535+0000","last_became_active":"2023-10-06T04:39:14.862562+0000","last_became_peered":"2023-10-06T04:39:14.862562+0000","last_unstale":"2023-10-06T04:39:14.866535+0000","last_undegraded":"2023-10-06T04:39:14.866535+0000","last_fullsized":"2023-10-06T04:39:14.866535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:13.279378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842489+0000","last_change":"2023-10-06T04:39:10.801609+0000","last_active":"2023-10-06T04:39:14.842489+0000","last_peered":"2023-10-06T04:39:14.842489+0000","last_clean":"2023-10-06T04:39:14.842489+0000","last_became_active":"2023-10-06T04:39:10.798490+0000","last_became_peered":"2023-10-06T04:39:10.798490+0000","last_unstale":"2023-10-06T04:39:14.842489+0000","last_undegraded":"2023-10-06T04:39:14.842489+0000","last_fullsized":"2023-10-06T04:39:14.842489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:13.365650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847962+0000","last_change":"2023-10-06T04:39:09.776674+0000","last_active":"2023-10-06T04:39:14.847962+0000","last_peered":"2023-10-06T04:39:14.847962+0000","last_clean":"2023-10-06T04:39:14.847962+0000","last_became_active":"2023-10-06T04:39:09.776334+0000","last_became_peered":"2023-10-06T04:39:09.776334+0000","last_unstale":"2023-10-06T04:39:14.847962+0000","last_undegraded":"2023-10-06T04:39:14.847962+0000","last_fullsized":"2023-10-06T04:39:14.847962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:02.883989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.878170+0000","last_change":"2023-10-06T04:39:14.873753+0000","last_active":"2023-10-06T04:39:14.878170+0000","last_peered":"2023-10-06T04:39:14.878170+0000","last_clean":"2023-10-06T04:39:14.878170+0000","last_became_active":"2023-10-06T04:39:14.873034+0000","last_became_peered":"2023-10-06T04:39:14.873034+0000","last_unstale":"2023-10-06T04:39:14.878170+0000","last_undegraded":"2023-10-06T04:39:14.878170+0000","last_fullsized":"2023-10-06T04:39:14.878170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:26.716449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842122+0000","last_change":"2023-10-06T04:39:10.807800+0000","last_active":"2023-10-06T04:39:14.842122+0000","last_peered":"2023-10-06T04:39:14.842122+0000","last_clean":"2023-10-06T04:39:14.842122+0000","last_became_active":"2023-10-06T04:39:10.807550+0000","last_became_peered":"2023-10-06T04:39:10.807550+0000","last_unstale":"2023-10-06T04:39:14.842122+0000","last_undegraded":"2023-10-06T04:39:14.842122+0000","last_fullsized":"2023-10-06T04:39:14.842122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:10.727863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838754+0000","last_change":"2023-10-06T04:39:09.776972+0000","last_active":"2023-10-06T04:39:14.838754+0000","last_peered":"2023-10-06T04:39:14.838754+0000","last_clean":"2023-10-06T04:39:14.838754+0000","last_became_active":"2023-10-06T04:39:09.776582+0000","last_became_peered":"2023-10-06T04:39:09.776582+0000","last_unstale":"2023-10-06T04:39:14.838754+0000","last_undegraded":"2023-10-06T04:39:14.838754+0000","last_fullsized":"2023-10-06T04:39:14.838754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:46.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.870886+0000","last_change":"2023-10-06T04:39:14.866468+0000","last_active":"2023-10-06T04:39:14.870886+0000","last_peered":"2023-10-06T04:39:14.870886+0000","last_clean":"2023-10-06T04:39:14.870886+0000","last_became_active":"2023-10-06T04:39:14.865978+0000","last_became_peered":"2023-10-06T04:39:14.865978+0000","last_unstale":"2023-10-06T04:39:14.870886+0000","last_undegraded":"2023-10-06T04:39:14.870886+0000","last_fullsized":"2023-10-06T04:39:14.870886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:26.328198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847077+0000","last_change":"2023-10-06T04:39:10.795850+0000","last_active":"2023-10-06T04:39:14.847077+0000","last_peered":"2023-10-06T04:39:14.847077+0000","last_clean":"2023-10-06T04:39:14.847077+0000","last_became_active":"2023-10-06T04:39:10.795532+0000","last_became_peered":"2023-10-06T04:39:10.795532+0000","last_unstale":"2023-10-06T04:39:14.847077+0000","last_undegraded":"2023-10-06T04:39:14.847077+0000","last_fullsized":"2023-10-06T04:39:14.847077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852581+0000","last_change":"2023-10-06T04:39:09.778260+0000","last_active":"2023-10-06T04:39:14.852581+0000","last_peered":"2023-10-06T04:39:14.852581+0000","last_clean":"2023-10-06T04:39:14.852581+0000","last_became_active":"2023-10-06T04:39:09.777976+0000","last_became_peered":"2023-10-06T04:39:09.777976+0000","last_unstale":"2023-10-06T04:39:14.852581+0000","last_undegraded":"2023-10-06T04:39:14.852581+0000","last_fullsized":"2023-10-06T04:39:14.852581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:20.229663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.862419+0000","last_change":"2023-10-06T04:39:14.857650+0000","last_active":"2023-10-06T04:39:14.862419+0000","last_peered":"2023-10-06T04:39:14.862419+0000","last_clean":"2023-10-06T04:39:14.862419+0000","last_became_active":"2023-10-06T04:39:14.857219+0000","last_became_peered":"2023-10-06T04:39:14.857219+0000","last_unstale":"2023-10-06T04:39:14.862419+0000","last_undegraded":"2023-10-06T04:39:14.862419+0000","last_fullsized":"2023-10-06T04:39:14.862419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:39.404929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847783+0000","last_change":"2023-10-06T04:39:10.800707+0000","last_active":"2023-10-06T04:39:14.847783+0000","last_peered":"2023-10-06T04:39:14.847783+0000","last_clean":"2023-10-06T04:39:14.847783+0000","last_became_active":"2023-10-06T04:39:10.800342+0000","last_became_peered":"2023-10-06T04:39:10.800342+0000","last_unstale":"2023-10-06T04:39:14.847783+0000","last_undegraded":"2023-10-06T04:39:14.847783+0000","last_fullsized":"2023-10-06T04:39:14.847783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:55.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.859752+0000","last_change":"2023-10-06T04:39:09.769967+0000","last_active":"2023-10-06T04:39:14.859752+0000","last_peered":"2023-10-06T04:39:14.859752+0000","last_clean":"2023-10-06T04:39:14.859752+0000","last_became_active":"2023-10-06T04:39:09.769644+0000","last_became_peered":"2023-10-06T04:39:09.769644+0000","last_unstale":"2023-10-06T04:39:14.859752+0000","last_undegraded":"2023-10-06T04:39:14.859752+0000","last_fullsized":"2023-10-06T04:39:14.859752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:23.492104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.870881+0000","last_change":"2023-10-06T04:39:14.866314+0000","last_active":"2023-10-06T04:39:14.870881+0000","last_peered":"2023-10-06T04:39:14.870881+0000","last_clean":"2023-10-06T04:39:14.870881+0000","last_became_active":"2023-10-06T04:39:14.864322+0000","last_became_peered":"2023-10-06T04:39:14.864322+0000","last_unstale":"2023-10-06T04:39:14.870881+0000","last_undegraded":"2023-10-06T04:39:14.870881+0000","last_fullsized":"2023-10-06T04:39:14.870881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:16.031710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841402+0000","last_change":"2023-10-06T04:39:10.804925+0000","last_active":"2023-10-06T04:39:14.841402+0000","last_peered":"2023-10-06T04:39:14.841402+0000","last_clean":"2023-10-06T04:39:14.841402+0000","last_became_active":"2023-10-06T04:39:10.804608+0000","last_became_peered":"2023-10-06T04:39:10.804608+0000","last_unstale":"2023-10-06T04:39:14.841402+0000","last_undegraded":"2023-10-06T04:39:14.841402+0000","last_fullsized":"2023-10-06T04:39:14.841402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:11.605186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.862470+0000","last_change":"2023-10-06T04:39:09.779200+0000","last_active":"2023-10-06T04:39:14.862470+0000","last_peered":"2023-10-06T04:39:14.862470+0000","last_clean":"2023-10-06T04:39:14.862470+0000","last_became_active":"2023-10-06T04:39:09.778902+0000","last_became_peered":"2023-10-06T04:39:09.778902+0000","last_unstale":"2023-10-06T04:39:14.862470+0000","last_undegraded":"2023-10-06T04:39:14.862470+0000","last_fullsized":"2023-10-06T04:39:14.862470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:43.836062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869506+0000","last_change":"2023-10-06T04:39:14.865345+0000","last_active":"2023-10-06T04:39:14.869506+0000","last_peered":"2023-10-06T04:39:14.869506+0000","last_clean":"2023-10-06T04:39:14.869506+0000","last_became_active":"2023-10-06T04:39:14.864895+0000","last_became_peered":"2023-10-06T04:39:14.864895+0000","last_unstale":"2023-10-06T04:39:14.869506+0000","last_undegraded":"2023-10-06T04:39:14.869506+0000","last_fullsized":"2023-10-06T04:39:14.869506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:04.884267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.846486+0000","last_change":"2023-10-06T04:39:10.798199+0000","last_active":"2023-10-06T04:39:14.846486+0000","last_peered":"2023-10-06T04:39:14.846486+0000","last_clean":"2023-10-06T04:39:14.846486+0000","last_became_active":"2023-10-06T04:39:10.797887+0000","last_became_peered":"2023-10-06T04:39:10.797887+0000","last_unstale":"2023-10-06T04:39:14.846486+0000","last_undegraded":"2023-10-06T04:39:14.846486+0000","last_fullsized":"2023-10-06T04:39:14.846486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:18.751471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.860419+0000","last_change":"2023-10-06T04:39:09.778482+0000","last_active":"2023-10-06T04:39:14.860419+0000","last_peered":"2023-10-06T04:39:14.860419+0000","last_clean":"2023-10-06T04:39:14.860419+0000","last_became_active":"2023-10-06T04:39:09.778203+0000","last_became_peered":"2023-10-06T04:39:09.778203+0000","last_unstale":"2023-10-06T04:39:14.860419+0000","last_undegraded":"2023-10-06T04:39:14.860419+0000","last_fullsized":"2023-10-06T04:39:14.860419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:57.313274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.873841+0000","last_change":"2023-10-06T04:39:14.869414+0000","last_active":"2023-10-06T04:39:14.873841+0000","last_peered":"2023-10-06T04:39:14.873841+0000","last_clean":"2023-10-06T04:39:14.873841+0000","last_became_active":"2023-10-06T04:39:14.866496+0000","last_became_peered":"2023-10-06T04:39:14.866496+0000","last_unstale":"2023-10-06T04:39:14.873841+0000","last_undegraded":"2023-10-06T04:39:14.873841+0000","last_fullsized":"2023-10-06T04:39:14.873841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:21.891013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.863781+0000","last_change":"2023-10-06T04:39:14.862719+0000","last_active":"2023-10-06T04:39:14.863781+0000","last_peered":"2023-10-06T04:39:14.863781+0000","last_clean":"2023-10-06T04:39:14.863781+0000","last_became_active":"2023-10-06T04:39:14.862055+0000","last_became_peered":"2023-10-06T04:39:14.862055+0000","last_unstale":"2023-10-06T04:39:14.863781+0000","last_undegraded":"2023-10-06T04:39:14.863781+0000","last_fullsized":"2023-10-06T04:39:14.863781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:13.176385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847135+0000","last_change":"2023-10-06T04:39:09.765721+0000","last_active":"2023-10-06T04:39:14.847135+0000","last_peered":"2023-10-06T04:39:14.847135+0000","last_clean":"2023-10-06T04:39:14.847135+0000","last_became_active":"2023-10-06T04:39:09.765371+0000","last_became_peered":"2023-10-06T04:39:09.765371+0000","last_unstale":"2023-10-06T04:39:14.847135+0000","last_undegraded":"2023-10-06T04:39:14.847135+0000","last_fullsized":"2023-10-06T04:39:14.847135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:46.555480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.839035+0000","last_change":"2023-10-06T04:39:10.802886+0000","last_active":"2023-10-06T04:39:14.839035+0000","last_peered":"2023-10-06T04:39:14.839035+0000","last_clean":"2023-10-06T04:39:14.839035+0000","last_became_active":"2023-10-06T04:39:10.802550+0000","last_became_peered":"2023-10-06T04:39:10.802550+0000","last_unstale":"2023-10-06T04:39:14.839035+0000","last_undegraded":"2023-10-06T04:39:14.839035+0000","last_fullsized":"2023-10-06T04:39:14.839035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869112+0000","last_change":"2023-10-06T04:39:14.865749+0000","last_active":"2023-10-06T04:39:14.869112+0000","last_peered":"2023-10-06T04:39:14.869112+0000","last_clean":"2023-10-06T04:39:14.869112+0000","last_became_active":"2023-10-06T04:39:14.865283+0000","last_became_peered":"2023-10-06T04:39:14.865283+0000","last_unstale":"2023-10-06T04:39:14.869112+0000","last_undegraded":"2023-10-06T04:39:14.869112+0000","last_fullsized":"2023-10-06T04:39:14.869112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:22.513353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.858777+0000","last_change":"2023-10-06T04:39:09.778439+0000","last_active":"2023-10-06T04:39:14.858777+0000","last_peered":"2023-10-06T04:39:14.858777+0000","last_clean":"2023-10-06T04:39:14.858777+0000","last_became_active":"2023-10-06T04:39:09.778107+0000","last_became_peered":"2023-10-06T04:39:09.778107+0000","last_unstale":"2023-10-06T04:39:14.858777+0000","last_undegraded":"2023-10-06T04:39:14.858777+0000","last_fullsized":"2023-10-06T04:39:14.858777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:14.344401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851798+0000","last_change":"2023-10-06T04:39:10.800973+0000","last_active":"2023-10-06T04:39:14.851798+0000","last_peered":"2023-10-06T04:39:14.851798+0000","last_clean":"2023-10-06T04:39:14.851798+0000","last_became_active":"2023-10-06T04:39:10.800682+0000","last_became_peered":"2023-10-06T04:39:10.800682+0000","last_unstale":"2023-10-06T04:39:14.851798+0000","last_undegraded":"2023-10-06T04:39:14.851798+0000","last_fullsized":"2023-10-06T04:39:14.851798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:10.727863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847077+0000","last_change":"2023-10-06T04:39:09.766574+0000","last_active":"2023-10-06T04:39:14.847077+0000","last_peered":"2023-10-06T04:39:14.847077+0000","last_clean":"2023-10-06T04:39:14.847077+0000","last_became_active":"2023-10-06T04:39:09.765846+0000","last_became_peered":"2023-10-06T04:39:09.765846+0000","last_unstale":"2023-10-06T04:39:14.847077+0000","last_undegraded":"2023-10-06T04:39:14.847077+0000","last_fullsized":"2023-10-06T04:39:14.847077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:11.332865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853442+0000","last_change":"2023-10-06T04:39:10.800587+0000","last_active":"2023-10-06T04:39:14.853442+0000","last_peered":"2023-10-06T04:39:14.853442+0000","last_clean":"2023-10-06T04:39:14.853442+0000","last_became_active":"2023-10-06T04:39:10.798566+0000","last_became_peered":"2023-10-06T04:39:10.798566+0000","last_unstale":"2023-10-06T04:39:14.853442+0000","last_undegraded":"2023-10-06T04:39:14.853442+0000","last_fullsized":"2023-10-06T04:39:14.853442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:22.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869120+0000","last_change":"2023-10-06T04:39:14.865777+0000","last_active":"2023-10-06T04:39:14.869120+0000","last_peered":"2023-10-06T04:39:14.869120+0000","last_clean":"2023-10-06T04:39:14.869120+0000","last_became_active":"2023-10-06T04:39:14.865221+0000","last_became_peered":"2023-10-06T04:39:14.865221+0000","last_unstale":"2023-10-06T04:39:14.869120+0000","last_undegraded":"2023-10-06T04:39:14.869120+0000","last_fullsized":"2023-10-06T04:39:14.869120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:59.144138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851863+0000","last_change":"2023-10-06T04:39:09.779350+0000","last_active":"2023-10-06T04:39:14.851863+0000","last_peered":"2023-10-06T04:39:14.851863+0000","last_clean":"2023-10-06T04:39:14.851863+0000","last_became_active":"2023-10-06T04:39:09.778933+0000","last_became_peered":"2023-10-06T04:39:09.778933+0000","last_unstale":"2023-10-06T04:39:14.851863+0000","last_undegraded":"2023-10-06T04:39:14.851863+0000","last_fullsized":"2023-10-06T04:39:14.851863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:44.185428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838211+0000","last_change":"2023-10-06T04:39:10.803199+0000","last_active":"2023-10-06T04:39:14.838211+0000","last_peered":"2023-10-06T04:39:14.838211+0000","last_clean":"2023-10-06T04:39:14.838211+0000","last_became_active":"2023-10-06T04:39:10.802891+0000","last_became_peered":"2023-10-06T04:39:10.802891+0000","last_unstale":"2023-10-06T04:39:14.838211+0000","last_undegraded":"2023-10-06T04:39:14.838211+0000","last_fullsized":"2023-10-06T04:39:14.838211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876047+0000","last_change":"2023-10-06T04:39:14.874845+0000","last_active":"2023-10-06T04:39:14.876047+0000","last_peered":"2023-10-06T04:39:14.876047+0000","last_clean":"2023-10-06T04:39:14.876047+0000","last_became_active":"2023-10-06T04:39:14.874448+0000","last_became_peered":"2023-10-06T04:39:14.874448+0000","last_unstale":"2023-10-06T04:39:14.876047+0000","last_undegraded":"2023-10-06T04:39:14.876047+0000","last_fullsized":"2023-10-06T04:39:14.876047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:35.411077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847019+0000","last_change":"2023-10-06T04:39:10.796169+0000","last_active":"2023-10-06T04:39:14.847019+0000","last_peered":"2023-10-06T04:39:14.847019+0000","last_clean":"2023-10-06T04:39:14.847019+0000","last_became_active":"2023-10-06T04:39:10.795900+0000","last_became_peered":"2023-10-06T04:39:10.795900+0000","last_unstale":"2023-10-06T04:39:14.847019+0000","last_undegraded":"2023-10-06T04:39:14.847019+0000","last_fullsized":"2023-10-06T04:39:14.847019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:03.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.836968+0000","last_change":"2023-10-06T04:39:10.803152+0000","last_active":"2023-10-06T04:39:14.836968+0000","last_peered":"2023-10-06T04:39:14.836968+0000","last_clean":"2023-10-06T04:39:14.836968+0000","last_became_active":"2023-10-06T04:39:10.802831+0000","last_became_peered":"2023-10-06T04:39:10.802831+0000","last_unstale":"2023-10-06T04:39:14.836968+0000","last_undegraded":"2023-10-06T04:39:14.836968+0000","last_fullsized":"2023-10-06T04:39:14.836968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.405720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841420+0000","last_change":"2023-10-06T04:39:10.801514+0000","last_active":"2023-10-06T04:39:14.841420+0000","last_peered":"2023-10-06T04:39:14.841420+0000","last_clean":"2023-10-06T04:39:14.841420+0000","last_became_active":"2023-10-06T04:39:10.798059+0000","last_became_peered":"2023-10-06T04:39:10.798059+0000","last_unstale":"2023-10-06T04:39:14.841420+0000","last_undegraded":"2023-10-06T04:39:14.841420+0000","last_fullsized":"2023-10-06T04:39:14.841420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838585+0000","last_change":"2023-10-06T04:39:10.799859+0000","last_active":"2023-10-06T04:39:14.838585+0000","last_peered":"2023-10-06T04:39:14.838585+0000","last_clean":"2023-10-06T04:39:14.838585+0000","last_became_active":"2023-10-06T04:39:10.799533+0000","last_became_peered":"2023-10-06T04:39:10.799533+0000","last_unstale":"2023-10-06T04:39:14.838585+0000","last_undegraded":"2023-10-06T04:39:14.838585+0000","last_fullsized":"2023-10-06T04:39:14.838585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:11.209344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856350+0000","last_change":"2023-10-06T04:39:10.795334+0000","last_active":"2023-10-06T04:39:14.856350+0000","last_peered":"2023-10-06T04:39:14.856350+0000","last_clean":"2023-10-06T04:39:14.856350+0000","last_became_active":"2023-10-06T04:39:10.795033+0000","last_became_peered":"2023-10-06T04:39:10.795033+0000","last_unstale":"2023-10-06T04:39:14.856350+0000","last_undegraded":"2023-10-06T04:39:14.856350+0000","last_fullsized":"2023-10-06T04:39:14.856350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:18.751471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853357+0000","last_change":"2023-10-06T04:39:10.799770+0000","last_active":"2023-10-06T04:39:14.853357+0000","last_peered":"2023-10-06T04:39:14.853357+0000","last_clean":"2023-10-06T04:39:14.853357+0000","last_became_active":"2023-10-06T04:39:10.798941+0000","last_became_peered":"2023-10-06T04:39:10.798941+0000","last_unstale":"2023-10-06T04:39:14.853357+0000","last_undegraded":"2023-10-06T04:39:14.853357+0000","last_fullsized":"2023-10-06T04:39:14.853357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:52.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856727+0000","last_change":"2023-10-06T04:39:10.795471+0000","last_active":"2023-10-06T04:39:14.856727+0000","last_peered":"2023-10-06T04:39:14.856727+0000","last_clean":"2023-10-06T04:39:14.856727+0000","last_became_active":"2023-10-06T04:39:10.795120+0000","last_became_peered":"2023-10-06T04:39:10.795120+0000","last_unstale":"2023-10-06T04:39:14.856727+0000","last_undegraded":"2023-10-06T04:39:14.856727+0000","last_fullsized":"2023-10-06T04:39:14.856727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:52.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856227+0000","last_change":"2023-10-06T04:39:10.799379+0000","last_active":"2023-10-06T04:39:14.856227+0000","last_peered":"2023-10-06T04:39:14.856227+0000","last_clean":"2023-10-06T04:39:14.856227+0000","last_became_active":"2023-10-06T04:39:10.799087+0000","last_became_peered":"2023-10-06T04:39:10.799087+0000","last_unstale":"2023-10-06T04:39:14.856227+0000","last_undegraded":"2023-10-06T04:39:14.856227+0000","last_fullsized":"2023-10-06T04:39:14.856227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:38.502648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852196+0000","last_change":"2023-10-06T04:39:10.804696+0000","last_active":"2023-10-06T04:39:14.852196+0000","last_peered":"2023-10-06T04:39:14.852196+0000","last_clean":"2023-10-06T04:39:14.852196+0000","last_became_active":"2023-10-06T04:39:10.804399+0000","last_became_peered":"2023-10-06T04:39:10.804399+0000","last_unstale":"2023-10-06T04:39:14.852196+0000","last_undegraded":"2023-10-06T04:39:14.852196+0000","last_fullsized":"2023-10-06T04:39:14.852196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.836751+0000","last_change":"2023-10-06T04:39:10.799293+0000","last_active":"2023-10-06T04:39:14.836751+0000","last_peered":"2023-10-06T04:39:14.836751+0000","last_clean":"2023-10-06T04:39:14.836751+0000","last_became_active":"2023-10-06T04:39:10.798825+0000","last_became_peered":"2023-10-06T04:39:10.798825+0000","last_unstale":"2023-10-06T04:39:14.836751+0000","last_undegraded":"2023-10-06T04:39:14.836751+0000","last_fullsized":"2023-10-06T04:39:14.836751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.420412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.846972+0000","last_change":"2023-10-06T04:39:10.797145+0000","last_active":"2023-10-06T04:39:14.846972+0000","last_peered":"2023-10-06T04:39:14.846972+0000","last_clean":"2023-10-06T04:39:14.846972+0000","last_became_active":"2023-10-06T04:39:10.796689+0000","last_became_peered":"2023-10-06T04:39:10.796689+0000","last_unstale":"2023-10-06T04:39:14.846972+0000","last_undegraded":"2023-10-06T04:39:14.846972+0000","last_fullsized":"2023-10-06T04:39:14.846972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:11.209344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851753+0000","last_change":"2023-10-06T04:39:10.805749+0000","last_active":"2023-10-06T04:39:14.851753+0000","last_peered":"2023-10-06T04:39:14.851753+0000","last_clean":"2023-10-06T04:39:14.851753+0000","last_became_active":"2023-10-06T04:39:10.804977+0000","last_became_peered":"2023-10-06T04:39:10.804977+0000","last_unstale":"2023-10-06T04:39:14.851753+0000","last_undegraded":"2023-10-06T04:39:14.851753+0000","last_fullsized":"2023-10-06T04:39:14.851753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:23.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841933+0000","last_change":"2023-10-06T04:39:10.794553+0000","last_active":"2023-10-06T04:39:14.841933+0000","last_peered":"2023-10-06T04:39:14.841933+0000","last_clean":"2023-10-06T04:39:14.841933+0000","last_became_active":"2023-10-06T04:39:10.794274+0000","last_became_peered":"2023-10-06T04:39:10.794274+0000","last_unstale":"2023-10-06T04:39:14.841933+0000","last_undegraded":"2023-10-06T04:39:14.841933+0000","last_fullsized":"2023-10-06T04:39:14.841933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:33.941624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842368+0000","last_change":"2023-10-06T04:39:10.800418+0000","last_active":"2023-10-06T04:39:14.842368+0000","last_peered":"2023-10-06T04:39:14.842368+0000","last_clean":"2023-10-06T04:39:14.842368+0000","last_became_active":"2023-10-06T04:39:10.799986+0000","last_became_peered":"2023-10-06T04:39:10.799986+0000","last_unstale":"2023-10-06T04:39:14.842368+0000","last_undegraded":"2023-10-06T04:39:14.842368+0000","last_fullsized":"2023-10-06T04:39:14.842368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:03.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842492+0000","last_change":"2023-10-06T04:39:10.801586+0000","last_active":"2023-10-06T04:39:14.842492+0000","last_peered":"2023-10-06T04:39:14.842492+0000","last_clean":"2023-10-06T04:39:14.842492+0000","last_became_active":"2023-10-06T04:39:10.798761+0000","last_became_peered":"2023-10-06T04:39:10.798761+0000","last_unstale":"2023-10-06T04:39:14.842492+0000","last_undegraded":"2023-10-06T04:39:14.842492+0000","last_fullsized":"2023-10-06T04:39:14.842492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.420412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850097+0000","last_change":"2023-10-06T04:39:10.805013+0000","last_active":"2023-10-06T04:39:14.850097+0000","last_peered":"2023-10-06T04:39:14.850097+0000","last_clean":"2023-10-06T04:39:14.850097+0000","last_became_active":"2023-10-06T04:39:10.804231+0000","last_became_peered":"2023-10-06T04:39:10.804231+0000","last_unstale":"2023-10-06T04:39:14.850097+0000","last_undegraded":"2023-10-06T04:39:14.850097+0000","last_fullsized":"2023-10-06T04:39:14.850097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.405720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.840959+0000","last_change":"2023-10-06T04:39:10.798938+0000","last_active":"2023-10-06T04:39:14.840959+0000","last_peered":"2023-10-06T04:39:14.840959+0000","last_clean":"2023-10-06T04:39:14.840959+0000","last_became_active":"2023-10-06T04:39:10.798178+0000","last_became_peered":"2023-10-06T04:39:10.798178+0000","last_unstale":"2023-10-06T04:39:14.840959+0000","last_undegraded":"2023-10-06T04:39:14.840959+0000","last_fullsized":"2023-10-06T04:39:14.840959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853520+0000","last_change":"2023-10-06T04:39:10.804784+0000","last_active":"2023-10-06T04:39:14.853520+0000","last_peered":"2023-10-06T04:39:14.853520+0000","last_clean":"2023-10-06T04:39:14.853520+0000","last_became_active":"2023-10-06T04:39:10.804072+0000","last_became_peered":"2023-10-06T04:39:10.804072+0000","last_unstale":"2023-10-06T04:39:14.853520+0000","last_undegraded":"2023-10-06T04:39:14.853520+0000","last_fullsized":"2023-10-06T04:39:14.853520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:11.209344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.849546+0000","last_change":"2023-10-06T04:39:10.794908+0000","last_active":"2023-10-06T04:39:14.849546+0000","last_peered":"2023-10-06T04:39:14.849546+0000","last_clean":"2023-10-06T04:39:14.849546+0000","last_became_active":"2023-10-06T04:39:10.794629+0000","last_became_peered":"2023-10-06T04:39:10.794629+0000","last_unstale":"2023-10-06T04:39:14.849546+0000","last_undegraded":"2023-10-06T04:39:14.849546+0000","last_fullsized":"2023-10-06T04:39:14.849546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:02.105244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841856+0000","last_change":"2023-10-06T04:39:10.807415+0000","last_active":"2023-10-06T04:39:14.841856+0000","last_peered":"2023-10-06T04:39:14.841856+0000","last_clean":"2023-10-06T04:39:14.841856+0000","last_became_active":"2023-10-06T04:39:10.807005+0000","last_became_peered":"2023-10-06T04:39:10.807005+0000","last_unstale":"2023-10-06T04:39:14.841856+0000","last_undegraded":"2023-10-06T04:39:14.841856+0000","last_fullsized":"2023-10-06T04:39:14.841856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:30.195878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842269+0000","last_change":"2023-10-06T04:39:10.798512+0000","last_active":"2023-10-06T04:39:14.842269+0000","last_peered":"2023-10-06T04:39:14.842269+0000","last_clean":"2023-10-06T04:39:14.842269+0000","last_became_active":"2023-10-06T04:39:10.798009+0000","last_became_peered":"2023-10-06T04:39:10.798009+0000","last_unstale":"2023-10-06T04:39:14.842269+0000","last_undegraded":"2023-10-06T04:39:14.842269+0000","last_fullsized":"2023-10-06T04:39:14.842269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:55.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842361+0000","last_change":"2023-10-06T04:39:10.807187+0000","last_active":"2023-10-06T04:39:14.842361+0000","last_peered":"2023-10-06T04:39:14.842361+0000","last_clean":"2023-10-06T04:39:14.842361+0000","last_became_active":"2023-10-06T04:39:10.801649+0000","last_became_peered":"2023-10-06T04:39:10.801649+0000","last_unstale":"2023-10-06T04:39:14.842361+0000","last_undegraded":"2023-10-06T04:39:14.842361+0000","last_fullsized":"2023-10-06T04:39:14.842361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:13.704974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.854108+0000","last_change":"2023-10-06T04:39:10.807376+0000","last_active":"2023-10-06T04:39:14.854108+0000","last_peered":"2023-10-06T04:39:14.854108+0000","last_clean":"2023-10-06T04:39:14.854108+0000","last_became_active":"2023-10-06T04:39:10.806927+0000","last_became_peered":"2023-10-06T04:39:10.806927+0000","last_unstale":"2023-10-06T04:39:14.854108+0000","last_undegraded":"2023-10-06T04:39:14.854108+0000","last_fullsized":"2023-10-06T04:39:14.854108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:26.481455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.849970+0000","last_change":"2023-10-06T04:39:10.805215+0000","last_active":"2023-10-06T04:39:14.849970+0000","last_peered":"2023-10-06T04:39:14.849970+0000","last_clean":"2023-10-06T04:39:14.849970+0000","last_became_active":"2023-10-06T04:39:10.804738+0000","last_became_peered":"2023-10-06T04:39:10.804738+0000","last_unstale":"2023-10-06T04:39:14.849970+0000","last_undegraded":"2023-10-06T04:39:14.849970+0000","last_fullsized":"2023-10-06T04:39:14.849970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.420412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.846395+0000","last_change":"2023-10-06T04:39:10.803687+0000","last_active":"2023-10-06T04:39:14.846395+0000","last_peered":"2023-10-06T04:39:14.846395+0000","last_clean":"2023-10-06T04:39:14.846395+0000","last_became_active":"2023-10-06T04:39:10.803340+0000","last_became_peered":"2023-10-06T04:39:10.803340+0000","last_unstale":"2023-10-06T04:39:14.846395+0000","last_undegraded":"2023-10-06T04:39:14.846395+0000","last_fullsized":"2023-10-06T04:39:14.846395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:48.240785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853384+0000","last_change":"2023-10-06T04:39:10.804576+0000","last_active":"2023-10-06T04:39:14.853384+0000","last_peered":"2023-10-06T04:39:14.853384+0000","last_clean":"2023-10-06T04:39:14.853384+0000","last_became_active":"2023-10-06T04:39:10.804020+0000","last_became_peered":"2023-10-06T04:39:10.804020+0000","last_unstale":"2023-10-06T04:39:14.853384+0000","last_undegraded":"2023-10-06T04:39:14.853384+0000","last_fullsized":"2023-10-06T04:39:14.853384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841006+0000","last_change":"2023-10-06T04:39:10.801393+0000","last_active":"2023-10-06T04:39:14.841006+0000","last_peered":"2023-10-06T04:39:14.841006+0000","last_clean":"2023-10-06T04:39:14.841006+0000","last_became_active":"2023-10-06T04:39:10.798538+0000","last_became_peered":"2023-10-06T04:39:10.798538+0000","last_unstale":"2023-10-06T04:39:14.841006+0000","last_undegraded":"2023-10-06T04:39:14.841006+0000","last_fullsized":"2023-10-06T04:39:14.841006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848529+0000","last_change":"2023-10-06T04:39:10.802134+0000","last_active":"2023-10-06T04:39:14.848529+0000","last_peered":"2023-10-06T04:39:14.848529+0000","last_clean":"2023-10-06T04:39:14.848529+0000","last_became_active":"2023-10-06T04:39:10.801808+0000","last_became_peered":"2023-10-06T04:39:10.801808+0000","last_unstale":"2023-10-06T04:39:14.848529+0000","last_undegraded":"2023-10-06T04:39:14.848529+0000","last_fullsized":"2023-10-06T04:39:14.848529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:01.174439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.845825+0000","last_change":"2023-10-06T04:39:10.797709+0000","last_active":"2023-10-06T04:39:14.845825+0000","last_peered":"2023-10-06T04:39:14.845825+0000","last_clean":"2023-10-06T04:39:14.845825+0000","last_became_active":"2023-10-06T04:39:10.796499+0000","last_became_peered":"2023-10-06T04:39:10.796499+0000","last_unstale":"2023-10-06T04:39:14.845825+0000","last_undegraded":"2023-10-06T04:39:14.845825+0000","last_fullsized":"2023-10-06T04:39:14.845825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:30.195878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842462+0000","last_change":"2023-10-06T04:39:10.806884+0000","last_active":"2023-10-06T04:39:14.842462+0000","last_peered":"2023-10-06T04:39:14.842462+0000","last_clean":"2023-10-06T04:39:14.842462+0000","last_became_active":"2023-10-06T04:39:10.798862+0000","last_became_peered":"2023-10-06T04:39:10.798862+0000","last_unstale":"2023-10-06T04:39:14.842462+0000","last_undegraded":"2023-10-06T04:39:14.842462+0000","last_fullsized":"2023-10-06T04:39:14.842462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.344818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853993+0000","last_change":"2023-10-06T04:39:10.799938+0000","last_active":"2023-10-06T04:39:14.853993+0000","last_peered":"2023-10-06T04:39:14.853993+0000","last_clean":"2023-10-06T04:39:14.853993+0000","last_became_active":"2023-10-06T04:39:10.799583+0000","last_became_peered":"2023-10-06T04:39:10.799583+0000","last_unstale":"2023-10-06T04:39:14.853993+0000","last_undegraded":"2023-10-06T04:39:14.853993+0000","last_fullsized":"2023-10-06T04:39:14.853993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:35.325688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.843018+0000","last_change":"2023-10-06T04:39:10.808298+0000","last_active":"2023-10-06T04:39:14.843018+0000","last_peered":"2023-10-06T04:39:14.843018+0000","last_clean":"2023-10-06T04:39:14.843018+0000","last_became_active":"2023-10-06T04:39:10.808027+0000","last_became_peered":"2023-10-06T04:39:10.808027+0000","last_unstale":"2023-10-06T04:39:14.843018+0000","last_undegraded":"2023-10-06T04:39:14.843018+0000","last_fullsized":"2023-10-06T04:39:14.843018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:21.233331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":122164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":892928,"data_stored":712996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":716372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":122074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":122698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":315392,"data_stored":125844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":122074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":122074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:39:31.020 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:39:31.020 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T04:39:31.020 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T04:39:31.021 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T04:39:31.021 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T04:39:31.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.121+0000 7f8e6663b700 1 Processor -- start 2023-10-06T04:39:31.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.121+0000 7f8e6663b700 1 -- start start 2023-10-06T04:39:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8e601531e0 0x7f8e601535b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e6015cbd0 0x7f8e6015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e60153af0 con 0x7f8e600cc870 2023-10-06T04:39:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e600cd400 con 0x7f8e601531e0 2023-10-06T04:39:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6015b1e0 con 0x7f8e6015cbd0 2023-10-06T04:39:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e64bd8700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8e600cc870 0x7f8e600cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36552/0 (socket says 172.21.15.37:36552) 2023-10-06T04:39:31.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e64bd8700 1 -- 172.21.15.37:0/1953077125 learned_addr learned my addr 172.21.15.37:0/1953077125 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:31.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5ffff700 1 --2- 172.21.15.37:0/1953077125 >> v2:172.21.15.83:3300/0 conn(0x7f8e601531e0 0x7f8e601535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5f7fe700 1 --2- 172.21.15.37:0/1953077125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e6015cbd0 0x7f8e6015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5effd700 1 -- 172.21.15.37:0/1953077125 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942198859 0 0) 0x7f8e60153af0 con 0x7f8e600cc870 2023-10-06T04:39:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5effd700 1 -- 172.21.15.37:0/1953077125 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e48003570 con 0x7f8e600cc870 2023-10-06T04:39:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5f7fe700 1 -- 172.21.15.37:0/1953077125 >> v2:172.21.15.83:3300/0 conn(0x7f8e601531e0 msgr2=0x7f8e601535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5f7fe700 1 --2- 172.21.15.37:0/1953077125 >> v2:172.21.15.83:3300/0 conn(0x7f8e601531e0 0x7f8e601535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5f7fe700 1 -- 172.21.15.37:0/1953077125 >> v1:172.21.15.37:6789/0 conn(0x7f8e600cc870 legacy=0x7f8e600cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5f7fe700 1 -- 172.21.15.37:0/1953077125 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6015d580 con 0x7f8e6015cbd0 2023-10-06T04:39:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5ffff700 1 --2- 172.21.15.37:0/1953077125 >> v2:172.21.15.83:3300/0 conn(0x7f8e601531e0 0x7f8e601535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5f7fe700 1 --2- 172.21.15.37:0/1953077125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e6015cbd0 0x7f8e6015d040 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e500098e0 tx=0x7f8e500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14c4225fde4966b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5effd700 1 -- 172.21.15.37:0/1953077125 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50011630 con 0x7f8e6015cbd0 2023-10-06T04:39:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5effd700 1 -- 172.21.15.37:0/1953077125 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e50011790 con 0x7f8e6015cbd0 2023-10-06T04:39:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e5effd700 1 -- 172.21.15.37:0/1953077125 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50011b30 con 0x7f8e6015cbd0 2023-10-06T04:39:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 -- 172.21.15.37:0/1953077125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e6015cbd0 msgr2=0x7f8e6015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 --2- 172.21.15.37:0/1953077125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e6015cbd0 0x7f8e6015d040 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e500098e0 tx=0x7f8e500091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 -- 172.21.15.37:0/1953077125 shutdown_connections 2023-10-06T04:39:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 --2- 172.21.15.37:0/1953077125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e6015cbd0 0x7f8e6015d040 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 --2- 172.21.15.37:0/1953077125 >> v2:172.21.15.83:3300/0 conn(0x7f8e601531e0 0x7f8e601535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 -- 172.21.15.37:0/1953077125 >> 172.21.15.37:0/1953077125 conn(0x7f8e60087ab0 msgr2=0x7f8e60067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 -- 172.21.15.37:0/1953077125 shutdown_connections 2023-10-06T04:39:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.125+0000 7f8e6663b700 1 -- 172.21.15.37:0/1953077125 wait complete. 2023-10-06T04:39:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e6663b700 1 Processor -- start 2023-10-06T04:39:31.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e6663b700 1 -- start start 2023-10-06T04:39:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e6663b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e601531e0 0x7f8e600b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e6663b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e60157d10 0x7f8e60169050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e6663b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e601586b0 0x7f8e60158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e6663b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e60159060 con 0x7f8e601586b0 2023-10-06T04:39:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e6663b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e600c8550 con 0x7f8e60157d10 2023-10-06T04:39:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e6663b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e600c8b10 con 0x7f8e601531e0 2023-10-06T04:39:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e64bd8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e601586b0 0x7f8e60158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e64bd8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e601586b0 0x7f8e60158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36558/0 (socket says 172.21.15.37:36558) 2023-10-06T04:39:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e64bd8700 1 -- 172.21.15.37:0/24652103 learned_addr learned my addr 172.21.15.37:0/24652103 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e5ffff700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e601531e0 0x7f8e600b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e5f7fe700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e60157d10 0x7f8e60169050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e64bd8700 1 -- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e601531e0 msgr2=0x7f8e600b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e64bd8700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e601531e0 0x7f8e600b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e64bd8700 1 -- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e60157d10 msgr2=0x7f8e60169050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e64bd8700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e60157d10 0x7f8e60169050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e64bd8700 1 -- 172.21.15.37:0/24652103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e54009420 con 0x7f8e601586b0 2023-10-06T04:39:31.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e5f7fe700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e60157d10 0x7f8e60169050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:31.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e64bd8700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e601586b0 0x7f8e60158b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800cca0 tx=0x7f8e58001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.129+0000 7f8e47fff700 1 -- 172.21.15.37:0/24652103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800a920 con 0x7f8e601586b0 2023-10-06T04:39:31.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.133+0000 7f8e47fff700 1 -- 172.21.15.37:0/24652103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5800aa80 con 0x7f8e601586b0 2023-10-06T04:39:31.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.133+0000 7f8e6663b700 1 -- 172.21.15.37:0/24652103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e50009420 con 0x7f8e601586b0 2023-10-06T04:39:31.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.133+0000 7f8e47fff700 1 -- 172.21.15.37:0/24652103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800ae00 con 0x7f8e601586b0 2023-10-06T04:39:31.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.133+0000 7f8e6663b700 1 -- 172.21.15.37:0/24652103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e600b3da0 con 0x7f8e601586b0 2023-10-06T04:39:31.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.133+0000 7f8e6663b700 1 -- 172.21.15.37:0/24652103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e60070ee0 con 0x7f8e601586b0 2023-10-06T04:39:31.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.133+0000 7f8e47fff700 1 -- 172.21.15.37:0/24652103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8e58007300 con 0x7f8e601586b0 2023-10-06T04:39:31.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.133+0000 7f8e47fff700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8e4c060550 0x7f8e4c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.133+0000 7f8e47fff700 1 -- 172.21.15.37:0/24652103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8e5807d040 con 0x7f8e601586b0 2023-10-06T04:39:31.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.133+0000 7f8e5ffff700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8e4c060550 0x7f8e4c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.137+0000 7f8e5ffff700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8e4c060550 0x7f8e4c062a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009f40 tx=0x7f8e540091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.145+0000 7f8e47fff700 1 -- 172.21.15.37:0/24652103 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8e5804d1d0 con 0x7f8e601586b0 2023-10-06T04:39:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.345+0000 7f8e6663b700 1 -- 172.21.15.37:0/24652103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8e600cdba0 con 0x7f8e601586b0 2023-10-06T04:39:31.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.353+0000 7f8e47fff700 1 -- 172.21.15.37:0/24652103 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154131 (secure 0 0 0) 0x7f8e58054e60 con 0x7f8e601586b0 2023-10-06T04:39:31.361 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:31.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.357+0000 7f8e6663b700 1 -- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8e4c060550 msgr2=0x7f8e4c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.357+0000 7f8e6663b700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8e4c060550 0x7f8e4c062a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009f40 tx=0x7f8e540091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.357+0000 7f8e6663b700 1 -- 172.21.15.37:0/24652103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e601586b0 msgr2=0x7f8e60158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.357+0000 7f8e6663b700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e601586b0 0x7f8e60158b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800cca0 tx=0x7f8e58001ae0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.357+0000 7f8e6663b700 1 -- 172.21.15.37:0/24652103 shutdown_connections 2023-10-06T04:39:31.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.357+0000 7f8e6663b700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8e4c060550 0x7f8e4c062a00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.357+0000 7f8e6663b700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e60157d10 0x7f8e60169050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.357+0000 7f8e6663b700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e601586b0 0x7f8e60158b20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.357+0000 7f8e6663b700 1 --2- 172.21.15.37:0/24652103 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e601531e0 0x7f8e600b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.357+0000 7f8e6663b700 1 -- 172.21.15.37:0/24652103 >> 172.21.15.37:0/24652103 conn(0x7f8e600cc870 msgr2=0x7f8e6015b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.357+0000 7f8e6663b700 1 -- 172.21.15.37:0/24652103 shutdown_connections 2023-10-06T04:39:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.357+0000 7f8e6663b700 1 -- 172.21.15.37:0/24652103 wait complete. 2023-10-06T04:39:31.376 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":33328},{"type":"v1","addr":"172.21.15.83:6833","nonce":33328}]},"active_addr":"172.21.15.83:6833/33328","active_change":"2023-10-06T04:38:51.007723+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":2624544567}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":3103901016}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":4180325281}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":1312453248}]}]} 2023-10-06T04:39:31.380 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T04:39:31.380 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T04:39:31.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.477+0000 7f4ef66b0700 1 Processor -- start 2023-10-06T04:39:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.477+0000 7f4ef66b0700 1 -- start start 2023-10-06T04:39:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.477+0000 7f4ef66b0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4ef006d290 0x7f4ef006d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.477+0000 7f4ef66b0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ef0158410 0x7f4ef0158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.477+0000 7f4ef66b0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef00cd7c0 con 0x7f4ef00acdc0 2023-10-06T04:39:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.477+0000 7f4ef66b0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef006dc50 con 0x7f4ef006d290 2023-10-06T04:39:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.477+0000 7f4ef66b0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0158050 con 0x7f4ef0158410 2023-10-06T04:39:31.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4ef4c4d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ef0158410 0x7f4ef0158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4eef7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4ef006d290 0x7f4ef006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4ef4c4d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ef0158410 0x7f4ef0158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40318/0 (socket says 172.21.15.37:40318) 2023-10-06T04:39:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4eef7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4ef006d290 0x7f4ef006d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34592/0 (socket says 172.21.15.37:34592) 2023-10-06T04:39:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4ef4c4d700 1 -- 172.21.15.37:0/3407533685 learned_addr learned my addr 172.21.15.37:0/3407533685 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4eef7fe700 1 -- 172.21.15.37:0/3407533685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ef0158410 msgr2=0x7f4ef0158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4eef7fe700 1 --2- 172.21.15.37:0/3407533685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ef0158410 0x7f4ef0158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4eef7fe700 1 -- 172.21.15.37:0/3407533685 >> v1:172.21.15.83:6789/0 conn(0x7f4ef00acdc0 legacy=0x7f4ef00ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4eef7fe700 1 -- 172.21.15.37:0/3407533685 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00ccbb0 con 0x7f4ef006d290 2023-10-06T04:39:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4ef4c4d700 1 --2- 172.21.15.37:0/3407533685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ef0158410 0x7f4ef0158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4eef7fe700 1 --2- 172.21.15.37:0/3407533685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ef006d290 0x7f4ef006d710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80098e0 tx=0x7f4ed80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17db50ff9fd8827a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4eeeffd700 1 -- 172.21.15.37:0/3407533685 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800b640 con 0x7f4ef006d290 2023-10-06T04:39:31.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4eeeffd700 1 -- 172.21.15.37:0/3407533685 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed800b7a0 con 0x7f4ef006d290 2023-10-06T04:39:31.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4eeeffd700 1 -- 172.21.15.37:0/3407533685 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800bb40 con 0x7f4ef006d290 2023-10-06T04:39:31.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4ef66b0700 1 -- 172.21.15.37:0/3407533685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ef006d290 msgr2=0x7f4ef006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4ef66b0700 1 --2- 172.21.15.37:0/3407533685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ef006d290 0x7f4ef006d710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80098e0 tx=0x7f4ed80091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4ef66b0700 1 -- 172.21.15.37:0/3407533685 shutdown_connections 2023-10-06T04:39:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4ef66b0700 1 --2- 172.21.15.37:0/3407533685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ef0158410 0x7f4ef0158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4ef66b0700 1 --2- 172.21.15.37:0/3407533685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ef006d290 0x7f4ef006d710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4ef66b0700 1 -- 172.21.15.37:0/3407533685 >> 172.21.15.37:0/3407533685 conn(0x7f4ef006c430 msgr2=0x7f4ef00af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4ef66b0700 1 -- 172.21.15.37:0/3407533685 shutdown_connections 2023-10-06T04:39:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.481+0000 7f4ef66b0700 1 -- 172.21.15.37:0/3407533685 wait complete. 2023-10-06T04:39:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ef66b0700 1 Processor -- start 2023-10-06T04:39:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ef66b0700 1 -- start start 2023-10-06T04:39:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ef66b0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef006d290 0x7f4ef00b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ef66b0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ef00acdc0 0x7f4ef016a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ef66b0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ef0158410 0x7f4ef014c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ef66b0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef01503b0 con 0x7f4ef006d290 2023-10-06T04:39:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ef66b0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0150690 con 0x7f4ef00acdc0 2023-10-06T04:39:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ef66b0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef016a8b0 con 0x7f4ef0158410 2023-10-06T04:39:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4eeffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef006d290 0x7f4ef00b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4eeffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef006d290 0x7f4ef00b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36568/0 (socket says 172.21.15.37:36568) 2023-10-06T04:39:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4eeffff700 1 -- 172.21.15.37:0/786793675 learned_addr learned my addr 172.21.15.37:0/786793675 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4eef7fe700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ef00acdc0 0x7f4ef016a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ef4c4d700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ef0158410 0x7f4ef014c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4eef7fe700 1 -- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ef0158410 msgr2=0x7f4ef014c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4eef7fe700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ef0158410 0x7f4ef014c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4eef7fe700 1 -- 172.21.15.37:0/786793675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef006d290 msgr2=0x7f4ef00b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4eef7fe700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef006d290 0x7f4ef00b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4eef7fe700 1 -- 172.21.15.37:0/786793675 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee8009ae0 con 0x7f4ef00acdc0 2023-10-06T04:39:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4eeffff700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef006d290 0x7f4ef00b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4eef7fe700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ef00acdc0 0x7f4ef016a370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8016000 tx=0x7f4ed8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ee7fff700 1 -- 172.21.15.37:0/786793675 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed801bc40 con 0x7f4ef00acdc0 2023-10-06T04:39:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ee7fff700 1 -- 172.21.15.37:0/786793675 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed801bde0 con 0x7f4ef00acdc0 2023-10-06T04:39:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ee7fff700 1 -- 172.21.15.37:0/786793675 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8011670 con 0x7f4ef00acdc0 2023-10-06T04:39:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ef66b0700 1 -- 172.21.15.37:0/786793675 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed8009420 con 0x7f4ef00acdc0 2023-10-06T04:39:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.485+0000 7f4ef66b0700 1 -- 172.21.15.37:0/786793675 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef016adf0 con 0x7f4ef00acdc0 2023-10-06T04:39:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.489+0000 7f4ef66b0700 1 -- 172.21.15.37:0/786793675 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef0150820 con 0x7f4ef00acdc0 2023-10-06T04:39:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.489+0000 7f4ee7fff700 1 -- 172.21.15.37:0/786793675 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4ed8011aa0 con 0x7f4ef00acdc0 2023-10-06T04:39:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.489+0000 7f4ee7fff700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4ed0060550 0x7f4ed0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.489+0000 7f4ee7fff700 1 -- 172.21.15.37:0/786793675 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4ed807e870 con 0x7f4ef00acdc0 2023-10-06T04:39:31.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.489+0000 7f4eeffff700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4ed0060550 0x7f4ed0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.493+0000 7f4eeffff700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4ed0060550 0x7f4ed0062a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0001e90 tx=0x7f4ee0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.497+0000 7f4ee7fff700 1 -- 172.21.15.37:0/786793675 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4ed804eaa0 con 0x7f4ef00acdc0 2023-10-06T04:39:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.661+0000 7f4ef66b0700 1 -- 172.21.15.37:0/786793675 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ef0070ee0 con 0x7f4ef00acdc0 2023-10-06T04:39:31.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.665+0000 7f4ee7fff700 1 -- 172.21.15.37:0/786793675 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f4ed80520c0 con 0x7f4ef00acdc0 2023-10-06T04:39:31.670 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:31.670 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:15.209829+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:31.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.669+0000 7f4ef66b0700 1 -- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4ed0060550 msgr2=0x7f4ed0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.669+0000 7f4ef66b0700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4ed0060550 0x7f4ed0062a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0001e90 tx=0x7f4ee0009040 comp rx=0 tx=0).stop 2023-10-06T04:39:31.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.669+0000 7f4ef66b0700 1 -- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ef00acdc0 msgr2=0x7f4ef016a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.669+0000 7f4ef66b0700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ef00acdc0 0x7f4ef016a370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8016000 tx=0x7f4ed8017000 comp rx=0 tx=0).stop 2023-10-06T04:39:31.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.669+0000 7f4ef66b0700 1 -- 172.21.15.37:0/786793675 shutdown_connections 2023-10-06T04:39:31.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.669+0000 7f4ef66b0700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4ed0060550 0x7f4ed0062a00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.669+0000 7f4ef66b0700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ef00acdc0 0x7f4ef016a370 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.669+0000 7f4ef66b0700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ef0158410 0x7f4ef014c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.669+0000 7f4ef66b0700 1 --2- 172.21.15.37:0/786793675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef006d290 0x7f4ef00b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.669+0000 7f4ef66b0700 1 -- 172.21.15.37:0/786793675 >> 172.21.15.37:0/786793675 conn(0x7f4ef006c430 msgr2=0x7f4ef015bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:31.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.669+0000 7f4ef66b0700 1 -- 172.21.15.37:0/786793675 shutdown_connections 2023-10-06T04:39:31.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.669+0000 7f4ef66b0700 1 -- 172.21.15.37:0/786793675 wait complete. 2023-10-06T04:39:31.690 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T04:39:31.691 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:31.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46d0a0b700 1 Processor -- start 2023-10-06T04:39:31.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46d0a0b700 1 -- start start 2023-10-06T04:39:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46d0a0b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f46cc1587d0 0x7f46cc15d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46d0a0b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46cc158ba0 0x7f46cc067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46d0a0b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46cc159040 con 0x7f46cc068230 2023-10-06T04:39:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46d0a0b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc15d6d0 con 0x7f46cc158ba0 2023-10-06T04:39:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46d0a0b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc0686b0 con 0x7f46cc1587d0 2023-10-06T04:39:31.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46caffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46cc158ba0 0x7f46cc067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46caffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46cc158ba0 0x7f46cc067cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36582/0 (socket says 172.21.15.37:36582) 2023-10-06T04:39:31.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46caffd700 1 -- 172.21.15.37:0/3955273494 learned_addr learned my addr 172.21.15.37:0/3955273494 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:31.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46cb7fe700 1 --2- 172.21.15.37:0/3955273494 >> v2:172.21.15.83:3300/0 conn(0x7f46cc1587d0 0x7f46cc15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46ca7fc700 1 -- 172.21.15.37:0/3955273494 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312750769 0 0) 0x7f46cc159040 con 0x7f46cc068230 2023-10-06T04:39:31.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46caffd700 1 -- 172.21.15.37:0/3955273494 >> v2:172.21.15.83:3300/0 conn(0x7f46cc1587d0 msgr2=0x7f46cc15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:31.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46caffd700 1 --2- 172.21.15.37:0/3955273494 >> v2:172.21.15.83:3300/0 conn(0x7f46cc1587d0 0x7f46cc15d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46caffd700 1 -- 172.21.15.37:0/3955273494 >> v1:172.21.15.83:6789/0 conn(0x7f46cc068230 legacy=0x7f46cc0ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46caffd700 1 -- 172.21.15.37:0/3955273494 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc0af7f0 con 0x7f46cc158ba0 2023-10-06T04:39:31.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46caffd700 1 --2- 172.21.15.37:0/3955273494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc158ba0 0x7f46cc067cf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0cd560 tx=0x7f46b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e502fc2eb9f4a2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46ca7fc700 1 -- 172.21.15.37:0/3955273494 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4009e70 con 0x7f46cc158ba0 2023-10-06T04:39:31.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46ca7fc700 1 -- 172.21.15.37:0/3955273494 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b400b860 con 0x7f46cc158ba0 2023-10-06T04:39:31.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.797+0000 7f46ca7fc700 1 -- 172.21.15.37:0/3955273494 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b400bc00 con 0x7f46cc158ba0 2023-10-06T04:39:31.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.801+0000 7f46d0a0b700 1 -- 172.21.15.37:0/3955273494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc158ba0 msgr2=0x7f46cc067cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.801+0000 7f46d0a0b700 1 --2- 172.21.15.37:0/3955273494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc158ba0 0x7f46cc067cf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0cd560 tx=0x7f46b4009250 comp rx=0 tx=0).stop 2023-10-06T04:39:31.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.801+0000 7f46d0a0b700 1 -- 172.21.15.37:0/3955273494 shutdown_connections 2023-10-06T04:39:31.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.801+0000 7f46d0a0b700 1 --2- 172.21.15.37:0/3955273494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc158ba0 0x7f46cc067cf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.801+0000 7f46d0a0b700 1 --2- 172.21.15.37:0/3955273494 >> v2:172.21.15.83:3300/0 conn(0x7f46cc1587d0 0x7f46cc15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.801+0000 7f46d0a0b700 1 -- 172.21.15.37:0/3955273494 >> 172.21.15.37:0/3955273494 conn(0x7f46cc0cc5f0 msgr2=0x7f46cc0cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:31.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.801+0000 7f46d0a0b700 1 -- 172.21.15.37:0/3955273494 shutdown_connections 2023-10-06T04:39:31.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.801+0000 7f46d0a0b700 1 -- 172.21.15.37:0/3955273494 wait complete. 2023-10-06T04:39:31.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.801+0000 7f46d0a0b700 1 Processor -- start 2023-10-06T04:39:31.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.801+0000 7f46d0a0b700 1 -- start start 2023-10-06T04:39:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46d0a0b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46cc068230 0x7f46cc0c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46d0a0b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46cc1587d0 0x7f46cc147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46d0a0b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc158ba0 0x7f46cc0c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46d0a0b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc0c93a0 con 0x7f46cc158ba0 2023-10-06T04:39:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46d0a0b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc0c9680 con 0x7f46cc068230 2023-10-06T04:39:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46d0a0b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc1595b0 con 0x7f46cc1587d0 2023-10-06T04:39:31.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46cbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc158ba0 0x7f46cc0c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46caffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46cc1587d0 0x7f46cc147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46cb7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46cc068230 0x7f46cc0c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46cbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc158ba0 0x7f46cc0c50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36590/0 (socket says 172.21.15.37:36590) 2023-10-06T04:39:31.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46cbfff700 1 -- 172.21.15.37:0/1055888256 learned_addr learned my addr 172.21.15.37:0/1055888256 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:31.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46cbfff700 1 -- 172.21.15.37:0/1055888256 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46cc1587d0 msgr2=0x7f46cc147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46cbfff700 1 --2- 172.21.15.37:0/1055888256 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46cc1587d0 0x7f46cc147df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46cbfff700 1 -- 172.21.15.37:0/1055888256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46cc068230 msgr2=0x7f46cc0c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46cbfff700 1 --2- 172.21.15.37:0/1055888256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46cc068230 0x7f46cc0c35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46cbfff700 1 -- 172.21.15.37:0/1055888256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b40094f0 con 0x7f46cc158ba0 2023-10-06T04:39:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46cbfff700 1 --2- 172.21.15.37:0/1055888256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc158ba0 0x7f46cc0c50b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c510 tx=0x7f46bc007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46c37fe700 1 -- 172.21.15.37:0/1055888256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc011590 con 0x7f46cc158ba0 2023-10-06T04:39:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46c37fe700 1 -- 172.21.15.37:0/1055888256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc0116f0 con 0x7f46cc158ba0 2023-10-06T04:39:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46d0a0b700 1 -- 172.21.15.37:0/1055888256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc159890 con 0x7f46cc158ba0 2023-10-06T04:39:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46c37fe700 1 -- 172.21.15.37:0/1055888256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc011ab0 con 0x7f46cc158ba0 2023-10-06T04:39:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46d0a0b700 1 -- 172.21.15.37:0/1055888256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc0c3b00 con 0x7f46cc158ba0 2023-10-06T04:39:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.805+0000 7f46d0a0b700 1 -- 172.21.15.37:0/1055888256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc0708a0 con 0x7f46cc158ba0 2023-10-06T04:39:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.809+0000 7f46c37fe700 1 -- 172.21.15.37:0/1055888256 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f46bc01b3b0 con 0x7f46cc158ba0 2023-10-06T04:39:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.809+0000 7f46c37fe700 1 --2- 172.21.15.37:0/1055888256 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f46b0060550 0x7f46b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.809+0000 7f46c37fe700 1 -- 172.21.15.37:0/1055888256 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f46bc07bf70 con 0x7f46cc158ba0 2023-10-06T04:39:31.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.809+0000 7f46cb7fe700 1 --2- 172.21.15.37:0/1055888256 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f46b0060550 0x7f46b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.809+0000 7f46cb7fe700 1 --2- 172.21.15.37:0/1055888256 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f46b0060550 0x7f46b0062a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46c400f570 tx=0x7f46c400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.817+0000 7f46c37fe700 1 -- 172.21.15.37:0/1055888256 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f46bc04c110 con 0x7f46cc158ba0 2023-10-06T04:39:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.977+0000 7f46d0a0b700 1 -- 172.21.15.37:0/1055888256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46cc0afad0 con 0x7f46cc158ba0 2023-10-06T04:39:31.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.981+0000 7f46c37fe700 1 -- 172.21.15.37:0/1055888256 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f46bc04f730 con 0x7f46cc158ba0 2023-10-06T04:39:31.987 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:31.987 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:15.209829+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.985+0000 7f46d0a0b700 1 -- 172.21.15.37:0/1055888256 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f46b0060550 msgr2=0x7f46b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.985+0000 7f46d0a0b700 1 --2- 172.21.15.37:0/1055888256 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f46b0060550 0x7f46b0062a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46c400f570 tx=0x7f46c400b040 comp rx=0 tx=0).stop 2023-10-06T04:39:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.985+0000 7f46d0a0b700 1 -- 172.21.15.37:0/1055888256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc158ba0 msgr2=0x7f46cc0c50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.985+0000 7f46d0a0b700 1 --2- 172.21.15.37:0/1055888256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc158ba0 0x7f46cc0c50b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c510 tx=0x7f46bc007f30 comp rx=0 tx=0).stop 2023-10-06T04:39:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.985+0000 7f46d0a0b700 1 -- 172.21.15.37:0/1055888256 shutdown_connections 2023-10-06T04:39:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.985+0000 7f46d0a0b700 1 --2- 172.21.15.37:0/1055888256 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f46b0060550 0x7f46b0062a00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.985+0000 7f46d0a0b700 1 --2- 172.21.15.37:0/1055888256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc158ba0 0x7f46cc0c50b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.985+0000 7f46d0a0b700 1 --2- 172.21.15.37:0/1055888256 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46cc1587d0 0x7f46cc147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.985+0000 7f46d0a0b700 1 --2- 172.21.15.37:0/1055888256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46cc068230 0x7f46cc0c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.985+0000 7f46d0a0b700 1 -- 172.21.15.37:0/1055888256 >> 172.21.15.37:0/1055888256 conn(0x7f46cc0cc5f0 msgr2=0x7f46cc0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.985+0000 7f46d0a0b700 1 -- 172.21.15.37:0/1055888256 shutdown_connections 2023-10-06T04:39:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:31.985+0000 7f46d0a0b700 1 -- 172.21.15.37:0/1055888256 wait complete. 2023-10-06T04:39:32.004 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T04:39:32.004 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T04:39:32.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T04:39:32.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T04:39:32.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T04:39:32.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T04:39:32.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T04:39:32.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T04:39:32.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.145+0000 7fa08c9b7700 1 Processor -- start 2023-10-06T04:39:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.145+0000 7fbc30806700 1 Processor -- start 2023-10-06T04:39:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.145+0000 7fa08c9b7700 1 -- start start 2023-10-06T04:39:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.145+0000 7fbc30806700 1 -- start start 2023-10-06T04:39:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26afc9700 1 Processor -- start 2023-10-06T04:39:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26afc9700 1 -- start start 2023-10-06T04:39:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc30806700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbc2c154cb0 0x7fbc2c0c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc30806700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c0c6a20 0x7fbc2c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc30806700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2c0c6fa0 con 0x7fbc2c0ca150 2023-10-06T04:39:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc30806700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2c0ca5d0 con 0x7fbc2c154cb0 2023-10-06T04:39:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc30806700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0c7280 con 0x7fbc2c0c6a20 2023-10-06T04:39:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08c9b7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0880c1550 0x7fa0880c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08c9b7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa0880cbeb0 0x7fa0880ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08c9b7700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0880c6fa0 con 0x7fa088154cb0 2023-10-06T04:39:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08c9b7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0880c7280 con 0x7fa0880c1550 2023-10-06T04:39:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08c9b7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0880c7560 con 0x7fa0880cbeb0 2023-10-06T04:39:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0880c1550 0x7fa0880c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0880c1550 0x7fa0880c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36592/0 (socket says 172.21.15.37:36592) 2023-10-06T04:39:32.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08659c700 1 -- 172.21.15.37:0/2247335783 learned_addr learned my addr 172.21.15.37:0/2247335783 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2b7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbc2c154cb0 0x7fbc2c0c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2affd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c0c6a20 0x7fbc2c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2affd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c0c6a20 0x7fbc2c0c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40334/0 (socket says 172.21.15.37:40334) 2023-10-06T04:39:32.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2affd700 1 -- 172.21.15.37:0/2309517699 learned_addr learned my addr 172.21.15.37:0/2309517699 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08759e700 1 --2- 172.21.15.37:0/2247335783 >> v2:172.21.15.83:3300/0 conn(0x7fa0880cbeb0 0x7fa0880ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2b7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbc2c154cb0 0x7fbc2c0c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34632/0 (socket says 172.21.15.37:34632) 2023-10-06T04:39:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26afc9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2640ad560 0x7fd2640ad930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26afc9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2640cc3f0 0x7fd2640c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26afc9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2640caca0 0x7fd2640cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26afc9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2640ca810 con 0x7fd2640ad560 2023-10-06T04:39:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26afc9700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2641570a0 con 0x7fd2640caca0 2023-10-06T04:39:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26afc9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2640c9c00 con 0x7fd2640cc3f0 2023-10-06T04:39:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08659c700 1 -- 172.21.15.37:0/2247335783 >> v2:172.21.15.83:3300/0 conn(0x7fa0880cbeb0 msgr2=0x7fa0880ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08659c700 1 --2- 172.21.15.37:0/2247335783 >> v2:172.21.15.83:3300/0 conn(0x7fa0880cbeb0 0x7fa0880ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08659c700 1 -- 172.21.15.37:0/2247335783 >> v1:172.21.15.37:6789/0 conn(0x7fa088154cb0 legacy=0x7fa0880c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08659c700 1 -- 172.21.15.37:0/2247335783 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0880c7840 con 0x7fa0880c1550 2023-10-06T04:39:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08759e700 1 --2- 172.21.15.37:0/2247335783 >> v2:172.21.15.83:3300/0 conn(0x7fa0880cbeb0 0x7fa0880ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:32.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2affd700 1 -- 172.21.15.37:0/2309517699 >> v2:172.21.15.83:3300/0 conn(0x7fbc2c154cb0 msgr2=0x7fbc2c0c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2affd700 1 --2- 172.21.15.37:0/2309517699 >> v2:172.21.15.83:3300/0 conn(0x7fbc2c154cb0 0x7fbc2c0c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2affd700 1 -- 172.21.15.37:0/2309517699 >> v1:172.21.15.37:6789/0 conn(0x7fbc2c0ca150 legacy=0x7fbc2c0c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2affd700 1 -- 172.21.15.37:0/2309517699 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c0c7560 con 0x7fbc2c0c6a20 2023-10-06T04:39:32.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26a7c8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2640caca0 0x7fd2640cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd269fc7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2640ad560 0x7fd2640ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26a7c8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2640caca0 0x7fd2640cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34648/0 (socket says 172.21.15.37:34648) 2023-10-06T04:39:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26a7c8700 1 -- 172.21.15.37:0/3192626128 learned_addr learned my addr 172.21.15.37:0/3192626128 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd2697c6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2640cc3f0 0x7fd2640c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08659c700 1 --2- 172.21.15.37:0/2247335783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880c1550 0x7fa0880c9c10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa08806e960 tx=0x7fa080009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166675126786a77a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7f3798b2a700 1 Processor -- start 2023-10-06T04:39:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2affd700 1 --2- 172.21.15.37:0/2309517699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c0c6a20 0x7fbc2c0c9c10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0099b0 tx=0x7fbc1c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8393bb50a1f844 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa085d9b700 1 -- 172.21.15.37:0/2247335783 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08000e070 con 0x7fa0880c1550 2023-10-06T04:39:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa085d9b700 1 -- 172.21.15.37:0/2247335783 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08000ba20 con 0x7fa0880c1550 2023-10-06T04:39:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa085d9b700 1 -- 172.21.15.37:0/2247335783 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0800092e0 con 0x7fa0880c1550 2023-10-06T04:39:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26a7c8700 1 -- 172.21.15.37:0/3192626128 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2640cc3f0 msgr2=0x7fd2640c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26a7c8700 1 --2- 172.21.15.37:0/3192626128 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2640cc3f0 0x7fd2640c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26a7c8700 1 -- 172.21.15.37:0/3192626128 >> v2:172.21.15.37:3300/0 conn(0x7fd2640ad560 msgr2=0x7fd2640ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26a7c8700 1 --2- 172.21.15.37:0/3192626128 >> v2:172.21.15.37:3300/0 conn(0x7fd2640ad560 0x7fd2640ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26a7c8700 1 -- 172.21.15.37:0/3192626128 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2640c9ee0 con 0x7fd2640caca0 2023-10-06T04:39:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd2697c6700 1 --2- 172.21.15.37:0/3192626128 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2640cc3f0 0x7fd2640c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd269fc7700 1 --2- 172.21.15.37:0/3192626128 >> v2:172.21.15.37:3300/0 conn(0x7fd2640ad560 0x7fd2640ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7f3798b2a700 1 -- start start 2023-10-06T04:39:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2a7fc700 1 -- 172.21.15.37:0/2309517699 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c009ea0 con 0x7fbc2c0c6a20 2023-10-06T04:39:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2a7fc700 1 -- 172.21.15.37:0/2309517699 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c00b860 con 0x7fbc2c0c6a20 2023-10-06T04:39:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc2a7fc700 1 -- 172.21.15.37:0/2309517699 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c00bc00 con 0x7fbc2c0c6a20 2023-10-06T04:39:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fe35ca38700 1 Processor -- start 2023-10-06T04:39:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fe35ca38700 1 -- start start 2023-10-06T04:39:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd26a7c8700 1 --2- 172.21.15.37:0/3192626128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2640caca0 0x7fd2640cb120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd264068c80 tx=0x7fd25c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=739b1967c8d74ee4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08c9b7700 1 -- 172.21.15.37:0/2247335783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880c1550 msgr2=0x7fa0880c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fa08c9b7700 1 --2- 172.21.15.37:0/2247335783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880c1550 0x7fa0880c9c10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa08806e960 tx=0x7fa080009840 comp rx=0 tx=0).stop 2023-10-06T04:39:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd268fc5700 1 -- 172.21.15.37:0/3192626128 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0092e0 con 0x7fd2640caca0 2023-10-06T04:39:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc30806700 1 -- 172.21.15.37:0/2309517699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c0c6a20 msgr2=0x7fbc2c0c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fbc30806700 1 --2- 172.21.15.37:0/2309517699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c0c6a20 0x7fbc2c0c9c10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0099b0 tx=0x7fbc1c009250 comp rx=0 tx=0).stop 2023-10-06T04:39:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd268fc5700 1 -- 172.21.15.37:0/3192626128 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c00ba20 con 0x7fd2640caca0 2023-10-06T04:39:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7fd268fc5700 1 -- 172.21.15.37:0/3192626128 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c00bde0 con 0x7fd2640caca0 2023-10-06T04:39:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 -- 172.21.15.37:0/2309517699 shutdown_connections 2023-10-06T04:39:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 --2- 172.21.15.37:0/2309517699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c0c6a20 0x7fbc2c0c9c10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 --2- 172.21.15.37:0/2309517699 >> v2:172.21.15.83:3300/0 conn(0x7fbc2c154cb0 0x7fbc2c0c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 -- 172.21.15.37:0/2309517699 >> 172.21.15.37:0/2309517699 conn(0x7fbc2c068770 msgr2=0x7fbc2c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fa08c9b7700 1 -- 172.21.15.37:0/2247335783 shutdown_connections 2023-10-06T04:39:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fa08c9b7700 1 --2- 172.21.15.37:0/2247335783 >> v2:172.21.15.83:3300/0 conn(0x7fa0880cbeb0 0x7fa0880ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fa08c9b7700 1 --2- 172.21.15.37:0/2247335783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880c1550 0x7fa0880c9c10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fa08c9b7700 1 -- 172.21.15.37:0/2247335783 >> 172.21.15.37:0/2247335783 conn(0x7fa088068770 msgr2=0x7fa0880cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 -- 172.21.15.37:0/2309517699 shutdown_connections 2023-10-06T04:39:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 -- 172.21.15.37:0/2309517699 wait complete. 2023-10-06T04:39:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe35ca38700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3580aa7e0 0x7fe3580a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe35ca38700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3580aabb0 0x7fe3580c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe35ca38700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35806a1b0 con 0x7fe35806ea10 2023-10-06T04:39:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe35ca38700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3581592c0 con 0x7fe3580aabb0 2023-10-06T04:39:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe35ca38700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3580a8f50 con 0x7fe3580aa7e0 2023-10-06T04:39:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fd26afc9700 1 -- 172.21.15.37:0/3192626128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2640caca0 msgr2=0x7fd2640cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fd26afc9700 1 --2- 172.21.15.37:0/3192626128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2640caca0 0x7fd2640cb120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd264068c80 tx=0x7fd25c009840 comp rx=0 tx=0).stop 2023-10-06T04:39:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe3577fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3580aa7e0 0x7fe3580a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe3577fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3580aa7e0 0x7fe3580a8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34664/0 (socket says 172.21.15.37:34664) 2023-10-06T04:39:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe3577fe700 1 -- 172.21.15.37:0/3115610755 learned_addr learned my addr 172.21.15.37:0/3115610755 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.149+0000 7f78116bd700 1 Processor -- start 2023-10-06T04:39:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f78116bd700 1 -- start start 2023-10-06T04:39:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fa08c9b7700 1 -- 172.21.15.37:0/2247335783 shutdown_connections 2023-10-06T04:39:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f3798b2a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3794156060 0x7f37940ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f3798b2a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f379414bfd0 0x7f379406e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f3798b2a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3794158b10 0x7f3794158f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f3798b2a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3794156430 con 0x7f379414bfd0 2023-10-06T04:39:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f3798b2a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379406e5e0 con 0x7f3794156060 2023-10-06T04:39:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f3798b2a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37940ca090 con 0x7f3794158b10 2023-10-06T04:39:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f379259c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3794156060 0x7f37940ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f379259c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3794156060 0x7f37940ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34680/0 (socket says 172.21.15.37:34680) 2023-10-06T04:39:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f379259c700 1 -- 172.21.15.37:0/811776926 learned_addr learned my addr 172.21.15.37:0/811776926 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f3792d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3794158b10 0x7f3794158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f78116bd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f780c154cb0 0x7f780c0c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f78116bd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f780c0cbeb0 0x7f780c0c0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe3577fe700 1 -- 172.21.15.37:0/3115610755 >> v2:172.21.15.37:3300/0 conn(0x7fe3580aabb0 msgr2=0x7fe3580c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe3577fe700 1 --2- 172.21.15.37:0/3115610755 >> v2:172.21.15.37:3300/0 conn(0x7fe3580aabb0 0x7fe3580c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe3577fe700 1 -- 172.21.15.37:0/3115610755 >> v1:172.21.15.37:6789/0 conn(0x7fe35806ea10 legacy=0x7fe358067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f78116bd700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0c6fa0 con 0x7f780c0c6a20 2023-10-06T04:39:32.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f78116bd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c0c7280 con 0x7f780c154cb0 2023-10-06T04:39:32.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f78116bd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0c7560 con 0x7f780c0cbeb0 2023-10-06T04:39:32.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe3577fe700 1 -- 172.21.15.37:0/3115610755 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580c6f00 con 0x7fe3580aa7e0 2023-10-06T04:39:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 Processor -- start 2023-10-06T04:39:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f379259c700 1 -- 172.21.15.37:0/811776926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3794158b10 msgr2=0x7f3794158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f379259c700 1 --2- 172.21.15.37:0/811776926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3794158b10 0x7f3794158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f379259c700 1 -- 172.21.15.37:0/811776926 >> v2:172.21.15.37:3300/0 conn(0x7f379414bfd0 msgr2=0x7f379406e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f379259c700 1 --2- 172.21.15.37:0/811776926 >> v2:172.21.15.37:3300/0 conn(0x7f379414bfd0 0x7f379406e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f379259c700 1 -- 172.21.15.37:0/811776926 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3794155bd0 con 0x7f3794156060 2023-10-06T04:39:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 -- start start 2023-10-06T04:39:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fd26afc9700 1 -- 172.21.15.37:0/3192626128 shutdown_connections 2023-10-06T04:39:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fd26afc9700 1 --2- 172.21.15.37:0/3192626128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2640caca0 0x7fd2640cb120 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fd26afc9700 1 --2- 172.21.15.37:0/3192626128 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2640cc3f0 0x7fd2640c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fd26afc9700 1 --2- 172.21.15.37:0/3192626128 >> v2:172.21.15.37:3300/0 conn(0x7fd2640ad560 0x7fd2640ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fd26afc9700 1 -- 172.21.15.37:0/3192626128 >> 172.21.15.37:0/3192626128 conn(0x7fd264068780 msgr2=0x7fd2640cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fd26afc9700 1 -- 172.21.15.37:0/3192626128 shutdown_connections 2023-10-06T04:39:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fd26afc9700 1 -- 172.21.15.37:0/3192626128 wait complete. 2023-10-06T04:39:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f780bfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f780c154cb0 0x7f780c0c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f780bfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f780c154cb0 0x7f780c0c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34684/0 (socket says 172.21.15.37:34684) 2023-10-06T04:39:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f780bfff700 1 -- 172.21.15.37:0/3728615326 learned_addr learned my addr 172.21.15.37:0/3728615326 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe3577fe700 1 --2- 172.21.15.37:0/3115610755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3580aa7e0 0x7fe3580a8a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3580cd0a0 tx=0x7fe348009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef4b87b0d24893c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f379259c700 1 --2- 172.21.15.37:0/811776926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3794156060 0x7f37940ad860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f379406a170 tx=0x7f3788009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=557604ef98a559fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f780affd700 1 -- 172.21.15.37:0/3728615326 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241312133 0 0) 0x7f780c0c6fa0 con 0x7f780c0c6a20 2023-10-06T04:39:32.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f780affd700 1 -- 172.21.15.37:0/3728615326 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f4003570 con 0x7f780c0c6a20 2023-10-06T04:39:32.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f780b7fe700 1 --2- 172.21.15.37:0/3728615326 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f780c0cbeb0 0x7f780c0c0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe3567fc700 1 -- 172.21.15.37:0/3115610755 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800b820 con 0x7fe3580aa7e0 2023-10-06T04:39:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe3567fc700 1 -- 172.21.15.37:0/3115610755 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34800b980 con 0x7fe3580aa7e0 2023-10-06T04:39:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fe3567fc700 1 -- 172.21.15.37:0/3115610755 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800bd20 con 0x7fe3580aa7e0 2023-10-06T04:39:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f780affd700 1 -- 172.21.15.37:0/3728615326 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 925614379 0 0) 0x7f77f4003570 con 0x7f780c0c6a20 2023-10-06T04:39:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f379159a700 1 -- 172.21.15.37:0/811776926 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788009ea0 con 0x7f3794156060 2023-10-06T04:39:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f379159a700 1 -- 172.21.15.37:0/811776926 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378800b820 con 0x7f3794156060 2023-10-06T04:39:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f379159a700 1 -- 172.21.15.37:0/811776926 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800bba0 con 0x7f3794156060 2023-10-06T04:39:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f780bfff700 1 -- 172.21.15.37:0/3728615326 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f780c0cbeb0 msgr2=0x7f780c0c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc2c0c6a20 0x7fbc2c0ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc2c0ca150 0x7fbc2c1534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c154cb0 0x7fbc2c0a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0aca70 con 0x7fbc2c0ca150 2023-10-06T04:39:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0ab770 con 0x7fbc2c0c6a20 2023-10-06T04:39:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc30806700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0aba50 con 0x7fbc2c154cb0 2023-10-06T04:39:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f780bfff700 1 --2- 172.21.15.37:0/3728615326 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f780c0cbeb0 0x7f780c0c0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f780bfff700 1 -- 172.21.15.37:0/3728615326 >> v1:172.21.15.37:6789/0 conn(0x7f780c0c6a20 legacy=0x7f780c0c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f780bfff700 1 -- 172.21.15.37:0/3728615326 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c0c7840 con 0x7f780c154cb0 2023-10-06T04:39:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc2b7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc2c0c6a20 0x7fbc2c0ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7f780bfff700 1 --2- 172.21.15.37:0/3728615326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f780c154cb0 0x7f780c0c64e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7804009f20 tx=0x7f7804009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d3e5f635ed9ea19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc2bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c154cb0 0x7fbc2c0a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc2bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c154cb0 0x7fbc2c0a95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40382/0 (socket says 172.21.15.37:40382) 2023-10-06T04:39:32.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc2bfff700 1 -- 172.21.15.37:0/3819921400 learned_addr learned my addr 172.21.15.37:0/3819921400 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fd26afc9700 1 Processor -- start 2023-10-06T04:39:32.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc2affd700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc2c0ca150 0x7fbc2c1534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fbc2b7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc2c0c6a20 0x7fbc2c0ac530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34686/0 (socket says 172.21.15.37:34686) 2023-10-06T04:39:32.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc2bfff700 1 -- 172.21.15.37:0/3819921400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc2c0c6a20 msgr2=0x7fbc2c0ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc2bfff700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc2c0c6a20 0x7fbc2c0ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc2bfff700 1 -- 172.21.15.37:0/3819921400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc2c0ca150 msgr2=0x7fbc2c1534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc2bfff700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc2c0ca150 0x7fbc2c1534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc2bfff700 1 -- 172.21.15.37:0/3819921400 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c0094f0 con 0x7fbc2c154cb0 2023-10-06T04:39:32.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc2b7fe700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc2c0c6a20 0x7fbc2c0ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:32.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc2bfff700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c154cb0 0x7fbc2c0a95c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000c560 tx=0x7fbc20007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 -- 172.21.15.37:0/811776926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3794156060 msgr2=0x7f37940ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 --2- 172.21.15.37:0/811776926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3794156060 0x7f37940ad860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f379406a170 tx=0x7f3788009250 comp rx=0 tx=0).stop 2023-10-06T04:39:32.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 -- 172.21.15.37:0/811776926 shutdown_connections 2023-10-06T04:39:32.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 --2- 172.21.15.37:0/811776926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3794158b10 0x7f3794158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 --2- 172.21.15.37:0/811776926 >> v2:172.21.15.37:3300/0 conn(0x7f379414bfd0 0x7f379406e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 --2- 172.21.15.37:0/811776926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3794156060 0x7f37940ad860 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 -- 172.21.15.37:0/811776926 >> 172.21.15.37:0/811776926 conn(0x7f37940667b0 msgr2=0x7f3794066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 -- 172.21.15.37:0/811776926 shutdown_connections 2023-10-06T04:39:32.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 -- 172.21.15.37:0/811776926 wait complete. 2023-10-06T04:39:32.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.153+0000 7fa08c9b7700 1 -- 172.21.15.37:0/2247335783 wait complete. 2023-10-06T04:39:32.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa08c9b7700 1 Processor -- start 2023-10-06T04:39:32.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa08c9b7700 1 -- start start 2023-10-06T04:39:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f780affd700 1 -- 172.21.15.37:0/3728615326 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400e070 con 0x7f780c154cb0 2023-10-06T04:39:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f780affd700 1 -- 172.21.15.37:0/3728615326 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78040090d0 con 0x7f780c154cb0 2023-10-06T04:39:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f780affd700 1 -- 172.21.15.37:0/3728615326 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800001470 con 0x7f780c154cb0 2023-10-06T04:39:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f78116bd700 1 -- 172.21.15.37:0/3728615326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f780c154cb0 msgr2=0x7f780c0c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f78116bd700 1 --2- 172.21.15.37:0/3728615326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f780c154cb0 0x7f780c0c64e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7804009f20 tx=0x7f7804009840 comp rx=0 tx=0).stop 2023-10-06T04:39:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fe35ca38700 1 -- 172.21.15.37:0/3115610755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3580aa7e0 msgr2=0x7fe3580a8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fe35ca38700 1 --2- 172.21.15.37:0/3115610755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3580aa7e0 0x7fe3580a8a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3580cd0a0 tx=0x7fe348009250 comp rx=0 tx=0).stop 2023-10-06T04:39:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fe35ca38700 1 -- 172.21.15.37:0/3115610755 shutdown_connections 2023-10-06T04:39:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fe35ca38700 1 --2- 172.21.15.37:0/3115610755 >> v2:172.21.15.37:3300/0 conn(0x7fe3580aabb0 0x7fe3580c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fe35ca38700 1 --2- 172.21.15.37:0/3115610755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3580aa7e0 0x7fe3580a8a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fe35ca38700 1 -- 172.21.15.37:0/3115610755 >> 172.21.15.37:0/3115610755 conn(0x7fe3580cc030 msgr2=0x7fe3580cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc137fe700 1 -- 172.21.15.37:0/3819921400 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20011590 con 0x7fbc2c154cb0 2023-10-06T04:39:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc30806700 1 -- 172.21.15.37:0/3819921400 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2c0abd30 con 0x7fbc2c154cb0 2023-10-06T04:39:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc30806700 1 -- 172.21.15.37:0/3819921400 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2c153a00 con 0x7fbc2c154cb0 2023-10-06T04:39:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc137fe700 1 -- 172.21.15.37:0/3819921400 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc200116f0 con 0x7fbc2c154cb0 2023-10-06T04:39:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc137fe700 1 -- 172.21.15.37:0/3819921400 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20011ab0 con 0x7fbc2c154cb0 2023-10-06T04:39:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 Processor -- start 2023-10-06T04:39:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 -- start start 2023-10-06T04:39:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa08c9b7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880c1550 0x7fa0881436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa08c9b7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0880cbeb0 0x7fa0881569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd26afc9700 1 -- start start 2023-10-06T04:39:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fe35ca38700 1 -- 172.21.15.37:0/3115610755 shutdown_connections 2023-10-06T04:39:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa08c9b7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa088154cb0 0x7fa088156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa08c9b7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa088143cd0 con 0x7fa0880c1550 2023-10-06T04:39:32.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa08c9b7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa088155a40 con 0x7fa088154cb0 2023-10-06T04:39:32.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa08c9b7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa088156560 con 0x7fa0880cbeb0 2023-10-06T04:39:32.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa086d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880c1550 0x7fa0881436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa086d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880c1550 0x7fa0881436f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36634/0 (socket says 172.21.15.37:36634) 2023-10-06T04:39:32.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa086d9d700 1 -- 172.21.15.37:0/1847931892 learned_addr learned my addr 172.21.15.37:0/1847931892 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd26afc9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2640ad560 0x7fd2641519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379414bfd0 0x7f3794140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3794156060 0x7f3794147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3794158b10 0x7f3794157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fe35ca38700 1 -- 172.21.15.37:0/3115610755 wait complete. 2023-10-06T04:39:32.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f78116bd700 1 -- 172.21.15.37:0/3728615326 shutdown_connections 2023-10-06T04:39:32.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f78116bd700 1 --2- 172.21.15.37:0/3728615326 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f780c0cbeb0 0x7f780c0c0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f78116bd700 1 --2- 172.21.15.37:0/3728615326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f780c154cb0 0x7f780c0c64e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd26afc9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2640caca0 0x7fd2640c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd26afc9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2640cc3f0 0x7fd264150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3794148680 con 0x7f3794158b10 2023-10-06T04:39:32.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3794148960 con 0x7f379414bfd0 2023-10-06T04:39:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f78116bd700 1 -- 172.21.15.37:0/3728615326 >> 172.21.15.37:0/3728615326 conn(0x7f780c068770 msgr2=0x7f780c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd26afc9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2640c38f0 con 0x7fd2640ad560 2023-10-06T04:39:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd26afc9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd264150840 con 0x7fd2640cc3f0 2023-10-06T04:39:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd26afc9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd264152050 con 0x7fd2640caca0 2023-10-06T04:39:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3798b2a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3794148c40 con 0x7f3794156060 2023-10-06T04:39:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa08759e700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa088154cb0 0x7fa088156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f379259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379414bfd0 0x7f3794140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f379259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379414bfd0 0x7f3794140c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34712/0 (socket says 172.21.15.37:34712) 2023-10-06T04:39:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f379259c700 1 -- 172.21.15.37:0/4075611415 learned_addr learned my addr 172.21.15.37:0/4075611415 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd269fc7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2640ad560 0x7fd2641519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fbc30806700 1 -- 172.21.15.37:0/3819921400 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc0c000fd0 con 0x7fbc2c154cb0 2023-10-06T04:39:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd269fc7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2640ad560 0x7fd2641519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36640/0 (socket says 172.21.15.37:36640) 2023-10-06T04:39:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd269fc7700 1 -- 172.21.15.37:0/1207077925 learned_addr learned my addr 172.21.15.37:0/1207077925 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd26a7c8700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2640cc3f0 0x7fd264150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fac3e634700 1 Processor -- start 2023-10-06T04:39:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3792d9d700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3794158b10 0x7f3794157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f78116bd700 1 -- 172.21.15.37:0/3728615326 shutdown_connections 2023-10-06T04:39:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f78116bd700 1 -- 172.21.15.37:0/3728615326 wait complete. 2023-10-06T04:39:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd2697c6700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2640caca0 0x7fd2640c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f379259c700 1 -- 172.21.15.37:0/4075611415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3794156060 msgr2=0x7f3794147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd269fc7700 1 -- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2640caca0 msgr2=0x7fd2640c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd269fc7700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2640caca0 0x7fd2640c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd269fc7700 1 -- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2640cc3f0 msgr2=0x7fd264150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd269fc7700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2640cc3f0 0x7fd264150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fd269fc7700 1 -- 172.21.15.37:0/1207077925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd260009420 con 0x7fd2640ad560 2023-10-06T04:39:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3791d9b700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3794156060 0x7f3794147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fac3e634700 1 -- start start 2023-10-06T04:39:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f379259c700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3794156060 0x7f3794147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fd269fc7700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2640ad560 0x7fd2641519c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd25400e8d0 tx=0x7fd254008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f379259c700 1 -- 172.21.15.37:0/4075611415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3794158b10 msgr2=0x7f3794157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f379259c700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3794158b10 0x7f3794157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f379259c700 1 -- 172.21.15.37:0/4075611415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37880094f0 con 0x7f379414bfd0 2023-10-06T04:39:32.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7f3791d9b700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3794156060 0x7f3794147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:32.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f379259c700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379414bfd0 0x7f3794140c90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f37880090b0 tx=0x7f3788017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe35ca38700 1 Processor -- start 2023-10-06T04:39:32.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fd259ffb700 1 -- 172.21.15.37:0/1207077925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254013410 con 0x7fd2640ad560 2023-10-06T04:39:32.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fd26afc9700 1 -- 172.21.15.37:0/1207077925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c009ae0 con 0x7fd2640ad560 2023-10-06T04:39:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fd259ffb700 1 -- 172.21.15.37:0/1207077925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd254013570 con 0x7fd2640ad560 2023-10-06T04:39:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fd259ffb700 1 -- 172.21.15.37:0/1207077925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254013910 con 0x7fd2640ad560 2023-10-06T04:39:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fbc137fe700 1 -- 172.21.15.37:0/3819921400 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbc20033a20 con 0x7fbc2c154cb0 2023-10-06T04:39:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fbc137fe700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbc18060550 0x7fbc18062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fbc137fe700 1 -- 172.21.15.37:0/3819921400 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbc2007c100 con 0x7fbc2c154cb0 2023-10-06T04:39:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fbc137fe700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x7fbc1806a220 0x7fbc1806c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fbc137fe700 1 -- 172.21.15.37:0/3819921400 --> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc1806cd20 con 0x7fbc1806a220 2023-10-06T04:39:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fbc137fe700 1 -- 172.21.15.37:0/3819921400 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc2007c4d0 con 0x7fbc2c154cb0 2023-10-06T04:39:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fbc2b7fe700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbc18060550 0x7fbc18062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fbc2affd700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x7fbc1806a220 0x7fbc1806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fbc2affd700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x7fbc1806a220 0x7fbc1806c650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fbc2b7fe700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbc18060550 0x7fbc18062a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c1560b0 tx=0x7fbc24009780 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f37827fc700 1 -- 172.21.15.37:0/4075611415 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800bba0 con 0x7f379414bfd0 2023-10-06T04:39:32.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f37827fc700 1 -- 172.21.15.37:0/4075611415 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378801f070 con 0x7f379414bfd0 2023-10-06T04:39:32.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f3798b2a700 1 -- 172.21.15.37:0/4075611415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3794148f20 con 0x7f379414bfd0 2023-10-06T04:39:32.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f37827fc700 1 -- 172.21.15.37:0/4075611415 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880266b0 con 0x7f379414bfd0 2023-10-06T04:39:32.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f3798b2a700 1 -- 172.21.15.37:0/4075611415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3794149b70 con 0x7f379414bfd0 2023-10-06T04:39:32.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f3798b2a700 1 -- 172.21.15.37:0/4075611415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3778000fd0 con 0x7f379414bfd0 2023-10-06T04:39:32.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac3e634700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac3814bfd0 0x7fac38156060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac3e634700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fac380cc480 0x7fac3806e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac3e634700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac380ca090 con 0x7fac380ad860 2023-10-06T04:39:32.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac3e634700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac3806e5e0 con 0x7fac380cc480 2023-10-06T04:39:32.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac3e634700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac38155bd0 con 0x7fac3814bfd0 2023-10-06T04:39:32.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac37fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac3814bfd0 0x7fac38156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac37fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac3814bfd0 0x7fac38156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40408/0 (socket says 172.21.15.37:40408) 2023-10-06T04:39:32.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac37fff700 1 -- 172.21.15.37:0/924595499 learned_addr learned my addr 172.21.15.37:0/924595499 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac37fff700 1 -- 172.21.15.37:0/924595499 >> v2:172.21.15.83:3300/0 conn(0x7fac380cc480 msgr2=0x7fac3806e0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:39:32.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac37fff700 1 --2- 172.21.15.37:0/924595499 >> v2:172.21.15.83:3300/0 conn(0x7fac380cc480 0x7fac3806e0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac37fff700 1 -- 172.21.15.37:0/924595499 >> v1:172.21.15.37:6789/0 conn(0x7fac380ad860 legacy=0x7fac380cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac37fff700 1 -- 172.21.15.37:0/924595499 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac380adcb0 con 0x7fac3814bfd0 2023-10-06T04:39:32.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac37fff700 1 --2- 172.21.15.37:0/924595499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac3814bfd0 0x7fac38156060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fac280091e0 tx=0x7fac28009ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72cc518ebccd7e56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac36ffd700 1 -- 172.21.15.37:0/924595499 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2800b790 con 0x7fac3814bfd0 2023-10-06T04:39:32.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac36ffd700 1 -- 172.21.15.37:0/924595499 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2800b8f0 con 0x7fac3814bfd0 2023-10-06T04:39:32.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fac36ffd700 1 -- 172.21.15.37:0/924595499 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2800bc70 con 0x7fac3814bfd0 2023-10-06T04:39:32.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa086d9d700 1 -- 172.21.15.37:0/1847931892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0880cbeb0 msgr2=0x7fa0881569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa086d9d700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0880cbeb0 0x7fa0881569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa086d9d700 1 -- 172.21.15.37:0/1847931892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa088154cb0 msgr2=0x7fa088156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa086d9d700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa088154cb0 0x7fa088156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.157+0000 7fa086d9d700 1 -- 172.21.15.37:0/1847931892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078009420 con 0x7fa0880c1550 2023-10-06T04:39:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fa086d9d700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880c1550 0x7fa0881436f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00c590 tx=0x7fa07c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fa06effd700 1 -- 172.21.15.37:0/1847931892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c011590 con 0x7fa0880c1550 2023-10-06T04:39:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fa06effd700 1 -- 172.21.15.37:0/1847931892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c0116f0 con 0x7fa0880c1550 2023-10-06T04:39:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fa06effd700 1 -- 172.21.15.37:0/1847931892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c011ab0 con 0x7fa0880c1550 2023-10-06T04:39:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fa08c9b7700 1 -- 172.21.15.37:0/1847931892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa080009ae0 con 0x7fa0880c1550 2023-10-06T04:39:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fa08c9b7700 1 -- 172.21.15.37:0/1847931892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa088155f10 con 0x7fa0880c1550 2023-10-06T04:39:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f78116bd700 1 Processor -- start 2023-10-06T04:39:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f78116bd700 1 -- start start 2023-10-06T04:39:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f78116bd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f780c0c6a20 0x7f780c178570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f78116bd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f780c0cbeb0 0x7f780c179600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f78116bd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f780c154cb0 0x7f780c1769e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f78116bd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0c3950 con 0x7f780c0cbeb0 2023-10-06T04:39:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f78116bd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0c3c30 con 0x7f780c154cb0 2023-10-06T04:39:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f78116bd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0c3f10 con 0x7f780c0c6a20 2023-10-06T04:39:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f780bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f780c0c6a20 0x7f780c178570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f780bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f780c0c6a20 0x7f780c178570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40426/0 (socket says 172.21.15.37:40426) 2023-10-06T04:39:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f780bfff700 1 -- 172.21.15.37:0/975669685 learned_addr learned my addr 172.21.15.37:0/975669685 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f780b7fe700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f780c0cbeb0 0x7f780c179600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fd26afc9700 1 -- 172.21.15.37:0/1207077925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd264154770 con 0x7fd2640ad560 2023-10-06T04:39:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fd26afc9700 1 -- 172.21.15.37:0/1207077925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd264070fd0 con 0x7fd2640ad560 2023-10-06T04:39:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe35ca38700 1 -- start start 2023-10-06T04:39:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe35ca38700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe35806ea10 0x7fe3580bfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe35ca38700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3580aa7e0 0x7fe3580c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe35ca38700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3580aabb0 0x7fe35815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe35ca38700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580c0400 con 0x7fe3580aabb0 2023-10-06T04:39:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe35ca38700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580c06e0 con 0x7fe35806ea10 2023-10-06T04:39:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe35ca38700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580c09c0 con 0x7fe3580aa7e0 2023-10-06T04:39:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe357fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3580aabb0 0x7fe35815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe357fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3580aabb0 0x7fe35815a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36648/0 (socket says 172.21.15.37:36648) 2023-10-06T04:39:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe357fff700 1 -- 172.21.15.37:0/68732155 learned_addr learned my addr 172.21.15.37:0/68732155 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe356ffd700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3580aa7e0 0x7fe3580c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe356ffd700 1 -- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe35806ea10 msgr2=0x7fe3580bfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe356ffd700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe35806ea10 0x7fe3580bfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe356ffd700 1 -- 172.21.15.37:0/68732155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3580aabb0 msgr2=0x7fe35815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe356ffd700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3580aabb0 0x7fe35815a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe356ffd700 1 -- 172.21.15.37:0/68732155 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3480094f0 con 0x7fe3580aa7e0 2023-10-06T04:39:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7fe356ffd700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3580aa7e0 0x7fe3580c1b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe35000bad0 tx=0x7fe350009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f780b7fe700 1 -- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f780c0c6a20 msgr2=0x7f780c178570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f780b7fe700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f780c0c6a20 0x7f780c178570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f780b7fe700 1 -- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f780c154cb0 msgr2=0x7f780c1769e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f780b7fe700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f780c154cb0 0x7f780c1769e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fe33f7fe700 1 -- 172.21.15.37:0/68732155 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000c840 con 0x7fe3580aa7e0 2023-10-06T04:39:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fe33f7fe700 1 -- 172.21.15.37:0/68732155 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35000c9c0 con 0x7fe3580aa7e0 2023-10-06T04:39:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.161+0000 7f780b7fe700 1 -- 172.21.15.37:0/975669685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7804009ae0 con 0x7f780c0cbeb0 2023-10-06T04:39:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fe35ca38700 1 -- 172.21.15.37:0/68732155 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3580c0ca0 con 0x7fe3580aa7e0 2023-10-06T04:39:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fe35ca38700 1 -- 172.21.15.37:0/68732155 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3580b1a50 con 0x7fe3580aa7e0 2023-10-06T04:39:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fe33f7fe700 1 -- 172.21.15.37:0/68732155 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000cd80 con 0x7fe3580aa7e0 2023-10-06T04:39:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fac3e634700 1 -- 172.21.15.37:0/924595499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac3814bfd0 msgr2=0x7fac38156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fac3e634700 1 --2- 172.21.15.37:0/924595499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac3814bfd0 0x7fac38156060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fac280091e0 tx=0x7fac28009ae0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f780b7fe700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f780c0cbeb0 0x7f780c179600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00bd00 tx=0x7f77fc00f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fa08c9b7700 1 -- 172.21.15.37:0/1847931892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0880708a0 con 0x7fa0880c1550 2023-10-06T04:39:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fac3e634700 1 -- 172.21.15.37:0/924595499 shutdown_connections 2023-10-06T04:39:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fac3e634700 1 --2- 172.21.15.37:0/924595499 >> v2:172.21.15.83:3300/0 conn(0x7fac380cc480 0x7fac3806e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fac3e634700 1 --2- 172.21.15.37:0/924595499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac3814bfd0 0x7fac38156060 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fac3e634700 1 -- 172.21.15.37:0/924595499 >> 172.21.15.37:0/924595499 conn(0x7fac380667b0 msgr2=0x7fac38066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f77f3fff700 1 -- 172.21.15.37:0/975669685 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00da80 con 0x7f780c0cbeb0 2023-10-06T04:39:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f77f3fff700 1 -- 172.21.15.37:0/975669685 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc00d2f0 con 0x7f780c0cbeb0 2023-10-06T04:39:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f78116bd700 1 -- 172.21.15.37:0/975669685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c0c41f0 con 0x7f780c0cbeb0 2023-10-06T04:39:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f78116bd700 1 -- 172.21.15.37:0/975669685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c178ab0 con 0x7f780c0cbeb0 2023-10-06T04:39:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f37827fc700 1 -- 172.21.15.37:0/4075611415 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3788026ae0 con 0x7f379414bfd0 2023-10-06T04:39:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fbc137fe700 1 -- 172.21.15.37:0/3819921400 <== osd.0 v2:172.21.15.37:6816/33416 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbc1806cd20 con 0x7fbc1806a220 2023-10-06T04:39:32.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fe35ca38700 1 -- 172.21.15.37:0/68732155 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe338000fd0 con 0x7fe3580aa7e0 2023-10-06T04:39:32.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fa06effd700 1 -- 172.21.15.37:0/1847931892 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa07c01c440 con 0x7fa0880c1550 2023-10-06T04:39:32.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f77f3fff700 1 -- 172.21.15.37:0/975669685 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00f8d0 con 0x7f780c0cbeb0 2023-10-06T04:39:32.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fa06effd700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa0740606a0 0x7fa074062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fa06effd700 1 -- 172.21.15.37:0/1847931892 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa07c07c200 con 0x7fa0880c1550 2023-10-06T04:39:32.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fa06effd700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] conn(0x7fa07406a2f0 0x7fa07406c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fa06effd700 1 -- 172.21.15.37:0/1847931892 --> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa07406cdf0 con 0x7fa07406a2f0 2023-10-06T04:39:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca2f3e700 1 Processor -- start 2023-10-06T04:39:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca2f3e700 1 -- start start 2023-10-06T04:39:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca2f3e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6c9c15d2e0 0x7f6c9c1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca2f3e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c9c0cc870 0x7f6c9c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca2f3e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9c153af0 con 0x7f6c9c1531e0 2023-10-06T04:39:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6c9bfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6c9c15d2e0 0x7f6c9c1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6c9bfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6c9c15d2e0 0x7f6c9c1535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34750/0 (socket says 172.21.15.37:34750) 2023-10-06T04:39:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6c9bfff700 1 -- 172.21.15.37:0/3470216862 learned_addr learned my addr 172.21.15.37:0/3470216862 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/3470216862 --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9c15b1e0 con 0x7f6c9c15d2e0 2023-10-06T04:39:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/3470216862 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0cd5e0 con 0x7f6c9c0cc870 2023-10-06T04:39:32.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca14db700 1 --2- 172.21.15.37:0/3470216862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c9c0cc870 0x7f6c9c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fd259ffb700 1 -- 172.21.15.37:0/1207077925 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd254013d00 con 0x7fd2640ad560 2023-10-06T04:39:32.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fd259ffb700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2480606a0 0x7fd248062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fd259ffb700 1 -- 172.21.15.37:0/1207077925 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd25407c950 con 0x7fd2640ad560 2023-10-06T04:39:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fa08659c700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa0740606a0 0x7fa074062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fd259ffb700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] conn(0x7fd24806a370 0x7fd24806c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fd259ffb700 1 -- 172.21.15.37:0/1207077925 --> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd24806ce70 con 0x7fd24806a370 2023-10-06T04:39:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fd259ffb700 1 -- 172.21.15.37:0/1207077925 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd254081220 con 0x7fd2640ad560 2023-10-06T04:39:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fd2697c6700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2480606a0 0x7fd248062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca14db700 1 -- 172.21.15.37:0/3470216862 >> v2:172.21.15.83:3300/0 conn(0x7f6c9c15d2e0 msgr2=0x7f6c9c1535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca14db700 1 --2- 172.21.15.37:0/3470216862 >> v2:172.21.15.83:3300/0 conn(0x7f6c9c15d2e0 0x7f6c9c1535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca14db700 1 -- 172.21.15.37:0/3470216862 >> v1:172.21.15.37:6789/0 conn(0x7f6c9c1531e0 legacy=0x7f6c9c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca14db700 1 -- 172.21.15.37:0/3470216862 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c15a8b0 con 0x7f6c9c0cc870 2023-10-06T04:39:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6ca14db700 1 --2- 172.21.15.37:0/3470216862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c9c0cc870 0x7f6c9c0cccf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009e60 tx=0x7f6c94009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9de317285880d8b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f37827fc700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3774060650 0x7f3774062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f37827fc700 1 -- 172.21.15.37:0/4075611415 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3788021070 con 0x7f379414bfd0 2023-10-06T04:39:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f37827fc700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] conn(0x7f377406a320 0x7f377406c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f37827fc700 1 -- 172.21.15.37:0/4075611415 --> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f377406ce20 con 0x7f377406a320 2023-10-06T04:39:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f37827fc700 1 -- 172.21.15.37:0/4075611415 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f378807eca0 con 0x7f379414bfd0 2023-10-06T04:39:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f3792d9d700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] conn(0x7f377406a320 0x7f377406c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f3791d9b700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3774060650 0x7f3774062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f78116bd700 1 -- 172.21.15.37:0/975669685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77ec000fd0 con 0x7f780c0cbeb0 2023-10-06T04:39:32.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fe33f7fe700 1 -- 172.21.15.37:0/68732155 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe350035a70 con 0x7fe3580aa7e0 2023-10-06T04:39:32.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fa06effd700 1 -- 172.21.15.37:0/1847931892 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa07c0011f0 con 0x7fa0880c1550 2023-10-06T04:39:32.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fa08759e700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] conn(0x7fa07406a2f0 0x7fa07406c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f3792d9d700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] conn(0x7f377406a320 0x7f377406c750 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fac3e634700 1 -- 172.21.15.37:0/924595499 shutdown_connections 2023-10-06T04:39:32.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6c9b7fe700 1 -- 172.21.15.37:0/3470216862 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400e070 con 0x7f6c9c0cc870 2023-10-06T04:39:32.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fd26a7c8700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] conn(0x7fd24806a370 0x7fd24806c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7fe33f7fe700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe344060550 0x7fe344062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6c9b7fe700 1 -- 172.21.15.37:0/3470216862 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9400bb20 con 0x7f6c9c0cc870 2023-10-06T04:39:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fe33f7fe700 1 -- 172.21.15.37:0/68732155 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe35007ce90 con 0x7fe3580aa7e0 2023-10-06T04:39:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.165+0000 7f6c9b7fe700 1 -- 172.21.15.37:0/3470216862 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94012430 con 0x7f6c9c0cc870 2023-10-06T04:39:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fa08659c700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa0740606a0 0x7fa074062b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa08806e960 tx=0x7fa080018000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fa08759e700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] conn(0x7fa07406a2f0 0x7fa07406c720 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fe33f7fe700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] conn(0x7fe34406a220 0x7fe34406c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fe33f7fe700 1 -- 172.21.15.37:0/68732155 --> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe34406cd20 con 0x7fe34406a220 2023-10-06T04:39:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fe33f7fe700 1 -- 172.21.15.37:0/68732155 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe35007d1c0 con 0x7fe3580aa7e0 2023-10-06T04:39:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fe3577fe700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe344060550 0x7fe344062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/3470216862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c9c0cc870 msgr2=0x7f6c9c0cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f6ca2f3e700 1 --2- 172.21.15.37:0/3470216862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c9c0cc870 0x7f6c9c0cccf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009e60 tx=0x7f6c94009780 comp rx=0 tx=0).stop 2023-10-06T04:39:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/3470216862 shutdown_connections 2023-10-06T04:39:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f6ca2f3e700 1 --2- 172.21.15.37:0/3470216862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c9c0cc870 0x7f6c9c0cccf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f6ca2f3e700 1 --2- 172.21.15.37:0/3470216862 >> v2:172.21.15.83:3300/0 conn(0x7f6c9c15d2e0 0x7f6c9c1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fa06effd700 1 -- 172.21.15.37:0/1847931892 <== osd.3 v2:172.21.15.37:6824/33417 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa07406cdf0 con 0x7fa07406a2f0 2023-10-06T04:39:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fd2697c6700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2480606a0 0x7fd248062b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2600093f0 tx=0x7fd260008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/3470216862 >> 172.21.15.37:0/3470216862 conn(0x7f6c9c087ab0 msgr2=0x7f6c9c067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f37827fc700 1 -- 172.21.15.37:0/4075611415 <== osd.1 v2:172.21.15.37:6801/33414 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f377406ce20 con 0x7f377406a320 2023-10-06T04:39:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/3470216862 shutdown_connections 2023-10-06T04:39:32.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f3791d9b700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3774060650 0x7f3774062b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3794066fb0 tx=0x7f378c0074f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/3470216862 wait complete. 2023-10-06T04:39:32.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fe3577fe700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe344060550 0x7fe344062a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3580cd0a0 tx=0x7fe348016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f77f3fff700 1 -- 172.21.15.37:0/975669685 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f77fc014070 con 0x7f780c0cbeb0 2023-10-06T04:39:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fac3e634700 1 -- 172.21.15.37:0/924595499 wait complete. 2023-10-06T04:39:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fac3e634700 1 Processor -- start 2023-10-06T04:39:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fd26a7c8700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] conn(0x7fd24806a370 0x7fd24806c7a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f77f3fff700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f77f8060550 0x7f77f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f77f3fff700 1 -- 172.21.15.37:0/975669685 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f77fc07c080 con 0x7f780c0cbeb0 2023-10-06T04:39:32.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f780bfff700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f77f8060550 0x7f77f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f77f3fff700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] conn(0x7f77f806a220 0x7f77f806c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f77f3fff700 1 -- 172.21.15.37:0/975669685 --> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77f806cd20 con 0x7f77f806a220 2023-10-06T04:39:32.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f77f3fff700 1 -- 172.21.15.37:0/975669685 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77fc07e6c0 con 0x7f780c0cbeb0 2023-10-06T04:39:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7fac3e634700 1 -- start start 2023-10-06T04:39:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f7810ebc700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] conn(0x7f77f806a220 0x7f77f806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f780bfff700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f77f8060550 0x7f77f8062a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f780400b020 tx=0x7f7804017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f7810ebc700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] conn(0x7f77f806a220 0x7f77f806c650 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3e634700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac380ad860 0x7fac381412f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3e634700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac380cc480 0x7fac38158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3e634700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3814bfd0 0x7fac38158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3e634700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3814f5e0 con 0x7fac3814bfd0 2023-10-06T04:39:32.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3e634700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac38150840 con 0x7fac380ad860 2023-10-06T04:39:32.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3e634700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3814ff10 con 0x7fac380cc480 2023-10-06T04:39:32.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fd259ffb700 1 -- 172.21.15.37:0/1207077925 <== osd.5 v2:172.21.15.83:6800/33663 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd24806ce70 con 0x7fd24806a370 2023-10-06T04:39:32.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f6ca2f3e700 1 Processor -- start 2023-10-06T04:39:32.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.169+0000 7f6ca2f3e700 1 -- start start 2023-10-06T04:39:32.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fe357fff700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] conn(0x7fe34406a220 0x7fe34406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac37fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac380ad860 0x7fac381412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3cbd1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3814bfd0 0x7fac38158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca2f3e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c9c1531e0 0x7f6c9c150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca2f3e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c9c15d2e0 0x7f6c9c0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3cbd1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3814bfd0 0x7fac38158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36672/0 (socket says 172.21.15.37:36672) 2023-10-06T04:39:32.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac377fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac380cc480 0x7fac38158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3cbd1700 1 -- 172.21.15.37:0/737656368 learned_addr learned my addr 172.21.15.37:0/737656368 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca2f3e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9c15b670 0x7f6c9c0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca2f3e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c1508a0 con 0x7f6c9c15d2e0 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca2f3e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0b3a60 con 0x7f6c9c15b670 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca2f3e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c06eea0 con 0x7f6c9c1531e0 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca0cda700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c9c1531e0 0x7f6c9c150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca0cda700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c9c1531e0 0x7f6c9c150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40462/0 (socket says 172.21.15.37:40462) 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca0cda700 1 -- 172.21.15.37:0/1164137872 learned_addr learned my addr 172.21.15.37:0/1164137872 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca14db700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9c15b670 0x7f6c9c0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3cbd1700 1 -- 172.21.15.37:0/737656368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac380cc480 msgr2=0x7fac38158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3cbd1700 1 --2- 172.21.15.37:0/737656368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac380cc480 0x7fac38158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3cbd1700 1 -- 172.21.15.37:0/737656368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac380ad860 msgr2=0x7fac381412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3cbd1700 1 --2- 172.21.15.37:0/737656368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac380ad860 0x7fac381412f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3cbd1700 1 -- 172.21.15.37:0/737656368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac28009d80 con 0x7fac3814bfd0 2023-10-06T04:39:32.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fe357fff700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] conn(0x7fe34406a220 0x7fe34406c650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3cbd1700 1 --2- 172.21.15.37:0/737656368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3814bfd0 0x7fac38158b90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac3000bb60 tx=0x7fac300097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca0cda700 1 -- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9c15b670 msgr2=0x7f6c9c0c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca0cda700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9c15b670 0x7f6c9c0c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca0cda700 1 -- 172.21.15.37:0/1164137872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c9c15d2e0 msgr2=0x7f6c9c0b3520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:39:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac1ffff700 1 -- 172.21.15.37:0/737656368 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3000c7c0 con 0x7fac3814bfd0 2023-10-06T04:39:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3e634700 1 -- 172.21.15.37:0/737656368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac381501f0 con 0x7fac3814bfd0 2023-10-06T04:39:32.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac1ffff700 1 -- 172.21.15.37:0/737656368 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3000c920 con 0x7fac3814bfd0 2023-10-06T04:39:32.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac1ffff700 1 -- 172.21.15.37:0/737656368 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3000cd20 con 0x7fac3814bfd0 2023-10-06T04:39:32.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7fac3e634700 1 -- 172.21.15.37:0/737656368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac38141830 con 0x7fac3814bfd0 2023-10-06T04:39:32.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f77f3fff700 1 -- 172.21.15.37:0/975669685 <== osd.4 v2:172.21.15.83:6816/33662 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f77f806cd20 con 0x7f77f806a220 2023-10-06T04:39:32.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca0cda700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c9c15d2e0 0x7f6c9c0b3520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca0cda700 1 -- 172.21.15.37:0/1164137872 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c94009a20 con 0x7f6c9c1531e0 2023-10-06T04:39:32.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.173+0000 7f6ca0cda700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c9c1531e0 0x7f6c9c150360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00b640 tx=0x7f6c8c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7f6c98ff9700 1 -- 172.21.15.37:0/1164137872 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c00f510 con 0x7f6c9c1531e0 2023-10-06T04:39:32.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7f6c98ff9700 1 -- 172.21.15.37:0/1164137872 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c00f670 con 0x7f6c9c1531e0 2023-10-06T04:39:32.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7f6c98ff9700 1 -- 172.21.15.37:0/1164137872 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c00fa30 con 0x7f6c9c1531e0 2023-10-06T04:39:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/1164137872 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c0c79c0 con 0x7f6c9c1531e0 2023-10-06T04:39:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/1164137872 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9c0c7f80 con 0x7f6c9c1531e0 2023-10-06T04:39:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7f6c98ff9700 1 -- 172.21.15.37:0/1164137872 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6c8c01a400 con 0x7f6c9c1531e0 2023-10-06T04:39:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7f6c98ff9700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6c88060550 0x7f6c88062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.185+0000 7fbc30806700 1 -- 172.21.15.37:0/3819921400 --> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc0c002d20 con 0x7fbc1806a220 2023-10-06T04:39:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.185+0000 7fbc137fe700 1 -- 172.21.15.37:0/3819921400 <== osd.0 v2:172.21.15.37:6816/33416 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbc0c002d20 con 0x7fbc1806a220 2023-10-06T04:39:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7fac1ffff700 1 -- 172.21.15.37:0/737656368 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fac30014620 con 0x7fac3814bfd0 2023-10-06T04:39:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7fac1ffff700 1 --2- 172.21.15.37:0/737656368 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fac200606f0 0x7fac20062ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7fac1ffff700 1 -- 172.21.15.37:0/737656368 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fac3007cc20 con 0x7fac3814bfd0 2023-10-06T04:39:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7fac37fff700 1 --2- 172.21.15.37:0/737656368 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fac200606f0 0x7fac20062ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7fac37fff700 1 --2- 172.21.15.37:0/737656368 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fac200606f0 0x7fac20062ba0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fac280091e0 tx=0x7fac28019000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.185+0000 7fac3e634700 1 --2- 172.21.15.37:0/737656368 >> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] conn(0x7fac180015f0 0x7fac18003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.185+0000 7fac3e634700 1 -- 172.21.15.37:0/737656368 --> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac18006b90 con 0x7fac180015f0 2023-10-06T04:39:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.185+0000 7fac377fe700 1 --2- 172.21.15.37:0/737656368 >> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] conn(0x7fac180015f0 0x7fac18003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.177+0000 7fe33f7fe700 1 -- 172.21.15.37:0/68732155 <== osd.6 v2:172.21.15.83:6808/33693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe34406cd20 con 0x7fe34406a220 2023-10-06T04:39:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.181+0000 7f6c98ff9700 1 -- 172.21.15.37:0/1164137872 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6c8c07c4e0 con 0x7f6c9c1531e0 2023-10-06T04:39:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.181+0000 7f6c9bfff700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6c88060550 0x7f6c88062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.181+0000 7f6c9bfff700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6c88060550 0x7f6c88062a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0681f0 tx=0x7f6c90009250 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.185+0000 7f6ca2f3e700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] conn(0x7f6c7c0015f0 0x7f6c7c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.185+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/1164137872 --> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c7c006b90 con 0x7f6c7c0015f0 2023-10-06T04:39:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.185+0000 7f6ca14db700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] conn(0x7f6c7c0015f0 0x7f6c7c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.185+0000 7fac377fe700 1 --2- 172.21.15.37:0/737656368 >> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] conn(0x7fac180015f0 0x7fac18003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.185+0000 7f6ca14db700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] conn(0x7f6c7c0015f0 0x7f6c7c003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.185+0000 7fac1ffff700 1 -- 172.21.15.37:0/737656368 <== osd.2 v2:172.21.15.37:6800/33415 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fac18006b90 con 0x7fac180015f0 2023-10-06T04:39:32.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.185+0000 7f6c98ff9700 1 -- 172.21.15.37:0/1164137872 <== osd.7 v2:172.21.15.83:6824/33674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6c7c006b90 con 0x7f6c7c0015f0 2023-10-06T04:39:32.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7fbc30806700 1 -- 172.21.15.37:0/3819921400 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x7fbc1806a220 msgr2=0x7fbc1806c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7fbc30806700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x7fbc1806a220 0x7fbc1806c650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7fbc30806700 1 -- 172.21.15.37:0/3819921400 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbc18060550 msgr2=0x7fbc18062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7fbc30806700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbc18060550 0x7fbc18062a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c1560b0 tx=0x7fbc24009780 comp rx=0 tx=0).stop 2023-10-06T04:39:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7fbc30806700 1 -- 172.21.15.37:0/3819921400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c154cb0 msgr2=0x7fbc2c0a95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7fbc30806700 1 --2- 172.21.15.37:0/3819921400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc2c154cb0 0x7fbc2c0a95c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000c560 tx=0x7fbc20007eb0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7fbc2bfff700 1 -- 172.21.15.37:0/3819921400 reap_dead start 2023-10-06T04:39:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7fbc30806700 1 -- 172.21.15.37:0/3819921400 shutdown_connections 2023-10-06T04:39:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7fbc30806700 1 -- 172.21.15.37:0/3819921400 >> 172.21.15.37:0/3819921400 conn(0x7fbc2c068770 msgr2=0x7fbc2c06a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7fbc30806700 1 -- 172.21.15.37:0/3819921400 shutdown_connections 2023-10-06T04:39:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7fbc30806700 1 -- 172.21.15.37:0/3819921400 wait complete. 2023-10-06T04:39:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7f78116bd700 1 -- 172.21.15.37:0/975669685 --> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77ec002d30 con 0x7f77f806a220 2023-10-06T04:39:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.193+0000 7f77f3fff700 1 -- 172.21.15.37:0/975669685 <== osd.4 v2:172.21.15.83:6816/33662 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77ec002d30 con 0x7f77f806a220 2023-10-06T04:39:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.197+0000 7f78116bd700 1 -- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] conn(0x7f77f806a220 msgr2=0x7f77f806c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.197+0000 7f78116bd700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] conn(0x7f77f806a220 0x7f77f806c650 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.197+0000 7f78116bd700 1 -- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f77f8060550 msgr2=0x7f77f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.197+0000 7f78116bd700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f77f8060550 0x7f77f8062a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f780400b020 tx=0x7f7804017000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.197+0000 7f78116bd700 1 -- 172.21.15.37:0/975669685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f780c0cbeb0 msgr2=0x7f780c179600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.197+0000 7f78116bd700 1 --2- 172.21.15.37:0/975669685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f780c0cbeb0 0x7f780c179600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00bd00 tx=0x7f77fc00f040 comp rx=0 tx=0).stop 2023-10-06T04:39:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.197+0000 7f7810ebc700 1 -- 172.21.15.37:0/975669685 reap_dead start 2023-10-06T04:39:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.197+0000 7fd26afc9700 1 -- 172.21.15.37:0/1207077925 --> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd2640708a0 con 0x7fd24806a370 2023-10-06T04:39:32.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.197+0000 7fd259ffb700 1 -- 172.21.15.37:0/1207077925 <== osd.5 v2:172.21.15.83:6800/33663 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd2640708a0 con 0x7fd24806a370 2023-10-06T04:39:32.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fd26afc9700 1 -- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] conn(0x7fd24806a370 msgr2=0x7fd24806c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fd26afc9700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] conn(0x7fd24806a370 0x7fd24806c7a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fd26afc9700 1 -- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2480606a0 msgr2=0x7fd248062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fd26afc9700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2480606a0 0x7fd248062b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2600093f0 tx=0x7fd260008040 comp rx=0 tx=0).stop 2023-10-06T04:39:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fd26afc9700 1 -- 172.21.15.37:0/1207077925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2640ad560 msgr2=0x7fd2641519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fd26afc9700 1 --2- 172.21.15.37:0/1207077925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2640ad560 0x7fd2641519c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd25400e8d0 tx=0x7fd254008040 comp rx=0 tx=0).stop 2023-10-06T04:39:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fd26a7c8700 1 -- 172.21.15.37:0/1207077925 reap_dead start 2023-10-06T04:39:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fd26afc9700 1 -- 172.21.15.37:0/1207077925 shutdown_connections 2023-10-06T04:39:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fd26afc9700 1 -- 172.21.15.37:0/1207077925 >> 172.21.15.37:0/1207077925 conn(0x7fd264068780 msgr2=0x7fd2640690a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fd26afc9700 1 -- 172.21.15.37:0/1207077925 shutdown_connections 2023-10-06T04:39:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fd26afc9700 1 -- 172.21.15.37:0/1207077925 wait complete. 2023-10-06T04:39:32.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe35ca38700 1 -- 172.21.15.37:0/68732155 --> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe338002d30 con 0x7fe34406a220 2023-10-06T04:39:32.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fa08c9b7700 1 -- 172.21.15.37:0/1847931892 --> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa088143270 con 0x7fa07406a2f0 2023-10-06T04:39:32.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fa06effd700 1 -- 172.21.15.37:0/1847931892 <== osd.3 v2:172.21.15.37:6824/33417 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa088143270 con 0x7fa07406a2f0 2023-10-06T04:39:32.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe33f7fe700 1 -- 172.21.15.37:0/68732155 <== osd.6 v2:172.21.15.83:6808/33693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe338002d30 con 0x7fe34406a220 2023-10-06T04:39:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe35ca38700 1 -- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] conn(0x7fe34406a220 msgr2=0x7fe34406c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe35ca38700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] conn(0x7fe34406a220 0x7fe34406c650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe35ca38700 1 -- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe344060550 msgr2=0x7fe344062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe35ca38700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe344060550 0x7fe344062a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3580cd0a0 tx=0x7fe348016000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe35ca38700 1 -- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3580aa7e0 msgr2=0x7fe3580c1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe35ca38700 1 --2- 172.21.15.37:0/68732155 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3580aa7e0 0x7fe3580c1b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe35000bad0 tx=0x7fe350009780 comp rx=0 tx=0).stop 2023-10-06T04:39:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe357fff700 1 -- 172.21.15.37:0/68732155 reap_dead start 2023-10-06T04:39:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe35ca38700 1 -- 172.21.15.37:0/68732155 shutdown_connections 2023-10-06T04:39:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe35ca38700 1 -- 172.21.15.37:0/68732155 >> 172.21.15.37:0/68732155 conn(0x7fe3580cc030 msgr2=0x7fe3581584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe35ca38700 1 -- 172.21.15.37:0/68732155 shutdown_connections 2023-10-06T04:39:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.201+0000 7fe35ca38700 1 -- 172.21.15.37:0/68732155 wait complete. 2023-10-06T04:39:32.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7f78116bd700 1 -- 172.21.15.37:0/975669685 shutdown_connections 2023-10-06T04:39:32.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7f78116bd700 1 -- 172.21.15.37:0/975669685 >> 172.21.15.37:0/975669685 conn(0x7f780c068770 msgr2=0x7f780c0c0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7f78116bd700 1 -- 172.21.15.37:0/975669685 shutdown_connections 2023-10-06T04:39:32.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7f78116bd700 1 -- 172.21.15.37:0/975669685 wait complete. 2023-10-06T04:39:32.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7f3798b2a700 1 -- 172.21.15.37:0/4075611415 --> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3778002d30 con 0x7f377406a320 2023-10-06T04:39:32.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7f37827fc700 1 -- 172.21.15.37:0/4075611415 <== osd.1 v2:172.21.15.37:6801/33414 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3778002d30 con 0x7f377406a320 2023-10-06T04:39:32.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7fa08c9b7700 1 -- 172.21.15.37:0/1847931892 >> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] conn(0x7fa07406a2f0 msgr2=0x7fa07406c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/1164137872 --> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6c7c005c20 con 0x7f6c7c0015f0 2023-10-06T04:39:32.255 INFO:teuthology.orchestra.run.smithi037.stdout:64424509449 2023-10-06T04:39:32.255 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:39:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7fa08c9b7700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] conn(0x7fa07406a2f0 0x7fa07406c720 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7fa08c9b7700 1 -- 172.21.15.37:0/1847931892 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa0740606a0 msgr2=0x7fa074062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7fa08c9b7700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa0740606a0 0x7fa074062b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa08806e960 tx=0x7fa080018000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7fa08c9b7700 1 -- 172.21.15.37:0/1847931892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880c1550 msgr2=0x7fa0881436f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7fa08c9b7700 1 --2- 172.21.15.37:0/1847931892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880c1550 0x7fa0881436f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00c590 tx=0x7fa07c00c950 comp rx=0 tx=0).stop 2023-10-06T04:39:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7fa08759e700 1 -- 172.21.15.37:0/1847931892 reap_dead start 2023-10-06T04:39:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7fa08c9b7700 1 -- 172.21.15.37:0/1847931892 shutdown_connections 2023-10-06T04:39:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.205+0000 7fa08c9b7700 1 -- 172.21.15.37:0/1847931892 >> 172.21.15.37:0/1847931892 conn(0x7fa088068770 msgr2=0x7fa08814bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7fa08c9b7700 1 -- 172.21.15.37:0/1847931892 shutdown_connections 2023-10-06T04:39:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7fa08c9b7700 1 -- 172.21.15.37:0/1847931892 wait complete. 2023-10-06T04:39:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f6c98ff9700 1 -- 172.21.15.37:0/1164137872 <== osd.7 v2:172.21.15.83:6824/33674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6c7c005c20 con 0x7f6c7c0015f0 2023-10-06T04:39:32.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7fac3e634700 1 -- 172.21.15.37:0/737656368 --> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fac18005c80 con 0x7fac180015f0 2023-10-06T04:39:32.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] conn(0x7f6c7c0015f0 msgr2=0x7f6c7c003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f6ca2f3e700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] conn(0x7f6c7c0015f0 0x7f6c7c003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f3798b2a700 1 -- 172.21.15.37:0/4075611415 >> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] conn(0x7f377406a320 msgr2=0x7f377406c750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f3798b2a700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] conn(0x7f377406a320 0x7f377406c750 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f3798b2a700 1 -- 172.21.15.37:0/4075611415 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3774060650 msgr2=0x7f3774062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6c88060550 msgr2=0x7f6c88062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f6ca2f3e700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6c88060550 0x7f6c88062a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0681f0 tx=0x7f6c90009250 comp rx=0 tx=0).stop 2023-10-06T04:39:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c9c1531e0 msgr2=0x7f6c9c150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f6ca2f3e700 1 --2- 172.21.15.37:0/1164137872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c9c1531e0 0x7f6c9c150360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00b640 tx=0x7f6c8c0090f0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f6ca14db700 1 -- 172.21.15.37:0/1164137872 reap_dead start 2023-10-06T04:39:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/1164137872 shutdown_connections 2023-10-06T04:39:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/1164137872 >> 172.21.15.37:0/1164137872 conn(0x7f6c9c0cc870 msgr2=0x7f6c9c0cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f3798b2a700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3774060650 0x7f3774062b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3794066fb0 tx=0x7f378c0074f0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f3798b2a700 1 -- 172.21.15.37:0/4075611415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379414bfd0 msgr2=0x7f3794140c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7fac1ffff700 1 -- 172.21.15.37:0/737656368 <== osd.2 v2:172.21.15.37:6800/33415 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fac18005c80 con 0x7fac180015f0 2023-10-06T04:39:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f3798b2a700 1 --2- 172.21.15.37:0/4075611415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379414bfd0 0x7f3794140c90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f37880090b0 tx=0x7f3788017000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f3792d9d700 1 -- 172.21.15.37:0/4075611415 reap_dead start 2023-10-06T04:39:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/1164137872 shutdown_connections 2023-10-06T04:39:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f6ca2f3e700 1 -- 172.21.15.37:0/1164137872 wait complete. 2023-10-06T04:39:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f3798b2a700 1 -- 172.21.15.37:0/4075611415 shutdown_connections 2023-10-06T04:39:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f3798b2a700 1 -- 172.21.15.37:0/4075611415 >> 172.21.15.37:0/4075611415 conn(0x7f37940667b0 msgr2=0x7f37940aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f3798b2a700 1 -- 172.21.15.37:0/4075611415 shutdown_connections 2023-10-06T04:39:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7f3798b2a700 1 -- 172.21.15.37:0/4075611415 wait complete. 2023-10-06T04:39:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7fac1dffb700 1 -- 172.21.15.37:0/737656368 >> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] conn(0x7fac180015f0 msgr2=0x7fac18003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7fac1dffb700 1 --2- 172.21.15.37:0/737656368 >> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] conn(0x7fac180015f0 0x7fac18003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7fac1dffb700 1 -- 172.21.15.37:0/737656368 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fac200606f0 msgr2=0x7fac20062ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7fac1dffb700 1 --2- 172.21.15.37:0/737656368 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fac200606f0 0x7fac20062ba0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fac280091e0 tx=0x7fac28019000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7fac1dffb700 1 -- 172.21.15.37:0/737656368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3814bfd0 msgr2=0x7fac38158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7fac1dffb700 1 --2- 172.21.15.37:0/737656368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3814bfd0 0x7fac38158b90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac3000bb60 tx=0x7fac300097c0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.209+0000 7fac3cbd1700 1 -- 172.21.15.37:0/737656368 reap_dead start 2023-10-06T04:39:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.213+0000 7fac1dffb700 1 -- 172.21.15.37:0/737656368 shutdown_connections 2023-10-06T04:39:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.213+0000 7fac1dffb700 1 -- 172.21.15.37:0/737656368 >> 172.21.15.37:0/737656368 conn(0x7fac380667b0 msgr2=0x7fac3814b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.213+0000 7fac1dffb700 1 -- 172.21.15.37:0/737656368 shutdown_connections 2023-10-06T04:39:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.213+0000 7fac1dffb700 1 -- 172.21.15.37:0/737656368 wait complete. 2023-10-06T04:39:32.266 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-10-06T04:39:32.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T04:39:32.267 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-10-06T04:39:32.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T04:39:32.268 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-10-06T04:39:32.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:39:32.269 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-10-06T04:39:32.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T04:39:32.270 INFO:teuthology.orchestra.run.smithi037.stdout:64424509451 2023-10-06T04:39:32.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T04:39:32.271 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-10-06T04:39:32.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T04:39:32.272 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-10-06T04:39:32.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T04:39:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4f276700 1 Processor -- start 2023-10-06T04:39:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ee73d0700 1 Processor -- start 2023-10-06T04:39:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4f276700 1 -- start start 2023-10-06T04:39:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ee73d0700 1 -- start start 2023-10-06T04:39:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fd2dd063700 1 Processor -- start 2023-10-06T04:39:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fd2dd063700 1 -- start start 2023-10-06T04:39:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ee73d0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ee0140480 0x7f0ee015b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ee73d0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ee00cbf60 0x7f0ee0157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ee73d0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee015ae00 con 0x7f0ee0157330 2023-10-06T04:39:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ee73d0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee0158340 con 0x7f0ee00cbf60 2023-10-06T04:39:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ee73d0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0157d80 con 0x7f0ee0140480 2023-10-06T04:39:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ee596d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ee00cbf60 0x7f0ee0157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fb7dd2f6700 1 Processor -- start 2023-10-06T04:39:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ee516c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ee0140480 0x7f0ee015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ee516c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ee0140480 0x7f0ee015b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40464/0 (socket says 172.21.15.37:40464) 2023-10-06T04:39:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ee516c700 1 -- 172.21.15.37:0/2446043893 learned_addr learned my addr 172.21.15.37:0/2446043893 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4f276700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a480c79c0 0x7f0a480c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4f276700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a480cc1a0 0x7f0a480c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4f276700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a480ca610 con 0x7f0a480aa8d0 2023-10-06T04:39:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4f276700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a480c9a00 con 0x7f0a480c79c0 2023-10-06T04:39:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4f276700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a480c9ce0 con 0x7f0a480cc1a0 2023-10-06T04:39:32.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4e274700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0a480aa8d0 0x7f0a480c72b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36602/0 (socket says 172.21.15.37:36602) 2023-10-06T04:39:32.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4e274700 1 -- 172.21.15.37:0/1933273005 learned_addr learned my addr 172.21.15.37:0/1933273005 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:32.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4da73700 1 --2- 172.21.15.37:0/1933273005 >> v2:172.21.15.37:3300/0 conn(0x7f0a480c79c0 0x7f0a480c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4ea75700 1 --2- 172.21.15.37:0/1933273005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a480cc1a0 0x7f0a480c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fb7dd2f6700 1 -- start start 2023-10-06T04:39:32.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4da73700 1 -- 172.21.15.37:0/1933273005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a480cc1a0 msgr2=0x7f0a480c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4da73700 1 --2- 172.21.15.37:0/1933273005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a480cc1a0 0x7f0a480c06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4da73700 1 -- 172.21.15.37:0/1933273005 >> v1:172.21.15.37:6789/0 conn(0x7f0a480aa8d0 legacy=0x7f0a480c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4da73700 1 -- 172.21.15.37:0/1933273005 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a480c9fc0 con 0x7f0a480c79c0 2023-10-06T04:39:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4da73700 1 --2- 172.21.15.37:0/1933273005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a480c79c0 0x7f0a480c9370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009e60 tx=0x7f0a40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9e5cc903457400 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fd2dd063700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2d8156800 0x7fd2d80cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fd2dd063700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2d80c9680 0x7fd2d80cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fd2dd063700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d80c9aa0 con 0x7fd2d8156bd0 2023-10-06T04:39:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fd2dd063700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d815dac0 con 0x7fd2d80c9680 2023-10-06T04:39:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fd2dd063700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8159800 con 0x7fd2d8156800 2023-10-06T04:39:32.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ee516c700 1 -- 172.21.15.37:0/2446043893 >> v2:172.21.15.37:3300/0 conn(0x7f0ee00cbf60 msgr2=0x7f0ee0157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0ed7fff700 1 -- 172.21.15.37:0/2446043893 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378060863 0 0) 0x7f0ee015ae00 con 0x7f0ee0157330 2023-10-06T04:39:32.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4d272700 1 -- 172.21.15.37:0/1933273005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000e070 con 0x7f0a480c79c0 2023-10-06T04:39:32.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fd2d759e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2d80c9680 0x7fd2d80cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4d272700 1 -- 172.21.15.37:0/1933273005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4000bb60 con 0x7f0a480c79c0 2023-10-06T04:39:32.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7f0a4d272700 1 -- 172.21.15.37:0/1933273005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40012430 con 0x7f0a480c79c0 2023-10-06T04:39:32.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fb311bcf700 1 Processor -- start 2023-10-06T04:39:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fdc496c7700 1 Processor -- start 2023-10-06T04:39:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fdc496c7700 1 -- start start 2023-10-06T04:39:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb311bcf700 1 -- start start 2023-10-06T04:39:32.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fd2d759e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2d80c9680 0x7fd2d80cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36698/0 (socket says 172.21.15.37:36698) 2023-10-06T04:39:32.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fd2d759e700 1 -- 172.21.15.37:0/3764701335 learned_addr learned my addr 172.21.15.37:0/3764701335 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.453+0000 7fd2d6d9d700 1 --2- 172.21.15.37:0/3764701335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2d8156800 0x7fd2d80cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7dd2f6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb7d80aa8d0 0x7fb7d80c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7dd2f6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7d80cc1a0 0x7fb7d80c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7dd2f6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80c77f0 0x7fb7d8159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7dd2f6700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d80ca610 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7dd2f6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d80c9a00 con 0x7fb7d80aa8d0 2023-10-06T04:39:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7dd2f6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80c9ce0 con 0x7fb7d80c77f0 2023-10-06T04:39:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0a4f276700 1 -- 172.21.15.37:0/1933273005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a480c79c0 msgr2=0x7f0a480c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0a4f276700 1 --2- 172.21.15.37:0/1933273005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a480c79c0 0x7f0a480c9370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009e60 tx=0x7f0a40009780 comp rx=0 tx=0).stop 2023-10-06T04:39:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fd2d6d9d700 1 -- 172.21.15.37:0/3764701335 >> v2:172.21.15.37:3300/0 conn(0x7fd2d80c9680 msgr2=0x7fd2d80cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fd2d6d9d700 1 --2- 172.21.15.37:0/3764701335 >> v2:172.21.15.37:3300/0 conn(0x7fd2d80c9680 0x7fd2d80cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fd2d6d9d700 1 -- 172.21.15.37:0/3764701335 >> v1:172.21.15.37:6789/0 conn(0x7fd2d8156bd0 legacy=0x7fd2d80c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fd2d6d9d700 1 -- 172.21.15.37:0/3764701335 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d8159ae0 con 0x7fd2d8156800 2023-10-06T04:39:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0a4f276700 1 -- 172.21.15.37:0/1933273005 shutdown_connections 2023-10-06T04:39:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0a4f276700 1 --2- 172.21.15.37:0/1933273005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a480cc1a0 0x7f0a480c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0a4f276700 1 --2- 172.21.15.37:0/1933273005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a480c79c0 0x7f0a480c9370 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0a4f276700 1 -- 172.21.15.37:0/1933273005 >> 172.21.15.37:0/1933273005 conn(0x7f0a48068780 msgr2=0x7f0a480cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7dcaf5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80c77f0 0x7fb7d8159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7dcaf5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80c77f0 0x7fb7d8159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40482/0 (socket says 172.21.15.37:40482) 2023-10-06T04:39:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7dcaf5700 1 -- 172.21.15.37:0/2103072593 learned_addr learned my addr 172.21.15.37:0/2103072593 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fd2d6d9d700 1 --2- 172.21.15.37:0/3764701335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2d8156800 0x7fd2d80cbb20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009e60 tx=0x7fd2c8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48231a8dd0bd65fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7d7fff700 1 --2- 172.21.15.37:0/2103072593 >> v2:172.21.15.83:3300/0 conn(0x7fb7d80aa8d0 0x7fb7d80c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee516c700 1 --2- 172.21.15.37:0/2446043893 >> v2:172.21.15.37:3300/0 conn(0x7f0ee00cbf60 0x7f0ee0157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee516c700 1 -- 172.21.15.37:0/2446043893 >> v1:172.21.15.83:6789/0 conn(0x7f0ee0157330 legacy=0x7f0ee00cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee516c700 1 -- 172.21.15.37:0/2446043893 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0158060 con 0x7f0ee0140480 2023-10-06T04:39:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee516c700 1 --2- 172.21.15.37:0/2446043893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ee0140480 0x7f0ee015b290 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009f20 tx=0x7f0ed8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f185924b2a877b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ed7fff700 1 -- 172.21.15.37:0/2446043893 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed800e070 con 0x7f0ee0140480 2023-10-06T04:39:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ed7fff700 1 -- 172.21.15.37:0/2446043893 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed800ba80 con 0x7f0ee0140480 2023-10-06T04:39:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ed7fff700 1 -- 172.21.15.37:0/2446043893 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80092e0 con 0x7f0ee0140480 2023-10-06T04:39:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee596d700 1 --2- 172.21.15.37:0/2446043893 >> v2:172.21.15.37:3300/0 conn(0x7f0ee00cbf60 0x7f0ee0157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0a4f276700 1 -- 172.21.15.37:0/1933273005 shutdown_connections 2023-10-06T04:39:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7d77fe700 1 --2- 172.21.15.37:0/2103072593 >> v2:172.21.15.37:3300/0 conn(0x7fb7d80cc1a0 0x7fb7d80c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc496c7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc441512d0 0x7fdc4406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc496c7700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc44158160 con 0x7fdc440ca7b0 2023-10-06T04:39:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc496c7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc44157290 con 0x7fdc440cbfc0 2023-10-06T04:39:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc496c7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc440ca3b0 con 0x7fdc441512d0 2023-10-06T04:39:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc42ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc441512d0 0x7fdc4406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc42ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc441512d0 0x7fdc4406d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40496/0 (socket says 172.21.15.37:40496) 2023-10-06T04:39:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc42ffd700 1 -- 172.21.15.37:0/3143177874 learned_addr learned my addr 172.21.15.37:0/3143177874 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fd2d5d9b700 1 -- 172.21.15.37:0/3764701335 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800e070 con 0x7fd2d8156800 2023-10-06T04:39:32.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0a4f276700 1 -- 172.21.15.37:0/1933273005 wait complete. 2023-10-06T04:39:32.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fd2d5d9b700 1 -- 172.21.15.37:0/3764701335 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c800bb60 con 0x7fd2d8156800 2023-10-06T04:39:32.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fd2d5d9b700 1 -- 172.21.15.37:0/3764701335 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8012430 con 0x7fd2d8156800 2023-10-06T04:39:32.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7dcaf5700 1 -- 172.21.15.37:0/2103072593 >> v2:172.21.15.83:3300/0 conn(0x7fb7d80aa8d0 msgr2=0x7fb7d80c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7dcaf5700 1 --2- 172.21.15.37:0/2103072593 >> v2:172.21.15.83:3300/0 conn(0x7fb7d80aa8d0 0x7fb7d80c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb7dcaf5700 1 -- 172.21.15.37:0/2103072593 >> v2:172.21.15.37:3300/0 conn(0x7fb7d80cc1a0 msgr2=0x7fb7d80c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc42ffd700 1 -- 172.21.15.37:0/3143177874 >> v1:172.21.15.83:6789/0 conn(0x7fdc440cbfc0 legacy=0x7fdc4415aa40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:39:32.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc42ffd700 1 -- 172.21.15.37:0/3143177874 >> v1:172.21.15.37:6789/0 conn(0x7fdc440ca7b0 legacy=0x7fdc440cb8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:39:32.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc42ffd700 1 -- 172.21.15.37:0/3143177874 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc44157550 con 0x7fdc441512d0 2023-10-06T04:39:32.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee73d0700 1 -- 172.21.15.37:0/2446043893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ee0140480 msgr2=0x7f0ee015b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee73d0700 1 --2- 172.21.15.37:0/2446043893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ee0140480 0x7f0ee015b290 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009f20 tx=0x7f0ed8009840 comp rx=0 tx=0).stop 2023-10-06T04:39:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb311bcf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb30c158830 0x7fb30c158c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb311bcf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb30c0acb00 0x7fb30c0cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb311bcf700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c0cc520 con 0x7fb30c0cbb80 2023-10-06T04:39:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb311bcf700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c0a9f20 con 0x7fb30c0acb00 2023-10-06T04:39:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb311bcf700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c0aaaa0 con 0x7fb30c158830 2023-10-06T04:39:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb310bcd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb30c158830 0x7fb30c158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb310bcd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb30c158830 0x7fb30c158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34802/0 (socket says 172.21.15.37:34802) 2023-10-06T04:39:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb310bcd700 1 -- 172.21.15.37:0/727787838 learned_addr learned my addr 172.21.15.37:0/727787838 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb310bcd700 1 -- 172.21.15.37:0/727787838 >> v2:172.21.15.37:3300/0 conn(0x7fb30c0acb00 msgr2=0x7fb30c0cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb310bcd700 1 --2- 172.21.15.37:0/727787838 >> v2:172.21.15.37:3300/0 conn(0x7fb30c0acb00 0x7fb30c0cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb310bcd700 1 -- 172.21.15.37:0/727787838 >> v1:172.21.15.37:6789/0 conn(0x7fb30c0cbb80 legacy=0x7fb30c0ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb310bcd700 1 -- 172.21.15.37:0/727787838 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c0aa170 con 0x7fb30c158830 2023-10-06T04:39:32.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee73d0700 1 -- 172.21.15.37:0/2446043893 shutdown_connections 2023-10-06T04:39:32.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee73d0700 1 --2- 172.21.15.37:0/2446043893 >> v2:172.21.15.37:3300/0 conn(0x7f0ee00cbf60 0x7f0ee0157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee73d0700 1 --2- 172.21.15.37:0/2446043893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ee0140480 0x7f0ee015b290 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee73d0700 1 -- 172.21.15.37:0/2446043893 >> 172.21.15.37:0/2446043893 conn(0x7f0ee00667b0 msgr2=0x7f0ee0066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee73d0700 1 -- 172.21.15.37:0/2446043893 shutdown_connections 2023-10-06T04:39:32.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0ee73d0700 1 -- 172.21.15.37:0/2446043893 wait complete. 2023-10-06T04:39:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc42ffd700 1 --2- 172.21.15.37:0/3143177874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc441512d0 0x7fdc4406d7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c014af0 tx=0x7fdc3c0143c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=320de82615d143a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb310bcd700 1 --2- 172.21.15.37:0/727787838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb30c158830 0x7fb30c158c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0cc780 tx=0x7fb2fc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8384dff10303611d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc41ffb700 1 -- 172.21.15.37:0/3143177874 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c013b50 con 0x7fdc441512d0 2023-10-06T04:39:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb30b7fe700 1 -- 172.21.15.37:0/727787838 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00b820 con 0x7fb30c158830 2023-10-06T04:39:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7f0a4f276700 1 Processor -- start 2023-10-06T04:39:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc41ffb700 1 -- 172.21.15.37:0/3143177874 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c013cb0 con 0x7fdc441512d0 2023-10-06T04:39:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fdc41ffb700 1 -- 172.21.15.37:0/3143177874 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c014050 con 0x7fdc441512d0 2023-10-06T04:39:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.457+0000 7fb30b7fe700 1 -- 172.21.15.37:0/727787838 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc00b980 con 0x7fb30c158830 2023-10-06T04:39:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fdc496c7700 1 -- 172.21.15.37:0/3143177874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc441512d0 msgr2=0x7fdc4406d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fdc496c7700 1 --2- 172.21.15.37:0/3143177874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc441512d0 0x7fdc4406d7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c014af0 tx=0x7fdc3c0143c0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee73d0700 1 Processor -- start 2023-10-06T04:39:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fb311bcf700 1 -- 172.21.15.37:0/727787838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb30c158830 msgr2=0x7fb30c158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fb311bcf700 1 --2- 172.21.15.37:0/727787838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb30c158830 0x7fb30c158c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0cc780 tx=0x7fb2fc009250 comp rx=0 tx=0).stop 2023-10-06T04:39:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fb311bcf700 1 -- 172.21.15.37:0/727787838 shutdown_connections 2023-10-06T04:39:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fb311bcf700 1 --2- 172.21.15.37:0/727787838 >> v2:172.21.15.37:3300/0 conn(0x7fb30c0acb00 0x7fb30c0cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fb311bcf700 1 --2- 172.21.15.37:0/727787838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb30c158830 0x7fb30c158c00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fb311bcf700 1 -- 172.21.15.37:0/727787838 >> 172.21.15.37:0/727787838 conn(0x7fb30c0cb780 msgr2=0x7fb30c06b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee73d0700 1 -- start start 2023-10-06T04:39:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fd2dd063700 1 -- 172.21.15.37:0/3764701335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2d8156800 msgr2=0x7fd2d80cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4f276700 1 -- start start 2023-10-06T04:39:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fd2dd063700 1 --2- 172.21.15.37:0/3764701335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2d8156800 0x7fd2d80cbb20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009e60 tx=0x7fd2c8009780 comp rx=0 tx=0).stop 2023-10-06T04:39:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fb311bcf700 1 -- 172.21.15.37:0/727787838 shutdown_connections 2023-10-06T04:39:32.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fb311bcf700 1 -- 172.21.15.37:0/727787838 wait complete. 2023-10-06T04:39:32.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fdc496c7700 1 -- 172.21.15.37:0/3143177874 shutdown_connections 2023-10-06T04:39:32.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fdc496c7700 1 --2- 172.21.15.37:0/3143177874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc441512d0 0x7fdc4406d7d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fdc496c7700 1 -- 172.21.15.37:0/3143177874 >> 172.21.15.37:0/3143177874 conn(0x7fdc440667b0 msgr2=0x7fdc44066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fd2dd063700 1 -- 172.21.15.37:0/3764701335 shutdown_connections 2023-10-06T04:39:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fd2dd063700 1 --2- 172.21.15.37:0/3764701335 >> v2:172.21.15.37:3300/0 conn(0x7fd2d80c9680 0x7fd2d80cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fd2dd063700 1 --2- 172.21.15.37:0/3764701335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2d8156800 0x7fd2d80cbb20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fd2dd063700 1 -- 172.21.15.37:0/3764701335 >> 172.21.15.37:0/3764701335 conn(0x7fd2d80667b0 msgr2=0x7fd2d8066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fd2dd063700 1 -- 172.21.15.37:0/3764701335 shutdown_connections 2023-10-06T04:39:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fd2dd063700 1 -- 172.21.15.37:0/3764701335 wait complete. 2023-10-06T04:39:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4f276700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a480aa8d0 0x7f0a481472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4f276700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a480c79c0 0x7f0a480b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4f276700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a480cc1a0 0x7f0a480c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4f276700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a48147830 con 0x7f0a480c79c0 2023-10-06T04:39:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4f276700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a480afdb0 con 0x7f0a480cc1a0 2023-10-06T04:39:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4f276700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a480aef00 con 0x7f0a480aa8d0 2023-10-06T04:39:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f13df8d8700 1 Processor -- start 2023-10-06T04:39:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fb7dcaf5700 1 --2- 172.21.15.37:0/2103072593 >> v2:172.21.15.37:3300/0 conn(0x7fb7d80cc1a0 0x7fb7d80c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f13df8d8700 1 -- start start 2023-10-06T04:39:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee73d0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ee00cbf60 0x7f0ee0169750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fdc496c7700 1 -- 172.21.15.37:0/3143177874 shutdown_connections 2023-10-06T04:39:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4da73700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a480c79c0 0x7f0a480b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4da73700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a480c79c0 0x7f0a480b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36736/0 (socket says 172.21.15.37:36736) 2023-10-06T04:39:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4da73700 1 -- 172.21.15.37:0/2792487135 learned_addr learned my addr 172.21.15.37:0/2792487135 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4e274700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a480aa8d0 0x7f0a481472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee73d0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ee0140480 0x7f0ee01562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee73d0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ee0157330 0x7f0ee00c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee73d0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee013a1c0 con 0x7f0ee0140480 2023-10-06T04:39:32.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee73d0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0169c90 con 0x7f0ee00cbf60 2023-10-06T04:39:32.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee73d0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee016c790 con 0x7f0ee0157330 2023-10-06T04:39:32.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fdc496c7700 1 -- 172.21.15.37:0/3143177874 wait complete. 2023-10-06T04:39:32.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee496b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ee0140480 0x7f0ee01562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee516c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ee00cbf60 0x7f0ee0169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4da73700 1 -- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a480aa8d0 msgr2=0x7f0a481472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4da73700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a480aa8d0 0x7f0a481472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4da73700 1 -- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a480cc1a0 msgr2=0x7f0a480c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4da73700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a480cc1a0 0x7f0a480c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4da73700 1 -- 172.21.15.37:0/2792487135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a40009a20 con 0x7f0a480c79c0 2023-10-06T04:39:32.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4e274700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a480aa8d0 0x7f0a481472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:32.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee496b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ee0140480 0x7f0ee01562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36738/0 (socket says 172.21.15.37:36738) 2023-10-06T04:39:32.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee496b700 1 -- 172.21.15.37:0/3450238313 learned_addr learned my addr 172.21.15.37:0/3450238313 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fb7dcaf5700 1 -- 172.21.15.37:0/2103072593 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d80c9fc0 con 0x7fb7d80c77f0 2023-10-06T04:39:32.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee596d700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ee0157330 0x7f0ee00c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fd2dd063700 1 Processor -- start 2023-10-06T04:39:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fb311bcf700 1 Processor -- start 2023-10-06T04:39:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fb311bcf700 1 -- start start 2023-10-06T04:39:32.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fd2dd063700 1 -- start start 2023-10-06T04:39:32.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4da73700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a480c79c0 0x7f0a480b0ad0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0a400097c0 tx=0x7f0a40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a3a7fc700 1 -- 172.21.15.37:0/2792487135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40012da0 con 0x7f0a480c79c0 2023-10-06T04:39:32.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f13df8d8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13d806de10 0x7f13d806e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f13df8d8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13d80cb400 0x7f13d80c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f13df8d8700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d80caf70 con 0x7f13d80c9e50 2023-10-06T04:39:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f13df8d8700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d80ca360 con 0x7f13d80cb400 2023-10-06T04:39:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f13df8d8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80ca640 con 0x7f13d806de10 2023-10-06T04:39:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a3a7fc700 1 -- 172.21.15.37:0/2792487135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40027470 con 0x7f0a480c79c0 2023-10-06T04:39:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a3a7fc700 1 -- 172.21.15.37:0/2792487135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40027830 con 0x7f0a480c79c0 2023-10-06T04:39:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4f276700 1 -- 172.21.15.37:0/2792487135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a480af1a0 con 0x7f0a480c79c0 2023-10-06T04:39:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0a4f276700 1 -- 172.21.15.37:0/2792487135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a480af760 con 0x7f0a480c79c0 2023-10-06T04:39:32.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f13dd674700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13d806de10 0x7f13d806e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f13dd674700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13d806de10 0x7f13d806e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40532/0 (socket says 172.21.15.37:40532) 2023-10-06T04:39:32.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f13dd674700 1 -- 172.21.15.37:0/4132672119 learned_addr learned my addr 172.21.15.37:0/4132672119 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f13dce73700 1 --2- 172.21.15.37:0/4132672119 >> v2:172.21.15.37:3300/0 conn(0x7f13d80cb400 0x7f13d80c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2dd063700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2d80c9680 0x7fd2d81504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2dd063700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2d8156800 0x7fd2d816d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2dd063700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d8156bd0 0x7fd2d8154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2dd063700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8151e70 con 0x7fd2d8156bd0 2023-10-06T04:39:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2dd063700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8152150 con 0x7fd2d80c9680 2023-10-06T04:39:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2dd063700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8155590 con 0x7fd2d8156800 2023-10-06T04:39:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f13dd674700 1 -- 172.21.15.37:0/4132672119 >> v2:172.21.15.37:3300/0 conn(0x7f13d80cb400 msgr2=0x7f13d80c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f13dd674700 1 --2- 172.21.15.37:0/4132672119 >> v2:172.21.15.37:3300/0 conn(0x7f13d80cb400 0x7f13d80c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f13dd674700 1 -- 172.21.15.37:0/4132672119 >> v1:172.21.15.37:6789/0 conn(0x7f13d80c9e50 legacy=0x7f13d8156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f13dd674700 1 -- 172.21.15.37:0/4132672119 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d80ca920 con 0x7f13d806de10 2023-10-06T04:39:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7dcaf5700 1 --2- 172.21.15.37:0/2103072593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80c77f0 0x7fb7d8159600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8063720 tx=0x7fb7c8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6dc1c7efe380278 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee496b700 1 -- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ee0157330 msgr2=0x7f0ee00c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee496b700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ee0157330 0x7f0ee00c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee496b700 1 -- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ee00cbf60 msgr2=0x7f0ee0169750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee496b700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ee00cbf60 0x7f0ee0169750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee496b700 1 -- 172.21.15.37:0/3450238313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8009ae0 con 0x7f0ee0140480 2023-10-06T04:39:32.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee496b700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ee0140480 0x7f0ee01562b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c5b0 tx=0x7f0ed0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ed57fa700 1 -- 172.21.15.37:0/3450238313 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0011590 con 0x7f0ee0140480 2023-10-06T04:39:32.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee73d0700 1 -- 172.21.15.37:0/3450238313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee016ca70 con 0x7f0ee0140480 2023-10-06T04:39:32.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7f0ee73d0700 1 -- 172.21.15.37:0/3450238313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee016d030 con 0x7f0ee0140480 2023-10-06T04:39:32.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2d659c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2d8156800 0x7fd2d816d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2d659c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2d8156800 0x7fd2d816d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40542/0 (socket says 172.21.15.37:40542) 2023-10-06T04:39:32.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2d659c700 1 -- 172.21.15.37:0/3628251111 learned_addr learned my addr 172.21.15.37:0/3628251111 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f13dd674700 1 --2- 172.21.15.37:0/4132672119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13d806de10 0x7f13d806e1e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009f20 tx=0x7f13cc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4370f341cb222135 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7d6ffd700 1 -- 172.21.15.37:0/2103072593 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c800b640 con 0x7fb7d80c77f0 2023-10-06T04:39:32.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7d6ffd700 1 -- 172.21.15.37:0/2103072593 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c800b7a0 con 0x7fb7d80c77f0 2023-10-06T04:39:32.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7d6ffd700 1 -- 172.21.15.37:0/2103072593 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c800bb60 con 0x7fb7d80c77f0 2023-10-06T04:39:32.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.461+0000 7fdc496c7700 1 Processor -- start 2023-10-06T04:39:32.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc496c7700 1 -- start start 2023-10-06T04:39:32.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f13d7fff700 1 -- 172.21.15.37:0/4132672119 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00e070 con 0x7f13d806de10 2023-10-06T04:39:32.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2d6d9d700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2d80c9680 0x7fd2d81504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2d759e700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d8156bd0 0x7fd2d8154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f0ed57fa700 1 -- 172.21.15.37:0/3450238313 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed0011710 con 0x7f0ee0140480 2023-10-06T04:39:32.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f0ed57fa700 1 -- 172.21.15.37:0/3450238313 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0011ad0 con 0x7f0ee0140480 2023-10-06T04:39:32.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7d77fe700 1 --2- 172.21.15.37:0/2103072593 >> v2:172.21.15.37:3300/0 conn(0x7fb7d80cc1a0 0x7fb7d80c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:32.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb311bcf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb30c0acb00 0x7fb30c0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb311bcf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb30c0cbb80 0x7fb30c15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/2103072593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80c77f0 msgr2=0x7fb7d8159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7dd2f6700 1 --2- 172.21.15.37:0/2103072593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80c77f0 0x7fb7d8159600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8063720 tx=0x7fb7c8009250 comp rx=0 tx=0).stop 2023-10-06T04:39:32.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb311bcf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb30c158830 0x7fb30c1410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb311bcf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c15de10 con 0x7fb30c0acb00 2023-10-06T04:39:32.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb311bcf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c15ec50 con 0x7fb30c158830 2023-10-06T04:39:32.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb311bcf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c15e040 con 0x7fb30c0cbb80 2023-10-06T04:39:32.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc496c7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc440ca7b0 0x7fdc4414c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f0a4f276700 1 -- 172.21.15.37:0/2792487135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a300052b0 con 0x7f0a480c79c0 2023-10-06T04:39:32.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f8bbf840700 1 Processor -- start 2023-10-06T04:39:32.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb30bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb30c0cbb80 0x7fb30c15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2d6d9d700 1 -- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2d8156800 msgr2=0x7fd2d816d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2d6d9d700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2d8156800 0x7fd2d816d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2d6d9d700 1 -- 172.21.15.37:0/3628251111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d8156bd0 msgr2=0x7fd2d8154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2d6d9d700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d8156bd0 0x7fd2d8154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2d6d9d700 1 -- 172.21.15.37:0/3628251111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8009a20 con 0x7fd2d80c9680 2023-10-06T04:39:32.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f8bbf840700 1 -- start start 2023-10-06T04:39:32.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb3113ce700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb30c158830 0x7fb30c1410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb3113ce700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb30c158830 0x7fb30c1410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34838/0 (socket says 172.21.15.37:34838) 2023-10-06T04:39:32.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb3113ce700 1 -- 172.21.15.37:0/3290759695 learned_addr learned my addr 172.21.15.37:0/3290759695 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f0a3a7fc700 1 -- 172.21.15.37:0/2792487135 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0a40024070 con 0x7f0a480c79c0 2023-10-06T04:39:32.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2d6d9d700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2d80c9680 0x7fd2d81504e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8016000 tx=0x7fd2c8019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc496c7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc440cbfc0 0x7fdc441536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc496c7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc441512d0 0x7fdc44156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc496c7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4414d510 con 0x7fdc440ca7b0 2023-10-06T04:39:32.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc496c7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc44156e00 con 0x7fdc440cbfc0 2023-10-06T04:39:32.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc496c7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc440c2e90 con 0x7fdc441512d0 2023-10-06T04:39:32.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f0a3a7fc700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0a2c0606a0 0x7f0a2c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f0a3a7fc700 1 -- 172.21.15.37:0/2792487135 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0a4007f2c0 con 0x7f0a480c79c0 2023-10-06T04:39:32.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2beffd700 1 -- 172.21.15.37:0/3628251111 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8012d00 con 0x7fd2d80c9680 2023-10-06T04:39:32.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2dd063700 1 -- 172.21.15.37:0/3628251111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d8155870 con 0x7fd2d80c9680 2023-10-06T04:39:32.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fd2dd063700 1 -- 172.21.15.37:0/3628251111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d8150a20 con 0x7fd2d80c9680 2023-10-06T04:39:32.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc427fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc440cbfc0 0x7fdc441536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc427fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc440cbfc0 0x7fdc441536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34848/0 (socket says 172.21.15.37:34848) 2023-10-06T04:39:32.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc427fc700 1 -- 172.21.15.37:0/1479313254 learned_addr learned my addr 172.21.15.37:0/1479313254 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f0a4e274700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0a2c0606a0 0x7f0a2c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/2103072593 shutdown_connections 2023-10-06T04:39:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7dd2f6700 1 --2- 172.21.15.37:0/2103072593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80c77f0 0x7fb7d8159600 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7dd2f6700 1 --2- 172.21.15.37:0/2103072593 >> v2:172.21.15.37:3300/0 conn(0x7fb7d80cc1a0 0x7fb7d80c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7dd2f6700 1 --2- 172.21.15.37:0/2103072593 >> v2:172.21.15.83:3300/0 conn(0x7fb7d80aa8d0 0x7fb7d80c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/2103072593 >> 172.21.15.37:0/2103072593 conn(0x7fb7d8068780 msgr2=0x7fb7d80cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/2103072593 shutdown_connections 2023-10-06T04:39:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb30bfff700 1 -- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb30c158830 msgr2=0x7fb30c1410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb30bfff700 1 --2- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb30c158830 0x7fb30c1410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb30bfff700 1 -- 172.21.15.37:0/3290759695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb30c0acb00 msgr2=0x7fb30c0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb30bfff700 1 --2- 172.21.15.37:0/3290759695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb30c0acb00 0x7fb30c0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb30bfff700 1 -- 172.21.15.37:0/3290759695 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc0094f0 con 0x7fb30c0cbb80 2023-10-06T04:39:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc427fc700 1 -- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc441512d0 msgr2=0x7fdc44156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc427fc700 1 --2- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc441512d0 0x7fdc44156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc427fc700 1 -- 172.21.15.37:0/1479313254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc440ca7b0 msgr2=0x7fdc4414c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc427fc700 1 --2- 172.21.15.37:0/1479313254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc440ca7b0 0x7fdc4414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc427fc700 1 -- 172.21.15.37:0/1479313254 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c014600 con 0x7fdc440cbfc0 2023-10-06T04:39:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fdc427fc700 1 --2- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc440cbfc0 0x7fdc441536b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400b5e0 tx=0x7fdc340090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f8bbf840700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bb80ad860 0x7f8bb814bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f8bbf840700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8bb806e0a0 0x7f8bb8159220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb30bfff700 1 --2- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb30c0cbb80 0x7fb30c15d8d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb30400bb00 tx=0x7fb304009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f8bbf840700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb80ca090 con 0x7f8bb8156060 2023-10-06T04:39:32.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f8bbf840700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb8156430 con 0x7f8bb80ad860 2023-10-06T04:39:32.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f8bbf840700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb8155bd0 con 0x7f8bb806e0a0 2023-10-06T04:39:32.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7f0ee73d0700 1 -- 172.21.15.37:0/3450238313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec00052b0 con 0x7f0ee0140480 2023-10-06T04:39:32.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fdc2affd700 1 -- 172.21.15.37:0/1479313254 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3400f510 con 0x7fdc440cbfc0 2023-10-06T04:39:32.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f0a4e274700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0a2c0606a0 0x7f0a2c062b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0a44001820 tx=0x7f0a44009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fd2beffd700 1 -- 172.21.15.37:0/3628251111 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c8012e60 con 0x7fd2d80c9680 2023-10-06T04:39:32.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fd2beffd700 1 -- 172.21.15.37:0/3628251111 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80276c0 con 0x7fd2d80c9680 2023-10-06T04:39:32.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f8bbcddb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bb80ad860 0x7f8bb814bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f8bbcddb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bb80ad860 0x7f8bb814bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36780/0 (socket says 172.21.15.37:36780) 2023-10-06T04:39:32.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f8bbcddb700 1 -- 172.21.15.37:0/1241980757 learned_addr learned my addr 172.21.15.37:0/1241980757 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f0ed57fa700 1 -- 172.21.15.37:0/3450238313 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0ed001b3b0 con 0x7f0ee0140480 2023-10-06T04:39:32.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fd2dd063700 1 -- 172.21.15.37:0/3628251111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d8070ee0 con 0x7fd2d80c9680 2023-10-06T04:39:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f8bbdddd700 1 --2- 172.21.15.37:0/1241980757 >> v2:172.21.15.83:3300/0 conn(0x7f8bb806e0a0 0x7f8bb8159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb308ff9700 1 -- 172.21.15.37:0/3290759695 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30400c840 con 0x7fb30c0cbb80 2023-10-06T04:39:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb311bcf700 1 -- 172.21.15.37:0/3290759695 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c15e320 con 0x7fb30c0cbb80 2023-10-06T04:39:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb311bcf700 1 -- 172.21.15.37:0/3290759695 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c15e8e0 con 0x7fb30c0cbb80 2023-10-06T04:39:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f0ed57fa700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0ec4068eb0 0x7f0ec406b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.465+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/2103072593 wait complete. 2023-10-06T04:39:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dd2f6700 1 Processor -- start 2023-10-06T04:39:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f0ed57fa700 1 -- 172.21.15.37:0/3450238313 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0ed007c070 con 0x7f0ee0140480 2023-10-06T04:39:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f8bbcddb700 1 -- 172.21.15.37:0/1241980757 >> v2:172.21.15.83:3300/0 conn(0x7f8bb806e0a0 msgr2=0x7f8bb8159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f8bbcddb700 1 --2- 172.21.15.37:0/1241980757 >> v2:172.21.15.83:3300/0 conn(0x7f8bb806e0a0 0x7f8bb8159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f8bbcddb700 1 -- 172.21.15.37:0/1241980757 >> v1:172.21.15.37:6789/0 conn(0x7f8bb8156060 legacy=0x7f8bb8158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f8bbcddb700 1 -- 172.21.15.37:0/1241980757 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80adce0 con 0x7f8bb80ad860 2023-10-06T04:39:32.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f0ee516c700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0ec4068eb0 0x7f0ec406b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fdc2affd700 1 -- 172.21.15.37:0/1479313254 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3400f690 con 0x7fdc440cbfc0 2023-10-06T04:39:32.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fdc2affd700 1 -- 172.21.15.37:0/1479313254 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3400fa50 con 0x7fdc440cbfc0 2023-10-06T04:39:32.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb308ff9700 1 -- 172.21.15.37:0/3290759695 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30400c9e0 con 0x7fb30c0cbb80 2023-10-06T04:39:32.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb308ff9700 1 -- 172.21.15.37:0/3290759695 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30400cda0 con 0x7fb30c0cbb80 2023-10-06T04:39:32.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f8bbcddb700 1 --2- 172.21.15.37:0/1241980757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb80ad860 0x7f8bb814bfd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8bb806d760 tx=0x7f8bb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbdef710a711b21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb311bcf700 1 -- 172.21.15.37:0/3290759695 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c04be00 con 0x7fb30c0cbb80 2023-10-06T04:39:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fd2beffd700 1 -- 172.21.15.37:0/3628251111 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd2c8024070 con 0x7fd2d80c9680 2023-10-06T04:39:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f13d7fff700 1 -- 172.21.15.37:0/4132672119 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc00ba40 con 0x7f13d806de10 2023-10-06T04:39:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f13d7fff700 1 -- 172.21.15.37:0/4132672119 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc0092e0 con 0x7f13d806de10 2023-10-06T04:39:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dd2f6700 1 -- start start 2023-10-06T04:39:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dd2f6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7d80aa8d0 0x7fb7d80b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dd2f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7d80c77f0 0x7fb7d8154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dd2f6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80cc1a0 0x7fb7d81554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dd2f6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80a5f30 con 0x7fb7d80c77f0 2023-10-06T04:39:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dd2f6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80c4af0 con 0x7fb7d80aa8d0 2023-10-06T04:39:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dd2f6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80a61f0 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fdc496c7700 1 -- 172.21.15.37:0/1479313254 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc440c3170 con 0x7fdc440cbfc0 2023-10-06T04:39:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fdc496c7700 1 -- 172.21.15.37:0/1479313254 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4414d1a0 con 0x7fdc440cbfc0 2023-10-06T04:39:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dcaf5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80cc1a0 0x7fb7d81554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dcaf5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80cc1a0 0x7fb7d81554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40574/0 (socket says 172.21.15.37:40574) 2023-10-06T04:39:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dcaf5700 1 -- 172.21.15.37:0/3694716993 learned_addr learned my addr 172.21.15.37:0/3694716993 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f0ee516c700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0ec4068eb0 0x7f0ec406b360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009ab0 tx=0x7f0ed8018000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb308ff9700 1 -- 172.21.15.37:0/3290759695 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb304006d50 con 0x7fb30c0cbb80 2023-10-06T04:39:32.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7d77fe700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7d80c77f0 0x7fb7d8154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dcaf5700 1 -- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7d80aa8d0 msgr2=0x7fb7d80b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dcaf5700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7d80aa8d0 0x7fb7d80b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dcaf5700 1 -- 172.21.15.37:0/3694716993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7d80c77f0 msgr2=0x7fb7d8154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dcaf5700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7d80c77f0 0x7fb7d8154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dcaf5700 1 -- 172.21.15.37:0/3694716993 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d0009a20 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb7dcaf5700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80cc1a0 0x7fb7d81554d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80094c0 tx=0x7fb7c8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb308ff9700 1 --2- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb2f8060550 0x7fb2f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f13df8d8700 1 -- 172.21.15.37:0/4132672119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13d806de10 msgr2=0x7f13d806e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f13df8d8700 1 --2- 172.21.15.37:0/4132672119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13d806de10 0x7f13d806e1e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009f20 tx=0x7f13cc009840 comp rx=0 tx=0).stop 2023-10-06T04:39:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fd2beffd700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2c4060580 0x7fd2c4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fd2beffd700 1 -- 172.21.15.37:0/3628251111 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd2c807f620 con 0x7fd2d80c9680 2023-10-06T04:39:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fb308ff9700 1 -- 172.21.15.37:0/3290759695 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb30407d1f0 con 0x7fb30c0cbb80 2023-10-06T04:39:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7fdc496c7700 1 -- 172.21.15.37:0/1479313254 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc440c0e10 con 0x7fdc440cbfc0 2023-10-06T04:39:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f13df8d8700 1 -- 172.21.15.37:0/4132672119 shutdown_connections 2023-10-06T04:39:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f13df8d8700 1 --2- 172.21.15.37:0/4132672119 >> v2:172.21.15.37:3300/0 conn(0x7f13d80cb400 0x7f13d80c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f13df8d8700 1 --2- 172.21.15.37:0/4132672119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13d806de10 0x7f13d806e1e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f13df8d8700 1 -- 172.21.15.37:0/4132672119 >> 172.21.15.37:0/4132672119 conn(0x7f13d80cbd40 msgr2=0x7f13d80cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7fb310bcd700 1 --2- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb2f8060550 0x7fb2f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.469+0000 7f13df8d8700 1 -- 172.21.15.37:0/4132672119 shutdown_connections 2023-10-06T04:39:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13df8d8700 1 -- 172.21.15.37:0/4132672119 wait complete. 2023-10-06T04:39:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7fd2d659c700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2c4060580 0x7fd2c4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7fd2d659c700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2c4060580 0x7fd2c4062a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0078a0 tx=0x7fd2cc007830 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7fb310bcd700 1 --2- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb2f8060550 0x7fb2f8062a00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0cc780 tx=0x7fb2fc016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13df8d8700 1 Processor -- start 2023-10-06T04:39:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13df8d8700 1 -- start start 2023-10-06T04:39:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f0a3a7fc700 1 -- 172.21.15.37:0/2792487135 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0a4004f480 con 0x7f0a480c79c0 2023-10-06T04:39:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13df8d8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13d806de10 0x7f13d8152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13df8d8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13d80c9e50 0x7f13d8155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13df8d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13d80cb400 0x7f13d8155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13df8d8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80c5700 con 0x7f13d80cb400 2023-10-06T04:39:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13df8d8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80c59e0 con 0x7f13d806de10 2023-10-06T04:39:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13df8d8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80c5cc0 con 0x7f13d80c9e50 2023-10-06T04:39:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13dde75700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13d80cb400 0x7f13d8155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13dde75700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13d80cb400 0x7f13d8155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36792/0 (socket says 172.21.15.37:36792) 2023-10-06T04:39:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13dde75700 1 -- 172.21.15.37:0/3633042309 learned_addr learned my addr 172.21.15.37:0/3633042309 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13dd674700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13d806de10 0x7f13d8152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13dce73700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13d80c9e50 0x7f13d8155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13dde75700 1 -- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13d80c9e50 msgr2=0x7f13d8155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13dde75700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13d80c9e50 0x7f13d8155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13dde75700 1 -- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13d806de10 msgr2=0x7f13d8152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13dde75700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13d806de10 0x7f13d8152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13dde75700 1 -- 172.21.15.37:0/3633042309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc009ae0 con 0x7f13d80cb400 2023-10-06T04:39:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.473+0000 7f13dde75700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13d80cb400 0x7f13d8155940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c5e0 tx=0x7f13d0007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.477+0000 7f8baffff700 1 -- 172.21.15.37:0/1241980757 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4009e70 con 0x7f8bb80ad860 2023-10-06T04:39:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.477+0000 7f13d57fa700 1 -- 172.21.15.37:0/3633042309 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0011590 con 0x7f13d80cb400 2023-10-06T04:39:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.477+0000 7f8baffff700 1 -- 172.21.15.37:0/1241980757 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb400b860 con 0x7f8bb80ad860 2023-10-06T04:39:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.477+0000 7f8baffff700 1 -- 172.21.15.37:0/1241980757 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb400bc00 con 0x7f8bb80ad860 2023-10-06T04:39:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.477+0000 7f13d57fa700 1 -- 172.21.15.37:0/3633042309 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d00116f0 con 0x7f13d80cb400 2023-10-06T04:39:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.477+0000 7f13d57fa700 1 -- 172.21.15.37:0/3633042309 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0011ab0 con 0x7f13d80cb400 2023-10-06T04:39:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.477+0000 7f13df8d8700 1 -- 172.21.15.37:0/3633042309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d80c5fa0 con 0x7f13d80cb400 2023-10-06T04:39:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.477+0000 7f0ed57fa700 1 -- 172.21.15.37:0/3450238313 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0ed004c1f0 con 0x7f0ee0140480 2023-10-06T04:39:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.477+0000 7f13df8d8700 1 -- 172.21.15.37:0/3633042309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d8152ac0 con 0x7f13d80cb400 2023-10-06T04:39:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.477+0000 7f8bbf840700 1 -- 172.21.15.37:0/1241980757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb80ad860 msgr2=0x7f8bb814bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.477+0000 7f8bbf840700 1 --2- 172.21.15.37:0/1241980757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb80ad860 0x7f8bb814bfd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8bb806d760 tx=0x7f8bb4009250 comp rx=0 tx=0).stop 2023-10-06T04:39:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.477+0000 7f13df8d8700 1 -- 172.21.15.37:0/3633042309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d81595b0 con 0x7f13d80cb400 2023-10-06T04:39:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 -- 172.21.15.37:0/1241980757 shutdown_connections 2023-10-06T04:39:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 --2- 172.21.15.37:0/1241980757 >> v2:172.21.15.83:3300/0 conn(0x7f8bb806e0a0 0x7f8bb8159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 --2- 172.21.15.37:0/1241980757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb80ad860 0x7f8bb814bfd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 -- 172.21.15.37:0/1241980757 >> 172.21.15.37:0/1241980757 conn(0x7f8bb80667b0 msgr2=0x7f8bb8066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 -- 172.21.15.37:0/1241980757 shutdown_connections 2023-10-06T04:39:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 -- 172.21.15.37:0/1241980757 wait complete. 2023-10-06T04:39:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f13d57fa700 1 -- 172.21.15.37:0/3633042309 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f13d001b3b0 con 0x7f13d80cb400 2023-10-06T04:39:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f13d57fa700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f13c8060670 0x7f13c8062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f13d57fa700 1 -- 172.21.15.37:0/3633042309 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f13d007c100 con 0x7f13d80cb400 2023-10-06T04:39:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 Processor -- start 2023-10-06T04:39:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 -- start start 2023-10-06T04:39:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bb806e0a0 0x7f8bb81466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bb80ad860 0x7f8bb813f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8156060 0x7f8bb81696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8140ba0 con 0x7f8bb8156060 2023-10-06T04:39:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb813fb00 con 0x7f8bb80ad860 2023-10-06T04:39:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbf840700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb813fde0 con 0x7f8bb806e0a0 2023-10-06T04:39:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbdddd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8156060 0x7f8bb81696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbdddd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8156060 0x7f8bb81696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36796/0 (socket says 172.21.15.37:36796) 2023-10-06T04:39:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbdddd700 1 -- 172.21.15.37:0/3787686596 learned_addr learned my addr 172.21.15.37:0/3787686596 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbcddb700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bb80ad860 0x7f8bb813f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbd5dc700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bb806e0a0 0x7f8bb81466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbdddd700 1 -- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bb806e0a0 msgr2=0x7f8bb81466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbdddd700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bb806e0a0 0x7f8bb81466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbdddd700 1 -- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bb80ad860 msgr2=0x7f8bb813f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbdddd700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bb80ad860 0x7f8bb813f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbdddd700 1 -- 172.21.15.37:0/3787686596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb40094f0 con 0x7f8bb8156060 2023-10-06T04:39:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbd5dc700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bb806e0a0 0x7f8bb81466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7f8bbdddd700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8156060 0x7f8bb81696c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800ea50 tx=0x7f8ba80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7fd2beffd700 1 -- 172.21.15.37:0/3628251111 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd2c804f720 con 0x7fd2d80c9680 2023-10-06T04:39:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7fb7bffff700 1 -- 172.21.15.37:0/3694716993 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c8011420 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7fb7bffff700 1 -- 172.21.15.37:0/3694716993 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c80115a0 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7fb7bffff700 1 -- 172.21.15.37:0/3694716993 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c8011960 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/3694716993 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c80094f0 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/3694716993 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d80c4530 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7fb7bffff700 1 -- 172.21.15.37:0/3694716993 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb7c8011cd0 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7fdc2affd700 1 -- 172.21.15.37:0/1479313254 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdc34024430 con 0x7fdc440cbfc0 2023-10-06T04:39:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7fdc2affd700 1 --2- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdc30060550 0x7fdc30062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7fdc2affd700 1 -- 172.21.15.37:0/1479313254 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdc3407cfe0 con 0x7fdc440cbfc0 2023-10-06T04:39:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7fdc42ffd700 1 --2- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdc30060550 0x7fdc30062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7f8bad7fa700 1 -- 172.21.15.37:0/3787686596 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba80096b0 con 0x7f8bb8156060 2023-10-06T04:39:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7f13dd674700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f13c8060670 0x7f13c8062b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7f8bad7fa700 1 -- 172.21.15.37:0/3787686596 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba800c850 con 0x7f8bb8156060 2023-10-06T04:39:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7fb7bffff700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7c4060620 0x7fb7c4062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7f8bbf840700 1 -- 172.21.15.37:0/3787686596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb81400c0 con 0x7f8bb8156060 2023-10-06T04:39:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7f8bad7fa700 1 -- 172.21.15.37:0/3787686596 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba800cc10 con 0x7f8bb8156060 2023-10-06T04:39:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7f8bbf840700 1 -- 172.21.15.37:0/3787686596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb8140680 con 0x7f8bb8156060 2023-10-06T04:39:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/3694716993 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d80708a0 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7fb7d7fff700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7c4060620 0x7fb7c4062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7fdc42ffd700 1 --2- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdc30060550 0x7fdc30062a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdc44159f60 tx=0x7fdc3c01e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.485+0000 7fb7bffff700 1 -- 172.21.15.37:0/3694716993 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb7c807e640 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.489+0000 7f13dd674700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f13c8060670 0x7f13c8062b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009880 tx=0x7f13cc017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.481+0000 7fb308ff9700 1 -- 172.21.15.37:0/3290759695 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb30404d390 con 0x7fb30c0cbb80 2023-10-06T04:39:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.489+0000 7f8bbf840700 1 -- 172.21.15.37:0/3787686596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b980052b0 con 0x7f8bb8156060 2023-10-06T04:39:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.489+0000 7f13d57fa700 1 -- 172.21.15.37:0/3633042309 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f13d004c2a0 con 0x7f13d80cb400 2023-10-06T04:39:32.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.489+0000 7fb7d7fff700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7c4060620 0x7fb7c4062ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009b10 tx=0x7fb7cc0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.489+0000 7fdc2affd700 1 -- 172.21.15.37:0/1479313254 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdc3404d2e0 con 0x7fdc440cbfc0 2023-10-06T04:39:32.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.497+0000 7fb7bffff700 1 -- 172.21.15.37:0/3694716993 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb7c80523d0 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.489+0000 7f8bad7fa700 1 -- 172.21.15.37:0/3787686596 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8ba8013470 con 0x7f8bb8156060 2023-10-06T04:39:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.497+0000 7f8bad7fa700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8b9c060580 0x7f8b9c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.497+0000 7f8bad7fa700 1 -- 172.21.15.37:0/3787686596 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8ba807cd90 con 0x7f8bb8156060 2023-10-06T04:39:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.497+0000 7f8bbd5dc700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8b9c060580 0x7f8b9c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.497+0000 7f8bbd5dc700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8b9c060580 0x7f8b9c062a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0007fd0 tx=0x7f8bb0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.505+0000 7f8bad7fa700 1 -- 172.21.15.37:0/3787686596 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8ba804cf30 con 0x7f8bb8156060 2023-10-06T04:39:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.789+0000 7f0a4f276700 1 -- 172.21.15.37:0/2792487135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0a30005560 con 0x7f0a480c79c0 2023-10-06T04:39:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.789+0000 7f0a3a7fc700 1 -- 172.21.15.37:0/2792487135 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a40052aa0 con 0x7f0a480c79c0 2023-10-06T04:39:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:64424509448 2023-10-06T04:39:32.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7f0a2bfff700 1 -- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0a2c0606a0 msgr2=0x7f0a2c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7f0a2bfff700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0a2c0606a0 0x7f0a2c062b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0a44001820 tx=0x7f0a44009040 comp rx=0 tx=0).stop 2023-10-06T04:39:32.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7f0a2bfff700 1 -- 172.21.15.37:0/2792487135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a480c79c0 msgr2=0x7f0a480b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7f0a2bfff700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a480c79c0 0x7f0a480b0ad0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0a400097c0 tx=0x7f0a40019000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7f0a2bfff700 1 -- 172.21.15.37:0/2792487135 shutdown_connections 2023-10-06T04:39:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7f0a2bfff700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0a2c0606a0 0x7f0a2c062b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7f0a2bfff700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a480cc1a0 0x7f0a480c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7f0a2bfff700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a480c79c0 0x7f0a480b0ad0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7f0a2bfff700 1 --2- 172.21.15.37:0/2792487135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a480aa8d0 0x7f0a481472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7f0a2bfff700 1 -- 172.21.15.37:0/2792487135 >> 172.21.15.37:0/2792487135 conn(0x7f0a48068780 msgr2=0x7f0a48154ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7f0a2bfff700 1 -- 172.21.15.37:0/2792487135 shutdown_connections 2023-10-06T04:39:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7f0a2bfff700 1 -- 172.21.15.37:0/2792487135 wait complete. 2023-10-06T04:39:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.797+0000 7fb311bcf700 1 -- 172.21.15.37:0/3290759695 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb30c15ed90 con 0x7fb30c0cbb80 2023-10-06T04:39:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.801+0000 7fb308ff9700 1 -- 172.21.15.37:0/3290759695 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb304022090 con 0x7fb30c0cbb80 2023-10-06T04:39:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:64424509450 2023-10-06T04:39:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.801+0000 7fb2f27fc700 1 -- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb2f8060550 msgr2=0x7fb2f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.801+0000 7fb2f27fc700 1 --2- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb2f8060550 0x7fb2f8062a00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0cc780 tx=0x7fb2fc016000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.801+0000 7f0ee73d0700 1 -- 172.21.15.37:0/3450238313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ec0005560 con 0x7f0ee0140480 2023-10-06T04:39:32.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.801+0000 7fb2f27fc700 1 -- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb30c0cbb80 msgr2=0x7fb30c15d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.801+0000 7fb2f27fc700 1 --2- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb30c0cbb80 0x7fb30c15d8d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb30400bb00 tx=0x7fb304009780 comp rx=0 tx=0).stop 2023-10-06T04:39:32.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.801+0000 7fb2f27fc700 1 -- 172.21.15.37:0/3290759695 shutdown_connections 2023-10-06T04:39:32.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.805+0000 7fb2f27fc700 1 --2- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb2f8060550 0x7fb2f8062a00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.805+0000 7fb2f27fc700 1 --2- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb30c158830 0x7fb30c1410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.805+0000 7fb2f27fc700 1 --2- 172.21.15.37:0/3290759695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb30c0cbb80 0x7fb30c15d8d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.805+0000 7fb2f27fc700 1 --2- 172.21.15.37:0/3290759695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb30c0acb00 0x7fb30c0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.805+0000 7fb2f27fc700 1 -- 172.21.15.37:0/3290759695 >> 172.21.15.37:0/3290759695 conn(0x7fb30c0cb780 msgr2=0x7fb30c0ac3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.805+0000 7f0ed57fa700 1 -- 172.21.15.37:0/3450238313 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ed004f810 con 0x7f0ee0140480 2023-10-06T04:39:32.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.805+0000 7fb2f27fc700 1 -- 172.21.15.37:0/3290759695 shutdown_connections 2023-10-06T04:39:32.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.805+0000 7fb2f27fc700 1 -- 172.21.15.37:0/3290759695 wait complete. 2023-10-06T04:39:32.812 INFO:teuthology.orchestra.run.smithi037.stdout:60129542152 2023-10-06T04:39:32.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7fd2dd063700 1 -- 172.21.15.37:0/3628251111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd2d80c9460 con 0x7fd2d80c9680 2023-10-06T04:39:32.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7f13df8d8700 1 -- 172.21.15.37:0/3633042309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f13d8070ee0 con 0x7f13d80cb400 2023-10-06T04:39:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7fdc496c7700 1 -- 172.21.15.37:0/1479313254 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdc440c0e10 con 0x7fdc440cbfc0 2023-10-06T04:39:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7f0ecaffd700 1 -- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0ec4068eb0 msgr2=0x7f0ec406b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7f0ecaffd700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0ec4068eb0 0x7f0ec406b360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009ab0 tx=0x7f0ed8018000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7f0ecaffd700 1 -- 172.21.15.37:0/3450238313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ee0140480 msgr2=0x7f0ee01562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7f0ecaffd700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ee0140480 0x7f0ee01562b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c5b0 tx=0x7f0ed0007f60 comp rx=0 tx=0).stop 2023-10-06T04:39:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7fd2beffd700 1 -- 172.21.15.37:0/3628251111 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd2c8052d40 con 0x7fd2d80c9680 2023-10-06T04:39:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7f0ecaffd700 1 -- 172.21.15.37:0/3450238313 shutdown_connections 2023-10-06T04:39:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7f0ecaffd700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0ec4068eb0 0x7f0ec406b360 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7f0ecaffd700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ee0157330 0x7f0ee00c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7f0ecaffd700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ee0140480 0x7f0ee01562b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7f0ecaffd700 1 --2- 172.21.15.37:0/3450238313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ee00cbf60 0x7f0ee0169750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.809+0000 7f0ecaffd700 1 -- 172.21.15.37:0/3450238313 >> 172.21.15.37:0/3450238313 conn(0x7f0ee00667b0 msgr2=0x7f0ee0068560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:60129542151 2023-10-06T04:39:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7f0ecaffd700 1 -- 172.21.15.37:0/3450238313 shutdown_connections 2023-10-06T04:39:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7f0ecaffd700 1 -- 172.21.15.37:0/3450238313 wait complete. 2023-10-06T04:39:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7f13d57fa700 1 -- 172.21.15.37:0/3633042309 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13d0017020 con 0x7f13d80cb400 2023-10-06T04:39:32.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2023-10-06T04:39:32.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc2affd700 1 -- 172.21.15.37:0/1479313254 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdc440c0e10 con 0x7fdc440cbfc0 2023-10-06T04:39:32.823 INFO:teuthology.orchestra.run.smithi037.stdout:60129542152 2023-10-06T04:39:32.824 INFO:teuthology.orchestra.run.smithi037.stdout:60129542151 2023-10-06T04:39:32.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/3694716993 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb7d80a6330 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc496c7700 1 -- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdc30060550 msgr2=0x7fdc30062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc496c7700 1 --2- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdc30060550 0x7fdc30062a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdc44159f60 tx=0x7fdc3c01e000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc496c7700 1 -- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc440cbfc0 msgr2=0x7fdc441536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc496c7700 1 --2- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc440cbfc0 0x7fdc441536b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400b5e0 tx=0x7fdc340090f0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc496c7700 1 -- 172.21.15.37:0/1479313254 shutdown_connections 2023-10-06T04:39:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc496c7700 1 --2- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdc30060550 0x7fdc30062a00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc496c7700 1 --2- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc440cbfc0 0x7fdc441536b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc496c7700 1 --2- 172.21.15.37:0/1479313254 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc441512d0 0x7fdc44156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc496c7700 1 --2- 172.21.15.37:0/1479313254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc440ca7b0 0x7fdc4414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc496c7700 1 -- 172.21.15.37:0/1479313254 >> 172.21.15.37:0/1479313254 conn(0x7fdc440667b0 msgr2=0x7fdc44150450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc496c7700 1 -- 172.21.15.37:0/1479313254 shutdown_connections 2023-10-06T04:39:32.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fdc496c7700 1 -- 172.21.15.37:0/1479313254 wait complete. 2023-10-06T04:39:32.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.813+0000 7fb7bffff700 1 -- 172.21.15.37:0/3694716993 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb7c806b070 con 0x7fb7d80cc1a0 2023-10-06T04:39:32.829 INFO:teuthology.orchestra.run.smithi037.stdout:60129542152 2023-10-06T04:39:32.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7f13df8d8700 1 -- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f13c8060670 msgr2=0x7f13c8062b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7f13df8d8700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f13c8060670 0x7f13c8062b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009880 tx=0x7f13cc017000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7f13df8d8700 1 -- 172.21.15.37:0/3633042309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13d80cb400 msgr2=0x7f13d8155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7f13df8d8700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13d80cb400 0x7f13d8155940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c5e0 tx=0x7f13d0007ed0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7f13df8d8700 1 -- 172.21.15.37:0/3633042309 shutdown_connections 2023-10-06T04:39:32.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7f13df8d8700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f13c8060670 0x7f13c8062b20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7f13df8d8700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13d80cb400 0x7f13d8155940 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7f13df8d8700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13d80c9e50 0x7f13d8155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7f13df8d8700 1 --2- 172.21.15.37:0/3633042309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13d806de10 0x7f13d8152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7f13df8d8700 1 -- 172.21.15.37:0/3633042309 >> 172.21.15.37:0/3633042309 conn(0x7f13d80cbd40 msgr2=0x7f13d80c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7f13df8d8700 1 -- 172.21.15.37:0/3633042309 shutdown_connections 2023-10-06T04:39:32.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7f13df8d8700 1 -- 172.21.15.37:0/3633042309 wait complete. 2023-10-06T04:39:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7c4060620 msgr2=0x7fb7c4062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7fb7dd2f6700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7c4060620 0x7fb7c4062ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009b10 tx=0x7fb7cc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80cc1a0 msgr2=0x7fb7d81554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7fb7dd2f6700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80cc1a0 0x7fb7d81554d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80094c0 tx=0x7fb7c8017000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/3694716993 shutdown_connections 2023-10-06T04:39:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7fb7dd2f6700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7c4060620 0x7fb7c4062ad0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7fb7dd2f6700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7d80cc1a0 0x7fb7d81554d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7fb7dd2f6700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7d80c77f0 0x7fb7d8154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7fb7dd2f6700 1 --2- 172.21.15.37:0/3694716993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7d80aa8d0 0x7fb7d80b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.817+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/3694716993 >> 172.21.15.37:0/3694716993 conn(0x7fb7d8068780 msgr2=0x7fb7d806d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/3694716993 shutdown_connections 2023-10-06T04:39:32.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fb7dd2f6700 1 -- 172.21.15.37:0/3694716993 wait complete. 2023-10-06T04:39:32.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2023-10-06T04:39:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fd2dd063700 1 -- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2c4060580 msgr2=0x7fd2c4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fd2dd063700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2c4060580 0x7fd2c4062a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0078a0 tx=0x7fd2cc007830 comp rx=0 tx=0).stop 2023-10-06T04:39:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fd2dd063700 1 -- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2d80c9680 msgr2=0x7fd2d81504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fd2dd063700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2d80c9680 0x7fd2d81504e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8016000 tx=0x7fd2c8019000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fd2dd063700 1 -- 172.21.15.37:0/3628251111 shutdown_connections 2023-10-06T04:39:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fd2dd063700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2c4060580 0x7fd2c4062a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fd2dd063700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d8156bd0 0x7fd2d8154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fd2dd063700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2d8156800 0x7fd2d816d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fd2dd063700 1 --2- 172.21.15.37:0/3628251111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2d80c9680 0x7fd2d81504e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fd2dd063700 1 -- 172.21.15.37:0/3628251111 >> 172.21.15.37:0/3628251111 conn(0x7fd2d80667b0 msgr2=0x7fd2d80c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fd2dd063700 1 -- 172.21.15.37:0/3628251111 shutdown_connections 2023-10-06T04:39:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7fd2dd063700 1 -- 172.21.15.37:0/3628251111 wait complete. 2023-10-06T04:39:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7f8bbf840700 1 -- 172.21.15.37:0/3787686596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8b98005830 con 0x7f8bb8156060 2023-10-06T04:39:32.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.821+0000 7f8bad7fa700 1 -- 172.21.15.37:0/3787686596 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ba8050550 con 0x7f8bb8156060 2023-10-06T04:39:32.837 INFO:teuthology.orchestra.run.smithi037.stdout:60129542151 2023-10-06T04:39:32.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.825+0000 7f8bbf840700 1 -- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8b9c060580 msgr2=0x7f8b9c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.825+0000 7f8bbf840700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8b9c060580 0x7f8b9c062a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0007fd0 tx=0x7f8bb0009040 comp rx=0 tx=0).stop 2023-10-06T04:39:32.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.825+0000 7f8bbf840700 1 -- 172.21.15.37:0/3787686596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8156060 msgr2=0x7f8bb81696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.825+0000 7f8bbf840700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8156060 0x7f8bb81696c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800ea50 tx=0x7f8ba80091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.825+0000 7f8bbf840700 1 -- 172.21.15.37:0/3787686596 shutdown_connections 2023-10-06T04:39:32.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.825+0000 7f8bbf840700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8b9c060580 0x7f8b9c062a30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.825+0000 7f8bbf840700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bb80ad860 0x7f8bb813f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.825+0000 7f8bbf840700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8156060 0x7f8bb81696c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.825+0000 7f8bbf840700 1 --2- 172.21.15.37:0/3787686596 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bb806e0a0 0x7f8bb81466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.825+0000 7f8bbf840700 1 -- 172.21.15.37:0/3787686596 >> 172.21.15.37:0/3787686596 conn(0x7f8bb80667b0 msgr2=0x7f8bb8156640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.825+0000 7f8bbf840700 1 -- 172.21.15.37:0/3787686596 shutdown_connections 2023-10-06T04:39:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:32.825+0000 7f8bbf840700 1 -- 172.21.15.37:0/3787686596 wait complete. 2023-10-06T04:39:32.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.2 2023-10-06T04:39:32.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.1 2023-10-06T04:39:32.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.6 2023-10-06T04:39:32.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.7 2023-10-06T04:39:32.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.5 2023-10-06T04:39:32.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.4 2023-10-06T04:39:33.824 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:39:33.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T04:39:33.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T04:39:33.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T04:39:33.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T04:39:33.844 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:39:33.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T04:39:33.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T04:39:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.957+0000 7fb7bc3ec700 1 Processor -- start 2023-10-06T04:39:33.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.957+0000 7fb7bc3ec700 1 -- start start 2023-10-06T04:39:33.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7bc3ec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7b4159520 0x7fb7b406d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7bc3ec700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b406dec0 con 0x7fb7b40c7850 2023-10-06T04:39:33.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7bc3ec700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b40ca8e0 con 0x7fb7b406da80 2023-10-06T04:39:33.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7bc3ec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b4152e80 con 0x7fb7b4159520 2023-10-06T04:39:33.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7ba989700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fb7b406da80 0x7fb7b41553a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:49832/0 (socket says 172.21.15.37:49832) 2023-10-06T04:39:33.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7ba989700 1 -- 172.21.15.37:0/2226132566 learned_addr learned my addr 172.21.15.37:0/2226132566 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:33.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7b9987700 1 --2- 172.21.15.37:0/2226132566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7b4159520 0x7fb7b406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7b9987700 1 -- 172.21.15.37:0/2226132566 >> v1:172.21.15.83:6789/0 conn(0x7fb7b406da80 legacy=0x7fb7b41553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7b9987700 1 -- 172.21.15.37:0/2226132566 >> v1:172.21.15.37:6789/0 conn(0x7fb7b40c7850 legacy=0x7fb7b40c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7b9987700 1 -- 172.21.15.37:0/2226132566 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40c9ec0 con 0x7fb7b4159520 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7b9987700 1 --2- 172.21.15.37:0/2226132566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7b4159520 0x7fb7b406d540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009d00 tx=0x7fb7ac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45fc44ddd22a8ee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7b9186700 1 -- 172.21.15.37:0/2226132566 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac00cbf0 con 0x7fb7b4159520 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7b9186700 1 -- 172.21.15.37:0/2226132566 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac00cd50 con 0x7fb7b4159520 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7b9186700 1 -- 172.21.15.37:0/2226132566 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac011630 con 0x7fb7b4159520 2023-10-06T04:39:33.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7bc3ec700 1 -- 172.21.15.37:0/2226132566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7b4159520 msgr2=0x7fb7b406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7bc3ec700 1 --2- 172.21.15.37:0/2226132566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7b4159520 0x7fb7b406d540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009d00 tx=0x7fb7ac009780 comp rx=0 tx=0).stop 2023-10-06T04:39:33.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7bc3ec700 1 -- 172.21.15.37:0/2226132566 shutdown_connections 2023-10-06T04:39:33.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7bc3ec700 1 --2- 172.21.15.37:0/2226132566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7b4159520 0x7fb7b406d540 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.961+0000 7fb7bc3ec700 1 -- 172.21.15.37:0/2226132566 >> 172.21.15.37:0/2226132566 conn(0x7fb7b40cb7f0 msgr2=0x7fb7b40cbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7bc3ec700 1 -- 172.21.15.37:0/2226132566 shutdown_connections 2023-10-06T04:39:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7bc3ec700 1 -- 172.21.15.37:0/2226132566 wait complete. 2023-10-06T04:39:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7bc3ec700 1 Processor -- start 2023-10-06T04:39:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7bc3ec700 1 -- start start 2023-10-06T04:39:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7bc3ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b406da80 0x7fb7b40c3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7bc3ec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7b40c7850 0x7fb7b40c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7bc3ec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7b4159520 0x7fb7b4145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7bc3ec700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b4156490 con 0x7fb7b406da80 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7bc3ec700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40c3890 con 0x7fb7b4159520 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7bc3ec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40c3b70 con 0x7fb7b40c7850 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7ba188700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b406da80 0x7fb7b40c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7ba188700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b406da80 0x7fb7b40c3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36808/0 (socket says 172.21.15.37:36808) 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7ba188700 1 -- 172.21.15.37:0/435534521 learned_addr learned my addr 172.21.15.37:0/435534521 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7b9987700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7b40c7850 0x7fb7b40c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7ba989700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7b4159520 0x7fb7b4145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7ba188700 1 -- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7b40c7850 msgr2=0x7fb7b40c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7ba188700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7b40c7850 0x7fb7b40c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7ba188700 1 -- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7b4159520 msgr2=0x7fb7b4145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7ba188700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7b4159520 0x7fb7b4145210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7ba188700 1 -- 172.21.15.37:0/435534521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac00d040 con 0x7fb7b406da80 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7ba188700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b406da80 0x7fb7b40c3250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400cec0 tx=0x7fb7a400c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7aa7fc700 1 -- 172.21.15.37:0/435534521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4013770 con 0x7fb7b406da80 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7aa7fc700 1 -- 172.21.15.37:0/435534521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a40138d0 con 0x7fb7b406da80 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7aa7fc700 1 -- 172.21.15.37:0/435534521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4013c90 con 0x7fb7b406da80 2023-10-06T04:39:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7bc3ec700 1 -- 172.21.15.37:0/435534521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b40c3e50 con 0x7fb7b406da80 2023-10-06T04:39:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.965+0000 7fb7bc3ec700 1 -- 172.21.15.37:0/435534521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b40c4db0 con 0x7fb7b406da80 2023-10-06T04:39:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.969+0000 7fb7bc3ec700 1 -- 172.21.15.37:0/435534521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b4156600 con 0x7fb7b406da80 2023-10-06T04:39:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.969+0000 7fb7aa7fc700 1 -- 172.21.15.37:0/435534521 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb7a4019030 con 0x7fb7b406da80 2023-10-06T04:39:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.969+0000 7fb7aa7fc700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7a00607c0 0x7fb7a0062c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.969+0000 7fb7aa7fc700 1 -- 172.21.15.37:0/435534521 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb7a4017070 con 0x7fb7b406da80 2023-10-06T04:39:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.969+0000 7fb7b9987700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7a00607c0 0x7fb7a0062c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.973+0000 7fb7b9987700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7a00607c0 0x7fb7a0062c70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0097c0 tx=0x7fb7ac019000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.973+0000 7f6c5aa49700 1 Processor -- start 2023-10-06T04:39:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.973+0000 7f6c5aa49700 1 -- start start 2023-10-06T04:39:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.977+0000 7f6c5aa49700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c5406db40 0x7f6c5415d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.973+0000 7fb7aa7fc700 1 -- 172.21.15.37:0/435534521 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb7b4156600 con 0x7fb7b406da80 2023-10-06T04:39:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.977+0000 7f6c5aa49700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540ca2b0 con 0x7f6c5415be80 2023-10-06T04:39:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.977+0000 7f6c5aa49700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540c93c0 con 0x7f6c5406d770 2023-10-06T04:39:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.977+0000 7f6c5aa49700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5415d950 con 0x7f6c5406db40 2023-10-06T04:39:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.977+0000 7f6c58fe6700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6c5415be80 0x7f6c540695f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36656/0 (socket says 172.21.15.37:36656) 2023-10-06T04:39:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.977+0000 7f6c58fe6700 1 -- 172.21.15.37:0/4009215283 learned_addr learned my addr 172.21.15.37:0/4009215283 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.977+0000 7f6c537fe700 1 --2- 172.21.15.37:0/4009215283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c5406db40 0x7f6c5415d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.977+0000 7f6c537fe700 1 -- 172.21.15.37:0/4009215283 >> v1:172.21.15.83:6789/0 conn(0x7f6c5406d770 legacy=0x7f6c540ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.977+0000 7f6c537fe700 1 -- 172.21.15.37:0/4009215283 >> v1:172.21.15.37:6789/0 conn(0x7f6c5415be80 legacy=0x7f6c540695f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.977+0000 7f6c537fe700 1 -- 172.21.15.37:0/4009215283 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540c96a0 con 0x7f6c5406db40 2023-10-06T04:39:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.977+0000 7f6c537fe700 1 --2- 172.21.15.37:0/4009215283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c5406db40 0x7f6c5415d410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009e90 tx=0x7f6c4c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfd16a793c0817a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c52ffd700 1 -- 172.21.15.37:0/4009215283 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00e070 con 0x7f6c5406db40 2023-10-06T04:39:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c52ffd700 1 -- 172.21.15.37:0/4009215283 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c00bb30 con 0x7f6c5406db40 2023-10-06T04:39:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 -- 172.21.15.37:0/4009215283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c5406db40 msgr2=0x7f6c5415d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 --2- 172.21.15.37:0/4009215283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c5406db40 0x7f6c5415d410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009e90 tx=0x7f6c4c009780 comp rx=0 tx=0).stop 2023-10-06T04:39:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 -- 172.21.15.37:0/4009215283 shutdown_connections 2023-10-06T04:39:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 --2- 172.21.15.37:0/4009215283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c5406db40 0x7f6c5415d410 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 -- 172.21.15.37:0/4009215283 >> 172.21.15.37:0/4009215283 conn(0x7f6c540cb7f0 msgr2=0x7f6c540cbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 -- 172.21.15.37:0/4009215283 shutdown_connections 2023-10-06T04:39:33.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 -- 172.21.15.37:0/4009215283 wait complete. 2023-10-06T04:39:33.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 Processor -- start 2023-10-06T04:39:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 -- start start 2023-10-06T04:39:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5406d770 0x7f6c540ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c5406db40 0x7f6c5415ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c5415be80 0x7f6c541556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5415efb0 con 0x7f6c5406db40 2023-10-06T04:39:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540af900 con 0x7f6c5406d770 2023-10-06T04:39:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c5aa49700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54155c00 con 0x7f6c5415be80 2023-10-06T04:39:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c537fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c5406db40 0x7f6c5415ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c537fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c5406db40 0x7f6c5415ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36818/0 (socket says 172.21.15.37:36818) 2023-10-06T04:39:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.981+0000 7f6c537fe700 1 -- 172.21.15.37:0/3517674927 learned_addr learned my addr 172.21.15.37:0/3517674927 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c53fff700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5406d770 0x7f6c540ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c58fe6700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c5415be80 0x7f6c541556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c537fe700 1 -- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c5415be80 msgr2=0x7f6c541556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c537fe700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c5415be80 0x7f6c541556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c537fe700 1 -- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5406d770 msgr2=0x7f6c540ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c537fe700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5406d770 0x7f6c540ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c537fe700 1 -- 172.21.15.37:0/3517674927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c009a20 con 0x7f6c5406db40 2023-10-06T04:39:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c53fff700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5406d770 0x7f6c540ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c537fe700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c5406db40 0x7f6c5415ea70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6c5406b9d0 tx=0x7f6c4c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c43fff700 1 -- 172.21.15.37:0/3517674927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0070e0 con 0x7f6c5406db40 2023-10-06T04:39:33.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c43fff700 1 -- 172.21.15.37:0/3517674927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c021070 con 0x7f6c5406db40 2023-10-06T04:39:33.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c5aa49700 1 -- 172.21.15.37:0/3517674927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c540aecf0 con 0x7f6c5406db40 2023-10-06T04:39:33.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c43fff700 1 -- 172.21.15.37:0/3517674927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c026430 con 0x7f6c5406db40 2023-10-06T04:39:33.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c5aa49700 1 -- 172.21.15.37:0/3517674927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c540af2b0 con 0x7f6c5406db40 2023-10-06T04:39:33.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c43fff700 1 -- 172.21.15.37:0/3517674927 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6c4c023030 con 0x7f6c5406db40 2023-10-06T04:39:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c43fff700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6c3c0606b0 0x7f6c3c062b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c43fff700 1 -- 172.21.15.37:0/3517674927 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6c4c07ed70 con 0x7f6c5406db40 2023-10-06T04:39:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c53fff700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6c3c0606b0 0x7f6c3c062b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.985+0000 7f6c53fff700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6c3c0606b0 0x7f6c3c062b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6c44000c00 tx=0x7f6c44009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba5857d700 1 Processor -- start 2023-10-06T04:39:33.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba5857d700 1 -- start start 2023-10-06T04:39:33.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba5857d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba500cb8b0 0x7fba500cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba5857d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba500ad200 con 0x7fba5015d0d0 2023-10-06T04:39:33.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba5857d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba500ad7c0 con 0x7fba5015d4a0 2023-10-06T04:39:33.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba5857d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba500cc210 con 0x7fba500cb8b0 2023-10-06T04:39:33.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba56319700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fba5015d0d0 0x7fba500adc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36672/0 (socket says 172.21.15.37:36672) 2023-10-06T04:39:33.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba56319700 1 -- 172.21.15.37:0/3808346150 learned_addr learned my addr 172.21.15.37:0/3808346150 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:33.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba56b1a700 1 --2- 172.21.15.37:0/3808346150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba500cb8b0 0x7fba500cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba55317700 1 -- 172.21.15.37:0/3808346150 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718749054 0 0) 0x7fba500ad200 con 0x7fba5015d0d0 2023-10-06T04:39:33.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba55317700 1 -- 172.21.15.37:0/3808346150 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba3c003570 con 0x7fba5015d0d0 2023-10-06T04:39:33.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba56b1a700 1 -- 172.21.15.37:0/3808346150 >> v1:172.21.15.83:6789/0 conn(0x7fba5015d4a0 legacy=0x7fba50160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba55317700 1 -- 172.21.15.37:0/3808346150 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541798415 0 0) 0x7fba500ad7c0 con 0x7fba5015d4a0 2023-10-06T04:39:33.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba56b1a700 1 -- 172.21.15.37:0/3808346150 >> v1:172.21.15.37:6789/0 conn(0x7fba5015d0d0 legacy=0x7fba500adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba56b1a700 1 -- 172.21.15.37:0/3808346150 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba500ae360 con 0x7fba500cb8b0 2023-10-06T04:39:33.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fd6f92c0700 1 Processor -- start 2023-10-06T04:39:33.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fd6f92c0700 1 -- start start 2023-10-06T04:39:33.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba56b1a700 1 --2- 172.21.15.37:0/3808346150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba500cb8b0 0x7fba500cbcd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fba48009e90 tx=0x7fba48009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=321655b7e8563d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7f6c5aa49700 1 -- 172.21.15.37:0/3517674927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c300052b0 con 0x7f6c5406db40 2023-10-06T04:39:33.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba55317700 1 -- 172.21.15.37:0/3808346150 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4800e070 con 0x7fba500cb8b0 2023-10-06T04:39:33.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba55317700 1 -- 172.21.15.37:0/3808346150 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4800bc80 con 0x7fba500cb8b0 2023-10-06T04:39:33.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fba55317700 1 -- 172.21.15.37:0/3808346150 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba48012430 con 0x7fba500cb8b0 2023-10-06T04:39:33.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7ff807150700 1 Processor -- start 2023-10-06T04:39:33.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fcd0b046700 1 Processor -- start 2023-10-06T04:39:33.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7fcd0b046700 1 -- start start 2023-10-06T04:39:33.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.989+0000 7ff807150700 1 -- start start 2023-10-06T04:39:33.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f92c0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd6f4158b70 0x7fd6f40c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f92c0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6f40c60a0 0x7fd6f40c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f92c0700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f40c7830 con 0x7fd6f406d4e0 2023-10-06T04:39:33.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f92c0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f40c6a30 con 0x7fd6f40c60a0 2023-10-06T04:39:33.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f92c0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f40c6c20 con 0x7fd6f4158b70 2023-10-06T04:39:33.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6f40c60a0 0x7fd6f40c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f8abf700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd6f406d4e0 0x7fd6f40c0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36684/0 (socket says 172.21.15.37:36684) 2023-10-06T04:39:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f8abf700 1 -- 172.21.15.37:0/2287655643 learned_addr learned my addr 172.21.15.37:0/2287655643 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f3fff700 1 --2- 172.21.15.37:0/2287655643 >> v2:172.21.15.83:3300/0 conn(0x7fd6f4158b70 0x7fd6f40c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f37fe700 1 -- 172.21.15.37:0/2287655643 >> v2:172.21.15.83:3300/0 conn(0x7fd6f4158b70 msgr2=0x7fd6f40c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f37fe700 1 --2- 172.21.15.37:0/2287655643 >> v2:172.21.15.83:3300/0 conn(0x7fd6f4158b70 0x7fd6f40c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f37fe700 1 -- 172.21.15.37:0/2287655643 >> v1:172.21.15.37:6789/0 conn(0x7fd6f406d4e0 legacy=0x7fd6f40c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f37fe700 1 -- 172.21.15.37:0/2287655643 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f40c6f00 con 0x7fd6f40c60a0 2023-10-06T04:39:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fd6f37fe700 1 --2- 172.21.15.37:0/2287655643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6f40c60a0 0x7fd6f40c64f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4075e90 tx=0x7fd6e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1ff344a4babb9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff807150700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8000cc120 0x7ff80006e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff807150700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff80006e740 0x7ff80015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff807150700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80006dd70 con 0x7ff8000cbd50 2023-10-06T04:39:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff807150700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80006eba0 con 0x7ff8000cc120 2023-10-06T04:39:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff807150700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8000add50 con 0x7ff80006e740 2023-10-06T04:39:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff7fffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8000cc120 0x7ff80006e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff7fffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8000cc120 0x7ff80006e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36834/0 (socket says 172.21.15.37:36834) 2023-10-06T04:39:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff7fffff700 1 -- 172.21.15.37:0/2838231114 learned_addr learned my addr 172.21.15.37:0/2838231114 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff8056ed700 1 --2- 172.21.15.37:0/2838231114 >> v2:172.21.15.83:3300/0 conn(0x7ff80006e740 0x7ff80015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff7fffff700 1 -- 172.21.15.37:0/2838231114 >> v2:172.21.15.83:3300/0 conn(0x7ff80006e740 msgr2=0x7ff80015cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff7fffff700 1 --2- 172.21.15.37:0/2838231114 >> v2:172.21.15.83:3300/0 conn(0x7ff80006e740 0x7ff80015cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff7fffff700 1 -- 172.21.15.37:0/2838231114 >> v1:172.21.15.37:6789/0 conn(0x7ff8000cbd50 legacy=0x7ff8000c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff7fffff700 1 -- 172.21.15.37:0/2838231114 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000ae030 con 0x7ff8000cc120 2023-10-06T04:39:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fcd0b046700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd040cc120 0x7fcd041555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fcd0b046700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd040c8b60 con 0x7fcd040cbd50 2023-10-06T04:39:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fcd0b046700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0415a6e0 con 0x7fcd04155b00 2023-10-06T04:39:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fcd0b046700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd040ae2c0 con 0x7fcd040cc120 2023-10-06T04:39:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7ff7fffff700 1 --2- 172.21.15.37:0/2838231114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8000cc120 0x7ff80006e200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff8000c8810 tx=0x7ff7f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279711923fa9761c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fcd03fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd040cc120 0x7fcd041555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fcd08de2700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcd040cbd50 0x7fcd040ad750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36702/0 (socket says 172.21.15.37:36702) 2023-10-06T04:39:34.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fcd08de2700 1 -- 172.21.15.37:0/3607276777 learned_addr learned my addr 172.21.15.37:0/3607276777 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:34.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fcd03fff700 1 -- 172.21.15.37:0/3607276777 >> v1:172.21.15.83:6789/0 conn(0x7fcd04155b00 legacy=0x7fcd040c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fcd03fff700 1 -- 172.21.15.37:0/3607276777 >> v1:172.21.15.37:6789/0 conn(0x7fcd040cbd50 legacy=0x7fcd040ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fcd03fff700 1 -- 172.21.15.37:0/3607276777 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd040c8230 con 0x7fcd040cc120 2023-10-06T04:39:34.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fba5857d700 1 -- 172.21.15.37:0/3808346150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba500cb8b0 msgr2=0x7fba500cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fba5857d700 1 --2- 172.21.15.37:0/3808346150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba500cb8b0 0x7fba500cbcd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fba48009e90 tx=0x7fba48009780 comp rx=0 tx=0).stop 2023-10-06T04:39:34.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fba5857d700 1 -- 172.21.15.37:0/3808346150 shutdown_connections 2023-10-06T04:39:34.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fba5857d700 1 --2- 172.21.15.37:0/3808346150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba500cb8b0 0x7fba500cbcd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fba5857d700 1 -- 172.21.15.37:0/3808346150 >> 172.21.15.37:0/3808346150 conn(0x7fba500667b0 msgr2=0x7fba50066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fcd03fff700 1 --2- 172.21.15.37:0/3607276777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd040cc120 0x7fcd041555c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fccf80098e0 tx=0x7fccf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2e03e987505ac6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fba5857d700 1 -- 172.21.15.37:0/3808346150 shutdown_connections 2023-10-06T04:39:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.993+0000 7fba5857d700 1 -- 172.21.15.37:0/3808346150 wait complete. 2023-10-06T04:39:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fcd037fe700 1 -- 172.21.15.37:0/3607276777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8009e80 con 0x7fcd040cc120 2023-10-06T04:39:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fcd037fe700 1 -- 172.21.15.37:0/3607276777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf800b860 con 0x7fcd040cc120 2023-10-06T04:39:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7f6c43fff700 1 -- 172.21.15.37:0/3517674927 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6c4c04ef10 con 0x7f6c5406db40 2023-10-06T04:39:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fba5857d700 1 Processor -- start 2023-10-06T04:39:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fd6f2ffd700 1 -- 172.21.15.37:0/2287655643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8011630 con 0x7fd6f40c60a0 2023-10-06T04:39:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fd6f2ffd700 1 -- 172.21.15.37:0/2287655643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e8011790 con 0x7fd6f40c60a0 2023-10-06T04:39:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fd6f2ffd700 1 -- 172.21.15.37:0/2287655643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8011b30 con 0x7fd6f40c60a0 2023-10-06T04:39:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fba5857d700 1 -- start start 2023-10-06T04:39:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fd6f92c0700 1 -- 172.21.15.37:0/2287655643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6f40c60a0 msgr2=0x7fd6f40c64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fd6f92c0700 1 --2- 172.21.15.37:0/2287655643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6f40c60a0 0x7fd6f40c64f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4075e90 tx=0x7fd6e80091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fd6f92c0700 1 -- 172.21.15.37:0/2287655643 shutdown_connections 2023-10-06T04:39:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fd6f92c0700 1 --2- 172.21.15.37:0/2287655643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6f40c60a0 0x7fd6f40c64f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fd6f92c0700 1 --2- 172.21.15.37:0/2287655643 >> v2:172.21.15.83:3300/0 conn(0x7fd6f4158b70 0x7fd6f40c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fd6f92c0700 1 -- 172.21.15.37:0/2287655643 >> 172.21.15.37:0/2287655643 conn(0x7fd6f4068770 msgr2=0x7fd6f40cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fba5857d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba500cb8b0 0x7fba50142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fcd037fe700 1 -- 172.21.15.37:0/3607276777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8009e80 con 0x7fcd040cc120 2023-10-06T04:39:34.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fcd0b046700 1 -- 172.21.15.37:0/3607276777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd040cc120 msgr2=0x7fcd041555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fcd0b046700 1 --2- 172.21.15.37:0/3607276777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd040cc120 0x7fcd041555c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fccf80098e0 tx=0x7fccf80091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fcd0b046700 1 -- 172.21.15.37:0/3607276777 shutdown_connections 2023-10-06T04:39:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fcd0b046700 1 --2- 172.21.15.37:0/3607276777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd040cc120 0x7fcd041555c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fcd0b046700 1 -- 172.21.15.37:0/3607276777 >> 172.21.15.37:0/3607276777 conn(0x7fcd040667b0 msgr2=0x7fcd04066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fba5857d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba5015d0d0 0x7fba5015e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fba5857d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba5015d4a0 0x7fba5015edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fba5857d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5015f2f0 con 0x7fba5015d0d0 2023-10-06T04:39:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fba5857d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba50158f80 con 0x7fba500cb8b0 2023-10-06T04:39:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fba5857d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba50159260 con 0x7fba5015d4a0 2023-10-06T04:39:34.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fd6f92c0700 1 -- 172.21.15.37:0/2287655643 shutdown_connections 2023-10-06T04:39:34.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7ff7ff7fe700 1 -- 172.21.15.37:0/2838231114 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f800e070 con 0x7ff8000cc120 2023-10-06T04:39:34.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fba55b18700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba5015d0d0 0x7fba5015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7ff7ff7fe700 1 -- 172.21.15.37:0/2838231114 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f80090d0 con 0x7ff8000cc120 2023-10-06T04:39:34.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7ff7ff7fe700 1 -- 172.21.15.37:0/2838231114 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f800bc20 con 0x7ff8000cc120 2023-10-06T04:39:34.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fcd0b046700 1 -- 172.21.15.37:0/3607276777 shutdown_connections 2023-10-06T04:39:34.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 -- 172.21.15.37:0/2838231114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8000cc120 msgr2=0x7ff80006e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 --2- 172.21.15.37:0/2838231114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8000cc120 0x7ff80006e200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff8000c8810 tx=0x7ff7f8009840 comp rx=0 tx=0).stop 2023-10-06T04:39:34.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 -- 172.21.15.37:0/2838231114 shutdown_connections 2023-10-06T04:39:34.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 --2- 172.21.15.37:0/2838231114 >> v2:172.21.15.83:3300/0 conn(0x7ff80006e740 0x7ff80015cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 --2- 172.21.15.37:0/2838231114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8000cc120 0x7ff80006e200 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 -- 172.21.15.37:0/2838231114 >> 172.21.15.37:0/2838231114 conn(0x7ff8000667b0 msgr2=0x7ff800066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 -- 172.21.15.37:0/2838231114 shutdown_connections 2023-10-06T04:39:34.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 -- 172.21.15.37:0/2838231114 wait complete. 2023-10-06T04:39:34.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fd6f92c0700 1 -- 172.21.15.37:0/2287655643 wait complete. 2023-10-06T04:39:34.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f92c0700 1 Processor -- start 2023-10-06T04:39:34.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fba55b18700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba5015d0d0 0x7fba5015e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36844/0 (socket says 172.21.15.37:36844) 2023-10-06T04:39:34.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fba55b18700 1 -- 172.21.15.37:0/1457160121 learned_addr learned my addr 172.21.15.37:0/1457160121 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:34.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:33.997+0000 7fba56b1a700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba5015d4a0 0x7fba5015edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fba56b1a700 1 -- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba500cb8b0 msgr2=0x7fba50142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fba56b1a700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba500cb8b0 0x7fba50142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fba56b1a700 1 -- 172.21.15.37:0/1457160121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba5015d0d0 msgr2=0x7fba5015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fba56b1a700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba5015d0d0 0x7fba5015e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fba56b1a700 1 -- 172.21.15.37:0/1457160121 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48009a20 con 0x7fba5015d4a0 2023-10-06T04:39:34.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fba56b1a700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba5015d4a0 0x7fba5015edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba48016000 tx=0x7fba48019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f92c0700 1 -- start start 2023-10-06T04:39:34.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 Processor -- start 2023-10-06T04:39:34.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fcd0b046700 1 -- 172.21.15.37:0/3607276777 wait complete. 2023-10-06T04:39:34.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 -- start start 2023-10-06T04:39:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f92c0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6f406d4e0 0x7fd6f40c3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f92c0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f40c60a0 0x7fd6f4156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f92c0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6f4158b70 0x7fd6f4153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f92c0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f41572a0 con 0x7fd6f4158b70 2023-10-06T04:39:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f92c0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f4153860 con 0x7fd6f406d4e0 2023-10-06T04:39:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f92c0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40c38f0 con 0x7fd6f40c60a0 2023-10-06T04:39:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6f406d4e0 0x7fd6f40c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f37fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f40c60a0 0x7fd6f4156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f37fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f40c60a0 0x7fd6f4156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40654/0 (socket says 172.21.15.37:40654) 2023-10-06T04:39:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f37fe700 1 -- 172.21.15.37:0/1479810080 learned_addr learned my addr 172.21.15.37:0/1479810080 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff80006e740 0x7ff80015afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8000cbd50 0x7ff80015d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff800157130 0x7ff80015d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80015d6a0 con 0x7ff80006e740 2023-10-06T04:39:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80015b5b0 con 0x7ff800157130 2023-10-06T04:39:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff807150700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80015b890 con 0x7ff8000cbd50 2023-10-06T04:39:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff804eec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff80006e740 0x7ff80015afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff804eec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff80006e740 0x7ff80015afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36848/0 (socket says 172.21.15.37:36848) 2023-10-06T04:39:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff804eec700 1 -- 172.21.15.37:0/2458314324 learned_addr learned my addr 172.21.15.37:0/2458314324 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff7fffff700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8000cbd50 0x7ff80015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff8056ed700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff800157130 0x7ff80015d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f8abf700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6f4158b70 0x7fd6f4153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f37fe700 1 -- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6f406d4e0 msgr2=0x7fd6f40c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f37fe700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6f406d4e0 0x7fd6f40c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f37fe700 1 -- 172.21.15.37:0/1479810080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6f4158b70 msgr2=0x7fd6f4153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f37fe700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6f4158b70 0x7fd6f4153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f37fe700 1 -- 172.21.15.37:0/1479810080 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e8009420 con 0x7fd6f40c60a0 2023-10-06T04:39:34.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff804eec700 1 -- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8000cbd50 msgr2=0x7ff80015d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff804eec700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8000cbd50 0x7ff80015d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff804eec700 1 -- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff800157130 msgr2=0x7ff80015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff804eec700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff800157130 0x7ff80015d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff804eec700 1 -- 172.21.15.37:0/2458314324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f8009ae0 con 0x7ff80006e740 2023-10-06T04:39:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7fd6f37fe700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f40c60a0 0x7fd6f4156d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4063780 tx=0x7fd6e8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.001+0000 7ff804eec700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff80006e740 0x7ff80015afd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000c4c0 tx=0x7ff7f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fba467fc700 1 -- 172.21.15.37:0/1457160121 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4801b610 con 0x7fba5015d4a0 2023-10-06T04:39:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7ff7fcff9700 1 -- 172.21.15.37:0/2458314324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0011590 con 0x7ff80006e740 2023-10-06T04:39:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fba467fc700 1 -- 172.21.15.37:0/1457160121 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba48020070 con 0x7fba5015d4a0 2023-10-06T04:39:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7ff7fcff9700 1 -- 172.21.15.37:0/2458314324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0011710 con 0x7ff80006e740 2023-10-06T04:39:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7ff7fcff9700 1 -- 172.21.15.37:0/2458314324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0011ad0 con 0x7ff80006e740 2023-10-06T04:39:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7ff807150700 1 -- 172.21.15.37:0/2458314324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80015bb70 con 0x7ff80006e740 2023-10-06T04:39:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7ff807150700 1 -- 172.21.15.37:0/2458314324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80016d890 con 0x7ff80006e740 2023-10-06T04:39:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fba5857d700 1 -- 172.21.15.37:0/1457160121 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba50159540 con 0x7fba5015d4a0 2023-10-06T04:39:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fba5857d700 1 -- 172.21.15.37:0/1457160121 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba50159b00 con 0x7fba5015d4a0 2023-10-06T04:39:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7ff7fcff9700 1 -- 172.21.15.37:0/2458314324 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff7f001b3b0 con 0x7ff80006e740 2023-10-06T04:39:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd0b046700 1 Processor -- start 2023-10-06T04:39:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd0b046700 1 -- start start 2023-10-06T04:39:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd0b046700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd040cbd50 0x7fcd040b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd0b046700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd040cc120 0x7fcd040af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7ff7fcff9700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff7ec060600 0x7ff7ec062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd0b046700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd04155b00 0x7fcd040c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7ff7fcff9700 1 -- 172.21.15.37:0/2458314324 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff7f007c150 con 0x7ff80006e740 2023-10-06T04:39:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd095e3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd04155b00 0x7fcd040c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd08de2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd040cbd50 0x7fcd040b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd095e3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd04155b00 0x7fcd040c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36868/0 (socket says 172.21.15.37:36868) 2023-10-06T04:39:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd095e3700 1 -- 172.21.15.37:0/3305165910 learned_addr learned my addr 172.21.15.37:0/3305165910 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040b12b0 con 0x7fcd04155b00 2023-10-06T04:39:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040af9c0 con 0x7fcd040cbd50 2023-10-06T04:39:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040affd0 con 0x7fcd040cc120 2023-10-06T04:39:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd03fff700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd040cc120 0x7fcd040af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7ff7fffff700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff7ec060600 0x7ff7ec062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd095e3700 1 -- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd040cc120 msgr2=0x7fcd040af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd095e3700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd040cc120 0x7fcd040af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd095e3700 1 -- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd040cbd50 msgr2=0x7fcd040b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd095e3700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd040cbd50 0x7fcd040b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.005+0000 7fcd095e3700 1 -- 172.21.15.37:0/3305165910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8009420 con 0x7fcd04155b00 2023-10-06T04:39:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.009+0000 7fcd095e3700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd04155b00 0x7fcd040c9480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c7f0 tx=0x7fccfc001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.009+0000 7ff7fffff700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff7ec060600 0x7ff7ec062ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8000c8810 tx=0x7ff7f8018000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.009+0000 7ff807150700 1 -- 172.21.15.37:0/2458314324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e00052b0 con 0x7ff80006e740 2023-10-06T04:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.009+0000 7fd6dbfff700 1 -- 172.21.15.37:0/1479810080 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8011b10 con 0x7fd6f40c60a0 2023-10-06T04:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.009+0000 7fd6dbfff700 1 -- 172.21.15.37:0/1479810080 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e80253f0 con 0x7fd6f40c60a0 2023-10-06T04:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.009+0000 7fd6dbfff700 1 -- 172.21.15.37:0/1479810080 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8025790 con 0x7fd6f40c60a0 2023-10-06T04:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.009+0000 7fd6f92c0700 1 -- 172.21.15.37:0/1479810080 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f40c3bd0 con 0x7fd6f40c60a0 2023-10-06T04:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.009+0000 7fd6f92c0700 1 -- 172.21.15.37:0/1479810080 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f40c4190 con 0x7fd6f40c60a0 2023-10-06T04:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.009+0000 7fd6f92c0700 1 -- 172.21.15.37:0/1479810080 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d40052b0 con 0x7fd6f40c60a0 2023-10-06T04:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.009+0000 7fd6dbfff700 1 -- 172.21.15.37:0/1479810080 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd6e8025b80 con 0x7fd6f40c60a0 2023-10-06T04:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fba467fc700 1 -- 172.21.15.37:0/1457160121 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4801ba00 con 0x7fba5015d4a0 2023-10-06T04:39:34.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fba467fc700 1 -- 172.21.15.37:0/1457160121 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fba48003040 con 0x7fba5015d4a0 2023-10-06T04:39:34.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fcd00ff9700 1 -- 172.21.15.37:0/3305165910 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc012630 con 0x7fcd04155b00 2023-10-06T04:39:34.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fcd00ff9700 1 -- 172.21.15.37:0/3305165910 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc012790 con 0x7fcd04155b00 2023-10-06T04:39:34.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fcd00ff9700 1 -- 172.21.15.37:0/3305165910 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc012b50 con 0x7fcd04155b00 2023-10-06T04:39:34.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fd6dbfff700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd6e0060620 0x7fd6e0062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fd6dbfff700 1 -- 172.21.15.37:0/1479810080 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd6e807e900 con 0x7fd6f40c60a0 2023-10-06T04:39:34.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fba467fc700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fba3c060b40 0x7fba3c062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fd6f3fff700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd6e0060620 0x7fd6e0062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fba467fc700 1 -- 172.21.15.37:0/1457160121 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fba48022070 con 0x7fba5015d4a0 2023-10-06T04:39:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fba56319700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fba3c060b40 0x7fba3c062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fba5857d700 1 -- 172.21.15.37:0/1457160121 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba340052e0 con 0x7fba5015d4a0 2023-10-06T04:39:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fd6f3fff700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd6e0060620 0x7fd6e0062ad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009d10 tx=0x7fd6e40091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fba56319700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fba3c060b40 0x7fba3c062ff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fba400058d0 tx=0x7fba400079d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd040b02b0 con 0x7fcd04155b00 2023-10-06T04:39:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd040b0870 con 0x7fcd04155b00 2023-10-06T04:39:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.013+0000 7ff7fcff9700 1 -- 172.21.15.37:0/2458314324 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff7f0017020 con 0x7ff80006e740 2023-10-06T04:39:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.017+0000 7fcd00ff9700 1 -- 172.21.15.37:0/3305165910 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fccfc003030 con 0x7fcd04155b00 2023-10-06T04:39:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.017+0000 7fcd00ff9700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fccf0060620 0x7fccf0062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.017+0000 7fcd00ff9700 1 -- 172.21.15.37:0/3305165910 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fccfc07c990 con 0x7fcd04155b00 2023-10-06T04:39:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.017+0000 7fcd08de2700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fccf0060620 0x7fccf0062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.017+0000 7fcd08de2700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fccf0060620 0x7fccf0062ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fccf4007130 tx=0x7fccf4007eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.017+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd04070ee0 con 0x7fcd04155b00 2023-10-06T04:39:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.021+0000 7fedbc8c4700 1 Processor -- start 2023-10-06T04:39:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.021+0000 7fedbc8c4700 1 -- start start 2023-10-06T04:39:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.021+0000 7fedbc8c4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fedb8158b70 0x7fedb80c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.021+0000 7fedbc8c4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb80c60a0 0x7fedb80c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.021+0000 7fedbc8c4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80c7830 con 0x7fedb806d4e0 2023-10-06T04:39:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.021+0000 7fedbc8c4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb80c6a30 con 0x7fedb8158b70 2023-10-06T04:39:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.021+0000 7fedbc8c4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80c6c20 con 0x7fedb80c60a0 2023-10-06T04:39:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.021+0000 7fd6dbfff700 1 -- 172.21.15.37:0/1479810080 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd6e804eb80 con 0x7fd6f40c60a0 2023-10-06T04:39:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.021+0000 7fedb7fff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fedb806d4e0 0x7fedb80c0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:49864/0 (socket says 172.21.15.37:49864) 2023-10-06T04:39:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.021+0000 7fedb7fff700 1 -- 172.21.15.37:0/46659305 learned_addr learned my addr 172.21.15.37:0/46659305 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.021+0000 7fedb77fe700 1 --2- 172.21.15.37:0/46659305 >> v2:172.21.15.83:3300/0 conn(0x7fedb8158b70 0x7fedb80c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.021+0000 7fedb6ffd700 1 --2- 172.21.15.37:0/46659305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb80c60a0 0x7fedb80c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.025+0000 7fedb77fe700 1 -- 172.21.15.37:0/46659305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb80c60a0 msgr2=0x7fedb80c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.025+0000 7fedb77fe700 1 --2- 172.21.15.37:0/46659305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb80c60a0 0x7fedb80c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.025+0000 7fedb77fe700 1 -- 172.21.15.37:0/46659305 >> v1:172.21.15.83:6789/0 conn(0x7fedb806d4e0 legacy=0x7fedb80c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.025+0000 7fedb77fe700 1 -- 172.21.15.37:0/46659305 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80c6f00 con 0x7fedb8158b70 2023-10-06T04:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.025+0000 7fedb6ffd700 1 --2- 172.21.15.37:0/46659305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb80c60a0 0x7fedb80c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.025+0000 7fedb77fe700 1 --2- 172.21.15.37:0/46659305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb8158b70 0x7fedb80c7cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fedac0098e0 tx=0x7fedac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba3de3958170db8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.025+0000 7fedb67fc700 1 -- 172.21.15.37:0/46659305 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00b640 con 0x7fedb8158b70 2023-10-06T04:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.025+0000 7fedb67fc700 1 -- 172.21.15.37:0/46659305 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac00b7a0 con 0x7fedb8158b70 2023-10-06T04:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.025+0000 7fedb67fc700 1 -- 172.21.15.37:0/46659305 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00bb40 con 0x7fedb8158b70 2023-10-06T04:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.025+0000 7fba467fc700 1 -- 172.21.15.37:0/1457160121 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fba4804f160 con 0x7fba5015d4a0 2023-10-06T04:39:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.025+0000 7fcd00ff9700 1 -- 172.21.15.37:0/3305165910 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fccfc04cbb0 con 0x7fcd04155b00 2023-10-06T04:39:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.029+0000 7fedbc8c4700 1 -- 172.21.15.37:0/46659305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb8158b70 msgr2=0x7fedb80c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.029+0000 7fedbc8c4700 1 --2- 172.21.15.37:0/46659305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb8158b70 0x7fedb80c7cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fedac0098e0 tx=0x7fedac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.029+0000 7fe3a3233700 1 Processor -- start 2023-10-06T04:39:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fedbc8c4700 1 -- 172.21.15.37:0/46659305 shutdown_connections 2023-10-06T04:39:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fedbc8c4700 1 --2- 172.21.15.37:0/46659305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb80c60a0 0x7fedb80c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fedbc8c4700 1 --2- 172.21.15.37:0/46659305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb8158b70 0x7fedb80c7cc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fedbc8c4700 1 -- 172.21.15.37:0/46659305 >> 172.21.15.37:0/46659305 conn(0x7fedb8068770 msgr2=0x7fedb80cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.029+0000 7fe3a3233700 1 -- start start 2023-10-06T04:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a3233700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe39c154cb0 0x7fe39c0c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a3233700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe39c0c6a20 0x7fe39c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a3233700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe39c0ca150 0x7fe39c0c0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a3233700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c0ca5d0 con 0x7fe39c0c6a20 2023-10-06T04:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a3233700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c0c6fa0 con 0x7fe39c154cb0 2023-10-06T04:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a3233700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0c7280 con 0x7fe39c0ca150 2023-10-06T04:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a2231700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe39c154cb0 0x7fe39c0c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a2231700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe39c154cb0 0x7fe39c0c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34960/0 (socket says 172.21.15.37:34960) 2023-10-06T04:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a2231700 1 -- 172.21.15.37:0/1772753078 learned_addr learned my addr 172.21.15.37:0/1772753078 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a1a30700 1 --2- 172.21.15.37:0/1772753078 >> v2:172.21.15.37:3300/0 conn(0x7fe39c0c6a20 0x7fe39c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a2a32700 1 --2- 172.21.15.37:0/1772753078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe39c0ca150 0x7fe39c0c0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a1a30700 1 -- 172.21.15.37:0/1772753078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe39c0ca150 msgr2=0x7fe39c0c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a1a30700 1 --2- 172.21.15.37:0/1772753078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe39c0ca150 0x7fe39c0c0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a1a30700 1 -- 172.21.15.37:0/1772753078 >> v2:172.21.15.83:3300/0 conn(0x7fe39c154cb0 msgr2=0x7fe39c0c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a1a30700 1 --2- 172.21.15.37:0/1772753078 >> v2:172.21.15.83:3300/0 conn(0x7fe39c154cb0 0x7fe39c0c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a1a30700 1 -- 172.21.15.37:0/1772753078 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c0c7560 con 0x7fe39c0c6a20 2023-10-06T04:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a2a32700 1 --2- 172.21.15.37:0/1772753078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe39c0ca150 0x7fe39c0c0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a1a30700 1 --2- 172.21.15.37:0/1772753078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe39c0c6a20 0x7fe39c0c9c10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0636d0 tx=0x7fe394009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d2b9e0d00aa3af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a122f700 1 -- 172.21.15.37:0/1772753078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39400e070 con 0x7fe39c0c6a20 2023-10-06T04:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.033+0000 7fe3a122f700 1 -- 172.21.15.37:0/1772753078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39400bb60 con 0x7fe39c0c6a20 2023-10-06T04:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.037+0000 7fe3a3233700 1 -- 172.21.15.37:0/1772753078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe39c0c6a20 msgr2=0x7fe39c0c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.037+0000 7fe3a3233700 1 --2- 172.21.15.37:0/1772753078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe39c0c6a20 0x7fe39c0c9c10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0636d0 tx=0x7fe394009780 comp rx=0 tx=0).stop 2023-10-06T04:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.037+0000 7fe3a3233700 1 -- 172.21.15.37:0/1772753078 shutdown_connections 2023-10-06T04:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.037+0000 7fe3a3233700 1 --2- 172.21.15.37:0/1772753078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe39c0ca150 0x7fe39c0c0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.037+0000 7fe3a3233700 1 --2- 172.21.15.37:0/1772753078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe39c0c6a20 0x7fe39c0c9c10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.037+0000 7fe3a3233700 1 --2- 172.21.15.37:0/1772753078 >> v2:172.21.15.83:3300/0 conn(0x7fe39c154cb0 0x7fe39c0c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.037+0000 7fe3a3233700 1 -- 172.21.15.37:0/1772753078 >> 172.21.15.37:0/1772753078 conn(0x7fe39c068770 msgr2=0x7fe39c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedbc8c4700 1 -- 172.21.15.37:0/46659305 shutdown_connections 2023-10-06T04:39:34.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a3233700 1 -- 172.21.15.37:0/1772753078 shutdown_connections 2023-10-06T04:39:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedbc8c4700 1 -- 172.21.15.37:0/46659305 wait complete. 2023-10-06T04:39:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedbc8c4700 1 Processor -- start 2023-10-06T04:39:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a3233700 1 -- 172.21.15.37:0/1772753078 wait complete. 2023-10-06T04:39:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a3233700 1 Processor -- start 2023-10-06T04:39:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedbc8c4700 1 -- start start 2023-10-06T04:39:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedbc8c4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb806d4e0 0x7fedb80aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedbc8c4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedb80c60a0 0x7fedb814a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedb6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedb80c60a0 0x7fedb814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedb6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedb80c60a0 0x7fedb814a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36886/0 (socket says 172.21.15.37:36886) 2023-10-06T04:39:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb806d4e0 0x7fedb80aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb806d4e0 0x7fedb80aa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:34964/0 (socket says 172.21.15.37:34964) 2023-10-06T04:39:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedb6ffd700 1 -- 172.21.15.37:0/3504410068 learned_addr learned my addr 172.21.15.37:0/3504410068 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedbc8c4700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb8158b70 0x7fedb80aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb814a8d0 con 0x7fedb80c60a0 2023-10-06T04:39:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80af490 con 0x7fedb806d4e0 2023-10-06T04:39:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80af730 con 0x7fedb8158b70 2023-10-06T04:39:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fedb7fff700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb8158b70 0x7fedb80aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fedb77fe700 1 -- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb8158b70 msgr2=0x7fedb80aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a3233700 1 -- start start 2023-10-06T04:39:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a3233700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0c6a20 0x7fe39c1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a3233700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe39c0ca150 0x7fe39c14f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a3233700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe39c154cb0 0x7fe39c14fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a3233700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0c2850 con 0x7fe39c154cb0 2023-10-06T04:39:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a3233700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c156000 con 0x7fe39c0c6a20 2023-10-06T04:39:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a3233700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c1562e0 con 0x7fe39c0ca150 2023-10-06T04:39:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a2a32700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe39c154cb0 0x7fe39c14fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a2a32700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe39c154cb0 0x7fe39c14fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36898/0 (socket says 172.21.15.37:36898) 2023-10-06T04:39:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.041+0000 7fe3a2a32700 1 -- 172.21.15.37:0/2974672052 learned_addr learned my addr 172.21.15.37:0/2974672052 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fe3a1a30700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe39c0ca150 0x7fe39c14f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fe3a2231700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0c6a20 0x7fe39c1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fe3a2a32700 1 -- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe39c0ca150 msgr2=0x7fe39c14f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fe3a2a32700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe39c0ca150 0x7fe39c14f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fe3a2a32700 1 -- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0c6a20 msgr2=0x7fe39c1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fedb77fe700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb8158b70 0x7fedb80aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fedb77fe700 1 -- 172.21.15.37:0/3504410068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedb80c60a0 msgr2=0x7fedb814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fedb77fe700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedb80c60a0 0x7fedb814a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fedb77fe700 1 -- 172.21.15.37:0/3504410068 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb0009a20 con 0x7fedb806d4e0 2023-10-06T04:39:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fedb6ffd700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedb80c60a0 0x7fedb814a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:34.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fedb7fff700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb8158b70 0x7fedb80aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:34.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fe3a2a32700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0c6a20 0x7fe39c1570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fe3a2a32700 1 -- 172.21.15.37:0/2974672052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394009a20 con 0x7fe39c154cb0 2023-10-06T04:39:34.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fedb77fe700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb806d4e0 0x7fedb80aa050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fedb80634f0 tx=0x7fedac017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fe3a2231700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0c6a20 0x7fe39c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:34.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fed9f7fe700 1 -- 172.21.15.37:0/3504410068 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00bb20 con 0x7fedb806d4e0 2023-10-06T04:39:34.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fe3a2a32700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe39c154cb0 0x7fe39c14fc50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe39800e870 tx=0x7fe398008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac009420 con 0x7fedb806d4e0 2023-10-06T04:39:34.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb80afcf0 con 0x7fedb806d4e0 2023-10-06T04:39:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fed9f7fe700 1 -- 172.21.15.37:0/3504410068 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac000c90 con 0x7fedb806d4e0 2023-10-06T04:39:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fed9f7fe700 1 -- 172.21.15.37:0/3504410068 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac011650 con 0x7fedb806d4e0 2023-10-06T04:39:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fe3927fc700 1 -- 172.21.15.37:0/2974672052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398013410 con 0x7fe39c154cb0 2023-10-06T04:39:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fe3927fc700 1 -- 172.21.15.37:0/2974672052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398013570 con 0x7fe39c154cb0 2023-10-06T04:39:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.045+0000 7fed9f7fe700 1 -- 172.21.15.37:0/3504410068 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fedac011a40 con 0x7fedb806d4e0 2023-10-06T04:39:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.049+0000 7fed9f7fe700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7feda40605d0 0x7feda4062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.049+0000 7fed9f7fe700 1 -- 172.21.15.37:0/3504410068 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fedac07e170 con 0x7fedb806d4e0 2023-10-06T04:39:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.049+0000 7fe3927fc700 1 -- 172.21.15.37:0/2974672052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3980138f0 con 0x7fe39c154cb0 2023-10-06T04:39:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.049+0000 7fe3a3233700 1 -- 172.21.15.37:0/2974672052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c1565c0 con 0x7fe39c154cb0 2023-10-06T04:39:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.049+0000 7fe3a3233700 1 -- 172.21.15.37:0/2974672052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c1575e0 con 0x7fe39c154cb0 2023-10-06T04:39:34.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.049+0000 7fedb6ffd700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7feda40605d0 0x7feda4062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.049+0000 7fedb6ffd700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7feda40605d0 0x7feda4062a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fedb814e250 tx=0x7fedb000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.049+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed980052b0 con 0x7fedb806d4e0 2023-10-06T04:39:34.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.049+0000 7fe3a3233700 1 -- 172.21.15.37:0/2974672052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c0c29c0 con 0x7fe39c154cb0 2023-10-06T04:39:34.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.049+0000 7fe3927fc700 1 -- 172.21.15.37:0/2974672052 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe398013ca0 con 0x7fe39c154cb0 2023-10-06T04:39:34.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.049+0000 7fe3927fc700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe3800605a0 0x7fe380062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.049+0000 7fe3927fc700 1 -- 172.21.15.37:0/2974672052 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe39807c830 con 0x7fe39c154cb0 2023-10-06T04:39:34.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.053+0000 7fe3a2231700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe3800605a0 0x7fe380062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.053+0000 7fe3a2231700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe3800605a0 0x7fe380062a50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe38c006fd0 tx=0x7fe38c00d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.057+0000 7fe3927fc700 1 -- 172.21.15.37:0/2974672052 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe3980504e0 con 0x7fe39c154cb0 2023-10-06T04:39:34.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.069+0000 7fed9f7fe700 1 -- 172.21.15.37:0/3504410068 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fedac04e2f0 con 0x7fedb806d4e0 2023-10-06T04:39:34.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.257+0000 7fb7bc3ec700 1 -- 172.21.15.37:0/435534521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb7b41565d0 con 0x7fb7b406da80 2023-10-06T04:39:34.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.257+0000 7fb7aa7fc700 1 -- 172.21.15.37:0/435534521 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb7a4021020 con 0x7fb7b406da80 2023-10-06T04:39:34.265 INFO:teuthology.orchestra.run.smithi037.stdout:64424509449 2023-10-06T04:39:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.269+0000 7fb797fff700 1 -- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7a00607c0 msgr2=0x7fb7a0062c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.269+0000 7fb797fff700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7a00607c0 0x7fb7a0062c70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0097c0 tx=0x7fb7ac019000 comp rx=0 tx=0).stop 2023-10-06T04:39:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.269+0000 7fb797fff700 1 -- 172.21.15.37:0/435534521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b406da80 msgr2=0x7fb7b40c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.269+0000 7fb797fff700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b406da80 0x7fb7b40c3250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400cec0 tx=0x7fb7a400c270 comp rx=0 tx=0).stop 2023-10-06T04:39:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.269+0000 7fb797fff700 1 -- 172.21.15.37:0/435534521 shutdown_connections 2023-10-06T04:39:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.269+0000 7fb797fff700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7a00607c0 0x7fb7a0062c70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.269+0000 7fb797fff700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7b4159520 0x7fb7b4145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.269+0000 7fb797fff700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7b40c7850 0x7fb7b40c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.269+0000 7fb797fff700 1 --2- 172.21.15.37:0/435534521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b406da80 0x7fb7b40c3250 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.269+0000 7fb797fff700 1 -- 172.21.15.37:0/435534521 >> 172.21.15.37:0/435534521 conn(0x7fb7b40cb7f0 msgr2=0x7fb7b415a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.269+0000 7fb797fff700 1 -- 172.21.15.37:0/435534521 shutdown_connections 2023-10-06T04:39:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.273+0000 7fb797fff700 1 -- 172.21.15.37:0/435534521 wait complete. 2023-10-06T04:39:34.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2023-10-06T04:39:34.290 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:34.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.297+0000 7f6c5aa49700 1 -- 172.21.15.37:0/3517674927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c30005830 con 0x7f6c5406db40 2023-10-06T04:39:34.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.297+0000 7f6c43fff700 1 -- 172.21.15.37:0/3517674927 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c4c052530 con 0x7f6c5406db40 2023-10-06T04:39:34.302 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-10-06T04:39:34.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.301+0000 7f6c5aa49700 1 -- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6c3c0606b0 msgr2=0x7f6c3c062b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.301+0000 7f6c5aa49700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6c3c0606b0 0x7f6c3c062b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6c44000c00 tx=0x7f6c44009040 comp rx=0 tx=0).stop 2023-10-06T04:39:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.301+0000 7f6c5aa49700 1 -- 172.21.15.37:0/3517674927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c5406db40 msgr2=0x7f6c5415ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.301+0000 7f6c5aa49700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c5406db40 0x7f6c5415ea70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6c5406b9d0 tx=0x7f6c4c018000 comp rx=0 tx=0).stop 2023-10-06T04:39:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.301+0000 7f6c5aa49700 1 -- 172.21.15.37:0/3517674927 shutdown_connections 2023-10-06T04:39:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.301+0000 7f6c5aa49700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6c3c0606b0 0x7f6c3c062b60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.301+0000 7f6c5aa49700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c5415be80 0x7f6c541556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.301+0000 7f6c5aa49700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c5406db40 0x7f6c5415ea70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.301+0000 7f6c5aa49700 1 --2- 172.21.15.37:0/3517674927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5406d770 0x7f6c540ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.301+0000 7f6c5aa49700 1 -- 172.21.15.37:0/3517674927 >> 172.21.15.37:0/3517674927 conn(0x7f6c540cb7f0 msgr2=0x7f6c540c1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.301+0000 7f6c5aa49700 1 -- 172.21.15.37:0/3517674927 shutdown_connections 2023-10-06T04:39:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.301+0000 7f6c5aa49700 1 -- 172.21.15.37:0/3517674927 wait complete. 2023-10-06T04:39:34.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.1 2023-10-06T04:39:34.318 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.321+0000 7ff807150700 1 -- 172.21.15.37:0/2458314324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7e0005560 con 0x7ff80006e740 2023-10-06T04:39:34.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.321+0000 7ff7fcff9700 1 -- 172.21.15.37:0/2458314324 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7f004fd20 con 0x7ff80006e740 2023-10-06T04:39:34.326 INFO:teuthology.orchestra.run.smithi037.stdout:64424509451 2023-10-06T04:39:34.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.325+0000 7ff807150700 1 -- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff7ec060600 msgr2=0x7ff7ec062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.325+0000 7ff807150700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff7ec060600 0x7ff7ec062ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8000c8810 tx=0x7ff7f8018000 comp rx=0 tx=0).stop 2023-10-06T04:39:34.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.325+0000 7ff807150700 1 -- 172.21.15.37:0/2458314324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff80006e740 msgr2=0x7ff80015afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.325+0000 7ff807150700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff80006e740 0x7ff80015afd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000c4c0 tx=0x7ff7f000c880 comp rx=0 tx=0).stop 2023-10-06T04:39:34.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.325+0000 7ff807150700 1 -- 172.21.15.37:0/2458314324 shutdown_connections 2023-10-06T04:39:34.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.325+0000 7ff807150700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff7ec060600 0x7ff7ec062ab0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.325+0000 7ff807150700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff800157130 0x7ff80015d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.325+0000 7ff807150700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8000cbd50 0x7ff80015d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.325+0000 7ff807150700 1 --2- 172.21.15.37:0/2458314324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff80006e740 0x7ff80015afd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.325+0000 7ff807150700 1 -- 172.21.15.37:0/2458314324 >> 172.21.15.37:0/2458314324 conn(0x7ff8000667b0 msgr2=0x7ff8000c97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.325+0000 7ff807150700 1 -- 172.21.15.37:0/2458314324 shutdown_connections 2023-10-06T04:39:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.325+0000 7ff807150700 1 -- 172.21.15.37:0/2458314324 wait complete. 2023-10-06T04:39:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fba5857d700 1 -- 172.21.15.37:0/1457160121 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fba34005590 con 0x7fba5015d4a0 2023-10-06T04:39:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fed98005560 con 0x7fedb806d4e0 2023-10-06T04:39:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fba467fc700 1 -- 172.21.15.37:0/1457160121 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba48052780 con 0x7fba5015d4a0 2023-10-06T04:39:34.338 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-10-06T04:39:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fed9f7fe700 1 -- 172.21.15.37:0/3504410068 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fedac015070 con 0x7fedb806d4e0 2023-10-06T04:39:34.338 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-10-06T04:39:34.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7feda40605d0 msgr2=0x7feda4062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7feda40605d0 0x7feda4062a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fedb814e250 tx=0x7fedb000b040 comp rx=0 tx=0).stop 2023-10-06T04:39:34.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb806d4e0 msgr2=0x7fedb80aa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb806d4e0 0x7fedb80aa050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fedb80634f0 tx=0x7fedac017000 comp rx=0 tx=0).stop 2023-10-06T04:39:34.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 shutdown_connections 2023-10-06T04:39:34.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7feda40605d0 0x7feda4062a80 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fedb814e250 tx=0x7fedb000b040 comp rx=0 tx=0).stop 2023-10-06T04:39:34.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb8158b70 0x7fedb80aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedb80c60a0 0x7fedb814a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 --2- 172.21.15.37:0/3504410068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb806d4e0 0x7fedb80aa050 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fedb80634f0 tx=0x7fedac017000 comp rx=0 tx=0).stop 2023-10-06T04:39:34.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 >> 172.21.15.37:0/3504410068 conn(0x7fedb8068770 msgr2=0x7fedb806d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 shutdown_connections 2023-10-06T04:39:34.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.333+0000 7fedbc8c4700 1 -- 172.21.15.37:0/3504410068 wait complete. 2023-10-06T04:39:34.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.337+0000 7fba5857d700 1 -- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fba3c060b40 msgr2=0x7fba3c062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.337+0000 7fba5857d700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fba3c060b40 0x7fba3c062ff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fba400058d0 tx=0x7fba400079d0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.337+0000 7fba5857d700 1 -- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba5015d4a0 msgr2=0x7fba5015edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.337+0000 7fba5857d700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba5015d4a0 0x7fba5015edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba48016000 tx=0x7fba48019000 comp rx=0 tx=0).stop 2023-10-06T04:39:34.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.337+0000 7fba5857d700 1 -- 172.21.15.37:0/1457160121 shutdown_connections 2023-10-06T04:39:34.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.337+0000 7fba5857d700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fba3c060b40 0x7fba3c062ff0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.337+0000 7fba5857d700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba5015d4a0 0x7fba5015edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.337+0000 7fba5857d700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba5015d0d0 0x7fba5015e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.337+0000 7fba5857d700 1 --2- 172.21.15.37:0/1457160121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba500cb8b0 0x7fba50142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.337+0000 7fba5857d700 1 -- 172.21.15.37:0/1457160121 >> 172.21.15.37:0/1457160121 conn(0x7fba500667b0 msgr2=0x7fba500b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.337+0000 7fba5857d700 1 -- 172.21.15.37:0/1457160121 shutdown_connections 2023-10-06T04:39:34.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.337+0000 7fba5857d700 1 -- 172.21.15.37:0/1457160121 wait complete. 2023-10-06T04:39:34.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.3 2023-10-06T04:39:34.344 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:34.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.341+0000 7fd6f92c0700 1 -- 172.21.15.37:0/1479810080 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd6d4005830 con 0x7fd6f40c60a0 2023-10-06T04:39:34.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.341+0000 7fd6dbfff700 1 -- 172.21.15.37:0/1479810080 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd6e8033020 con 0x7fd6f40c60a0 2023-10-06T04:39:34.345 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-10-06T04:39:34.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.341+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd040c8510 con 0x7fcd04155b00 2023-10-06T04:39:34.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fe3a3233700 1 -- 172.21.15.37:0/2974672052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe39c0708a0 con 0x7fe39c154cb0 2023-10-06T04:39:34.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fd6f92c0700 1 -- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd6e0060620 msgr2=0x7fd6e0062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fd6f92c0700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd6e0060620 0x7fd6e0062ad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009d10 tx=0x7fd6e40091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fd6f92c0700 1 -- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f40c60a0 msgr2=0x7fd6f4156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fd6f92c0700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f40c60a0 0x7fd6f4156d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4063780 tx=0x7fd6e8017000 comp rx=0 tx=0).stop 2023-10-06T04:39:34.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd00ff9700 1 -- 172.21.15.37:0/3305165910 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fccfc0501d0 con 0x7fcd04155b00 2023-10-06T04:39:34.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fd6f92c0700 1 -- 172.21.15.37:0/1479810080 shutdown_connections 2023-10-06T04:39:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fd6f92c0700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd6e0060620 0x7fd6e0062ad0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fd6f92c0700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6f4158b70 0x7fd6f4153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fd6f92c0700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f40c60a0 0x7fd6f4156d60 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4063780 tx=0x7fd6e8017000 comp rx=0 tx=0).stop 2023-10-06T04:39:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fd6f92c0700 1 --2- 172.21.15.37:0/1479810080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6f406d4e0 0x7fd6f40c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fd6f92c0700 1 -- 172.21.15.37:0/1479810080 >> 172.21.15.37:0/1479810080 conn(0x7fd6f4068770 msgr2=0x7fd6f40c1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.350 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-10-06T04:39:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fe3927fc700 1 -- 172.21.15.37:0/2974672052 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe398020090 con 0x7fe39c154cb0 2023-10-06T04:39:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fd6f92c0700 1 -- 172.21.15.37:0/1479810080 shutdown_connections 2023-10-06T04:39:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fd6f92c0700 1 -- 172.21.15.37:0/1479810080 wait complete. 2023-10-06T04:39:34.351 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-10-06T04:39:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fccf0060620 msgr2=0x7fccf0062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd0b046700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fccf0060620 0x7fccf0062ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fccf4007130 tx=0x7fccf4007eb0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd04155b00 msgr2=0x7fcd040c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd0b046700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd04155b00 0x7fcd040c9480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c7f0 tx=0x7fccfc001630 comp rx=0 tx=0).stop 2023-10-06T04:39:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 shutdown_connections 2023-10-06T04:39:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd0b046700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fccf0060620 0x7fccf0062ad0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd0b046700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd04155b00 0x7fcd040c9480 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd0b046700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd040cc120 0x7fcd040af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd0b046700 1 --2- 172.21.15.37:0/3305165910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd040cbd50 0x7fcd040b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 >> 172.21.15.37:0/3305165910 conn(0x7fcd040667b0 msgr2=0x7fcd040682f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 shutdown_connections 2023-10-06T04:39:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fcd0b046700 1 -- 172.21.15.37:0/3305165910 wait complete. 2023-10-06T04:39:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fe3a3233700 1 -- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe3800605a0 msgr2=0x7fe380062a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fe3a3233700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe3800605a0 0x7fe380062a50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe38c006fd0 tx=0x7fe38c00d040 comp rx=0 tx=0).stop 2023-10-06T04:39:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fe3a3233700 1 -- 172.21.15.37:0/2974672052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe39c154cb0 msgr2=0x7fe39c14fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fe3a3233700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe39c154cb0 0x7fe39c14fc50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe39800e870 tx=0x7fe398008040 comp rx=0 tx=0).stop 2023-10-06T04:39:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fe3a3233700 1 -- 172.21.15.37:0/2974672052 shutdown_connections 2023-10-06T04:39:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fe3a3233700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe3800605a0 0x7fe380062a50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fe3a3233700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe39c154cb0 0x7fe39c14fc50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fe3a3233700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe39c0ca150 0x7fe39c14f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fe3a3233700 1 --2- 172.21.15.37:0/2974672052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0c6a20 0x7fe39c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.345+0000 7fe3a3233700 1 -- 172.21.15.37:0/2974672052 >> 172.21.15.37:0/2974672052 conn(0x7fe39c068770 msgr2=0x7fe39c0c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.5 2023-10-06T04:39:34.355 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:34.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2023-10-06T04:39:34.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.349+0000 7fe3a3233700 1 -- 172.21.15.37:0/2974672052 shutdown_connections 2023-10-06T04:39:34.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.349+0000 7fe3a3233700 1 -- 172.21.15.37:0/2974672052 wait complete. 2023-10-06T04:39:34.356 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:34.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.7 2023-10-06T04:39:34.361 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:34.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.2 2023-10-06T04:39:34.363 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:34.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.4 2023-10-06T04:39:34.364 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:34.364 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:39:34.364 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:39:34.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f891b83e700 1 Processor -- start 2023-10-06T04:39:34.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f891b83e700 1 -- start start 2023-10-06T04:39:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f891b83e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89140aa6c0 0x7f89141561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f891b83e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89140ab5a0 0x7f89140acd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f891b83e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f89140aaa90 0x7f89140ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f891b83e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89140ac6f0 con 0x7f89140ab5a0 2023-10-06T04:39:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f891b83e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89140abb20 con 0x7f89140aaa90 2023-10-06T04:39:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f891b83e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89140abdc0 con 0x7f89140aa6c0 2023-10-06T04:39:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f8918dd9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89140ab5a0 0x7f89140acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f8918dd9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89140ab5a0 0x7f89140acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36900/0 (socket says 172.21.15.37:36900) 2023-10-06T04:39:34.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f8918dd9700 1 -- 172.21.15.37:0/2637676993 learned_addr learned my addr 172.21.15.37:0/2637676993 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:34.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f8919ddb700 1 --2- 172.21.15.37:0/2637676993 >> v2:172.21.15.83:3300/0 conn(0x7f89140aaa90 0x7f89140ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.449+0000 7f89195da700 1 --2- 172.21.15.37:0/2637676993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89140aa6c0 0x7f89141561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f8918dd9700 1 -- 172.21.15.37:0/2637676993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89140aa6c0 msgr2=0x7f89141561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:34.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f8918dd9700 1 --2- 172.21.15.37:0/2637676993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89140aa6c0 0x7f89141561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f8918dd9700 1 -- 172.21.15.37:0/2637676993 >> v2:172.21.15.83:3300/0 conn(0x7f89140aaa90 msgr2=0x7f89140ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f8918dd9700 1 --2- 172.21.15.37:0/2637676993 >> v2:172.21.15.83:3300/0 conn(0x7f89140aaa90 0x7f89140ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f8918dd9700 1 -- 172.21.15.37:0/2637676993 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89140ac0a0 con 0x7f89140ab5a0 2023-10-06T04:39:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f8918dd9700 1 --2- 172.21.15.37:0/2637676993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89140ab5a0 0x7f89140acd70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8914063660 tx=0x7f8908009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ee7fb76e4e453d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f8907fff700 1 -- 172.21.15.37:0/2637676993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890800b640 con 0x7f89140ab5a0 2023-10-06T04:39:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f8907fff700 1 -- 172.21.15.37:0/2637676993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890800b7a0 con 0x7f89140ab5a0 2023-10-06T04:39:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f8907fff700 1 -- 172.21.15.37:0/2637676993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890800bb60 con 0x7f89140ab5a0 2023-10-06T04:39:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f891b83e700 1 -- 172.21.15.37:0/2637676993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89140ab5a0 msgr2=0x7f89140acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f891b83e700 1 --2- 172.21.15.37:0/2637676993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89140ab5a0 0x7f89140acd70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8914063660 tx=0x7f8908009250 comp rx=0 tx=0).stop 2023-10-06T04:39:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f891b83e700 1 -- 172.21.15.37:0/2637676993 shutdown_connections 2023-10-06T04:39:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f891b83e700 1 --2- 172.21.15.37:0/2637676993 >> v2:172.21.15.83:3300/0 conn(0x7f89140aaa90 0x7f89140ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f891b83e700 1 --2- 172.21.15.37:0/2637676993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89140ab5a0 0x7f89140acd70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f891b83e700 1 --2- 172.21.15.37:0/2637676993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89140aa6c0 0x7f89141561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f891b83e700 1 -- 172.21.15.37:0/2637676993 >> 172.21.15.37:0/2637676993 conn(0x7f89140ccc60 msgr2=0x7f891406c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f891b83e700 1 -- 172.21.15.37:0/2637676993 shutdown_connections 2023-10-06T04:39:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f891b83e700 1 -- 172.21.15.37:0/2637676993 wait complete. 2023-10-06T04:39:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.453+0000 7f891b83e700 1 Processor -- start 2023-10-06T04:39:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f891b83e700 1 -- start start 2023-10-06T04:39:34.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f891b83e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89140aa6c0 0x7f891414de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f891b83e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89140aaa90 0x7f891414be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f891b83e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89140ab5a0 0x7f8914157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f891b83e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891414f740 con 0x7f89140ab5a0 2023-10-06T04:39:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f891b83e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891414e6a0 con 0x7f89140aaa90 2023-10-06T04:39:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f891b83e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891414e980 con 0x7f89140aa6c0 2023-10-06T04:39:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f8919ddb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89140ab5a0 0x7f8914157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f8919ddb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89140ab5a0 0x7f8914157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36910/0 (socket says 172.21.15.37:36910) 2023-10-06T04:39:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f8919ddb700 1 -- 172.21.15.37:0/1879854444 learned_addr learned my addr 172.21.15.37:0/1879854444 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f89195da700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89140aa6c0 0x7f891414de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f8918dd9700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89140aaa90 0x7f891414be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f8919ddb700 1 -- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89140aa6c0 msgr2=0x7f891414de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f8919ddb700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89140aa6c0 0x7f891414de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f8919ddb700 1 -- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89140aaa90 msgr2=0x7f891414be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f8919ddb700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89140aaa90 0x7f891414be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f8919ddb700 1 -- 172.21.15.37:0/1879854444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89080094f0 con 0x7f89140ab5a0 2023-10-06T04:39:34.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f8919ddb700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89140ab5a0 0x7f8914157840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f890c00e380 tx=0x7f890c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f89057fa700 1 -- 172.21.15.37:0/1879854444 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c00eec0 con 0x7f89140ab5a0 2023-10-06T04:39:34.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f89057fa700 1 -- 172.21.15.37:0/1879854444 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c012430 con 0x7f89140ab5a0 2023-10-06T04:39:34.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f89057fa700 1 -- 172.21.15.37:0/1879854444 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0127f0 con 0x7f89140ab5a0 2023-10-06T04:39:34.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f891b83e700 1 -- 172.21.15.37:0/1879854444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891414ec60 con 0x7f89140ab5a0 2023-10-06T04:39:34.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.457+0000 7f891b83e700 1 -- 172.21.15.37:0/1879854444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891414f220 con 0x7f89140ab5a0 2023-10-06T04:39:34.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.461+0000 7f891b83e700 1 -- 172.21.15.37:0/1879854444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891414f440 con 0x7f89140ab5a0 2023-10-06T04:39:34.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.461+0000 7f89057fa700 1 -- 172.21.15.37:0/1879854444 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f890c012ba0 con 0x7f89140ab5a0 2023-10-06T04:39:34.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.461+0000 7f89057fa700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f88f8060550 0x7f88f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.461+0000 7f89057fa700 1 -- 172.21.15.37:0/1879854444 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f890c016070 con 0x7f89140ab5a0 2023-10-06T04:39:34.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.461+0000 7f89195da700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f88f8060550 0x7f88f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.461+0000 7f89195da700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f88f8060550 0x7f88f8062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8910009d20 tx=0x7f89100091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.469+0000 7f89057fa700 1 -- 172.21.15.37:0/1879854444 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f890c04fe10 con 0x7f89140ab5a0 2023-10-06T04:39:34.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.621+0000 7f891b83e700 1 -- 172.21.15.37:0/1879854444 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8914070ee0 con 0x7f88f8060550 2023-10-06T04:39:34.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.641+0000 7f89057fa700 1 -- 172.21.15.37:0/1879854444 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367292 (secure 0 0 0) 0x7f8914070ee0 con 0x7f88f8060550 2023-10-06T04:39:34.655 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:34.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.649+0000 7f891b83e700 1 -- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f88f8060550 msgr2=0x7f88f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.649+0000 7f891b83e700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f88f8060550 0x7f88f8062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8910009d20 tx=0x7f89100091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.649+0000 7f891b83e700 1 -- 172.21.15.37:0/1879854444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89140ab5a0 msgr2=0x7f8914157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.649+0000 7f891b83e700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89140ab5a0 0x7f8914157840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f890c00e380 tx=0x7f890c00b040 comp rx=0 tx=0).stop 2023-10-06T04:39:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.649+0000 7f891b83e700 1 -- 172.21.15.37:0/1879854444 shutdown_connections 2023-10-06T04:39:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.649+0000 7f891b83e700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f88f8060550 0x7f88f8062a00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.649+0000 7f891b83e700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89140aaa90 0x7f891414be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.649+0000 7f891b83e700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89140ab5a0 0x7f8914157840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.649+0000 7f891b83e700 1 --2- 172.21.15.37:0/1879854444 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89140aa6c0 0x7f891414de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.649+0000 7f891b83e700 1 -- 172.21.15.37:0/1879854444 >> 172.21.15.37:0/1879854444 conn(0x7f89140ccc60 msgr2=0x7f89140b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.649+0000 7f891b83e700 1 -- 172.21.15.37:0/1879854444 shutdown_connections 2023-10-06T04:39:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.649+0000 7f891b83e700 1 -- 172.21.15.37:0/1879854444 wait complete. 2023-10-06T04:39:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:39:34.667 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-10-06T04:39:33.036456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381832,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592888,"statfs":{"total":773094113280,"available":770655117312,"internally_reserved":0,"allocated":3612672,"data_stored":2166296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005405"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872498+0000","last_change":"2023-10-06T04:39:14.870069+0000","last_active":"2023-10-06T04:39:14.872498+0000","last_peered":"2023-10-06T04:39:14.872498+0000","last_clean":"2023-10-06T04:39:14.872498+0000","last_became_active":"2023-10-06T04:39:14.869576+0000","last_became_peered":"2023-10-06T04:39:14.869576+0000","last_unstale":"2023-10-06T04:39:14.872498+0000","last_undegraded":"2023-10-06T04:39:14.872498+0000","last_fullsized":"2023-10-06T04:39:14.872498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:25.769047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850210+0000","last_change":"2023-10-06T04:39:09.765548+0000","last_active":"2023-10-06T04:39:14.850210+0000","last_peered":"2023-10-06T04:39:14.850210+0000","last_clean":"2023-10-06T04:39:14.850210+0000","last_became_active":"2023-10-06T04:39:09.765140+0000","last_became_peered":"2023-10-06T04:39:09.765140+0000","last_unstale":"2023-10-06T04:39:14.850210+0000","last_undegraded":"2023-10-06T04:39:14.850210+0000","last_fullsized":"2023-10-06T04:39:14.850210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:58.385216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841115+0000","last_change":"2023-10-06T04:39:10.798882+0000","last_active":"2023-10-06T04:39:14.841115+0000","last_peered":"2023-10-06T04:39:14.841115+0000","last_clean":"2023-10-06T04:39:14.841115+0000","last_became_active":"2023-10-06T04:39:10.796380+0000","last_became_peered":"2023-10-06T04:39:10.796380+0000","last_unstale":"2023-10-06T04:39:14.841115+0000","last_undegraded":"2023-10-06T04:39:14.841115+0000","last_fullsized":"2023-10-06T04:39:14.841115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:29.463649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.860905+0000","last_change":"2023-10-06T04:39:14.859612+0000","last_active":"2023-10-06T04:39:14.860905+0000","last_peered":"2023-10-06T04:39:14.860905+0000","last_clean":"2023-10-06T04:39:14.860905+0000","last_became_active":"2023-10-06T04:39:14.859171+0000","last_became_peered":"2023-10-06T04:39:14.859171+0000","last_unstale":"2023-10-06T04:39:14.860905+0000","last_undegraded":"2023-10-06T04:39:14.860905+0000","last_fullsized":"2023-10-06T04:39:14.860905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:08.925413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838625+0000","last_change":"2023-10-06T04:39:09.772959+0000","last_active":"2023-10-06T04:39:14.838625+0000","last_peered":"2023-10-06T04:39:14.838625+0000","last_clean":"2023-10-06T04:39:14.838625+0000","last_became_active":"2023-10-06T04:39:09.772627+0000","last_became_peered":"2023-10-06T04:39:09.772627+0000","last_unstale":"2023-10-06T04:39:14.838625+0000","last_undegraded":"2023-10-06T04:39:14.838625+0000","last_fullsized":"2023-10-06T04:39:14.838625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.246847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837554+0000","last_change":"2023-10-06T04:39:10.799763+0000","last_active":"2023-10-06T04:39:14.837554+0000","last_peered":"2023-10-06T04:39:14.837554+0000","last_clean":"2023-10-06T04:39:14.837554+0000","last_became_active":"2023-10-06T04:39:10.799183+0000","last_became_peered":"2023-10-06T04:39:10.799183+0000","last_unstale":"2023-10-06T04:39:14.837554+0000","last_undegraded":"2023-10-06T04:39:14.837554+0000","last_fullsized":"2023-10-06T04:39:14.837554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:23.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876042+0000","last_change":"2023-10-06T04:39:14.874393+0000","last_active":"2023-10-06T04:39:14.876042+0000","last_peered":"2023-10-06T04:39:14.876042+0000","last_clean":"2023-10-06T04:39:14.876042+0000","last_became_active":"2023-10-06T04:39:14.873970+0000","last_became_peered":"2023-10-06T04:39:14.873970+0000","last_unstale":"2023-10-06T04:39:14.876042+0000","last_undegraded":"2023-10-06T04:39:14.876042+0000","last_fullsized":"2023-10-06T04:39:14.876042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:42.042299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853530+0000","last_change":"2023-10-06T04:39:09.776483+0000","last_active":"2023-10-06T04:39:14.853530+0000","last_peered":"2023-10-06T04:39:14.853530+0000","last_clean":"2023-10-06T04:39:14.853530+0000","last_became_active":"2023-10-06T04:39:09.776194+0000","last_became_peered":"2023-10-06T04:39:09.776194+0000","last_unstale":"2023-10-06T04:39:14.853530+0000","last_undegraded":"2023-10-06T04:39:14.853530+0000","last_fullsized":"2023-10-06T04:39:14.853530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:25.823920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841254+0000","last_change":"2023-10-06T04:39:10.806796+0000","last_active":"2023-10-06T04:39:14.841254+0000","last_peered":"2023-10-06T04:39:14.841254+0000","last_clean":"2023-10-06T04:39:14.841254+0000","last_became_active":"2023-10-06T04:39:10.803473+0000","last_became_peered":"2023-10-06T04:39:10.803473+0000","last_unstale":"2023-10-06T04:39:14.841254+0000","last_undegraded":"2023-10-06T04:39:14.841254+0000","last_fullsized":"2023-10-06T04:39:14.841254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:01.174439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872813+0000","last_change":"2023-10-06T04:39:14.868943+0000","last_active":"2023-10-06T04:39:14.872813+0000","last_peered":"2023-10-06T04:39:14.872813+0000","last_clean":"2023-10-06T04:39:14.872813+0000","last_became_active":"2023-10-06T04:39:14.868312+0000","last_became_peered":"2023-10-06T04:39:14.868312+0000","last_unstale":"2023-10-06T04:39:14.872813+0000","last_undegraded":"2023-10-06T04:39:14.872813+0000","last_fullsized":"2023-10-06T04:39:14.872813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:07.134968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852547+0000","last_change":"2023-10-06T04:39:09.771371+0000","last_active":"2023-10-06T04:39:14.852547+0000","last_peered":"2023-10-06T04:39:14.852547+0000","last_clean":"2023-10-06T04:39:14.852547+0000","last_became_active":"2023-10-06T04:39:09.771102+0000","last_became_peered":"2023-10-06T04:39:09.771102+0000","last_unstale":"2023-10-06T04:39:14.852547+0000","last_undegraded":"2023-10-06T04:39:14.852547+0000","last_fullsized":"2023-10-06T04:39:14.852547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:17.992483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841809+0000","last_change":"2023-10-06T04:39:10.807784+0000","last_active":"2023-10-06T04:39:14.841809+0000","last_peered":"2023-10-06T04:39:14.841809+0000","last_clean":"2023-10-06T04:39:14.841809+0000","last_became_active":"2023-10-06T04:39:10.807517+0000","last_became_peered":"2023-10-06T04:39:10.807517+0000","last_unstale":"2023-10-06T04:39:14.841809+0000","last_undegraded":"2023-10-06T04:39:14.841809+0000","last_fullsized":"2023-10-06T04:39:14.841809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:01.254363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.878158+0000","last_change":"2023-10-06T04:39:14.873431+0000","last_active":"2023-10-06T04:39:14.878158+0000","last_peered":"2023-10-06T04:39:14.878158+0000","last_clean":"2023-10-06T04:39:14.878158+0000","last_became_active":"2023-10-06T04:39:14.873014+0000","last_became_peered":"2023-10-06T04:39:14.873014+0000","last_unstale":"2023-10-06T04:39:14.878158+0000","last_undegraded":"2023-10-06T04:39:14.878158+0000","last_fullsized":"2023-10-06T04:39:14.878158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:13.279378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848648+0000","last_change":"2023-10-06T04:39:09.777180+0000","last_active":"2023-10-06T04:39:14.848648+0000","last_peered":"2023-10-06T04:39:14.848648+0000","last_clean":"2023-10-06T04:39:14.848648+0000","last_became_active":"2023-10-06T04:39:09.776838+0000","last_became_peered":"2023-10-06T04:39:09.776838+0000","last_unstale":"2023-10-06T04:39:14.848648+0000","last_undegraded":"2023-10-06T04:39:14.848648+0000","last_fullsized":"2023-10-06T04:39:14.848648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:10.617248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842412+0000","last_change":"2023-10-06T04:39:10.806300+0000","last_active":"2023-10-06T04:39:14.842412+0000","last_peered":"2023-10-06T04:39:14.842412+0000","last_clean":"2023-10-06T04:39:14.842412+0000","last_became_active":"2023-10-06T04:39:10.800539+0000","last_became_peered":"2023-10-06T04:39:10.800539+0000","last_unstale":"2023-10-06T04:39:14.842412+0000","last_undegraded":"2023-10-06T04:39:14.842412+0000","last_fullsized":"2023-10-06T04:39:14.842412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:26.827588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.867191+0000","last_change":"2023-10-06T04:39:14.863502+0000","last_active":"2023-10-06T04:39:14.867191+0000","last_peered":"2023-10-06T04:39:14.867191+0000","last_clean":"2023-10-06T04:39:14.867191+0000","last_became_active":"2023-10-06T04:39:14.863064+0000","last_became_peered":"2023-10-06T04:39:14.863064+0000","last_unstale":"2023-10-06T04:39:14.867191+0000","last_undegraded":"2023-10-06T04:39:14.867191+0000","last_fullsized":"2023-10-06T04:39:14.867191+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:55.304482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841597+0000","last_change":"2023-10-06T04:39:09.770501+0000","last_active":"2023-10-06T04:39:14.841597+0000","last_peered":"2023-10-06T04:39:14.841597+0000","last_clean":"2023-10-06T04:39:14.841597+0000","last_became_active":"2023-10-06T04:39:09.770199+0000","last_became_peered":"2023-10-06T04:39:09.770199+0000","last_unstale":"2023-10-06T04:39:14.841597+0000","last_undegraded":"2023-10-06T04:39:14.841597+0000","last_fullsized":"2023-10-06T04:39:14.841597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:46.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838286+0000","last_change":"2023-10-06T04:39:10.798539+0000","last_active":"2023-10-06T04:39:14.838286+0000","last_peered":"2023-10-06T04:39:14.838286+0000","last_clean":"2023-10-06T04:39:14.838286+0000","last_became_active":"2023-10-06T04:39:10.798237+0000","last_became_peered":"2023-10-06T04:39:10.798237+0000","last_unstale":"2023-10-06T04:39:14.838286+0000","last_undegraded":"2023-10-06T04:39:14.838286+0000","last_fullsized":"2023-10-06T04:39:14.838286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:10.727863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876193+0000","last_change":"2023-10-06T04:39:14.872340+0000","last_active":"2023-10-06T04:39:14.876193+0000","last_peered":"2023-10-06T04:39:14.876193+0000","last_clean":"2023-10-06T04:39:14.876193+0000","last_became_active":"2023-10-06T04:39:14.871698+0000","last_became_peered":"2023-10-06T04:39:14.871698+0000","last_unstale":"2023-10-06T04:39:14.876193+0000","last_undegraded":"2023-10-06T04:39:14.876193+0000","last_fullsized":"2023-10-06T04:39:14.876193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:21.553198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855800+0000","last_change":"2023-10-06T04:39:09.773699+0000","last_active":"2023-10-06T04:39:14.855800+0000","last_peered":"2023-10-06T04:39:14.855800+0000","last_clean":"2023-10-06T04:39:14.855800+0000","last_became_active":"2023-10-06T04:39:09.773399+0000","last_became_peered":"2023-10-06T04:39:09.773399+0000","last_unstale":"2023-10-06T04:39:14.855800+0000","last_undegraded":"2023-10-06T04:39:14.855800+0000","last_fullsized":"2023-10-06T04:39:14.855800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:25.823920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851512+0000","last_change":"2023-10-06T04:39:10.795142+0000","last_active":"2023-10-06T04:39:14.851512+0000","last_peered":"2023-10-06T04:39:14.851512+0000","last_clean":"2023-10-06T04:39:14.851512+0000","last_became_active":"2023-10-06T04:39:10.794525+0000","last_became_peered":"2023-10-06T04:39:10.794525+0000","last_unstale":"2023-10-06T04:39:14.851512+0000","last_undegraded":"2023-10-06T04:39:14.851512+0000","last_fullsized":"2023-10-06T04:39:14.851512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.875584+0000","last_change":"2023-10-06T04:39:14.869540+0000","last_active":"2023-10-06T04:39:14.875584+0000","last_peered":"2023-10-06T04:39:14.875584+0000","last_clean":"2023-10-06T04:39:14.875584+0000","last_became_active":"2023-10-06T04:39:14.869118+0000","last_became_peered":"2023-10-06T04:39:14.869118+0000","last_unstale":"2023-10-06T04:39:14.875584+0000","last_undegraded":"2023-10-06T04:39:14.875584+0000","last_fullsized":"2023-10-06T04:39:14.875584+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:32.206420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837301+0000","last_change":"2023-10-06T04:39:09.776975+0000","last_active":"2023-10-06T04:39:14.837301+0000","last_peered":"2023-10-06T04:39:14.837301+0000","last_clean":"2023-10-06T04:39:14.837301+0000","last_became_active":"2023-10-06T04:39:09.776600+0000","last_became_peered":"2023-10-06T04:39:09.776600+0000","last_unstale":"2023-10-06T04:39:14.837301+0000","last_undegraded":"2023-10-06T04:39:14.837301+0000","last_fullsized":"2023-10-06T04:39:14.837301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:10.617248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848811+0000","last_change":"2023-10-06T04:39:10.795446+0000","last_active":"2023-10-06T04:39:14.848811+0000","last_peered":"2023-10-06T04:39:14.848811+0000","last_clean":"2023-10-06T04:39:14.848811+0000","last_became_active":"2023-10-06T04:39:10.795269+0000","last_became_peered":"2023-10-06T04:39:10.795269+0000","last_unstale":"2023-10-06T04:39:14.848811+0000","last_undegraded":"2023-10-06T04:39:14.848811+0000","last_fullsized":"2023-10-06T04:39:14.848811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:21.233331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.836827+0000","last_change":"2023-10-06T04:39:10.796045+0000","last_active":"2023-10-06T04:39:14.836827+0000","last_peered":"2023-10-06T04:39:14.836827+0000","last_clean":"2023-10-06T04:39:14.836827+0000","last_became_active":"2023-10-06T04:39:10.795810+0000","last_became_peered":"2023-10-06T04:39:10.795810+0000","last_unstale":"2023-10-06T04:39:14.836827+0000","last_undegraded":"2023-10-06T04:39:14.836827+0000","last_fullsized":"2023-10-06T04:39:14.836827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:01.174439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850318+0000","last_change":"2023-10-06T04:39:09.767108+0000","last_active":"2023-10-06T04:39:14.850318+0000","last_peered":"2023-10-06T04:39:14.850318+0000","last_clean":"2023-10-06T04:39:14.850318+0000","last_became_active":"2023-10-06T04:39:09.765912+0000","last_became_peered":"2023-10-06T04:39:09.765912+0000","last_unstale":"2023-10-06T04:39:14.850318+0000","last_undegraded":"2023-10-06T04:39:14.850318+0000","last_fullsized":"2023-10-06T04:39:14.850318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.246847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.873803+0000","last_change":"2023-10-06T04:39:14.867667+0000","last_active":"2023-10-06T04:39:14.873803+0000","last_peered":"2023-10-06T04:39:14.873803+0000","last_clean":"2023-10-06T04:39:14.873803+0000","last_became_active":"2023-10-06T04:39:14.866987+0000","last_became_peered":"2023-10-06T04:39:14.866987+0000","last_unstale":"2023-10-06T04:39:14.873803+0000","last_undegraded":"2023-10-06T04:39:14.873803+0000","last_fullsized":"2023-10-06T04:39:14.873803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837163+0000","last_change":"2023-10-06T04:39:10.800091+0000","last_active":"2023-10-06T04:39:14.837163+0000","last_peered":"2023-10-06T04:39:14.837163+0000","last_clean":"2023-10-06T04:39:14.837163+0000","last_became_active":"2023-10-06T04:39:10.799013+0000","last_became_peered":"2023-10-06T04:39:10.799013+0000","last_unstale":"2023-10-06T04:39:14.837163+0000","last_undegraded":"2023-10-06T04:39:14.837163+0000","last_fullsized":"2023-10-06T04:39:14.837163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:12.187845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.854203+0000","last_change":"2023-10-06T04:39:09.765938+0000","last_active":"2023-10-06T04:39:14.854203+0000","last_peered":"2023-10-06T04:39:14.854203+0000","last_clean":"2023-10-06T04:39:14.854203+0000","last_became_active":"2023-10-06T04:39:09.765605+0000","last_became_peered":"2023-10-06T04:39:09.765605+0000","last_unstale":"2023-10-06T04:39:14.854203+0000","last_undegraded":"2023-10-06T04:39:14.854203+0000","last_fullsized":"2023-10-06T04:39:14.854203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:29.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876139+0000","last_change":"2023-10-06T04:39:14.874600+0000","last_active":"2023-10-06T04:39:14.876139+0000","last_peered":"2023-10-06T04:39:14.876139+0000","last_clean":"2023-10-06T04:39:14.876139+0000","last_became_active":"2023-10-06T04:39:14.874193+0000","last_became_peered":"2023-10-06T04:39:14.874193+0000","last_unstale":"2023-10-06T04:39:14.876139+0000","last_undegraded":"2023-10-06T04:39:14.876139+0000","last_fullsized":"2023-10-06T04:39:14.876139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:32.206420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.859491+0000","last_change":"2023-10-06T04:39:09.779107+0000","last_active":"2023-10-06T04:39:14.859491+0000","last_peered":"2023-10-06T04:39:14.859491+0000","last_clean":"2023-10-06T04:39:14.859491+0000","last_became_active":"2023-10-06T04:39:09.778810+0000","last_became_peered":"2023-10-06T04:39:09.778810+0000","last_unstale":"2023-10-06T04:39:14.859491+0000","last_undegraded":"2023-10-06T04:39:14.859491+0000","last_fullsized":"2023-10-06T04:39:14.859491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:53:29.527825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855898+0000","last_change":"2023-10-06T04:39:10.801962+0000","last_active":"2023-10-06T04:39:14.855898+0000","last_peered":"2023-10-06T04:39:14.855898+0000","last_clean":"2023-10-06T04:39:14.855898+0000","last_became_active":"2023-10-06T04:39:10.801671+0000","last_became_peered":"2023-10-06T04:39:10.801671+0000","last_unstale":"2023-10-06T04:39:14.855898+0000","last_undegraded":"2023-10-06T04:39:14.855898+0000","last_fullsized":"2023-10-06T04:39:14.855898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:22.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.866385+0000","last_change":"2023-10-06T04:39:14.862383+0000","last_active":"2023-10-06T04:39:14.866385+0000","last_peered":"2023-10-06T04:39:14.866385+0000","last_clean":"2023-10-06T04:39:14.866385+0000","last_became_active":"2023-10-06T04:39:14.861956+0000","last_became_peered":"2023-10-06T04:39:14.861956+0000","last_unstale":"2023-10-06T04:39:14.866385+0000","last_undegraded":"2023-10-06T04:39:14.866385+0000","last_fullsized":"2023-10-06T04:39:14.866385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:49.720754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.672346+0000","last_change":"2023-10-06T04:39:09.780007+0000","last_active":"2023-10-06T04:39:20.672346+0000","last_peered":"2023-10-06T04:39:20.672346+0000","last_clean":"2023-10-06T04:39:20.672346+0000","last_became_active":"2023-10-06T04:39:09.779738+0000","last_became_peered":"2023-10-06T04:39:09.779738+0000","last_unstale":"2023-10-06T04:39:20.672346+0000","last_undegraded":"2023-10-06T04:39:20.672346+0000","last_fullsized":"2023-10-06T04:39:20.672346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:10.617248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841824+0000","last_change":"2023-10-06T04:39:10.801723+0000","last_active":"2023-10-06T04:39:14.841824+0000","last_peered":"2023-10-06T04:39:14.841824+0000","last_clean":"2023-10-06T04:39:14.841824+0000","last_became_active":"2023-10-06T04:39:10.796435+0000","last_became_peered":"2023-10-06T04:39:10.796435+0000","last_unstale":"2023-10-06T04:39:14.841824+0000","last_undegraded":"2023-10-06T04:39:14.841824+0000","last_fullsized":"2023-10-06T04:39:14.841824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:59.444958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872388+0000","last_change":"2023-10-06T04:39:14.868717+0000","last_active":"2023-10-06T04:39:14.872388+0000","last_peered":"2023-10-06T04:39:14.872388+0000","last_clean":"2023-10-06T04:39:14.872388+0000","last_became_active":"2023-10-06T04:39:14.868184+0000","last_became_peered":"2023-10-06T04:39:14.868184+0000","last_unstale":"2023-10-06T04:39:14.872388+0000","last_undegraded":"2023-10-06T04:39:14.872388+0000","last_fullsized":"2023-10-06T04:39:14.872388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:45.298495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841634+0000","last_change":"2023-10-06T04:39:10.801737+0000","last_active":"2023-10-06T04:39:14.841634+0000","last_peered":"2023-10-06T04:39:14.841634+0000","last_clean":"2023-10-06T04:39:14.841634+0000","last_became_active":"2023-10-06T04:39:10.798733+0000","last_became_peered":"2023-10-06T04:39:10.798733+0000","last_unstale":"2023-10-06T04:39:14.841634+0000","last_undegraded":"2023-10-06T04:39:14.841634+0000","last_fullsized":"2023-10-06T04:39:14.841634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:33.684956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848907+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:39:14.848907+0000","last_peered":"2023-10-06T04:39:14.848907+0000","last_clean":"2023-10-06T04:39:14.848907+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:39:14.848907+0000","last_undegraded":"2023-10-06T04:39:14.848907+0000","last_fullsized":"2023-10-06T04:39:14.848907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:15.745754+0000","last_change":"2023-10-06T04:39:09.768361+0000","last_active":"2023-10-06T04:39:15.745754+0000","last_peered":"2023-10-06T04:39:15.745754+0000","last_clean":"2023-10-06T04:39:15.745754+0000","last_became_active":"2023-10-06T04:39:09.766351+0000","last_became_peered":"2023-10-06T04:39:09.766351+0000","last_unstale":"2023-10-06T04:39:15.745754+0000","last_undegraded":"2023-10-06T04:39:15.745754+0000","last_fullsized":"2023-10-06T04:39:15.745754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.815387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.866361+0000","last_change":"2023-10-06T04:39:14.862660+0000","last_active":"2023-10-06T04:39:14.866361+0000","last_peered":"2023-10-06T04:39:14.866361+0000","last_clean":"2023-10-06T04:39:14.866361+0000","last_became_active":"2023-10-06T04:39:14.862199+0000","last_became_peered":"2023-10-06T04:39:14.862199+0000","last_unstale":"2023-10-06T04:39:14.866361+0000","last_undegraded":"2023-10-06T04:39:14.866361+0000","last_fullsized":"2023-10-06T04:39:14.866361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:41.103920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837055+0000","last_change":"2023-10-06T04:39:10.793084+0000","last_active":"2023-10-06T04:39:14.837055+0000","last_peered":"2023-10-06T04:39:14.837055+0000","last_clean":"2023-10-06T04:39:14.837055+0000","last_became_active":"2023-10-06T04:39:10.791458+0000","last_became_peered":"2023-10-06T04:39:10.791458+0000","last_unstale":"2023-10-06T04:39:14.837055+0000","last_undegraded":"2023-10-06T04:39:14.837055+0000","last_fullsized":"2023-10-06T04:39:14.837055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856903+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:39:14.856903+0000","last_peered":"2023-10-06T04:39:14.856903+0000","last_clean":"2023-10-06T04:39:14.856903+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:39:14.856903+0000","last_undegraded":"2023-10-06T04:39:14.856903+0000","last_fullsized":"2023-10-06T04:39:14.856903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.839331+0000","last_change":"2023-10-06T04:39:09.773058+0000","last_active":"2023-10-06T04:39:14.839331+0000","last_peered":"2023-10-06T04:39:14.839331+0000","last_clean":"2023-10-06T04:39:14.839331+0000","last_became_active":"2023-10-06T04:39:09.772555+0000","last_became_peered":"2023-10-06T04:39:09.772555+0000","last_unstale":"2023-10-06T04:39:14.839331+0000","last_undegraded":"2023-10-06T04:39:14.839331+0000","last_fullsized":"2023-10-06T04:39:14.839331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:11.332865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.868688+0000","last_change":"2023-10-06T04:39:14.865402+0000","last_active":"2023-10-06T04:39:14.868688+0000","last_peered":"2023-10-06T04:39:14.868688+0000","last_clean":"2023-10-06T04:39:14.868688+0000","last_became_active":"2023-10-06T04:39:14.864905+0000","last_became_peered":"2023-10-06T04:39:14.864905+0000","last_unstale":"2023-10-06T04:39:14.868688+0000","last_undegraded":"2023-10-06T04:39:14.868688+0000","last_fullsized":"2023-10-06T04:39:14.868688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:58.993957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848392+0000","last_change":"2023-10-06T04:39:10.798497+0000","last_active":"2023-10-06T04:39:14.848392+0000","last_peered":"2023-10-06T04:39:14.848392+0000","last_clean":"2023-10-06T04:39:14.848392+0000","last_became_active":"2023-10-06T04:39:10.798125+0000","last_became_peered":"2023-10-06T04:39:10.798125+0000","last_unstale":"2023-10-06T04:39:14.848392+0000","last_undegraded":"2023-10-06T04:39:14.848392+0000","last_fullsized":"2023-10-06T04:39:14.848392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:12.187845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.859837+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:39:14.859837+0000","last_peered":"2023-10-06T04:39:14.859837+0000","last_clean":"2023-10-06T04:39:14.859837+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:39:14.859837+0000","last_undegraded":"2023-10-06T04:39:14.859837+0000","last_fullsized":"2023-10-06T04:39:14.859837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856260+0000","last_change":"2023-10-06T04:39:09.767635+0000","last_active":"2023-10-06T04:39:14.856260+0000","last_peered":"2023-10-06T04:39:14.856260+0000","last_clean":"2023-10-06T04:39:14.856260+0000","last_became_active":"2023-10-06T04:39:09.766515+0000","last_became_peered":"2023-10-06T04:39:09.766515+0000","last_unstale":"2023-10-06T04:39:14.856260+0000","last_undegraded":"2023-10-06T04:39:14.856260+0000","last_fullsized":"2023-10-06T04:39:14.856260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:17.992483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.867777+0000","last_change":"2023-10-06T04:39:14.863791+0000","last_active":"2023-10-06T04:39:14.867777+0000","last_peered":"2023-10-06T04:39:14.867777+0000","last_clean":"2023-10-06T04:39:14.867777+0000","last_became_active":"2023-10-06T04:39:14.863352+0000","last_became_peered":"2023-10-06T04:39:14.863352+0000","last_unstale":"2023-10-06T04:39:14.867777+0000","last_undegraded":"2023-10-06T04:39:14.867777+0000","last_fullsized":"2023-10-06T04:39:14.867777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855895+0000","last_change":"2023-10-06T04:39:10.797542+0000","last_active":"2023-10-06T04:39:14.855895+0000","last_peered":"2023-10-06T04:39:14.855895+0000","last_clean":"2023-10-06T04:39:14.855895+0000","last_became_active":"2023-10-06T04:39:10.797197+0000","last_became_peered":"2023-10-06T04:39:10.797197+0000","last_unstale":"2023-10-06T04:39:14.855895+0000","last_undegraded":"2023-10-06T04:39:14.855895+0000","last_fullsized":"2023-10-06T04:39:14.855895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:19.381736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856440+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:39:14.856440+0000","last_peered":"2023-10-06T04:39:14.856440+0000","last_clean":"2023-10-06T04:39:14.856440+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:39:14.856440+0000","last_undegraded":"2023-10-06T04:39:14.856440+0000","last_fullsized":"2023-10-06T04:39:14.856440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853612+0000","last_change":"2023-10-06T04:39:09.774270+0000","last_active":"2023-10-06T04:39:14.853612+0000","last_peered":"2023-10-06T04:39:14.853612+0000","last_clean":"2023-10-06T04:39:14.853612+0000","last_became_active":"2023-10-06T04:39:09.773928+0000","last_became_peered":"2023-10-06T04:39:09.773928+0000","last_unstale":"2023-10-06T04:39:14.853612+0000","last_undegraded":"2023-10-06T04:39:14.853612+0000","last_fullsized":"2023-10-06T04:39:14.853612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:02.332937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872357+0000","last_change":"2023-10-06T04:39:14.862336+0000","last_active":"2023-10-06T04:39:14.872357+0000","last_peered":"2023-10-06T04:39:14.872357+0000","last_clean":"2023-10-06T04:39:14.872357+0000","last_became_active":"2023-10-06T04:39:14.861912+0000","last_became_peered":"2023-10-06T04:39:14.861912+0000","last_unstale":"2023-10-06T04:39:14.872357+0000","last_undegraded":"2023-10-06T04:39:14.872357+0000","last_fullsized":"2023-10-06T04:39:14.872357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:21.891013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856096+0000","last_change":"2023-10-06T04:39:10.809172+0000","last_active":"2023-10-06T04:39:14.856096+0000","last_peered":"2023-10-06T04:39:14.856096+0000","last_clean":"2023-10-06T04:39:14.856096+0000","last_became_active":"2023-10-06T04:39:10.808897+0000","last_became_peered":"2023-10-06T04:39:10.808897+0000","last_unstale":"2023-10-06T04:39:14.856096+0000","last_undegraded":"2023-10-06T04:39:14.856096+0000","last_fullsized":"2023-10-06T04:39:14.856096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:35.325688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841922+0000","last_change":"2023-10-06T04:39:09.776105+0000","last_active":"2023-10-06T04:39:14.841922+0000","last_peered":"2023-10-06T04:39:14.841922+0000","last_clean":"2023-10-06T04:39:14.841922+0000","last_became_active":"2023-10-06T04:39:09.775817+0000","last_became_peered":"2023-10-06T04:39:09.775817+0000","last_unstale":"2023-10-06T04:39:14.841922+0000","last_undegraded":"2023-10-06T04:39:14.841922+0000","last_fullsized":"2023-10-06T04:39:14.841922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.815387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850247+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:39:14.850247+0000","last_peered":"2023-10-06T04:39:14.850247+0000","last_clean":"2023-10-06T04:39:14.850247+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:39:14.850247+0000","last_undegraded":"2023-10-06T04:39:14.850247+0000","last_fullsized":"2023-10-06T04:39:14.850247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872489+0000","last_change":"2023-10-06T04:39:14.863703+0000","last_active":"2023-10-06T04:39:14.872489+0000","last_peered":"2023-10-06T04:39:14.872489+0000","last_clean":"2023-10-06T04:39:14.872489+0000","last_became_active":"2023-10-06T04:39:14.863109+0000","last_became_peered":"2023-10-06T04:39:14.863109+0000","last_unstale":"2023-10-06T04:39:14.872489+0000","last_undegraded":"2023-10-06T04:39:14.872489+0000","last_fullsized":"2023-10-06T04:39:14.872489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:42.472361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856436+0000","last_change":"2023-10-06T04:39:10.797649+0000","last_active":"2023-10-06T04:39:14.856436+0000","last_peered":"2023-10-06T04:39:14.856436+0000","last_clean":"2023-10-06T04:39:14.856436+0000","last_became_active":"2023-10-06T04:39:10.797361+0000","last_became_peered":"2023-10-06T04:39:10.797361+0000","last_unstale":"2023-10-06T04:39:14.856436+0000","last_undegraded":"2023-10-06T04:39:14.856436+0000","last_fullsized":"2023-10-06T04:39:14.856436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:26.481455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855493+0000","last_change":"2023-10-06T04:39:09.767363+0000","last_active":"2023-10-06T04:39:14.855493+0000","last_peered":"2023-10-06T04:39:14.855493+0000","last_clean":"2023-10-06T04:39:14.855493+0000","last_became_active":"2023-10-06T04:39:09.766080+0000","last_became_peered":"2023-10-06T04:39:09.766080+0000","last_unstale":"2023-10-06T04:39:14.855493+0000","last_undegraded":"2023-10-06T04:39:14.855493+0000","last_fullsized":"2023-10-06T04:39:14.855493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:43.060143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842850+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:39:14.842850+0000","last_peered":"2023-10-06T04:39:14.842850+0000","last_clean":"2023-10-06T04:39:14.842850+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:39:14.842850+0000","last_undegraded":"2023-10-06T04:39:14.842850+0000","last_fullsized":"2023-10-06T04:39:14.842850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.870947+0000","last_change":"2023-10-06T04:39:14.865800+0000","last_active":"2023-10-06T04:39:14.870947+0000","last_peered":"2023-10-06T04:39:14.870947+0000","last_clean":"2023-10-06T04:39:14.870947+0000","last_became_active":"2023-10-06T04:39:14.863915+0000","last_became_peered":"2023-10-06T04:39:14.863915+0000","last_unstale":"2023-10-06T04:39:14.870947+0000","last_undegraded":"2023-10-06T04:39:14.870947+0000","last_fullsized":"2023-10-06T04:39:14.870947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851680+0000","last_change":"2023-10-06T04:39:10.796784+0000","last_active":"2023-10-06T04:39:14.851680+0000","last_peered":"2023-10-06T04:39:14.851680+0000","last_clean":"2023-10-06T04:39:14.851680+0000","last_became_active":"2023-10-06T04:39:10.796340+0000","last_became_peered":"2023-10-06T04:39:10.796340+0000","last_unstale":"2023-10-06T04:39:14.851680+0000","last_undegraded":"2023-10-06T04:39:14.851680+0000","last_fullsized":"2023-10-06T04:39:14.851680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847307+0000","last_change":"2023-10-06T04:39:09.776306+0000","last_active":"2023-10-06T04:39:14.847307+0000","last_peered":"2023-10-06T04:39:14.847307+0000","last_clean":"2023-10-06T04:39:14.847307+0000","last_became_active":"2023-10-06T04:39:09.775920+0000","last_became_peered":"2023-10-06T04:39:09.775920+0000","last_unstale":"2023-10-06T04:39:14.847307+0000","last_undegraded":"2023-10-06T04:39:14.847307+0000","last_fullsized":"2023-10-06T04:39:14.847307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:46.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852352+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:39:14.852352+0000","last_peered":"2023-10-06T04:39:14.852352+0000","last_clean":"2023-10-06T04:39:14.852352+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:39:14.852352+0000","last_undegraded":"2023-10-06T04:39:14.852352+0000","last_fullsized":"2023-10-06T04:39:14.852352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872195+0000","last_change":"2023-10-06T04:39:14.870766+0000","last_active":"2023-10-06T04:39:14.872195+0000","last_peered":"2023-10-06T04:39:14.872195+0000","last_clean":"2023-10-06T04:39:14.872195+0000","last_became_active":"2023-10-06T04:39:14.870293+0000","last_became_peered":"2023-10-06T04:39:14.870293+0000","last_unstale":"2023-10-06T04:39:14.872195+0000","last_undegraded":"2023-10-06T04:39:14.872195+0000","last_fullsized":"2023-10-06T04:39:14.872195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:25.769047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848956+0000","last_change":"2023-10-06T04:39:10.808367+0000","last_active":"2023-10-06T04:39:14.848956+0000","last_peered":"2023-10-06T04:39:14.848956+0000","last_clean":"2023-10-06T04:39:14.848956+0000","last_became_active":"2023-10-06T04:39:10.808087+0000","last_became_peered":"2023-10-06T04:39:10.808087+0000","last_unstale":"2023-10-06T04:39:14.848956+0000","last_undegraded":"2023-10-06T04:39:14.848956+0000","last_fullsized":"2023-10-06T04:39:14.848956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:52.160791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837257+0000","last_change":"2023-10-06T04:39:09.766937+0000","last_active":"2023-10-06T04:39:14.837257+0000","last_peered":"2023-10-06T04:39:14.837257+0000","last_clean":"2023-10-06T04:39:14.837257+0000","last_became_active":"2023-10-06T04:39:09.766577+0000","last_became_peered":"2023-10-06T04:39:09.766577+0000","last_unstale":"2023-10-06T04:39:14.837257+0000","last_undegraded":"2023-10-06T04:39:14.837257+0000","last_fullsized":"2023-10-06T04:39:14.837257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:58.385216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852746+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:39:14.852746+0000","last_peered":"2023-10-06T04:39:14.852746+0000","last_clean":"2023-10-06T04:39:14.852746+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:39:14.852746+0000","last_undegraded":"2023-10-06T04:39:14.852746+0000","last_fullsized":"2023-10-06T04:39:14.852746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852451+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:39:14.852451+0000","last_peered":"2023-10-06T04:39:14.852451+0000","last_clean":"2023-10-06T04:39:14.852451+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:39:14.852451+0000","last_undegraded":"2023-10-06T04:39:14.852451+0000","last_fullsized":"2023-10-06T04:39:14.852451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869388+0000","last_change":"2023-10-06T04:39:14.867879+0000","last_active":"2023-10-06T04:39:14.869388+0000","last_peered":"2023-10-06T04:39:14.869388+0000","last_clean":"2023-10-06T04:39:14.869388+0000","last_became_active":"2023-10-06T04:39:14.866139+0000","last_became_peered":"2023-10-06T04:39:14.866139+0000","last_unstale":"2023-10-06T04:39:14.869388+0000","last_undegraded":"2023-10-06T04:39:14.869388+0000","last_fullsized":"2023-10-06T04:39:14.869388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:43.629206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856342+0000","last_change":"2023-10-06T04:39:10.803484+0000","last_active":"2023-10-06T04:39:14.856342+0000","last_peered":"2023-10-06T04:39:14.856342+0000","last_clean":"2023-10-06T04:39:14.856342+0000","last_became_active":"2023-10-06T04:39:10.803189+0000","last_became_peered":"2023-10-06T04:39:10.803189+0000","last_unstale":"2023-10-06T04:39:14.856342+0000","last_undegraded":"2023-10-06T04:39:14.856342+0000","last_fullsized":"2023-10-06T04:39:14.856342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:48.240785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837543+0000","last_change":"2023-10-06T04:39:09.774774+0000","last_active":"2023-10-06T04:39:14.837543+0000","last_peered":"2023-10-06T04:39:14.837543+0000","last_clean":"2023-10-06T04:39:14.837543+0000","last_became_active":"2023-10-06T04:39:09.772662+0000","last_became_peered":"2023-10-06T04:39:09.772662+0000","last_unstale":"2023-10-06T04:39:14.837543+0000","last_undegraded":"2023-10-06T04:39:14.837543+0000","last_fullsized":"2023-10-06T04:39:14.837543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.815387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.867295+0000","last_change":"2023-10-06T04:39:14.863555+0000","last_active":"2023-10-06T04:39:14.867295+0000","last_peered":"2023-10-06T04:39:14.867295+0000","last_clean":"2023-10-06T04:39:14.867295+0000","last_became_active":"2023-10-06T04:39:14.863126+0000","last_became_peered":"2023-10-06T04:39:14.863126+0000","last_unstale":"2023-10-06T04:39:14.867295+0000","last_undegraded":"2023-10-06T04:39:14.867295+0000","last_fullsized":"2023-10-06T04:39:14.867295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:58.313292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842510+0000","last_change":"2023-10-06T04:39:10.801300+0000","last_active":"2023-10-06T04:39:14.842510+0000","last_peered":"2023-10-06T04:39:14.842510+0000","last_clean":"2023-10-06T04:39:14.842510+0000","last_became_active":"2023-10-06T04:39:10.797999+0000","last_became_peered":"2023-10-06T04:39:10.797999+0000","last_unstale":"2023-10-06T04:39:14.842510+0000","last_undegraded":"2023-10-06T04:39:14.842510+0000","last_fullsized":"2023-10-06T04:39:14.842510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:23.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841749+0000","last_change":"2023-10-06T04:39:09.772680+0000","last_active":"2023-10-06T04:39:14.841749+0000","last_peered":"2023-10-06T04:39:14.841749+0000","last_clean":"2023-10-06T04:39:14.841749+0000","last_became_active":"2023-10-06T04:39:09.770748+0000","last_became_peered":"2023-10-06T04:39:09.770748+0000","last_unstale":"2023-10-06T04:39:14.841749+0000","last_undegraded":"2023-10-06T04:39:14.841749+0000","last_fullsized":"2023-10-06T04:39:14.841749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:08.396735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.866535+0000","last_change":"2023-10-06T04:39:14.863771+0000","last_active":"2023-10-06T04:39:14.866535+0000","last_peered":"2023-10-06T04:39:14.866535+0000","last_clean":"2023-10-06T04:39:14.866535+0000","last_became_active":"2023-10-06T04:39:14.862562+0000","last_became_peered":"2023-10-06T04:39:14.862562+0000","last_unstale":"2023-10-06T04:39:14.866535+0000","last_undegraded":"2023-10-06T04:39:14.866535+0000","last_fullsized":"2023-10-06T04:39:14.866535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:13.279378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842489+0000","last_change":"2023-10-06T04:39:10.801609+0000","last_active":"2023-10-06T04:39:14.842489+0000","last_peered":"2023-10-06T04:39:14.842489+0000","last_clean":"2023-10-06T04:39:14.842489+0000","last_became_active":"2023-10-06T04:39:10.798490+0000","last_became_peered":"2023-10-06T04:39:10.798490+0000","last_unstale":"2023-10-06T04:39:14.842489+0000","last_undegraded":"2023-10-06T04:39:14.842489+0000","last_fullsized":"2023-10-06T04:39:14.842489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:13.365650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847962+0000","last_change":"2023-10-06T04:39:09.776674+0000","last_active":"2023-10-06T04:39:14.847962+0000","last_peered":"2023-10-06T04:39:14.847962+0000","last_clean":"2023-10-06T04:39:14.847962+0000","last_became_active":"2023-10-06T04:39:09.776334+0000","last_became_peered":"2023-10-06T04:39:09.776334+0000","last_unstale":"2023-10-06T04:39:14.847962+0000","last_undegraded":"2023-10-06T04:39:14.847962+0000","last_fullsized":"2023-10-06T04:39:14.847962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:02.883989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.878170+0000","last_change":"2023-10-06T04:39:14.873753+0000","last_active":"2023-10-06T04:39:14.878170+0000","last_peered":"2023-10-06T04:39:14.878170+0000","last_clean":"2023-10-06T04:39:14.878170+0000","last_became_active":"2023-10-06T04:39:14.873034+0000","last_became_peered":"2023-10-06T04:39:14.873034+0000","last_unstale":"2023-10-06T04:39:14.878170+0000","last_undegraded":"2023-10-06T04:39:14.878170+0000","last_fullsized":"2023-10-06T04:39:14.878170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:26.716449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842122+0000","last_change":"2023-10-06T04:39:10.807800+0000","last_active":"2023-10-06T04:39:14.842122+0000","last_peered":"2023-10-06T04:39:14.842122+0000","last_clean":"2023-10-06T04:39:14.842122+0000","last_became_active":"2023-10-06T04:39:10.807550+0000","last_became_peered":"2023-10-06T04:39:10.807550+0000","last_unstale":"2023-10-06T04:39:14.842122+0000","last_undegraded":"2023-10-06T04:39:14.842122+0000","last_fullsized":"2023-10-06T04:39:14.842122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:10.727863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838754+0000","last_change":"2023-10-06T04:39:09.776972+0000","last_active":"2023-10-06T04:39:14.838754+0000","last_peered":"2023-10-06T04:39:14.838754+0000","last_clean":"2023-10-06T04:39:14.838754+0000","last_became_active":"2023-10-06T04:39:09.776582+0000","last_became_peered":"2023-10-06T04:39:09.776582+0000","last_unstale":"2023-10-06T04:39:14.838754+0000","last_undegraded":"2023-10-06T04:39:14.838754+0000","last_fullsized":"2023-10-06T04:39:14.838754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:46.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.870886+0000","last_change":"2023-10-06T04:39:14.866468+0000","last_active":"2023-10-06T04:39:14.870886+0000","last_peered":"2023-10-06T04:39:14.870886+0000","last_clean":"2023-10-06T04:39:14.870886+0000","last_became_active":"2023-10-06T04:39:14.865978+0000","last_became_peered":"2023-10-06T04:39:14.865978+0000","last_unstale":"2023-10-06T04:39:14.870886+0000","last_undegraded":"2023-10-06T04:39:14.870886+0000","last_fullsized":"2023-10-06T04:39:14.870886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:26.328198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847077+0000","last_change":"2023-10-06T04:39:10.795850+0000","last_active":"2023-10-06T04:39:14.847077+0000","last_peered":"2023-10-06T04:39:14.847077+0000","last_clean":"2023-10-06T04:39:14.847077+0000","last_became_active":"2023-10-06T04:39:10.795532+0000","last_became_peered":"2023-10-06T04:39:10.795532+0000","last_unstale":"2023-10-06T04:39:14.847077+0000","last_undegraded":"2023-10-06T04:39:14.847077+0000","last_fullsized":"2023-10-06T04:39:14.847077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852581+0000","last_change":"2023-10-06T04:39:09.778260+0000","last_active":"2023-10-06T04:39:14.852581+0000","last_peered":"2023-10-06T04:39:14.852581+0000","last_clean":"2023-10-06T04:39:14.852581+0000","last_became_active":"2023-10-06T04:39:09.777976+0000","last_became_peered":"2023-10-06T04:39:09.777976+0000","last_unstale":"2023-10-06T04:39:14.852581+0000","last_undegraded":"2023-10-06T04:39:14.852581+0000","last_fullsized":"2023-10-06T04:39:14.852581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:20.229663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.862419+0000","last_change":"2023-10-06T04:39:14.857650+0000","last_active":"2023-10-06T04:39:14.862419+0000","last_peered":"2023-10-06T04:39:14.862419+0000","last_clean":"2023-10-06T04:39:14.862419+0000","last_became_active":"2023-10-06T04:39:14.857219+0000","last_became_peered":"2023-10-06T04:39:14.857219+0000","last_unstale":"2023-10-06T04:39:14.862419+0000","last_undegraded":"2023-10-06T04:39:14.862419+0000","last_fullsized":"2023-10-06T04:39:14.862419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:39.404929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847783+0000","last_change":"2023-10-06T04:39:10.800707+0000","last_active":"2023-10-06T04:39:14.847783+0000","last_peered":"2023-10-06T04:39:14.847783+0000","last_clean":"2023-10-06T04:39:14.847783+0000","last_became_active":"2023-10-06T04:39:10.800342+0000","last_became_peered":"2023-10-06T04:39:10.800342+0000","last_unstale":"2023-10-06T04:39:14.847783+0000","last_undegraded":"2023-10-06T04:39:14.847783+0000","last_fullsized":"2023-10-06T04:39:14.847783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:55.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.859752+0000","last_change":"2023-10-06T04:39:09.769967+0000","last_active":"2023-10-06T04:39:14.859752+0000","last_peered":"2023-10-06T04:39:14.859752+0000","last_clean":"2023-10-06T04:39:14.859752+0000","last_became_active":"2023-10-06T04:39:09.769644+0000","last_became_peered":"2023-10-06T04:39:09.769644+0000","last_unstale":"2023-10-06T04:39:14.859752+0000","last_undegraded":"2023-10-06T04:39:14.859752+0000","last_fullsized":"2023-10-06T04:39:14.859752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:23.492104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.870881+0000","last_change":"2023-10-06T04:39:14.866314+0000","last_active":"2023-10-06T04:39:14.870881+0000","last_peered":"2023-10-06T04:39:14.870881+0000","last_clean":"2023-10-06T04:39:14.870881+0000","last_became_active":"2023-10-06T04:39:14.864322+0000","last_became_peered":"2023-10-06T04:39:14.864322+0000","last_unstale":"2023-10-06T04:39:14.870881+0000","last_undegraded":"2023-10-06T04:39:14.870881+0000","last_fullsized":"2023-10-06T04:39:14.870881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:16.031710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841402+0000","last_change":"2023-10-06T04:39:10.804925+0000","last_active":"2023-10-06T04:39:14.841402+0000","last_peered":"2023-10-06T04:39:14.841402+0000","last_clean":"2023-10-06T04:39:14.841402+0000","last_became_active":"2023-10-06T04:39:10.804608+0000","last_became_peered":"2023-10-06T04:39:10.804608+0000","last_unstale":"2023-10-06T04:39:14.841402+0000","last_undegraded":"2023-10-06T04:39:14.841402+0000","last_fullsized":"2023-10-06T04:39:14.841402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:11.605186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.862470+0000","last_change":"2023-10-06T04:39:09.779200+0000","last_active":"2023-10-06T04:39:14.862470+0000","last_peered":"2023-10-06T04:39:14.862470+0000","last_clean":"2023-10-06T04:39:14.862470+0000","last_became_active":"2023-10-06T04:39:09.778902+0000","last_became_peered":"2023-10-06T04:39:09.778902+0000","last_unstale":"2023-10-06T04:39:14.862470+0000","last_undegraded":"2023-10-06T04:39:14.862470+0000","last_fullsized":"2023-10-06T04:39:14.862470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:43.836062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869506+0000","last_change":"2023-10-06T04:39:14.865345+0000","last_active":"2023-10-06T04:39:14.869506+0000","last_peered":"2023-10-06T04:39:14.869506+0000","last_clean":"2023-10-06T04:39:14.869506+0000","last_became_active":"2023-10-06T04:39:14.864895+0000","last_became_peered":"2023-10-06T04:39:14.864895+0000","last_unstale":"2023-10-06T04:39:14.869506+0000","last_undegraded":"2023-10-06T04:39:14.869506+0000","last_fullsized":"2023-10-06T04:39:14.869506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:04.884267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.846486+0000","last_change":"2023-10-06T04:39:10.798199+0000","last_active":"2023-10-06T04:39:14.846486+0000","last_peered":"2023-10-06T04:39:14.846486+0000","last_clean":"2023-10-06T04:39:14.846486+0000","last_became_active":"2023-10-06T04:39:10.797887+0000","last_became_peered":"2023-10-06T04:39:10.797887+0000","last_unstale":"2023-10-06T04:39:14.846486+0000","last_undegraded":"2023-10-06T04:39:14.846486+0000","last_fullsized":"2023-10-06T04:39:14.846486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:18.751471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.860419+0000","last_change":"2023-10-06T04:39:09.778482+0000","last_active":"2023-10-06T04:39:14.860419+0000","last_peered":"2023-10-06T04:39:14.860419+0000","last_clean":"2023-10-06T04:39:14.860419+0000","last_became_active":"2023-10-06T04:39:09.778203+0000","last_became_peered":"2023-10-06T04:39:09.778203+0000","last_unstale":"2023-10-06T04:39:14.860419+0000","last_undegraded":"2023-10-06T04:39:14.860419+0000","last_fullsized":"2023-10-06T04:39:14.860419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:57.313274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.873841+0000","last_change":"2023-10-06T04:39:14.869414+0000","last_active":"2023-10-06T04:39:14.873841+0000","last_peered":"2023-10-06T04:39:14.873841+0000","last_clean":"2023-10-06T04:39:14.873841+0000","last_became_active":"2023-10-06T04:39:14.866496+0000","last_became_peered":"2023-10-06T04:39:14.866496+0000","last_unstale":"2023-10-06T04:39:14.873841+0000","last_undegraded":"2023-10-06T04:39:14.873841+0000","last_fullsized":"2023-10-06T04:39:14.873841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:21.891013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.863781+0000","last_change":"2023-10-06T04:39:14.862719+0000","last_active":"2023-10-06T04:39:14.863781+0000","last_peered":"2023-10-06T04:39:14.863781+0000","last_clean":"2023-10-06T04:39:14.863781+0000","last_became_active":"2023-10-06T04:39:14.862055+0000","last_became_peered":"2023-10-06T04:39:14.862055+0000","last_unstale":"2023-10-06T04:39:14.863781+0000","last_undegraded":"2023-10-06T04:39:14.863781+0000","last_fullsized":"2023-10-06T04:39:14.863781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:13.176385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847135+0000","last_change":"2023-10-06T04:39:09.765721+0000","last_active":"2023-10-06T04:39:14.847135+0000","last_peered":"2023-10-06T04:39:14.847135+0000","last_clean":"2023-10-06T04:39:14.847135+0000","last_became_active":"2023-10-06T04:39:09.765371+0000","last_became_peered":"2023-10-06T04:39:09.765371+0000","last_unstale":"2023-10-06T04:39:14.847135+0000","last_undegraded":"2023-10-06T04:39:14.847135+0000","last_fullsized":"2023-10-06T04:39:14.847135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:46.555480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.839035+0000","last_change":"2023-10-06T04:39:10.802886+0000","last_active":"2023-10-06T04:39:14.839035+0000","last_peered":"2023-10-06T04:39:14.839035+0000","last_clean":"2023-10-06T04:39:14.839035+0000","last_became_active":"2023-10-06T04:39:10.802550+0000","last_became_peered":"2023-10-06T04:39:10.802550+0000","last_unstale":"2023-10-06T04:39:14.839035+0000","last_undegraded":"2023-10-06T04:39:14.839035+0000","last_fullsized":"2023-10-06T04:39:14.839035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869112+0000","last_change":"2023-10-06T04:39:14.865749+0000","last_active":"2023-10-06T04:39:14.869112+0000","last_peered":"2023-10-06T04:39:14.869112+0000","last_clean":"2023-10-06T04:39:14.869112+0000","last_became_active":"2023-10-06T04:39:14.865283+0000","last_became_peered":"2023-10-06T04:39:14.865283+0000","last_unstale":"2023-10-06T04:39:14.869112+0000","last_undegraded":"2023-10-06T04:39:14.869112+0000","last_fullsized":"2023-10-06T04:39:14.869112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:22.513353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.858777+0000","last_change":"2023-10-06T04:39:09.778439+0000","last_active":"2023-10-06T04:39:14.858777+0000","last_peered":"2023-10-06T04:39:14.858777+0000","last_clean":"2023-10-06T04:39:14.858777+0000","last_became_active":"2023-10-06T04:39:09.778107+0000","last_became_peered":"2023-10-06T04:39:09.778107+0000","last_unstale":"2023-10-06T04:39:14.858777+0000","last_undegraded":"2023-10-06T04:39:14.858777+0000","last_fullsized":"2023-10-06T04:39:14.858777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:14.344401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851798+0000","last_change":"2023-10-06T04:39:10.800973+0000","last_active":"2023-10-06T04:39:14.851798+0000","last_peered":"2023-10-06T04:39:14.851798+0000","last_clean":"2023-10-06T04:39:14.851798+0000","last_became_active":"2023-10-06T04:39:10.800682+0000","last_became_peered":"2023-10-06T04:39:10.800682+0000","last_unstale":"2023-10-06T04:39:14.851798+0000","last_undegraded":"2023-10-06T04:39:14.851798+0000","last_fullsized":"2023-10-06T04:39:14.851798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:10.727863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847077+0000","last_change":"2023-10-06T04:39:09.766574+0000","last_active":"2023-10-06T04:39:14.847077+0000","last_peered":"2023-10-06T04:39:14.847077+0000","last_clean":"2023-10-06T04:39:14.847077+0000","last_became_active":"2023-10-06T04:39:09.765846+0000","last_became_peered":"2023-10-06T04:39:09.765846+0000","last_unstale":"2023-10-06T04:39:14.847077+0000","last_undegraded":"2023-10-06T04:39:14.847077+0000","last_fullsized":"2023-10-06T04:39:14.847077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:11.332865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853442+0000","last_change":"2023-10-06T04:39:10.800587+0000","last_active":"2023-10-06T04:39:14.853442+0000","last_peered":"2023-10-06T04:39:14.853442+0000","last_clean":"2023-10-06T04:39:14.853442+0000","last_became_active":"2023-10-06T04:39:10.798566+0000","last_became_peered":"2023-10-06T04:39:10.798566+0000","last_unstale":"2023-10-06T04:39:14.853442+0000","last_undegraded":"2023-10-06T04:39:14.853442+0000","last_fullsized":"2023-10-06T04:39:14.853442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:22.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869120+0000","last_change":"2023-10-06T04:39:14.865777+0000","last_active":"2023-10-06T04:39:14.869120+0000","last_peered":"2023-10-06T04:39:14.869120+0000","last_clean":"2023-10-06T04:39:14.869120+0000","last_became_active":"2023-10-06T04:39:14.865221+0000","last_became_peered":"2023-10-06T04:39:14.865221+0000","last_unstale":"2023-10-06T04:39:14.869120+0000","last_undegraded":"2023-10-06T04:39:14.869120+0000","last_fullsized":"2023-10-06T04:39:14.869120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:59.144138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851863+0000","last_change":"2023-10-06T04:39:09.779350+0000","last_active":"2023-10-06T04:39:14.851863+0000","last_peered":"2023-10-06T04:39:14.851863+0000","last_clean":"2023-10-06T04:39:14.851863+0000","last_became_active":"2023-10-06T04:39:09.778933+0000","last_became_peered":"2023-10-06T04:39:09.778933+0000","last_unstale":"2023-10-06T04:39:14.851863+0000","last_undegraded":"2023-10-06T04:39:14.851863+0000","last_fullsized":"2023-10-06T04:39:14.851863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:44.185428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838211+0000","last_change":"2023-10-06T04:39:10.803199+0000","last_active":"2023-10-06T04:39:14.838211+0000","last_peered":"2023-10-06T04:39:14.838211+0000","last_clean":"2023-10-06T04:39:14.838211+0000","last_became_active":"2023-10-06T04:39:10.802891+0000","last_became_peered":"2023-10-06T04:39:10.802891+0000","last_unstale":"2023-10-06T04:39:14.838211+0000","last_undegraded":"2023-10-06T04:39:14.838211+0000","last_fullsized":"2023-10-06T04:39:14.838211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876047+0000","last_change":"2023-10-06T04:39:14.874845+0000","last_active":"2023-10-06T04:39:14.876047+0000","last_peered":"2023-10-06T04:39:14.876047+0000","last_clean":"2023-10-06T04:39:14.876047+0000","last_became_active":"2023-10-06T04:39:14.874448+0000","last_became_peered":"2023-10-06T04:39:14.874448+0000","last_unstale":"2023-10-06T04:39:14.876047+0000","last_undegraded":"2023-10-06T04:39:14.876047+0000","last_fullsized":"2023-10-06T04:39:14.876047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:35.411077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847019+0000","last_change":"2023-10-06T04:39:10.796169+0000","last_active":"2023-10-06T04:39:14.847019+0000","last_peered":"2023-10-06T04:39:14.847019+0000","last_clean":"2023-10-06T04:39:14.847019+0000","last_became_active":"2023-10-06T04:39:10.795900+0000","last_became_peered":"2023-10-06T04:39:10.795900+0000","last_unstale":"2023-10-06T04:39:14.847019+0000","last_undegraded":"2023-10-06T04:39:14.847019+0000","last_fullsized":"2023-10-06T04:39:14.847019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:03.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.836968+0000","last_change":"2023-10-06T04:39:10.803152+0000","last_active":"2023-10-06T04:39:14.836968+0000","last_peered":"2023-10-06T04:39:14.836968+0000","last_clean":"2023-10-06T04:39:14.836968+0000","last_became_active":"2023-10-06T04:39:10.802831+0000","last_became_peered":"2023-10-06T04:39:10.802831+0000","last_unstale":"2023-10-06T04:39:14.836968+0000","last_undegraded":"2023-10-06T04:39:14.836968+0000","last_fullsized":"2023-10-06T04:39:14.836968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.405720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841420+0000","last_change":"2023-10-06T04:39:10.801514+0000","last_active":"2023-10-06T04:39:14.841420+0000","last_peered":"2023-10-06T04:39:14.841420+0000","last_clean":"2023-10-06T04:39:14.841420+0000","last_became_active":"2023-10-06T04:39:10.798059+0000","last_became_peered":"2023-10-06T04:39:10.798059+0000","last_unstale":"2023-10-06T04:39:14.841420+0000","last_undegraded":"2023-10-06T04:39:14.841420+0000","last_fullsized":"2023-10-06T04:39:14.841420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838585+0000","last_change":"2023-10-06T04:39:10.799859+0000","last_active":"2023-10-06T04:39:14.838585+0000","last_peered":"2023-10-06T04:39:14.838585+0000","last_clean":"2023-10-06T04:39:14.838585+0000","last_became_active":"2023-10-06T04:39:10.799533+0000","last_became_peered":"2023-10-06T04:39:10.799533+0000","last_unstale":"2023-10-06T04:39:14.838585+0000","last_undegraded":"2023-10-06T04:39:14.838585+0000","last_fullsized":"2023-10-06T04:39:14.838585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:11.209344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856350+0000","last_change":"2023-10-06T04:39:10.795334+0000","last_active":"2023-10-06T04:39:14.856350+0000","last_peered":"2023-10-06T04:39:14.856350+0000","last_clean":"2023-10-06T04:39:14.856350+0000","last_became_active":"2023-10-06T04:39:10.795033+0000","last_became_peered":"2023-10-06T04:39:10.795033+0000","last_unstale":"2023-10-06T04:39:14.856350+0000","last_undegraded":"2023-10-06T04:39:14.856350+0000","last_fullsized":"2023-10-06T04:39:14.856350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:18.751471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853357+0000","last_change":"2023-10-06T04:39:10.799770+0000","last_active":"2023-10-06T04:39:14.853357+0000","last_peered":"2023-10-06T04:39:14.853357+0000","last_clean":"2023-10-06T04:39:14.853357+0000","last_became_active":"2023-10-06T04:39:10.798941+0000","last_became_peered":"2023-10-06T04:39:10.798941+0000","last_unstale":"2023-10-06T04:39:14.853357+0000","last_undegraded":"2023-10-06T04:39:14.853357+0000","last_fullsized":"2023-10-06T04:39:14.853357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:52.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856727+0000","last_change":"2023-10-06T04:39:10.795471+0000","last_active":"2023-10-06T04:39:14.856727+0000","last_peered":"2023-10-06T04:39:14.856727+0000","last_clean":"2023-10-06T04:39:14.856727+0000","last_became_active":"2023-10-06T04:39:10.795120+0000","last_became_peered":"2023-10-06T04:39:10.795120+0000","last_unstale":"2023-10-06T04:39:14.856727+0000","last_undegraded":"2023-10-06T04:39:14.856727+0000","last_fullsized":"2023-10-06T04:39:14.856727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:52.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856227+0000","last_change":"2023-10-06T04:39:10.799379+0000","last_active":"2023-10-06T04:39:14.856227+0000","last_peered":"2023-10-06T04:39:14.856227+0000","last_clean":"2023-10-06T04:39:14.856227+0000","last_became_active":"2023-10-06T04:39:10.799087+0000","last_became_peered":"2023-10-06T04:39:10.799087+0000","last_unstale":"2023-10-06T04:39:14.856227+0000","last_undegraded":"2023-10-06T04:39:14.856227+0000","last_fullsized":"2023-10-06T04:39:14.856227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:38.502648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852196+0000","last_change":"2023-10-06T04:39:10.804696+0000","last_active":"2023-10-06T04:39:14.852196+0000","last_peered":"2023-10-06T04:39:14.852196+0000","last_clean":"2023-10-06T04:39:14.852196+0000","last_became_active":"2023-10-06T04:39:10.804399+0000","last_became_peered":"2023-10-06T04:39:10.804399+0000","last_unstale":"2023-10-06T04:39:14.852196+0000","last_undegraded":"2023-10-06T04:39:14.852196+0000","last_fullsized":"2023-10-06T04:39:14.852196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.836751+0000","last_change":"2023-10-06T04:39:10.799293+0000","last_active":"2023-10-06T04:39:14.836751+0000","last_peered":"2023-10-06T04:39:14.836751+0000","last_clean":"2023-10-06T04:39:14.836751+0000","last_became_active":"2023-10-06T04:39:10.798825+0000","last_became_peered":"2023-10-06T04:39:10.798825+0000","last_unstale":"2023-10-06T04:39:14.836751+0000","last_undegraded":"2023-10-06T04:39:14.836751+0000","last_fullsized":"2023-10-06T04:39:14.836751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.420412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.846972+0000","last_change":"2023-10-06T04:39:10.797145+0000","last_active":"2023-10-06T04:39:14.846972+0000","last_peered":"2023-10-06T04:39:14.846972+0000","last_clean":"2023-10-06T04:39:14.846972+0000","last_became_active":"2023-10-06T04:39:10.796689+0000","last_became_peered":"2023-10-06T04:39:10.796689+0000","last_unstale":"2023-10-06T04:39:14.846972+0000","last_undegraded":"2023-10-06T04:39:14.846972+0000","last_fullsized":"2023-10-06T04:39:14.846972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:11.209344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851753+0000","last_change":"2023-10-06T04:39:10.805749+0000","last_active":"2023-10-06T04:39:14.851753+0000","last_peered":"2023-10-06T04:39:14.851753+0000","last_clean":"2023-10-06T04:39:14.851753+0000","last_became_active":"2023-10-06T04:39:10.804977+0000","last_became_peered":"2023-10-06T04:39:10.804977+0000","last_unstale":"2023-10-06T04:39:14.851753+0000","last_undegraded":"2023-10-06T04:39:14.851753+0000","last_fullsized":"2023-10-06T04:39:14.851753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:23.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841933+0000","last_change":"2023-10-06T04:39:10.794553+0000","last_active":"2023-10-06T04:39:14.841933+0000","last_peered":"2023-10-06T04:39:14.841933+0000","last_clean":"2023-10-06T04:39:14.841933+0000","last_became_active":"2023-10-06T04:39:10.794274+0000","last_became_peered":"2023-10-06T04:39:10.794274+0000","last_unstale":"2023-10-06T04:39:14.841933+0000","last_undegraded":"2023-10-06T04:39:14.841933+0000","last_fullsized":"2023-10-06T04:39:14.841933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:33.941624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842368+0000","last_change":"2023-10-06T04:39:10.800418+0000","last_active":"2023-10-06T04:39:14.842368+0000","last_peered":"2023-10-06T04:39:14.842368+0000","last_clean":"2023-10-06T04:39:14.842368+0000","last_became_active":"2023-10-06T04:39:10.799986+0000","last_became_peered":"2023-10-06T04:39:10.799986+0000","last_unstale":"2023-10-06T04:39:14.842368+0000","last_undegraded":"2023-10-06T04:39:14.842368+0000","last_fullsized":"2023-10-06T04:39:14.842368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:03.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842492+0000","last_change":"2023-10-06T04:39:10.801586+0000","last_active":"2023-10-06T04:39:14.842492+0000","last_peered":"2023-10-06T04:39:14.842492+0000","last_clean":"2023-10-06T04:39:14.842492+0000","last_became_active":"2023-10-06T04:39:10.798761+0000","last_became_peered":"2023-10-06T04:39:10.798761+0000","last_unstale":"2023-10-06T04:39:14.842492+0000","last_undegraded":"2023-10-06T04:39:14.842492+0000","last_fullsized":"2023-10-06T04:39:14.842492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.420412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850097+0000","last_change":"2023-10-06T04:39:10.805013+0000","last_active":"2023-10-06T04:39:14.850097+0000","last_peered":"2023-10-06T04:39:14.850097+0000","last_clean":"2023-10-06T04:39:14.850097+0000","last_became_active":"2023-10-06T04:39:10.804231+0000","last_became_peered":"2023-10-06T04:39:10.804231+0000","last_unstale":"2023-10-06T04:39:14.850097+0000","last_undegraded":"2023-10-06T04:39:14.850097+0000","last_fullsized":"2023-10-06T04:39:14.850097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.405720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.840959+0000","last_change":"2023-10-06T04:39:10.798938+0000","last_active":"2023-10-06T04:39:14.840959+0000","last_peered":"2023-10-06T04:39:14.840959+0000","last_clean":"2023-10-06T04:39:14.840959+0000","last_became_active":"2023-10-06T04:39:10.798178+0000","last_became_peered":"2023-10-06T04:39:10.798178+0000","last_unstale":"2023-10-06T04:39:14.840959+0000","last_undegraded":"2023-10-06T04:39:14.840959+0000","last_fullsized":"2023-10-06T04:39:14.840959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853520+0000","last_change":"2023-10-06T04:39:10.804784+0000","last_active":"2023-10-06T04:39:14.853520+0000","last_peered":"2023-10-06T04:39:14.853520+0000","last_clean":"2023-10-06T04:39:14.853520+0000","last_became_active":"2023-10-06T04:39:10.804072+0000","last_became_peered":"2023-10-06T04:39:10.804072+0000","last_unstale":"2023-10-06T04:39:14.853520+0000","last_undegraded":"2023-10-06T04:39:14.853520+0000","last_fullsized":"2023-10-06T04:39:14.853520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:11.209344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.849546+0000","last_change":"2023-10-06T04:39:10.794908+0000","last_active":"2023-10-06T04:39:14.849546+0000","last_peered":"2023-10-06T04:39:14.849546+0000","last_clean":"2023-10-06T04:39:14.849546+0000","last_became_active":"2023-10-06T04:39:10.794629+0000","last_became_peered":"2023-10-06T04:39:10.794629+0000","last_unstale":"2023-10-06T04:39:14.849546+0000","last_undegraded":"2023-10-06T04:39:14.849546+0000","last_fullsized":"2023-10-06T04:39:14.849546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:02.105244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841856+0000","last_change":"2023-10-06T04:39:10.807415+0000","last_active":"2023-10-06T04:39:14.841856+0000","last_peered":"2023-10-06T04:39:14.841856+0000","last_clean":"2023-10-06T04:39:14.841856+0000","last_became_active":"2023-10-06T04:39:10.807005+0000","last_became_peered":"2023-10-06T04:39:10.807005+0000","last_unstale":"2023-10-06T04:39:14.841856+0000","last_undegraded":"2023-10-06T04:39:14.841856+0000","last_fullsized":"2023-10-06T04:39:14.841856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:30.195878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842269+0000","last_change":"2023-10-06T04:39:10.798512+0000","last_active":"2023-10-06T04:39:14.842269+0000","last_peered":"2023-10-06T04:39:14.842269+0000","last_clean":"2023-10-06T04:39:14.842269+0000","last_became_active":"2023-10-06T04:39:10.798009+0000","last_became_peered":"2023-10-06T04:39:10.798009+0000","last_unstale":"2023-10-06T04:39:14.842269+0000","last_undegraded":"2023-10-06T04:39:14.842269+0000","last_fullsized":"2023-10-06T04:39:14.842269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:55.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842361+0000","last_change":"2023-10-06T04:39:10.807187+0000","last_active":"2023-10-06T04:39:14.842361+0000","last_peered":"2023-10-06T04:39:14.842361+0000","last_clean":"2023-10-06T04:39:14.842361+0000","last_became_active":"2023-10-06T04:39:10.801649+0000","last_became_peered":"2023-10-06T04:39:10.801649+0000","last_unstale":"2023-10-06T04:39:14.842361+0000","last_undegraded":"2023-10-06T04:39:14.842361+0000","last_fullsized":"2023-10-06T04:39:14.842361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:13.704974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.854108+0000","last_change":"2023-10-06T04:39:10.807376+0000","last_active":"2023-10-06T04:39:14.854108+0000","last_peered":"2023-10-06T04:39:14.854108+0000","last_clean":"2023-10-06T04:39:14.854108+0000","last_became_active":"2023-10-06T04:39:10.806927+0000","last_became_peered":"2023-10-06T04:39:10.806927+0000","last_unstale":"2023-10-06T04:39:14.854108+0000","last_undegraded":"2023-10-06T04:39:14.854108+0000","last_fullsized":"2023-10-06T04:39:14.854108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:26.481455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.849970+0000","last_change":"2023-10-06T04:39:10.805215+0000","last_active":"2023-10-06T04:39:14.849970+0000","last_peered":"2023-10-06T04:39:14.849970+0000","last_clean":"2023-10-06T04:39:14.849970+0000","last_became_active":"2023-10-06T04:39:10.804738+0000","last_became_peered":"2023-10-06T04:39:10.804738+0000","last_unstale":"2023-10-06T04:39:14.849970+0000","last_undegraded":"2023-10-06T04:39:14.849970+0000","last_fullsized":"2023-10-06T04:39:14.849970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.420412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.846395+0000","last_change":"2023-10-06T04:39:10.803687+0000","last_active":"2023-10-06T04:39:14.846395+0000","last_peered":"2023-10-06T04:39:14.846395+0000","last_clean":"2023-10-06T04:39:14.846395+0000","last_became_active":"2023-10-06T04:39:10.803340+0000","last_became_peered":"2023-10-06T04:39:10.803340+0000","last_unstale":"2023-10-06T04:39:14.846395+0000","last_undegraded":"2023-10-06T04:39:14.846395+0000","last_fullsized":"2023-10-06T04:39:14.846395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:48.240785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853384+0000","last_change":"2023-10-06T04:39:10.804576+0000","last_active":"2023-10-06T04:39:14.853384+0000","last_peered":"2023-10-06T04:39:14.853384+0000","last_clean":"2023-10-06T04:39:14.853384+0000","last_became_active":"2023-10-06T04:39:10.804020+0000","last_became_peered":"2023-10-06T04:39:10.804020+0000","last_unstale":"2023-10-06T04:39:14.853384+0000","last_undegraded":"2023-10-06T04:39:14.853384+0000","last_fullsized":"2023-10-06T04:39:14.853384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841006+0000","last_change":"2023-10-06T04:39:10.801393+0000","last_active":"2023-10-06T04:39:14.841006+0000","last_peered":"2023-10-06T04:39:14.841006+0000","last_clean":"2023-10-06T04:39:14.841006+0000","last_became_active":"2023-10-06T04:39:10.798538+0000","last_became_peered":"2023-10-06T04:39:10.798538+0000","last_unstale":"2023-10-06T04:39:14.841006+0000","last_undegraded":"2023-10-06T04:39:14.841006+0000","last_fullsized":"2023-10-06T04:39:14.841006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848529+0000","last_change":"2023-10-06T04:39:10.802134+0000","last_active":"2023-10-06T04:39:14.848529+0000","last_peered":"2023-10-06T04:39:14.848529+0000","last_clean":"2023-10-06T04:39:14.848529+0000","last_became_active":"2023-10-06T04:39:10.801808+0000","last_became_peered":"2023-10-06T04:39:10.801808+0000","last_unstale":"2023-10-06T04:39:14.848529+0000","last_undegraded":"2023-10-06T04:39:14.848529+0000","last_fullsized":"2023-10-06T04:39:14.848529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:01.174439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.845825+0000","last_change":"2023-10-06T04:39:10.797709+0000","last_active":"2023-10-06T04:39:14.845825+0000","last_peered":"2023-10-06T04:39:14.845825+0000","last_clean":"2023-10-06T04:39:14.845825+0000","last_became_active":"2023-10-06T04:39:10.796499+0000","last_became_peered":"2023-10-06T04:39:10.796499+0000","last_unstale":"2023-10-06T04:39:14.845825+0000","last_undegraded":"2023-10-06T04:39:14.845825+0000","last_fullsized":"2023-10-06T04:39:14.845825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:30.195878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842462+0000","last_change":"2023-10-06T04:39:10.806884+0000","last_active":"2023-10-06T04:39:14.842462+0000","last_peered":"2023-10-06T04:39:14.842462+0000","last_clean":"2023-10-06T04:39:14.842462+0000","last_became_active":"2023-10-06T04:39:10.798862+0000","last_became_peered":"2023-10-06T04:39:10.798862+0000","last_unstale":"2023-10-06T04:39:14.842462+0000","last_undegraded":"2023-10-06T04:39:14.842462+0000","last_fullsized":"2023-10-06T04:39:14.842462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.344818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853993+0000","last_change":"2023-10-06T04:39:10.799938+0000","last_active":"2023-10-06T04:39:14.853993+0000","last_peered":"2023-10-06T04:39:14.853993+0000","last_clean":"2023-10-06T04:39:14.853993+0000","last_became_active":"2023-10-06T04:39:10.799583+0000","last_became_peered":"2023-10-06T04:39:10.799583+0000","last_unstale":"2023-10-06T04:39:14.853993+0000","last_undegraded":"2023-10-06T04:39:14.853993+0000","last_fullsized":"2023-10-06T04:39:14.853993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:35.325688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.843018+0000","last_change":"2023-10-06T04:39:10.808298+0000","last_active":"2023-10-06T04:39:14.843018+0000","last_peered":"2023-10-06T04:39:14.843018+0000","last_clean":"2023-10-06T04:39:14.843018+0000","last_became_active":"2023-10-06T04:39:10.808027+0000","last_became_peered":"2023-10-06T04:39:10.808027+0000","last_unstale":"2023-10-06T04:39:14.843018+0000","last_undegraded":"2023-10-06T04:39:14.843018+0000","last_fullsized":"2023-10-06T04:39:14.843018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:21.233331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":122164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":892928,"data_stored":712996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":716372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":122074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":122698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":315392,"data_stored":125844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":122074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":122074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:39:34.678 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:39:34.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.773+0000 7f4d37fff700 1 Processor -- start 2023-10-06T04:39:34.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.773+0000 7f4d37fff700 1 -- start start 2023-10-06T04:39:34.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d38155bd0 0x7f4d380af660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4d380afba0 0x7f4d380cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d380c2700 con 0x7f4d380c1660 2023-10-06T04:39:34.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d380c1af0 con 0x7f4d380afba0 2023-10-06T04:39:34.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380c1dd0 con 0x7f4d38155bd0 2023-10-06T04:39:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d377fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4d380afba0 0x7f4d380cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d36ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d38155bd0 0x7f4d380af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d367fc700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f4d380c1660 0x7f4d380c2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:49876/0 (socket says 172.21.15.37:49876) 2023-10-06T04:39:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d377fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4d380afba0 0x7f4d380cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:35010/0 (socket says 172.21.15.37:35010) 2023-10-06T04:39:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d377fe700 1 -- 172.21.15.37:0/678520553 learned_addr learned my addr 172.21.15.37:0/678520553 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d36ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d38155bd0 0x7f4d380af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40730/0 (socket says 172.21.15.37:40730) 2023-10-06T04:39:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d377fe700 1 -- 172.21.15.37:0/678520553 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d38155bd0 msgr2=0x7f4d380af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d377fe700 1 --2- 172.21.15.37:0/678520553 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d38155bd0 0x7f4d380af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d377fe700 1 -- 172.21.15.37:0/678520553 >> v1:172.21.15.83:6789/0 conn(0x7f4d380c1660 legacy=0x7f4d380c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d377fe700 1 -- 172.21.15.37:0/678520553 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380c20b0 con 0x7f4d380afba0 2023-10-06T04:39:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d36ffd700 1 --2- 172.21.15.37:0/678520553 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d38155bd0 0x7f4d380af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d377fe700 1 --2- 172.21.15.37:0/678520553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d380afba0 0x7f4d380cb4a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009f20 tx=0x7f4d30009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc9126a8c8c07677 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d35ffb700 1 -- 172.21.15.37:0/678520553 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3000e070 con 0x7f4d380afba0 2023-10-06T04:39:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d35ffb700 1 -- 172.21.15.37:0/678520553 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3000b9d0 con 0x7f4d380afba0 2023-10-06T04:39:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d35ffb700 1 -- 172.21.15.37:0/678520553 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d300092e0 con 0x7f4d380afba0 2023-10-06T04:39:34.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 -- 172.21.15.37:0/678520553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d380afba0 msgr2=0x7f4d380cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 --2- 172.21.15.37:0/678520553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d380afba0 0x7f4d380cb4a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009f20 tx=0x7f4d30009840 comp rx=0 tx=0).stop 2023-10-06T04:39:34.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 -- 172.21.15.37:0/678520553 shutdown_connections 2023-10-06T04:39:34.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 --2- 172.21.15.37:0/678520553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d380afba0 0x7f4d380cb4a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 --2- 172.21.15.37:0/678520553 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d38155bd0 0x7f4d380af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 -- 172.21.15.37:0/678520553 >> 172.21.15.37:0/678520553 conn(0x7f4d380695e0 msgr2=0x7f4d380cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 -- 172.21.15.37:0/678520553 shutdown_connections 2023-10-06T04:39:34.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.777+0000 7f4d37fff700 1 -- 172.21.15.37:0/678520553 wait complete. 2023-10-06T04:39:34.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.781+0000 7f4d37fff700 1 Processor -- start 2023-10-06T04:39:34.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.781+0000 7f4d37fff700 1 -- start start 2023-10-06T04:39:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d37fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380afba0 0x7f4d3814b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d37fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d380c1660 0x7f4d380b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d37fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d38155bd0 0x7f4d38150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d37fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3814ba00 con 0x7f4d380afba0 2023-10-06T04:39:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d37fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380b1ac0 con 0x7f4d380c1660 2023-10-06T04:39:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d37fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d38156d90 con 0x7f4d38155bd0 2023-10-06T04:39:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d36ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380afba0 0x7f4d3814b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d36ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380afba0 0x7f4d3814b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36920/0 (socket says 172.21.15.37:36920) 2023-10-06T04:39:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d36ffd700 1 -- 172.21.15.37:0/1045916043 learned_addr learned my addr 172.21.15.37:0/1045916043 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d367fc700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d380c1660 0x7f4d380b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d377fe700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d38155bd0 0x7f4d38150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d36ffd700 1 -- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d38155bd0 msgr2=0x7f4d38150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d36ffd700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d38155bd0 0x7f4d38150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d36ffd700 1 -- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d380c1660 msgr2=0x7f4d380b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d36ffd700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d380c1660 0x7f4d380b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d36ffd700 1 -- 172.21.15.37:0/1045916043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c009420 con 0x7f4d380afba0 2023-10-06T04:39:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d36ffd700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380afba0 0x7f4d3814b4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009e80 tx=0x7f4d2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d1effd700 1 -- 172.21.15.37:0/1045916043 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00c850 con 0x7f4d380afba0 2023-10-06T04:39:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d1effd700 1 -- 172.21.15.37:0/1045916043 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c00c9b0 con 0x7f4d380afba0 2023-10-06T04:39:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d1effd700 1 -- 172.21.15.37:0/1045916043 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00cd30 con 0x7f4d380afba0 2023-10-06T04:39:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d37fff700 1 -- 172.21.15.37:0/1045916043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d30009ae0 con 0x7f4d380afba0 2023-10-06T04:39:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d37fff700 1 -- 172.21.15.37:0/1045916043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d380c9b80 con 0x7f4d380afba0 2023-10-06T04:39:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.785+0000 7f4d37fff700 1 -- 172.21.15.37:0/1045916043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d380708a0 con 0x7f4d380afba0 2023-10-06T04:39:34.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.789+0000 7f4d1effd700 1 -- 172.21.15.37:0/1045916043 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4d2c011660 con 0x7f4d380afba0 2023-10-06T04:39:34.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.789+0000 7f4d1effd700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d24060550 0x7f4d24062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.789+0000 7f4d1effd700 1 -- 172.21.15.37:0/1045916043 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4d2c07eb30 con 0x7f4d380afba0 2023-10-06T04:39:34.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.789+0000 7f4d367fc700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d24060550 0x7f4d24062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.789+0000 7f4d367fc700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d24060550 0x7f4d24062a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4d3814f180 tx=0x7f4d28007eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.793+0000 7f4d1effd700 1 -- 172.21.15.37:0/1045916043 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4d2c052760 con 0x7f4d380afba0 2023-10-06T04:39:34.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.945+0000 7f4d37fff700 1 -- 172.21.15.37:0/1045916043 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d380c2390 con 0x7f4d24060550 2023-10-06T04:39:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.965+0000 7f4d1effd700 1 -- 172.21.15.37:0/1045916043 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367292 (secure 0 0 0) 0x7f4d380c2390 con 0x7f4d24060550 2023-10-06T04:39:34.976 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:34.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.969+0000 7f4d37fff700 1 -- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d24060550 msgr2=0x7f4d24062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.969+0000 7f4d37fff700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d24060550 0x7f4d24062a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4d3814f180 tx=0x7f4d28007eb0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.969+0000 7f4d37fff700 1 -- 172.21.15.37:0/1045916043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380afba0 msgr2=0x7f4d3814b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.969+0000 7f4d37fff700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380afba0 0x7f4d3814b4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009e80 tx=0x7f4d2c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.969+0000 7f4d37fff700 1 -- 172.21.15.37:0/1045916043 shutdown_connections 2023-10-06T04:39:34.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.969+0000 7f4d37fff700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d24060550 0x7f4d24062a00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.969+0000 7f4d37fff700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d380c1660 0x7f4d380b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.969+0000 7f4d37fff700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d38155bd0 0x7f4d38150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.969+0000 7f4d37fff700 1 --2- 172.21.15.37:0/1045916043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380afba0 0x7f4d3814b4c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.969+0000 7f4d37fff700 1 -- 172.21.15.37:0/1045916043 >> 172.21.15.37:0/1045916043 conn(0x7f4d380695e0 msgr2=0x7f4d381532b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.969+0000 7f4d37fff700 1 -- 172.21.15.37:0/1045916043 shutdown_connections 2023-10-06T04:39:34.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:34.969+0000 7f4d37fff700 1 -- 172.21.15.37:0/1045916043 wait complete. 2023-10-06T04:39:34.981 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:39:34.989 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-10-06T04:39:33.036456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381832,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592888,"statfs":{"total":773094113280,"available":770655117312,"internally_reserved":0,"allocated":3612672,"data_stored":2166296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005405"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872498+0000","last_change":"2023-10-06T04:39:14.870069+0000","last_active":"2023-10-06T04:39:14.872498+0000","last_peered":"2023-10-06T04:39:14.872498+0000","last_clean":"2023-10-06T04:39:14.872498+0000","last_became_active":"2023-10-06T04:39:14.869576+0000","last_became_peered":"2023-10-06T04:39:14.869576+0000","last_unstale":"2023-10-06T04:39:14.872498+0000","last_undegraded":"2023-10-06T04:39:14.872498+0000","last_fullsized":"2023-10-06T04:39:14.872498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:25.769047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850210+0000","last_change":"2023-10-06T04:39:09.765548+0000","last_active":"2023-10-06T04:39:14.850210+0000","last_peered":"2023-10-06T04:39:14.850210+0000","last_clean":"2023-10-06T04:39:14.850210+0000","last_became_active":"2023-10-06T04:39:09.765140+0000","last_became_peered":"2023-10-06T04:39:09.765140+0000","last_unstale":"2023-10-06T04:39:14.850210+0000","last_undegraded":"2023-10-06T04:39:14.850210+0000","last_fullsized":"2023-10-06T04:39:14.850210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:58.385216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841115+0000","last_change":"2023-10-06T04:39:10.798882+0000","last_active":"2023-10-06T04:39:14.841115+0000","last_peered":"2023-10-06T04:39:14.841115+0000","last_clean":"2023-10-06T04:39:14.841115+0000","last_became_active":"2023-10-06T04:39:10.796380+0000","last_became_peered":"2023-10-06T04:39:10.796380+0000","last_unstale":"2023-10-06T04:39:14.841115+0000","last_undegraded":"2023-10-06T04:39:14.841115+0000","last_fullsized":"2023-10-06T04:39:14.841115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:29.463649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.860905+0000","last_change":"2023-10-06T04:39:14.859612+0000","last_active":"2023-10-06T04:39:14.860905+0000","last_peered":"2023-10-06T04:39:14.860905+0000","last_clean":"2023-10-06T04:39:14.860905+0000","last_became_active":"2023-10-06T04:39:14.859171+0000","last_became_peered":"2023-10-06T04:39:14.859171+0000","last_unstale":"2023-10-06T04:39:14.860905+0000","last_undegraded":"2023-10-06T04:39:14.860905+0000","last_fullsized":"2023-10-06T04:39:14.860905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:08.925413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838625+0000","last_change":"2023-10-06T04:39:09.772959+0000","last_active":"2023-10-06T04:39:14.838625+0000","last_peered":"2023-10-06T04:39:14.838625+0000","last_clean":"2023-10-06T04:39:14.838625+0000","last_became_active":"2023-10-06T04:39:09.772627+0000","last_became_peered":"2023-10-06T04:39:09.772627+0000","last_unstale":"2023-10-06T04:39:14.838625+0000","last_undegraded":"2023-10-06T04:39:14.838625+0000","last_fullsized":"2023-10-06T04:39:14.838625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.246847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837554+0000","last_change":"2023-10-06T04:39:10.799763+0000","last_active":"2023-10-06T04:39:14.837554+0000","last_peered":"2023-10-06T04:39:14.837554+0000","last_clean":"2023-10-06T04:39:14.837554+0000","last_became_active":"2023-10-06T04:39:10.799183+0000","last_became_peered":"2023-10-06T04:39:10.799183+0000","last_unstale":"2023-10-06T04:39:14.837554+0000","last_undegraded":"2023-10-06T04:39:14.837554+0000","last_fullsized":"2023-10-06T04:39:14.837554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:23.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876042+0000","last_change":"2023-10-06T04:39:14.874393+0000","last_active":"2023-10-06T04:39:14.876042+0000","last_peered":"2023-10-06T04:39:14.876042+0000","last_clean":"2023-10-06T04:39:14.876042+0000","last_became_active":"2023-10-06T04:39:14.873970+0000","last_became_peered":"2023-10-06T04:39:14.873970+0000","last_unstale":"2023-10-06T04:39:14.876042+0000","last_undegraded":"2023-10-06T04:39:14.876042+0000","last_fullsized":"2023-10-06T04:39:14.876042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:42.042299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853530+0000","last_change":"2023-10-06T04:39:09.776483+0000","last_active":"2023-10-06T04:39:14.853530+0000","last_peered":"2023-10-06T04:39:14.853530+0000","last_clean":"2023-10-06T04:39:14.853530+0000","last_became_active":"2023-10-06T04:39:09.776194+0000","last_became_peered":"2023-10-06T04:39:09.776194+0000","last_unstale":"2023-10-06T04:39:14.853530+0000","last_undegraded":"2023-10-06T04:39:14.853530+0000","last_fullsized":"2023-10-06T04:39:14.853530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:25.823920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841254+0000","last_change":"2023-10-06T04:39:10.806796+0000","last_active":"2023-10-06T04:39:14.841254+0000","last_peered":"2023-10-06T04:39:14.841254+0000","last_clean":"2023-10-06T04:39:14.841254+0000","last_became_active":"2023-10-06T04:39:10.803473+0000","last_became_peered":"2023-10-06T04:39:10.803473+0000","last_unstale":"2023-10-06T04:39:14.841254+0000","last_undegraded":"2023-10-06T04:39:14.841254+0000","last_fullsized":"2023-10-06T04:39:14.841254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:01.174439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872813+0000","last_change":"2023-10-06T04:39:14.868943+0000","last_active":"2023-10-06T04:39:14.872813+0000","last_peered":"2023-10-06T04:39:14.872813+0000","last_clean":"2023-10-06T04:39:14.872813+0000","last_became_active":"2023-10-06T04:39:14.868312+0000","last_became_peered":"2023-10-06T04:39:14.868312+0000","last_unstale":"2023-10-06T04:39:14.872813+0000","last_undegraded":"2023-10-06T04:39:14.872813+0000","last_fullsized":"2023-10-06T04:39:14.872813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:07.134968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852547+0000","last_change":"2023-10-06T04:39:09.771371+0000","last_active":"2023-10-06T04:39:14.852547+0000","last_peered":"2023-10-06T04:39:14.852547+0000","last_clean":"2023-10-06T04:39:14.852547+0000","last_became_active":"2023-10-06T04:39:09.771102+0000","last_became_peered":"2023-10-06T04:39:09.771102+0000","last_unstale":"2023-10-06T04:39:14.852547+0000","last_undegraded":"2023-10-06T04:39:14.852547+0000","last_fullsized":"2023-10-06T04:39:14.852547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:17.992483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841809+0000","last_change":"2023-10-06T04:39:10.807784+0000","last_active":"2023-10-06T04:39:14.841809+0000","last_peered":"2023-10-06T04:39:14.841809+0000","last_clean":"2023-10-06T04:39:14.841809+0000","last_became_active":"2023-10-06T04:39:10.807517+0000","last_became_peered":"2023-10-06T04:39:10.807517+0000","last_unstale":"2023-10-06T04:39:14.841809+0000","last_undegraded":"2023-10-06T04:39:14.841809+0000","last_fullsized":"2023-10-06T04:39:14.841809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:01.254363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.878158+0000","last_change":"2023-10-06T04:39:14.873431+0000","last_active":"2023-10-06T04:39:14.878158+0000","last_peered":"2023-10-06T04:39:14.878158+0000","last_clean":"2023-10-06T04:39:14.878158+0000","last_became_active":"2023-10-06T04:39:14.873014+0000","last_became_peered":"2023-10-06T04:39:14.873014+0000","last_unstale":"2023-10-06T04:39:14.878158+0000","last_undegraded":"2023-10-06T04:39:14.878158+0000","last_fullsized":"2023-10-06T04:39:14.878158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:13.279378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848648+0000","last_change":"2023-10-06T04:39:09.777180+0000","last_active":"2023-10-06T04:39:14.848648+0000","last_peered":"2023-10-06T04:39:14.848648+0000","last_clean":"2023-10-06T04:39:14.848648+0000","last_became_active":"2023-10-06T04:39:09.776838+0000","last_became_peered":"2023-10-06T04:39:09.776838+0000","last_unstale":"2023-10-06T04:39:14.848648+0000","last_undegraded":"2023-10-06T04:39:14.848648+0000","last_fullsized":"2023-10-06T04:39:14.848648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:10.617248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842412+0000","last_change":"2023-10-06T04:39:10.806300+0000","last_active":"2023-10-06T04:39:14.842412+0000","last_peered":"2023-10-06T04:39:14.842412+0000","last_clean":"2023-10-06T04:39:14.842412+0000","last_became_active":"2023-10-06T04:39:10.800539+0000","last_became_peered":"2023-10-06T04:39:10.800539+0000","last_unstale":"2023-10-06T04:39:14.842412+0000","last_undegraded":"2023-10-06T04:39:14.842412+0000","last_fullsized":"2023-10-06T04:39:14.842412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:26.827588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.867191+0000","last_change":"2023-10-06T04:39:14.863502+0000","last_active":"2023-10-06T04:39:14.867191+0000","last_peered":"2023-10-06T04:39:14.867191+0000","last_clean":"2023-10-06T04:39:14.867191+0000","last_became_active":"2023-10-06T04:39:14.863064+0000","last_became_peered":"2023-10-06T04:39:14.863064+0000","last_unstale":"2023-10-06T04:39:14.867191+0000","last_undegraded":"2023-10-06T04:39:14.867191+0000","last_fullsized":"2023-10-06T04:39:14.867191+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:55.304482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841597+0000","last_change":"2023-10-06T04:39:09.770501+0000","last_active":"2023-10-06T04:39:14.841597+0000","last_peered":"2023-10-06T04:39:14.841597+0000","last_clean":"2023-10-06T04:39:14.841597+0000","last_became_active":"2023-10-06T04:39:09.770199+0000","last_became_peered":"2023-10-06T04:39:09.770199+0000","last_unstale":"2023-10-06T04:39:14.841597+0000","last_undegraded":"2023-10-06T04:39:14.841597+0000","last_fullsized":"2023-10-06T04:39:14.841597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:46.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838286+0000","last_change":"2023-10-06T04:39:10.798539+0000","last_active":"2023-10-06T04:39:14.838286+0000","last_peered":"2023-10-06T04:39:14.838286+0000","last_clean":"2023-10-06T04:39:14.838286+0000","last_became_active":"2023-10-06T04:39:10.798237+0000","last_became_peered":"2023-10-06T04:39:10.798237+0000","last_unstale":"2023-10-06T04:39:14.838286+0000","last_undegraded":"2023-10-06T04:39:14.838286+0000","last_fullsized":"2023-10-06T04:39:14.838286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:10.727863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876193+0000","last_change":"2023-10-06T04:39:14.872340+0000","last_active":"2023-10-06T04:39:14.876193+0000","last_peered":"2023-10-06T04:39:14.876193+0000","last_clean":"2023-10-06T04:39:14.876193+0000","last_became_active":"2023-10-06T04:39:14.871698+0000","last_became_peered":"2023-10-06T04:39:14.871698+0000","last_unstale":"2023-10-06T04:39:14.876193+0000","last_undegraded":"2023-10-06T04:39:14.876193+0000","last_fullsized":"2023-10-06T04:39:14.876193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:21.553198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855800+0000","last_change":"2023-10-06T04:39:09.773699+0000","last_active":"2023-10-06T04:39:14.855800+0000","last_peered":"2023-10-06T04:39:14.855800+0000","last_clean":"2023-10-06T04:39:14.855800+0000","last_became_active":"2023-10-06T04:39:09.773399+0000","last_became_peered":"2023-10-06T04:39:09.773399+0000","last_unstale":"2023-10-06T04:39:14.855800+0000","last_undegraded":"2023-10-06T04:39:14.855800+0000","last_fullsized":"2023-10-06T04:39:14.855800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:25.823920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851512+0000","last_change":"2023-10-06T04:39:10.795142+0000","last_active":"2023-10-06T04:39:14.851512+0000","last_peered":"2023-10-06T04:39:14.851512+0000","last_clean":"2023-10-06T04:39:14.851512+0000","last_became_active":"2023-10-06T04:39:10.794525+0000","last_became_peered":"2023-10-06T04:39:10.794525+0000","last_unstale":"2023-10-06T04:39:14.851512+0000","last_undegraded":"2023-10-06T04:39:14.851512+0000","last_fullsized":"2023-10-06T04:39:14.851512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.875584+0000","last_change":"2023-10-06T04:39:14.869540+0000","last_active":"2023-10-06T04:39:14.875584+0000","last_peered":"2023-10-06T04:39:14.875584+0000","last_clean":"2023-10-06T04:39:14.875584+0000","last_became_active":"2023-10-06T04:39:14.869118+0000","last_became_peered":"2023-10-06T04:39:14.869118+0000","last_unstale":"2023-10-06T04:39:14.875584+0000","last_undegraded":"2023-10-06T04:39:14.875584+0000","last_fullsized":"2023-10-06T04:39:14.875584+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:32.206420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837301+0000","last_change":"2023-10-06T04:39:09.776975+0000","last_active":"2023-10-06T04:39:14.837301+0000","last_peered":"2023-10-06T04:39:14.837301+0000","last_clean":"2023-10-06T04:39:14.837301+0000","last_became_active":"2023-10-06T04:39:09.776600+0000","last_became_peered":"2023-10-06T04:39:09.776600+0000","last_unstale":"2023-10-06T04:39:14.837301+0000","last_undegraded":"2023-10-06T04:39:14.837301+0000","last_fullsized":"2023-10-06T04:39:14.837301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:10.617248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848811+0000","last_change":"2023-10-06T04:39:10.795446+0000","last_active":"2023-10-06T04:39:14.848811+0000","last_peered":"2023-10-06T04:39:14.848811+0000","last_clean":"2023-10-06T04:39:14.848811+0000","last_became_active":"2023-10-06T04:39:10.795269+0000","last_became_peered":"2023-10-06T04:39:10.795269+0000","last_unstale":"2023-10-06T04:39:14.848811+0000","last_undegraded":"2023-10-06T04:39:14.848811+0000","last_fullsized":"2023-10-06T04:39:14.848811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:21.233331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.836827+0000","last_change":"2023-10-06T04:39:10.796045+0000","last_active":"2023-10-06T04:39:14.836827+0000","last_peered":"2023-10-06T04:39:14.836827+0000","last_clean":"2023-10-06T04:39:14.836827+0000","last_became_active":"2023-10-06T04:39:10.795810+0000","last_became_peered":"2023-10-06T04:39:10.795810+0000","last_unstale":"2023-10-06T04:39:14.836827+0000","last_undegraded":"2023-10-06T04:39:14.836827+0000","last_fullsized":"2023-10-06T04:39:14.836827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:01.174439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850318+0000","last_change":"2023-10-06T04:39:09.767108+0000","last_active":"2023-10-06T04:39:14.850318+0000","last_peered":"2023-10-06T04:39:14.850318+0000","last_clean":"2023-10-06T04:39:14.850318+0000","last_became_active":"2023-10-06T04:39:09.765912+0000","last_became_peered":"2023-10-06T04:39:09.765912+0000","last_unstale":"2023-10-06T04:39:14.850318+0000","last_undegraded":"2023-10-06T04:39:14.850318+0000","last_fullsized":"2023-10-06T04:39:14.850318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.246847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.873803+0000","last_change":"2023-10-06T04:39:14.867667+0000","last_active":"2023-10-06T04:39:14.873803+0000","last_peered":"2023-10-06T04:39:14.873803+0000","last_clean":"2023-10-06T04:39:14.873803+0000","last_became_active":"2023-10-06T04:39:14.866987+0000","last_became_peered":"2023-10-06T04:39:14.866987+0000","last_unstale":"2023-10-06T04:39:14.873803+0000","last_undegraded":"2023-10-06T04:39:14.873803+0000","last_fullsized":"2023-10-06T04:39:14.873803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837163+0000","last_change":"2023-10-06T04:39:10.800091+0000","last_active":"2023-10-06T04:39:14.837163+0000","last_peered":"2023-10-06T04:39:14.837163+0000","last_clean":"2023-10-06T04:39:14.837163+0000","last_became_active":"2023-10-06T04:39:10.799013+0000","last_became_peered":"2023-10-06T04:39:10.799013+0000","last_unstale":"2023-10-06T04:39:14.837163+0000","last_undegraded":"2023-10-06T04:39:14.837163+0000","last_fullsized":"2023-10-06T04:39:14.837163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:12.187845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.854203+0000","last_change":"2023-10-06T04:39:09.765938+0000","last_active":"2023-10-06T04:39:14.854203+0000","last_peered":"2023-10-06T04:39:14.854203+0000","last_clean":"2023-10-06T04:39:14.854203+0000","last_became_active":"2023-10-06T04:39:09.765605+0000","last_became_peered":"2023-10-06T04:39:09.765605+0000","last_unstale":"2023-10-06T04:39:14.854203+0000","last_undegraded":"2023-10-06T04:39:14.854203+0000","last_fullsized":"2023-10-06T04:39:14.854203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:29.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876139+0000","last_change":"2023-10-06T04:39:14.874600+0000","last_active":"2023-10-06T04:39:14.876139+0000","last_peered":"2023-10-06T04:39:14.876139+0000","last_clean":"2023-10-06T04:39:14.876139+0000","last_became_active":"2023-10-06T04:39:14.874193+0000","last_became_peered":"2023-10-06T04:39:14.874193+0000","last_unstale":"2023-10-06T04:39:14.876139+0000","last_undegraded":"2023-10-06T04:39:14.876139+0000","last_fullsized":"2023-10-06T04:39:14.876139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:32.206420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.859491+0000","last_change":"2023-10-06T04:39:09.779107+0000","last_active":"2023-10-06T04:39:14.859491+0000","last_peered":"2023-10-06T04:39:14.859491+0000","last_clean":"2023-10-06T04:39:14.859491+0000","last_became_active":"2023-10-06T04:39:09.778810+0000","last_became_peered":"2023-10-06T04:39:09.778810+0000","last_unstale":"2023-10-06T04:39:14.859491+0000","last_undegraded":"2023-10-06T04:39:14.859491+0000","last_fullsized":"2023-10-06T04:39:14.859491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:53:29.527825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855898+0000","last_change":"2023-10-06T04:39:10.801962+0000","last_active":"2023-10-06T04:39:14.855898+0000","last_peered":"2023-10-06T04:39:14.855898+0000","last_clean":"2023-10-06T04:39:14.855898+0000","last_became_active":"2023-10-06T04:39:10.801671+0000","last_became_peered":"2023-10-06T04:39:10.801671+0000","last_unstale":"2023-10-06T04:39:14.855898+0000","last_undegraded":"2023-10-06T04:39:14.855898+0000","last_fullsized":"2023-10-06T04:39:14.855898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:22.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.866385+0000","last_change":"2023-10-06T04:39:14.862383+0000","last_active":"2023-10-06T04:39:14.866385+0000","last_peered":"2023-10-06T04:39:14.866385+0000","last_clean":"2023-10-06T04:39:14.866385+0000","last_became_active":"2023-10-06T04:39:14.861956+0000","last_became_peered":"2023-10-06T04:39:14.861956+0000","last_unstale":"2023-10-06T04:39:14.866385+0000","last_undegraded":"2023-10-06T04:39:14.866385+0000","last_fullsized":"2023-10-06T04:39:14.866385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:49.720754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.672346+0000","last_change":"2023-10-06T04:39:09.780007+0000","last_active":"2023-10-06T04:39:20.672346+0000","last_peered":"2023-10-06T04:39:20.672346+0000","last_clean":"2023-10-06T04:39:20.672346+0000","last_became_active":"2023-10-06T04:39:09.779738+0000","last_became_peered":"2023-10-06T04:39:09.779738+0000","last_unstale":"2023-10-06T04:39:20.672346+0000","last_undegraded":"2023-10-06T04:39:20.672346+0000","last_fullsized":"2023-10-06T04:39:20.672346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:10.617248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841824+0000","last_change":"2023-10-06T04:39:10.801723+0000","last_active":"2023-10-06T04:39:14.841824+0000","last_peered":"2023-10-06T04:39:14.841824+0000","last_clean":"2023-10-06T04:39:14.841824+0000","last_became_active":"2023-10-06T04:39:10.796435+0000","last_became_peered":"2023-10-06T04:39:10.796435+0000","last_unstale":"2023-10-06T04:39:14.841824+0000","last_undegraded":"2023-10-06T04:39:14.841824+0000","last_fullsized":"2023-10-06T04:39:14.841824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:59.444958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872388+0000","last_change":"2023-10-06T04:39:14.868717+0000","last_active":"2023-10-06T04:39:14.872388+0000","last_peered":"2023-10-06T04:39:14.872388+0000","last_clean":"2023-10-06T04:39:14.872388+0000","last_became_active":"2023-10-06T04:39:14.868184+0000","last_became_peered":"2023-10-06T04:39:14.868184+0000","last_unstale":"2023-10-06T04:39:14.872388+0000","last_undegraded":"2023-10-06T04:39:14.872388+0000","last_fullsized":"2023-10-06T04:39:14.872388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:45.298495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841634+0000","last_change":"2023-10-06T04:39:10.801737+0000","last_active":"2023-10-06T04:39:14.841634+0000","last_peered":"2023-10-06T04:39:14.841634+0000","last_clean":"2023-10-06T04:39:14.841634+0000","last_became_active":"2023-10-06T04:39:10.798733+0000","last_became_peered":"2023-10-06T04:39:10.798733+0000","last_unstale":"2023-10-06T04:39:14.841634+0000","last_undegraded":"2023-10-06T04:39:14.841634+0000","last_fullsized":"2023-10-06T04:39:14.841634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:33.684956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848907+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:39:14.848907+0000","last_peered":"2023-10-06T04:39:14.848907+0000","last_clean":"2023-10-06T04:39:14.848907+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:39:14.848907+0000","last_undegraded":"2023-10-06T04:39:14.848907+0000","last_fullsized":"2023-10-06T04:39:14.848907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:15.745754+0000","last_change":"2023-10-06T04:39:09.768361+0000","last_active":"2023-10-06T04:39:15.745754+0000","last_peered":"2023-10-06T04:39:15.745754+0000","last_clean":"2023-10-06T04:39:15.745754+0000","last_became_active":"2023-10-06T04:39:09.766351+0000","last_became_peered":"2023-10-06T04:39:09.766351+0000","last_unstale":"2023-10-06T04:39:15.745754+0000","last_undegraded":"2023-10-06T04:39:15.745754+0000","last_fullsized":"2023-10-06T04:39:15.745754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.815387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.866361+0000","last_change":"2023-10-06T04:39:14.862660+0000","last_active":"2023-10-06T04:39:14.866361+0000","last_peered":"2023-10-06T04:39:14.866361+0000","last_clean":"2023-10-06T04:39:14.866361+0000","last_became_active":"2023-10-06T04:39:14.862199+0000","last_became_peered":"2023-10-06T04:39:14.862199+0000","last_unstale":"2023-10-06T04:39:14.866361+0000","last_undegraded":"2023-10-06T04:39:14.866361+0000","last_fullsized":"2023-10-06T04:39:14.866361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:41.103920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837055+0000","last_change":"2023-10-06T04:39:10.793084+0000","last_active":"2023-10-06T04:39:14.837055+0000","last_peered":"2023-10-06T04:39:14.837055+0000","last_clean":"2023-10-06T04:39:14.837055+0000","last_became_active":"2023-10-06T04:39:10.791458+0000","last_became_peered":"2023-10-06T04:39:10.791458+0000","last_unstale":"2023-10-06T04:39:14.837055+0000","last_undegraded":"2023-10-06T04:39:14.837055+0000","last_fullsized":"2023-10-06T04:39:14.837055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856903+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:39:14.856903+0000","last_peered":"2023-10-06T04:39:14.856903+0000","last_clean":"2023-10-06T04:39:14.856903+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:39:14.856903+0000","last_undegraded":"2023-10-06T04:39:14.856903+0000","last_fullsized":"2023-10-06T04:39:14.856903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.839331+0000","last_change":"2023-10-06T04:39:09.773058+0000","last_active":"2023-10-06T04:39:14.839331+0000","last_peered":"2023-10-06T04:39:14.839331+0000","last_clean":"2023-10-06T04:39:14.839331+0000","last_became_active":"2023-10-06T04:39:09.772555+0000","last_became_peered":"2023-10-06T04:39:09.772555+0000","last_unstale":"2023-10-06T04:39:14.839331+0000","last_undegraded":"2023-10-06T04:39:14.839331+0000","last_fullsized":"2023-10-06T04:39:14.839331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:11.332865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.868688+0000","last_change":"2023-10-06T04:39:14.865402+0000","last_active":"2023-10-06T04:39:14.868688+0000","last_peered":"2023-10-06T04:39:14.868688+0000","last_clean":"2023-10-06T04:39:14.868688+0000","last_became_active":"2023-10-06T04:39:14.864905+0000","last_became_peered":"2023-10-06T04:39:14.864905+0000","last_unstale":"2023-10-06T04:39:14.868688+0000","last_undegraded":"2023-10-06T04:39:14.868688+0000","last_fullsized":"2023-10-06T04:39:14.868688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:58.993957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848392+0000","last_change":"2023-10-06T04:39:10.798497+0000","last_active":"2023-10-06T04:39:14.848392+0000","last_peered":"2023-10-06T04:39:14.848392+0000","last_clean":"2023-10-06T04:39:14.848392+0000","last_became_active":"2023-10-06T04:39:10.798125+0000","last_became_peered":"2023-10-06T04:39:10.798125+0000","last_unstale":"2023-10-06T04:39:14.848392+0000","last_undegraded":"2023-10-06T04:39:14.848392+0000","last_fullsized":"2023-10-06T04:39:14.848392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:12.187845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.859837+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:39:14.859837+0000","last_peered":"2023-10-06T04:39:14.859837+0000","last_clean":"2023-10-06T04:39:14.859837+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:39:14.859837+0000","last_undegraded":"2023-10-06T04:39:14.859837+0000","last_fullsized":"2023-10-06T04:39:14.859837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856260+0000","last_change":"2023-10-06T04:39:09.767635+0000","last_active":"2023-10-06T04:39:14.856260+0000","last_peered":"2023-10-06T04:39:14.856260+0000","last_clean":"2023-10-06T04:39:14.856260+0000","last_became_active":"2023-10-06T04:39:09.766515+0000","last_became_peered":"2023-10-06T04:39:09.766515+0000","last_unstale":"2023-10-06T04:39:14.856260+0000","last_undegraded":"2023-10-06T04:39:14.856260+0000","last_fullsized":"2023-10-06T04:39:14.856260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:17.992483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.867777+0000","last_change":"2023-10-06T04:39:14.863791+0000","last_active":"2023-10-06T04:39:14.867777+0000","last_peered":"2023-10-06T04:39:14.867777+0000","last_clean":"2023-10-06T04:39:14.867777+0000","last_became_active":"2023-10-06T04:39:14.863352+0000","last_became_peered":"2023-10-06T04:39:14.863352+0000","last_unstale":"2023-10-06T04:39:14.867777+0000","last_undegraded":"2023-10-06T04:39:14.867777+0000","last_fullsized":"2023-10-06T04:39:14.867777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855895+0000","last_change":"2023-10-06T04:39:10.797542+0000","last_active":"2023-10-06T04:39:14.855895+0000","last_peered":"2023-10-06T04:39:14.855895+0000","last_clean":"2023-10-06T04:39:14.855895+0000","last_became_active":"2023-10-06T04:39:10.797197+0000","last_became_peered":"2023-10-06T04:39:10.797197+0000","last_unstale":"2023-10-06T04:39:14.855895+0000","last_undegraded":"2023-10-06T04:39:14.855895+0000","last_fullsized":"2023-10-06T04:39:14.855895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:19.381736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856440+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:39:14.856440+0000","last_peered":"2023-10-06T04:39:14.856440+0000","last_clean":"2023-10-06T04:39:14.856440+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:39:14.856440+0000","last_undegraded":"2023-10-06T04:39:14.856440+0000","last_fullsized":"2023-10-06T04:39:14.856440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853612+0000","last_change":"2023-10-06T04:39:09.774270+0000","last_active":"2023-10-06T04:39:14.853612+0000","last_peered":"2023-10-06T04:39:14.853612+0000","last_clean":"2023-10-06T04:39:14.853612+0000","last_became_active":"2023-10-06T04:39:09.773928+0000","last_became_peered":"2023-10-06T04:39:09.773928+0000","last_unstale":"2023-10-06T04:39:14.853612+0000","last_undegraded":"2023-10-06T04:39:14.853612+0000","last_fullsized":"2023-10-06T04:39:14.853612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:02.332937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872357+0000","last_change":"2023-10-06T04:39:14.862336+0000","last_active":"2023-10-06T04:39:14.872357+0000","last_peered":"2023-10-06T04:39:14.872357+0000","last_clean":"2023-10-06T04:39:14.872357+0000","last_became_active":"2023-10-06T04:39:14.861912+0000","last_became_peered":"2023-10-06T04:39:14.861912+0000","last_unstale":"2023-10-06T04:39:14.872357+0000","last_undegraded":"2023-10-06T04:39:14.872357+0000","last_fullsized":"2023-10-06T04:39:14.872357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:21.891013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856096+0000","last_change":"2023-10-06T04:39:10.809172+0000","last_active":"2023-10-06T04:39:14.856096+0000","last_peered":"2023-10-06T04:39:14.856096+0000","last_clean":"2023-10-06T04:39:14.856096+0000","last_became_active":"2023-10-06T04:39:10.808897+0000","last_became_peered":"2023-10-06T04:39:10.808897+0000","last_unstale":"2023-10-06T04:39:14.856096+0000","last_undegraded":"2023-10-06T04:39:14.856096+0000","last_fullsized":"2023-10-06T04:39:14.856096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:35.325688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841922+0000","last_change":"2023-10-06T04:39:09.776105+0000","last_active":"2023-10-06T04:39:14.841922+0000","last_peered":"2023-10-06T04:39:14.841922+0000","last_clean":"2023-10-06T04:39:14.841922+0000","last_became_active":"2023-10-06T04:39:09.775817+0000","last_became_peered":"2023-10-06T04:39:09.775817+0000","last_unstale":"2023-10-06T04:39:14.841922+0000","last_undegraded":"2023-10-06T04:39:14.841922+0000","last_fullsized":"2023-10-06T04:39:14.841922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.815387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850247+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:39:14.850247+0000","last_peered":"2023-10-06T04:39:14.850247+0000","last_clean":"2023-10-06T04:39:14.850247+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:39:14.850247+0000","last_undegraded":"2023-10-06T04:39:14.850247+0000","last_fullsized":"2023-10-06T04:39:14.850247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872489+0000","last_change":"2023-10-06T04:39:14.863703+0000","last_active":"2023-10-06T04:39:14.872489+0000","last_peered":"2023-10-06T04:39:14.872489+0000","last_clean":"2023-10-06T04:39:14.872489+0000","last_became_active":"2023-10-06T04:39:14.863109+0000","last_became_peered":"2023-10-06T04:39:14.863109+0000","last_unstale":"2023-10-06T04:39:14.872489+0000","last_undegraded":"2023-10-06T04:39:14.872489+0000","last_fullsized":"2023-10-06T04:39:14.872489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:42.472361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856436+0000","last_change":"2023-10-06T04:39:10.797649+0000","last_active":"2023-10-06T04:39:14.856436+0000","last_peered":"2023-10-06T04:39:14.856436+0000","last_clean":"2023-10-06T04:39:14.856436+0000","last_became_active":"2023-10-06T04:39:10.797361+0000","last_became_peered":"2023-10-06T04:39:10.797361+0000","last_unstale":"2023-10-06T04:39:14.856436+0000","last_undegraded":"2023-10-06T04:39:14.856436+0000","last_fullsized":"2023-10-06T04:39:14.856436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:26.481455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.855493+0000","last_change":"2023-10-06T04:39:09.767363+0000","last_active":"2023-10-06T04:39:14.855493+0000","last_peered":"2023-10-06T04:39:14.855493+0000","last_clean":"2023-10-06T04:39:14.855493+0000","last_became_active":"2023-10-06T04:39:09.766080+0000","last_became_peered":"2023-10-06T04:39:09.766080+0000","last_unstale":"2023-10-06T04:39:14.855493+0000","last_undegraded":"2023-10-06T04:39:14.855493+0000","last_fullsized":"2023-10-06T04:39:14.855493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:43.060143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842850+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:39:14.842850+0000","last_peered":"2023-10-06T04:39:14.842850+0000","last_clean":"2023-10-06T04:39:14.842850+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:39:14.842850+0000","last_undegraded":"2023-10-06T04:39:14.842850+0000","last_fullsized":"2023-10-06T04:39:14.842850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.870947+0000","last_change":"2023-10-06T04:39:14.865800+0000","last_active":"2023-10-06T04:39:14.870947+0000","last_peered":"2023-10-06T04:39:14.870947+0000","last_clean":"2023-10-06T04:39:14.870947+0000","last_became_active":"2023-10-06T04:39:14.863915+0000","last_became_peered":"2023-10-06T04:39:14.863915+0000","last_unstale":"2023-10-06T04:39:14.870947+0000","last_undegraded":"2023-10-06T04:39:14.870947+0000","last_fullsized":"2023-10-06T04:39:14.870947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851680+0000","last_change":"2023-10-06T04:39:10.796784+0000","last_active":"2023-10-06T04:39:14.851680+0000","last_peered":"2023-10-06T04:39:14.851680+0000","last_clean":"2023-10-06T04:39:14.851680+0000","last_became_active":"2023-10-06T04:39:10.796340+0000","last_became_peered":"2023-10-06T04:39:10.796340+0000","last_unstale":"2023-10-06T04:39:14.851680+0000","last_undegraded":"2023-10-06T04:39:14.851680+0000","last_fullsized":"2023-10-06T04:39:14.851680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847307+0000","last_change":"2023-10-06T04:39:09.776306+0000","last_active":"2023-10-06T04:39:14.847307+0000","last_peered":"2023-10-06T04:39:14.847307+0000","last_clean":"2023-10-06T04:39:14.847307+0000","last_became_active":"2023-10-06T04:39:09.775920+0000","last_became_peered":"2023-10-06T04:39:09.775920+0000","last_unstale":"2023-10-06T04:39:14.847307+0000","last_undegraded":"2023-10-06T04:39:14.847307+0000","last_fullsized":"2023-10-06T04:39:14.847307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:46.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852352+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:39:14.852352+0000","last_peered":"2023-10-06T04:39:14.852352+0000","last_clean":"2023-10-06T04:39:14.852352+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:39:14.852352+0000","last_undegraded":"2023-10-06T04:39:14.852352+0000","last_fullsized":"2023-10-06T04:39:14.852352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.872195+0000","last_change":"2023-10-06T04:39:14.870766+0000","last_active":"2023-10-06T04:39:14.872195+0000","last_peered":"2023-10-06T04:39:14.872195+0000","last_clean":"2023-10-06T04:39:14.872195+0000","last_became_active":"2023-10-06T04:39:14.870293+0000","last_became_peered":"2023-10-06T04:39:14.870293+0000","last_unstale":"2023-10-06T04:39:14.872195+0000","last_undegraded":"2023-10-06T04:39:14.872195+0000","last_fullsized":"2023-10-06T04:39:14.872195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:25.769047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848956+0000","last_change":"2023-10-06T04:39:10.808367+0000","last_active":"2023-10-06T04:39:14.848956+0000","last_peered":"2023-10-06T04:39:14.848956+0000","last_clean":"2023-10-06T04:39:14.848956+0000","last_became_active":"2023-10-06T04:39:10.808087+0000","last_became_peered":"2023-10-06T04:39:10.808087+0000","last_unstale":"2023-10-06T04:39:14.848956+0000","last_undegraded":"2023-10-06T04:39:14.848956+0000","last_fullsized":"2023-10-06T04:39:14.848956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:52.160791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837257+0000","last_change":"2023-10-06T04:39:09.766937+0000","last_active":"2023-10-06T04:39:14.837257+0000","last_peered":"2023-10-06T04:39:14.837257+0000","last_clean":"2023-10-06T04:39:14.837257+0000","last_became_active":"2023-10-06T04:39:09.766577+0000","last_became_peered":"2023-10-06T04:39:09.766577+0000","last_unstale":"2023-10-06T04:39:14.837257+0000","last_undegraded":"2023-10-06T04:39:14.837257+0000","last_fullsized":"2023-10-06T04:39:14.837257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:58.385216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852746+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:39:14.852746+0000","last_peered":"2023-10-06T04:39:14.852746+0000","last_clean":"2023-10-06T04:39:14.852746+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:39:14.852746+0000","last_undegraded":"2023-10-06T04:39:14.852746+0000","last_fullsized":"2023-10-06T04:39:14.852746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852451+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:39:14.852451+0000","last_peered":"2023-10-06T04:39:14.852451+0000","last_clean":"2023-10-06T04:39:14.852451+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:39:14.852451+0000","last_undegraded":"2023-10-06T04:39:14.852451+0000","last_fullsized":"2023-10-06T04:39:14.852451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869388+0000","last_change":"2023-10-06T04:39:14.867879+0000","last_active":"2023-10-06T04:39:14.869388+0000","last_peered":"2023-10-06T04:39:14.869388+0000","last_clean":"2023-10-06T04:39:14.869388+0000","last_became_active":"2023-10-06T04:39:14.866139+0000","last_became_peered":"2023-10-06T04:39:14.866139+0000","last_unstale":"2023-10-06T04:39:14.869388+0000","last_undegraded":"2023-10-06T04:39:14.869388+0000","last_fullsized":"2023-10-06T04:39:14.869388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:43.629206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856342+0000","last_change":"2023-10-06T04:39:10.803484+0000","last_active":"2023-10-06T04:39:14.856342+0000","last_peered":"2023-10-06T04:39:14.856342+0000","last_clean":"2023-10-06T04:39:14.856342+0000","last_became_active":"2023-10-06T04:39:10.803189+0000","last_became_peered":"2023-10-06T04:39:10.803189+0000","last_unstale":"2023-10-06T04:39:14.856342+0000","last_undegraded":"2023-10-06T04:39:14.856342+0000","last_fullsized":"2023-10-06T04:39:14.856342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:48.240785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.837543+0000","last_change":"2023-10-06T04:39:09.774774+0000","last_active":"2023-10-06T04:39:14.837543+0000","last_peered":"2023-10-06T04:39:14.837543+0000","last_clean":"2023-10-06T04:39:14.837543+0000","last_became_active":"2023-10-06T04:39:09.772662+0000","last_became_peered":"2023-10-06T04:39:09.772662+0000","last_unstale":"2023-10-06T04:39:14.837543+0000","last_undegraded":"2023-10-06T04:39:14.837543+0000","last_fullsized":"2023-10-06T04:39:14.837543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.815387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.867295+0000","last_change":"2023-10-06T04:39:14.863555+0000","last_active":"2023-10-06T04:39:14.867295+0000","last_peered":"2023-10-06T04:39:14.867295+0000","last_clean":"2023-10-06T04:39:14.867295+0000","last_became_active":"2023-10-06T04:39:14.863126+0000","last_became_peered":"2023-10-06T04:39:14.863126+0000","last_unstale":"2023-10-06T04:39:14.867295+0000","last_undegraded":"2023-10-06T04:39:14.867295+0000","last_fullsized":"2023-10-06T04:39:14.867295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:58.313292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842510+0000","last_change":"2023-10-06T04:39:10.801300+0000","last_active":"2023-10-06T04:39:14.842510+0000","last_peered":"2023-10-06T04:39:14.842510+0000","last_clean":"2023-10-06T04:39:14.842510+0000","last_became_active":"2023-10-06T04:39:10.797999+0000","last_became_peered":"2023-10-06T04:39:10.797999+0000","last_unstale":"2023-10-06T04:39:14.842510+0000","last_undegraded":"2023-10-06T04:39:14.842510+0000","last_fullsized":"2023-10-06T04:39:14.842510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:23.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841749+0000","last_change":"2023-10-06T04:39:09.772680+0000","last_active":"2023-10-06T04:39:14.841749+0000","last_peered":"2023-10-06T04:39:14.841749+0000","last_clean":"2023-10-06T04:39:14.841749+0000","last_became_active":"2023-10-06T04:39:09.770748+0000","last_became_peered":"2023-10-06T04:39:09.770748+0000","last_unstale":"2023-10-06T04:39:14.841749+0000","last_undegraded":"2023-10-06T04:39:14.841749+0000","last_fullsized":"2023-10-06T04:39:14.841749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:08.396735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.866535+0000","last_change":"2023-10-06T04:39:14.863771+0000","last_active":"2023-10-06T04:39:14.866535+0000","last_peered":"2023-10-06T04:39:14.866535+0000","last_clean":"2023-10-06T04:39:14.866535+0000","last_became_active":"2023-10-06T04:39:14.862562+0000","last_became_peered":"2023-10-06T04:39:14.862562+0000","last_unstale":"2023-10-06T04:39:14.866535+0000","last_undegraded":"2023-10-06T04:39:14.866535+0000","last_fullsized":"2023-10-06T04:39:14.866535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:13.279378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842489+0000","last_change":"2023-10-06T04:39:10.801609+0000","last_active":"2023-10-06T04:39:14.842489+0000","last_peered":"2023-10-06T04:39:14.842489+0000","last_clean":"2023-10-06T04:39:14.842489+0000","last_became_active":"2023-10-06T04:39:10.798490+0000","last_became_peered":"2023-10-06T04:39:10.798490+0000","last_unstale":"2023-10-06T04:39:14.842489+0000","last_undegraded":"2023-10-06T04:39:14.842489+0000","last_fullsized":"2023-10-06T04:39:14.842489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:13.365650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847962+0000","last_change":"2023-10-06T04:39:09.776674+0000","last_active":"2023-10-06T04:39:14.847962+0000","last_peered":"2023-10-06T04:39:14.847962+0000","last_clean":"2023-10-06T04:39:14.847962+0000","last_became_active":"2023-10-06T04:39:09.776334+0000","last_became_peered":"2023-10-06T04:39:09.776334+0000","last_unstale":"2023-10-06T04:39:14.847962+0000","last_undegraded":"2023-10-06T04:39:14.847962+0000","last_fullsized":"2023-10-06T04:39:14.847962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:02.883989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.878170+0000","last_change":"2023-10-06T04:39:14.873753+0000","last_active":"2023-10-06T04:39:14.878170+0000","last_peered":"2023-10-06T04:39:14.878170+0000","last_clean":"2023-10-06T04:39:14.878170+0000","last_became_active":"2023-10-06T04:39:14.873034+0000","last_became_peered":"2023-10-06T04:39:14.873034+0000","last_unstale":"2023-10-06T04:39:14.878170+0000","last_undegraded":"2023-10-06T04:39:14.878170+0000","last_fullsized":"2023-10-06T04:39:14.878170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:26.716449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842122+0000","last_change":"2023-10-06T04:39:10.807800+0000","last_active":"2023-10-06T04:39:14.842122+0000","last_peered":"2023-10-06T04:39:14.842122+0000","last_clean":"2023-10-06T04:39:14.842122+0000","last_became_active":"2023-10-06T04:39:10.807550+0000","last_became_peered":"2023-10-06T04:39:10.807550+0000","last_unstale":"2023-10-06T04:39:14.842122+0000","last_undegraded":"2023-10-06T04:39:14.842122+0000","last_fullsized":"2023-10-06T04:39:14.842122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:10.727863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838754+0000","last_change":"2023-10-06T04:39:09.776972+0000","last_active":"2023-10-06T04:39:14.838754+0000","last_peered":"2023-10-06T04:39:14.838754+0000","last_clean":"2023-10-06T04:39:14.838754+0000","last_became_active":"2023-10-06T04:39:09.776582+0000","last_became_peered":"2023-10-06T04:39:09.776582+0000","last_unstale":"2023-10-06T04:39:14.838754+0000","last_undegraded":"2023-10-06T04:39:14.838754+0000","last_fullsized":"2023-10-06T04:39:14.838754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:46.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.870886+0000","last_change":"2023-10-06T04:39:14.866468+0000","last_active":"2023-10-06T04:39:14.870886+0000","last_peered":"2023-10-06T04:39:14.870886+0000","last_clean":"2023-10-06T04:39:14.870886+0000","last_became_active":"2023-10-06T04:39:14.865978+0000","last_became_peered":"2023-10-06T04:39:14.865978+0000","last_unstale":"2023-10-06T04:39:14.870886+0000","last_undegraded":"2023-10-06T04:39:14.870886+0000","last_fullsized":"2023-10-06T04:39:14.870886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:26.328198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847077+0000","last_change":"2023-10-06T04:39:10.795850+0000","last_active":"2023-10-06T04:39:14.847077+0000","last_peered":"2023-10-06T04:39:14.847077+0000","last_clean":"2023-10-06T04:39:14.847077+0000","last_became_active":"2023-10-06T04:39:10.795532+0000","last_became_peered":"2023-10-06T04:39:10.795532+0000","last_unstale":"2023-10-06T04:39:14.847077+0000","last_undegraded":"2023-10-06T04:39:14.847077+0000","last_fullsized":"2023-10-06T04:39:14.847077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852581+0000","last_change":"2023-10-06T04:39:09.778260+0000","last_active":"2023-10-06T04:39:14.852581+0000","last_peered":"2023-10-06T04:39:14.852581+0000","last_clean":"2023-10-06T04:39:14.852581+0000","last_became_active":"2023-10-06T04:39:09.777976+0000","last_became_peered":"2023-10-06T04:39:09.777976+0000","last_unstale":"2023-10-06T04:39:14.852581+0000","last_undegraded":"2023-10-06T04:39:14.852581+0000","last_fullsized":"2023-10-06T04:39:14.852581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:20.229663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.862419+0000","last_change":"2023-10-06T04:39:14.857650+0000","last_active":"2023-10-06T04:39:14.862419+0000","last_peered":"2023-10-06T04:39:14.862419+0000","last_clean":"2023-10-06T04:39:14.862419+0000","last_became_active":"2023-10-06T04:39:14.857219+0000","last_became_peered":"2023-10-06T04:39:14.857219+0000","last_unstale":"2023-10-06T04:39:14.862419+0000","last_undegraded":"2023-10-06T04:39:14.862419+0000","last_fullsized":"2023-10-06T04:39:14.862419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:39.404929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847783+0000","last_change":"2023-10-06T04:39:10.800707+0000","last_active":"2023-10-06T04:39:14.847783+0000","last_peered":"2023-10-06T04:39:14.847783+0000","last_clean":"2023-10-06T04:39:14.847783+0000","last_became_active":"2023-10-06T04:39:10.800342+0000","last_became_peered":"2023-10-06T04:39:10.800342+0000","last_unstale":"2023-10-06T04:39:14.847783+0000","last_undegraded":"2023-10-06T04:39:14.847783+0000","last_fullsized":"2023-10-06T04:39:14.847783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:55.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.859752+0000","last_change":"2023-10-06T04:39:09.769967+0000","last_active":"2023-10-06T04:39:14.859752+0000","last_peered":"2023-10-06T04:39:14.859752+0000","last_clean":"2023-10-06T04:39:14.859752+0000","last_became_active":"2023-10-06T04:39:09.769644+0000","last_became_peered":"2023-10-06T04:39:09.769644+0000","last_unstale":"2023-10-06T04:39:14.859752+0000","last_undegraded":"2023-10-06T04:39:14.859752+0000","last_fullsized":"2023-10-06T04:39:14.859752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:23.492104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.870881+0000","last_change":"2023-10-06T04:39:14.866314+0000","last_active":"2023-10-06T04:39:14.870881+0000","last_peered":"2023-10-06T04:39:14.870881+0000","last_clean":"2023-10-06T04:39:14.870881+0000","last_became_active":"2023-10-06T04:39:14.864322+0000","last_became_peered":"2023-10-06T04:39:14.864322+0000","last_unstale":"2023-10-06T04:39:14.870881+0000","last_undegraded":"2023-10-06T04:39:14.870881+0000","last_fullsized":"2023-10-06T04:39:14.870881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:16.031710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841402+0000","last_change":"2023-10-06T04:39:10.804925+0000","last_active":"2023-10-06T04:39:14.841402+0000","last_peered":"2023-10-06T04:39:14.841402+0000","last_clean":"2023-10-06T04:39:14.841402+0000","last_became_active":"2023-10-06T04:39:10.804608+0000","last_became_peered":"2023-10-06T04:39:10.804608+0000","last_unstale":"2023-10-06T04:39:14.841402+0000","last_undegraded":"2023-10-06T04:39:14.841402+0000","last_fullsized":"2023-10-06T04:39:14.841402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:11.605186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.862470+0000","last_change":"2023-10-06T04:39:09.779200+0000","last_active":"2023-10-06T04:39:14.862470+0000","last_peered":"2023-10-06T04:39:14.862470+0000","last_clean":"2023-10-06T04:39:14.862470+0000","last_became_active":"2023-10-06T04:39:09.778902+0000","last_became_peered":"2023-10-06T04:39:09.778902+0000","last_unstale":"2023-10-06T04:39:14.862470+0000","last_undegraded":"2023-10-06T04:39:14.862470+0000","last_fullsized":"2023-10-06T04:39:14.862470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:43.836062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869506+0000","last_change":"2023-10-06T04:39:14.865345+0000","last_active":"2023-10-06T04:39:14.869506+0000","last_peered":"2023-10-06T04:39:14.869506+0000","last_clean":"2023-10-06T04:39:14.869506+0000","last_became_active":"2023-10-06T04:39:14.864895+0000","last_became_peered":"2023-10-06T04:39:14.864895+0000","last_unstale":"2023-10-06T04:39:14.869506+0000","last_undegraded":"2023-10-06T04:39:14.869506+0000","last_fullsized":"2023-10-06T04:39:14.869506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:04.884267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.846486+0000","last_change":"2023-10-06T04:39:10.798199+0000","last_active":"2023-10-06T04:39:14.846486+0000","last_peered":"2023-10-06T04:39:14.846486+0000","last_clean":"2023-10-06T04:39:14.846486+0000","last_became_active":"2023-10-06T04:39:10.797887+0000","last_became_peered":"2023-10-06T04:39:10.797887+0000","last_unstale":"2023-10-06T04:39:14.846486+0000","last_undegraded":"2023-10-06T04:39:14.846486+0000","last_fullsized":"2023-10-06T04:39:14.846486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:18.751471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.860419+0000","last_change":"2023-10-06T04:39:09.778482+0000","last_active":"2023-10-06T04:39:14.860419+0000","last_peered":"2023-10-06T04:39:14.860419+0000","last_clean":"2023-10-06T04:39:14.860419+0000","last_became_active":"2023-10-06T04:39:09.778203+0000","last_became_peered":"2023-10-06T04:39:09.778203+0000","last_unstale":"2023-10-06T04:39:14.860419+0000","last_undegraded":"2023-10-06T04:39:14.860419+0000","last_fullsized":"2023-10-06T04:39:14.860419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:57.313274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.873841+0000","last_change":"2023-10-06T04:39:14.869414+0000","last_active":"2023-10-06T04:39:14.873841+0000","last_peered":"2023-10-06T04:39:14.873841+0000","last_clean":"2023-10-06T04:39:14.873841+0000","last_became_active":"2023-10-06T04:39:14.866496+0000","last_became_peered":"2023-10-06T04:39:14.866496+0000","last_unstale":"2023-10-06T04:39:14.873841+0000","last_undegraded":"2023-10-06T04:39:14.873841+0000","last_fullsized":"2023-10-06T04:39:14.873841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:21.891013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.863781+0000","last_change":"2023-10-06T04:39:14.862719+0000","last_active":"2023-10-06T04:39:14.863781+0000","last_peered":"2023-10-06T04:39:14.863781+0000","last_clean":"2023-10-06T04:39:14.863781+0000","last_became_active":"2023-10-06T04:39:14.862055+0000","last_became_peered":"2023-10-06T04:39:14.862055+0000","last_unstale":"2023-10-06T04:39:14.863781+0000","last_undegraded":"2023-10-06T04:39:14.863781+0000","last_fullsized":"2023-10-06T04:39:14.863781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:13.176385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847135+0000","last_change":"2023-10-06T04:39:09.765721+0000","last_active":"2023-10-06T04:39:14.847135+0000","last_peered":"2023-10-06T04:39:14.847135+0000","last_clean":"2023-10-06T04:39:14.847135+0000","last_became_active":"2023-10-06T04:39:09.765371+0000","last_became_peered":"2023-10-06T04:39:09.765371+0000","last_unstale":"2023-10-06T04:39:14.847135+0000","last_undegraded":"2023-10-06T04:39:14.847135+0000","last_fullsized":"2023-10-06T04:39:14.847135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:46.555480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.839035+0000","last_change":"2023-10-06T04:39:10.802886+0000","last_active":"2023-10-06T04:39:14.839035+0000","last_peered":"2023-10-06T04:39:14.839035+0000","last_clean":"2023-10-06T04:39:14.839035+0000","last_became_active":"2023-10-06T04:39:10.802550+0000","last_became_peered":"2023-10-06T04:39:10.802550+0000","last_unstale":"2023-10-06T04:39:14.839035+0000","last_undegraded":"2023-10-06T04:39:14.839035+0000","last_fullsized":"2023-10-06T04:39:14.839035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869112+0000","last_change":"2023-10-06T04:39:14.865749+0000","last_active":"2023-10-06T04:39:14.869112+0000","last_peered":"2023-10-06T04:39:14.869112+0000","last_clean":"2023-10-06T04:39:14.869112+0000","last_became_active":"2023-10-06T04:39:14.865283+0000","last_became_peered":"2023-10-06T04:39:14.865283+0000","last_unstale":"2023-10-06T04:39:14.869112+0000","last_undegraded":"2023-10-06T04:39:14.869112+0000","last_fullsized":"2023-10-06T04:39:14.869112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:22.513353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.858777+0000","last_change":"2023-10-06T04:39:09.778439+0000","last_active":"2023-10-06T04:39:14.858777+0000","last_peered":"2023-10-06T04:39:14.858777+0000","last_clean":"2023-10-06T04:39:14.858777+0000","last_became_active":"2023-10-06T04:39:09.778107+0000","last_became_peered":"2023-10-06T04:39:09.778107+0000","last_unstale":"2023-10-06T04:39:14.858777+0000","last_undegraded":"2023-10-06T04:39:14.858777+0000","last_fullsized":"2023-10-06T04:39:14.858777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:14.344401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851798+0000","last_change":"2023-10-06T04:39:10.800973+0000","last_active":"2023-10-06T04:39:14.851798+0000","last_peered":"2023-10-06T04:39:14.851798+0000","last_clean":"2023-10-06T04:39:14.851798+0000","last_became_active":"2023-10-06T04:39:10.800682+0000","last_became_peered":"2023-10-06T04:39:10.800682+0000","last_unstale":"2023-10-06T04:39:14.851798+0000","last_undegraded":"2023-10-06T04:39:14.851798+0000","last_fullsized":"2023-10-06T04:39:14.851798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:10.727863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847077+0000","last_change":"2023-10-06T04:39:09.766574+0000","last_active":"2023-10-06T04:39:14.847077+0000","last_peered":"2023-10-06T04:39:14.847077+0000","last_clean":"2023-10-06T04:39:14.847077+0000","last_became_active":"2023-10-06T04:39:09.765846+0000","last_became_peered":"2023-10-06T04:39:09.765846+0000","last_unstale":"2023-10-06T04:39:14.847077+0000","last_undegraded":"2023-10-06T04:39:14.847077+0000","last_fullsized":"2023-10-06T04:39:14.847077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:11.332865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853442+0000","last_change":"2023-10-06T04:39:10.800587+0000","last_active":"2023-10-06T04:39:14.853442+0000","last_peered":"2023-10-06T04:39:14.853442+0000","last_clean":"2023-10-06T04:39:14.853442+0000","last_became_active":"2023-10-06T04:39:10.798566+0000","last_became_peered":"2023-10-06T04:39:10.798566+0000","last_unstale":"2023-10-06T04:39:14.853442+0000","last_undegraded":"2023-10-06T04:39:14.853442+0000","last_fullsized":"2023-10-06T04:39:14.853442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:22.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.869120+0000","last_change":"2023-10-06T04:39:14.865777+0000","last_active":"2023-10-06T04:39:14.869120+0000","last_peered":"2023-10-06T04:39:14.869120+0000","last_clean":"2023-10-06T04:39:14.869120+0000","last_became_active":"2023-10-06T04:39:14.865221+0000","last_became_peered":"2023-10-06T04:39:14.865221+0000","last_unstale":"2023-10-06T04:39:14.869120+0000","last_undegraded":"2023-10-06T04:39:14.869120+0000","last_fullsized":"2023-10-06T04:39:14.869120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:59.144138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851863+0000","last_change":"2023-10-06T04:39:09.779350+0000","last_active":"2023-10-06T04:39:14.851863+0000","last_peered":"2023-10-06T04:39:14.851863+0000","last_clean":"2023-10-06T04:39:14.851863+0000","last_became_active":"2023-10-06T04:39:09.778933+0000","last_became_peered":"2023-10-06T04:39:09.778933+0000","last_unstale":"2023-10-06T04:39:14.851863+0000","last_undegraded":"2023-10-06T04:39:14.851863+0000","last_fullsized":"2023-10-06T04:39:14.851863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:08.736059+0000","last_clean_scrub_stamp":"2023-10-06T04:39:08.736059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:44.185428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838211+0000","last_change":"2023-10-06T04:39:10.803199+0000","last_active":"2023-10-06T04:39:14.838211+0000","last_peered":"2023-10-06T04:39:14.838211+0000","last_clean":"2023-10-06T04:39:14.838211+0000","last_became_active":"2023-10-06T04:39:10.802891+0000","last_became_peered":"2023-10-06T04:39:10.802891+0000","last_unstale":"2023-10-06T04:39:14.838211+0000","last_undegraded":"2023-10-06T04:39:14.838211+0000","last_fullsized":"2023-10-06T04:39:14.838211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.876047+0000","last_change":"2023-10-06T04:39:14.874845+0000","last_active":"2023-10-06T04:39:14.876047+0000","last_peered":"2023-10-06T04:39:14.876047+0000","last_clean":"2023-10-06T04:39:14.876047+0000","last_became_active":"2023-10-06T04:39:14.874448+0000","last_became_peered":"2023-10-06T04:39:14.874448+0000","last_unstale":"2023-10-06T04:39:14.876047+0000","last_undegraded":"2023-10-06T04:39:14.876047+0000","last_fullsized":"2023-10-06T04:39:14.876047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:13.818968+0000","last_clean_scrub_stamp":"2023-10-06T04:39:13.818968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:35.411077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.847019+0000","last_change":"2023-10-06T04:39:10.796169+0000","last_active":"2023-10-06T04:39:14.847019+0000","last_peered":"2023-10-06T04:39:14.847019+0000","last_clean":"2023-10-06T04:39:14.847019+0000","last_became_active":"2023-10-06T04:39:10.795900+0000","last_became_peered":"2023-10-06T04:39:10.795900+0000","last_unstale":"2023-10-06T04:39:14.847019+0000","last_undegraded":"2023-10-06T04:39:14.847019+0000","last_fullsized":"2023-10-06T04:39:14.847019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:03.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.836968+0000","last_change":"2023-10-06T04:39:10.803152+0000","last_active":"2023-10-06T04:39:14.836968+0000","last_peered":"2023-10-06T04:39:14.836968+0000","last_clean":"2023-10-06T04:39:14.836968+0000","last_became_active":"2023-10-06T04:39:10.802831+0000","last_became_peered":"2023-10-06T04:39:10.802831+0000","last_unstale":"2023-10-06T04:39:14.836968+0000","last_undegraded":"2023-10-06T04:39:14.836968+0000","last_fullsized":"2023-10-06T04:39:14.836968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.405720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841420+0000","last_change":"2023-10-06T04:39:10.801514+0000","last_active":"2023-10-06T04:39:14.841420+0000","last_peered":"2023-10-06T04:39:14.841420+0000","last_clean":"2023-10-06T04:39:14.841420+0000","last_became_active":"2023-10-06T04:39:10.798059+0000","last_became_peered":"2023-10-06T04:39:10.798059+0000","last_unstale":"2023-10-06T04:39:14.841420+0000","last_undegraded":"2023-10-06T04:39:14.841420+0000","last_fullsized":"2023-10-06T04:39:14.841420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.838585+0000","last_change":"2023-10-06T04:39:10.799859+0000","last_active":"2023-10-06T04:39:14.838585+0000","last_peered":"2023-10-06T04:39:14.838585+0000","last_clean":"2023-10-06T04:39:14.838585+0000","last_became_active":"2023-10-06T04:39:10.799533+0000","last_became_peered":"2023-10-06T04:39:10.799533+0000","last_unstale":"2023-10-06T04:39:14.838585+0000","last_undegraded":"2023-10-06T04:39:14.838585+0000","last_fullsized":"2023-10-06T04:39:14.838585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:11.209344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856350+0000","last_change":"2023-10-06T04:39:10.795334+0000","last_active":"2023-10-06T04:39:14.856350+0000","last_peered":"2023-10-06T04:39:14.856350+0000","last_clean":"2023-10-06T04:39:14.856350+0000","last_became_active":"2023-10-06T04:39:10.795033+0000","last_became_peered":"2023-10-06T04:39:10.795033+0000","last_unstale":"2023-10-06T04:39:14.856350+0000","last_undegraded":"2023-10-06T04:39:14.856350+0000","last_fullsized":"2023-10-06T04:39:14.856350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:18.751471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853357+0000","last_change":"2023-10-06T04:39:10.799770+0000","last_active":"2023-10-06T04:39:14.853357+0000","last_peered":"2023-10-06T04:39:14.853357+0000","last_clean":"2023-10-06T04:39:14.853357+0000","last_became_active":"2023-10-06T04:39:10.798941+0000","last_became_peered":"2023-10-06T04:39:10.798941+0000","last_unstale":"2023-10-06T04:39:14.853357+0000","last_undegraded":"2023-10-06T04:39:14.853357+0000","last_fullsized":"2023-10-06T04:39:14.853357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:52.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856727+0000","last_change":"2023-10-06T04:39:10.795471+0000","last_active":"2023-10-06T04:39:14.856727+0000","last_peered":"2023-10-06T04:39:14.856727+0000","last_clean":"2023-10-06T04:39:14.856727+0000","last_became_active":"2023-10-06T04:39:10.795120+0000","last_became_peered":"2023-10-06T04:39:10.795120+0000","last_unstale":"2023-10-06T04:39:14.856727+0000","last_undegraded":"2023-10-06T04:39:14.856727+0000","last_fullsized":"2023-10-06T04:39:14.856727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:52.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.856227+0000","last_change":"2023-10-06T04:39:10.799379+0000","last_active":"2023-10-06T04:39:14.856227+0000","last_peered":"2023-10-06T04:39:14.856227+0000","last_clean":"2023-10-06T04:39:14.856227+0000","last_became_active":"2023-10-06T04:39:10.799087+0000","last_became_peered":"2023-10-06T04:39:10.799087+0000","last_unstale":"2023-10-06T04:39:14.856227+0000","last_undegraded":"2023-10-06T04:39:14.856227+0000","last_fullsized":"2023-10-06T04:39:14.856227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:38.502648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.852196+0000","last_change":"2023-10-06T04:39:10.804696+0000","last_active":"2023-10-06T04:39:14.852196+0000","last_peered":"2023-10-06T04:39:14.852196+0000","last_clean":"2023-10-06T04:39:14.852196+0000","last_became_active":"2023-10-06T04:39:10.804399+0000","last_became_peered":"2023-10-06T04:39:10.804399+0000","last_unstale":"2023-10-06T04:39:14.852196+0000","last_undegraded":"2023-10-06T04:39:14.852196+0000","last_fullsized":"2023-10-06T04:39:14.852196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:37.561240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.836751+0000","last_change":"2023-10-06T04:39:10.799293+0000","last_active":"2023-10-06T04:39:14.836751+0000","last_peered":"2023-10-06T04:39:14.836751+0000","last_clean":"2023-10-06T04:39:14.836751+0000","last_became_active":"2023-10-06T04:39:10.798825+0000","last_became_peered":"2023-10-06T04:39:10.798825+0000","last_unstale":"2023-10-06T04:39:14.836751+0000","last_undegraded":"2023-10-06T04:39:14.836751+0000","last_fullsized":"2023-10-06T04:39:14.836751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.420412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.846972+0000","last_change":"2023-10-06T04:39:10.797145+0000","last_active":"2023-10-06T04:39:14.846972+0000","last_peered":"2023-10-06T04:39:14.846972+0000","last_clean":"2023-10-06T04:39:14.846972+0000","last_became_active":"2023-10-06T04:39:10.796689+0000","last_became_peered":"2023-10-06T04:39:10.796689+0000","last_unstale":"2023-10-06T04:39:14.846972+0000","last_undegraded":"2023-10-06T04:39:14.846972+0000","last_fullsized":"2023-10-06T04:39:14.846972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:11.209344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.851753+0000","last_change":"2023-10-06T04:39:10.805749+0000","last_active":"2023-10-06T04:39:14.851753+0000","last_peered":"2023-10-06T04:39:14.851753+0000","last_clean":"2023-10-06T04:39:14.851753+0000","last_became_active":"2023-10-06T04:39:10.804977+0000","last_became_peered":"2023-10-06T04:39:10.804977+0000","last_unstale":"2023-10-06T04:39:14.851753+0000","last_undegraded":"2023-10-06T04:39:14.851753+0000","last_fullsized":"2023-10-06T04:39:14.851753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:23.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841933+0000","last_change":"2023-10-06T04:39:10.794553+0000","last_active":"2023-10-06T04:39:14.841933+0000","last_peered":"2023-10-06T04:39:14.841933+0000","last_clean":"2023-10-06T04:39:14.841933+0000","last_became_active":"2023-10-06T04:39:10.794274+0000","last_became_peered":"2023-10-06T04:39:10.794274+0000","last_unstale":"2023-10-06T04:39:14.841933+0000","last_undegraded":"2023-10-06T04:39:14.841933+0000","last_fullsized":"2023-10-06T04:39:14.841933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:33.941624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842368+0000","last_change":"2023-10-06T04:39:10.800418+0000","last_active":"2023-10-06T04:39:14.842368+0000","last_peered":"2023-10-06T04:39:14.842368+0000","last_clean":"2023-10-06T04:39:14.842368+0000","last_became_active":"2023-10-06T04:39:10.799986+0000","last_became_peered":"2023-10-06T04:39:10.799986+0000","last_unstale":"2023-10-06T04:39:14.842368+0000","last_undegraded":"2023-10-06T04:39:14.842368+0000","last_fullsized":"2023-10-06T04:39:14.842368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:03.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842492+0000","last_change":"2023-10-06T04:39:10.801586+0000","last_active":"2023-10-06T04:39:14.842492+0000","last_peered":"2023-10-06T04:39:14.842492+0000","last_clean":"2023-10-06T04:39:14.842492+0000","last_became_active":"2023-10-06T04:39:10.798761+0000","last_became_peered":"2023-10-06T04:39:10.798761+0000","last_unstale":"2023-10-06T04:39:14.842492+0000","last_undegraded":"2023-10-06T04:39:14.842492+0000","last_fullsized":"2023-10-06T04:39:14.842492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.420412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.850097+0000","last_change":"2023-10-06T04:39:10.805013+0000","last_active":"2023-10-06T04:39:14.850097+0000","last_peered":"2023-10-06T04:39:14.850097+0000","last_clean":"2023-10-06T04:39:14.850097+0000","last_became_active":"2023-10-06T04:39:10.804231+0000","last_became_peered":"2023-10-06T04:39:10.804231+0000","last_unstale":"2023-10-06T04:39:14.850097+0000","last_undegraded":"2023-10-06T04:39:14.850097+0000","last_fullsized":"2023-10-06T04:39:14.850097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.405720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.840959+0000","last_change":"2023-10-06T04:39:10.798938+0000","last_active":"2023-10-06T04:39:14.840959+0000","last_peered":"2023-10-06T04:39:14.840959+0000","last_clean":"2023-10-06T04:39:14.840959+0000","last_became_active":"2023-10-06T04:39:10.798178+0000","last_became_peered":"2023-10-06T04:39:10.798178+0000","last_unstale":"2023-10-06T04:39:14.840959+0000","last_undegraded":"2023-10-06T04:39:14.840959+0000","last_fullsized":"2023-10-06T04:39:14.840959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853520+0000","last_change":"2023-10-06T04:39:10.804784+0000","last_active":"2023-10-06T04:39:14.853520+0000","last_peered":"2023-10-06T04:39:14.853520+0000","last_clean":"2023-10-06T04:39:14.853520+0000","last_became_active":"2023-10-06T04:39:10.804072+0000","last_became_peered":"2023-10-06T04:39:10.804072+0000","last_unstale":"2023-10-06T04:39:14.853520+0000","last_undegraded":"2023-10-06T04:39:14.853520+0000","last_fullsized":"2023-10-06T04:39:14.853520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:11.209344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.849546+0000","last_change":"2023-10-06T04:39:10.794908+0000","last_active":"2023-10-06T04:39:14.849546+0000","last_peered":"2023-10-06T04:39:14.849546+0000","last_clean":"2023-10-06T04:39:14.849546+0000","last_became_active":"2023-10-06T04:39:10.794629+0000","last_became_peered":"2023-10-06T04:39:10.794629+0000","last_unstale":"2023-10-06T04:39:14.849546+0000","last_undegraded":"2023-10-06T04:39:14.849546+0000","last_fullsized":"2023-10-06T04:39:14.849546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:02.105244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841856+0000","last_change":"2023-10-06T04:39:10.807415+0000","last_active":"2023-10-06T04:39:14.841856+0000","last_peered":"2023-10-06T04:39:14.841856+0000","last_clean":"2023-10-06T04:39:14.841856+0000","last_became_active":"2023-10-06T04:39:10.807005+0000","last_became_peered":"2023-10-06T04:39:10.807005+0000","last_unstale":"2023-10-06T04:39:14.841856+0000","last_undegraded":"2023-10-06T04:39:14.841856+0000","last_fullsized":"2023-10-06T04:39:14.841856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:30.195878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842269+0000","last_change":"2023-10-06T04:39:10.798512+0000","last_active":"2023-10-06T04:39:14.842269+0000","last_peered":"2023-10-06T04:39:14.842269+0000","last_clean":"2023-10-06T04:39:14.842269+0000","last_became_active":"2023-10-06T04:39:10.798009+0000","last_became_peered":"2023-10-06T04:39:10.798009+0000","last_unstale":"2023-10-06T04:39:14.842269+0000","last_undegraded":"2023-10-06T04:39:14.842269+0000","last_fullsized":"2023-10-06T04:39:14.842269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:55.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842361+0000","last_change":"2023-10-06T04:39:10.807187+0000","last_active":"2023-10-06T04:39:14.842361+0000","last_peered":"2023-10-06T04:39:14.842361+0000","last_clean":"2023-10-06T04:39:14.842361+0000","last_became_active":"2023-10-06T04:39:10.801649+0000","last_became_peered":"2023-10-06T04:39:10.801649+0000","last_unstale":"2023-10-06T04:39:14.842361+0000","last_undegraded":"2023-10-06T04:39:14.842361+0000","last_fullsized":"2023-10-06T04:39:14.842361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:13.704974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.854108+0000","last_change":"2023-10-06T04:39:10.807376+0000","last_active":"2023-10-06T04:39:14.854108+0000","last_peered":"2023-10-06T04:39:14.854108+0000","last_clean":"2023-10-06T04:39:14.854108+0000","last_became_active":"2023-10-06T04:39:10.806927+0000","last_became_peered":"2023-10-06T04:39:10.806927+0000","last_unstale":"2023-10-06T04:39:14.854108+0000","last_undegraded":"2023-10-06T04:39:14.854108+0000","last_fullsized":"2023-10-06T04:39:14.854108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:26.481455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.849970+0000","last_change":"2023-10-06T04:39:10.805215+0000","last_active":"2023-10-06T04:39:14.849970+0000","last_peered":"2023-10-06T04:39:14.849970+0000","last_clean":"2023-10-06T04:39:14.849970+0000","last_became_active":"2023-10-06T04:39:10.804738+0000","last_became_peered":"2023-10-06T04:39:10.804738+0000","last_unstale":"2023-10-06T04:39:14.849970+0000","last_undegraded":"2023-10-06T04:39:14.849970+0000","last_fullsized":"2023-10-06T04:39:14.849970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.420412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.846395+0000","last_change":"2023-10-06T04:39:10.803687+0000","last_active":"2023-10-06T04:39:14.846395+0000","last_peered":"2023-10-06T04:39:14.846395+0000","last_clean":"2023-10-06T04:39:14.846395+0000","last_became_active":"2023-10-06T04:39:10.803340+0000","last_became_peered":"2023-10-06T04:39:10.803340+0000","last_unstale":"2023-10-06T04:39:14.846395+0000","last_undegraded":"2023-10-06T04:39:14.846395+0000","last_fullsized":"2023-10-06T04:39:14.846395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:48.240785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853384+0000","last_change":"2023-10-06T04:39:10.804576+0000","last_active":"2023-10-06T04:39:14.853384+0000","last_peered":"2023-10-06T04:39:14.853384+0000","last_clean":"2023-10-06T04:39:14.853384+0000","last_became_active":"2023-10-06T04:39:10.804020+0000","last_became_peered":"2023-10-06T04:39:10.804020+0000","last_unstale":"2023-10-06T04:39:14.853384+0000","last_undegraded":"2023-10-06T04:39:14.853384+0000","last_fullsized":"2023-10-06T04:39:14.853384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.971882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.841006+0000","last_change":"2023-10-06T04:39:10.801393+0000","last_active":"2023-10-06T04:39:14.841006+0000","last_peered":"2023-10-06T04:39:14.841006+0000","last_clean":"2023-10-06T04:39:14.841006+0000","last_became_active":"2023-10-06T04:39:10.798538+0000","last_became_peered":"2023-10-06T04:39:10.798538+0000","last_unstale":"2023-10-06T04:39:14.841006+0000","last_undegraded":"2023-10-06T04:39:14.841006+0000","last_fullsized":"2023-10-06T04:39:14.841006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.848529+0000","last_change":"2023-10-06T04:39:10.802134+0000","last_active":"2023-10-06T04:39:14.848529+0000","last_peered":"2023-10-06T04:39:14.848529+0000","last_clean":"2023-10-06T04:39:14.848529+0000","last_became_active":"2023-10-06T04:39:10.801808+0000","last_became_peered":"2023-10-06T04:39:10.801808+0000","last_unstale":"2023-10-06T04:39:14.848529+0000","last_undegraded":"2023-10-06T04:39:14.848529+0000","last_fullsized":"2023-10-06T04:39:14.848529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:01.174439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.845825+0000","last_change":"2023-10-06T04:39:10.797709+0000","last_active":"2023-10-06T04:39:14.845825+0000","last_peered":"2023-10-06T04:39:14.845825+0000","last_clean":"2023-10-06T04:39:14.845825+0000","last_became_active":"2023-10-06T04:39:10.796499+0000","last_became_peered":"2023-10-06T04:39:10.796499+0000","last_unstale":"2023-10-06T04:39:14.845825+0000","last_undegraded":"2023-10-06T04:39:14.845825+0000","last_fullsized":"2023-10-06T04:39:14.845825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:30.195878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.842462+0000","last_change":"2023-10-06T04:39:10.806884+0000","last_active":"2023-10-06T04:39:14.842462+0000","last_peered":"2023-10-06T04:39:14.842462+0000","last_clean":"2023-10-06T04:39:14.842462+0000","last_became_active":"2023-10-06T04:39:10.798862+0000","last_became_peered":"2023-10-06T04:39:10.798862+0000","last_unstale":"2023-10-06T04:39:14.842462+0000","last_undegraded":"2023-10-06T04:39:14.842462+0000","last_fullsized":"2023-10-06T04:39:14.842462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.344818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.853993+0000","last_change":"2023-10-06T04:39:10.799938+0000","last_active":"2023-10-06T04:39:14.853993+0000","last_peered":"2023-10-06T04:39:14.853993+0000","last_clean":"2023-10-06T04:39:14.853993+0000","last_became_active":"2023-10-06T04:39:10.799583+0000","last_became_peered":"2023-10-06T04:39:10.799583+0000","last_unstale":"2023-10-06T04:39:14.853993+0000","last_undegraded":"2023-10-06T04:39:14.853993+0000","last_fullsized":"2023-10-06T04:39:14.853993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:35.325688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T04:39:14.843018+0000","last_change":"2023-10-06T04:39:10.808298+0000","last_active":"2023-10-06T04:39:14.843018+0000","last_peered":"2023-10-06T04:39:14.843018+0000","last_clean":"2023-10-06T04:39:14.843018+0000","last_became_active":"2023-10-06T04:39:10.808027+0000","last_became_peered":"2023-10-06T04:39:10.808027+0000","last_unstale":"2023-10-06T04:39:14.843018+0000","last_undegraded":"2023-10-06T04:39:14.843018+0000","last_fullsized":"2023-10-06T04:39:14.843018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:09.739727+0000","last_clean_scrub_stamp":"2023-10-06T04:39:09.739727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:21.233331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":122164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":892928,"data_stored":712996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":716372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":122074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":122698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":315392,"data_stored":125844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":122074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":122074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:39:34.998 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:39:34.998 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T04:39:34.998 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T04:39:34.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T04:39:35.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.093+0000 7fb8f37c5700 1 Processor -- start 2023-10-06T04:39:35.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.093+0000 7fb8f37c5700 1 -- start start 2023-10-06T04:39:35.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.093+0000 7fb8f37c5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8ec0c6e20 0x7fb8ec0ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.093+0000 7fb8f37c5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec0c8cb0 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.093+0000 7fb8f37c5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec156180 con 0x7fb8ec0c9140 2023-10-06T04:39:35.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.093+0000 7fb8f37c5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0c7e90 con 0x7fb8ec0c6e20 2023-10-06T04:39:35.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f1561700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb8ec0ae5e0 0x7fb8ec06e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36708/0 (socket says 172.21.15.37:36708) 2023-10-06T04:39:35.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f1561700 1 -- 172.21.15.37:0/4055812943 learned_addr learned my addr 172.21.15.37:0/4055812943 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:35.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f1d62700 1 --2- 172.21.15.37:0/4055812943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8ec0c6e20 0x7fb8ec0ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8e3fff700 1 -- 172.21.15.37:0/4055812943 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441131012 0 0) 0x7fb8ec0c8cb0 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8e3fff700 1 -- 172.21.15.37:0/4055812943 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d8003570 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8e3fff700 1 -- 172.21.15.37:0/4055812943 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710492998 0 0) 0x7fb8ec156180 con 0x7fb8ec0c9140 2023-10-06T04:39:35.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8e3fff700 1 -- 172.21.15.37:0/4055812943 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8ec0c8cb0 con 0x7fb8ec0c9140 2023-10-06T04:39:35.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f1d62700 1 -- 172.21.15.37:0/4055812943 >> v1:172.21.15.83:6789/0 conn(0x7fb8ec0c9140 legacy=0x7fb8ec0c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f1d62700 1 -- 172.21.15.37:0/4055812943 >> v1:172.21.15.37:6789/0 conn(0x7fb8ec0ae5e0 legacy=0x7fb8ec06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f1d62700 1 -- 172.21.15.37:0/4055812943 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec0c80a0 con 0x7fb8ec0c6e20 2023-10-06T04:39:35.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f1d62700 1 --2- 172.21.15.37:0/4055812943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8ec0c6e20 0x7fb8ec0ace60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009e90 tx=0x7fb8e4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6413f24522bf05d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8e3fff700 1 -- 172.21.15.37:0/4055812943 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400e070 con 0x7fb8ec0c6e20 2023-10-06T04:39:35.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8e3fff700 1 -- 172.21.15.37:0/4055812943 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400bb80 con 0x7fb8ec0c6e20 2023-10-06T04:39:35.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8e3fff700 1 -- 172.21.15.37:0/4055812943 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4012430 con 0x7fb8ec0c6e20 2023-10-06T04:39:35.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f37c5700 1 -- 172.21.15.37:0/4055812943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8ec0c6e20 msgr2=0x7fb8ec0ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f37c5700 1 --2- 172.21.15.37:0/4055812943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8ec0c6e20 0x7fb8ec0ace60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009e90 tx=0x7fb8e4009780 comp rx=0 tx=0).stop 2023-10-06T04:39:35.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f37c5700 1 -- 172.21.15.37:0/4055812943 shutdown_connections 2023-10-06T04:39:35.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f37c5700 1 --2- 172.21.15.37:0/4055812943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8ec0c6e20 0x7fb8ec0ace60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f37c5700 1 -- 172.21.15.37:0/4055812943 >> 172.21.15.37:0/4055812943 conn(0x7fb8ec067cf0 msgr2=0x7fb8ec0680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:35.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f37c5700 1 -- 172.21.15.37:0/4055812943 shutdown_connections 2023-10-06T04:39:35.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.097+0000 7fb8f37c5700 1 -- 172.21.15.37:0/4055812943 wait complete. 2023-10-06T04:39:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f37c5700 1 Processor -- start 2023-10-06T04:39:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f37c5700 1 -- start start 2023-10-06T04:39:35.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f37c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ec0ae5e0 0x7fb8ec0c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f37c5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec0c6e20 0x7fb8ec14a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f37c5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8ec0c9140 0x7fb8ec0b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f37c5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0bfa40 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f37c5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0bfd00 con 0x7fb8ec0c6e20 2023-10-06T04:39:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f37c5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0bffe0 con 0x7fb8ec0c9140 2023-10-06T04:39:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f1561700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ec0ae5e0 0x7fb8ec0c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f1561700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ec0ae5e0 0x7fb8ec0c1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36934/0 (socket says 172.21.15.37:36934) 2023-10-06T04:39:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f1561700 1 -- 172.21.15.37:0/2086410935 learned_addr learned my addr 172.21.15.37:0/2086410935 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f0d60700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec0c6e20 0x7fb8ec14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f1d62700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8ec0c9140 0x7fb8ec0b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f1561700 1 -- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8ec0c9140 msgr2=0x7fb8ec0b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f1561700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8ec0c9140 0x7fb8ec0b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f1561700 1 -- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec0c6e20 msgr2=0x7fb8ec14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f1561700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec0c6e20 0x7fb8ec14a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f1561700 1 -- 172.21.15.37:0/2086410935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4009a20 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f1561700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ec0ae5e0 0x7fb8ec0c1ca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800c790 tx=0x7fb8e8007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8e17fa700 1 -- 172.21.15.37:0/2086410935 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8005b30 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8e17fa700 1 -- 172.21.15.37:0/2086410935 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e8005cd0 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8e17fa700 1 -- 172.21.15.37:0/2086410935 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8007320 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f37c5700 1 -- 172.21.15.37:0/2086410935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec0c02c0 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.101+0000 7fb8f37c5700 1 -- 172.21.15.37:0/2086410935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ec0c21e0 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.105+0000 7fb8f37c5700 1 -- 172.21.15.37:0/2086410935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ec04be00 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.105+0000 7fb8e17fa700 1 -- 172.21.15.37:0/2086410935 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb8e8012400 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.105+0000 7fb8e17fa700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb8d0060550 0x7fb8d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.105+0000 7fb8e17fa700 1 -- 172.21.15.37:0/2086410935 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb8e807bf10 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.105+0000 7fb8f0d60700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb8d0060550 0x7fb8d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.105+0000 7fb8f0d60700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb8d0060550 0x7fb8d0062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0abd00 tx=0x7fb8dc007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.113+0000 7fb8e17fa700 1 -- 172.21.15.37:0/2086410935 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb8e8049be0 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.301+0000 7fb8f37c5700 1 -- 172.21.15.37:0/2086410935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb8ec159610 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.301+0000 7fb8e17fa700 1 -- 172.21.15.37:0/2086410935 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb8e8017040 con 0x7fb8ec0ae5e0 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T04:39:35.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.301+0000 7fb8f37c5700 1 -- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb8d0060550 msgr2=0x7fb8d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.301+0000 7fb8f37c5700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb8d0060550 0x7fb8d0062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0abd00 tx=0x7fb8dc007d50 comp rx=0 tx=0).stop 2023-10-06T04:39:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.301+0000 7fb8f37c5700 1 -- 172.21.15.37:0/2086410935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ec0ae5e0 msgr2=0x7fb8ec0c1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.301+0000 7fb8f37c5700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ec0ae5e0 0x7fb8ec0c1ca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800c790 tx=0x7fb8e8007e80 comp rx=0 tx=0).stop 2023-10-06T04:39:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.305+0000 7fb8f37c5700 1 -- 172.21.15.37:0/2086410935 shutdown_connections 2023-10-06T04:39:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.305+0000 7fb8f37c5700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb8d0060550 0x7fb8d0062a00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.305+0000 7fb8f37c5700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec0c6e20 0x7fb8ec14a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.305+0000 7fb8f37c5700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8ec0c9140 0x7fb8ec0b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.305+0000 7fb8f37c5700 1 --2- 172.21.15.37:0/2086410935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ec0ae5e0 0x7fb8ec0c1ca0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.305+0000 7fb8f37c5700 1 -- 172.21.15.37:0/2086410935 >> 172.21.15.37:0/2086410935 conn(0x7fb8ec067cf0 msgr2=0x7fb8ec155760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.305+0000 7fb8f37c5700 1 -- 172.21.15.37:0/2086410935 shutdown_connections 2023-10-06T04:39:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.305+0000 7fb8f37c5700 1 -- 172.21.15.37:0/2086410935 wait complete. 2023-10-06T04:39:35.319 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T04:39:35.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:35.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 Processor -- start 2023-10-06T04:39:35.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 -- start start 2023-10-06T04:39:35.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9bc155130 0x7fb9bc158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9bc159360 0x7fb9bc0afe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9bc159780 con 0x7fb9bc155500 2023-10-06T04:39:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9bc0cbbf0 con 0x7fb9bc155130 2023-10-06T04:39:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc0b0910 con 0x7fb9bc159360 2023-10-06T04:39:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9baffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9bc155130 0x7fb9bc158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9ba7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb9bc155500 0x7fb9bc0c9a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36720/0 (socket says 172.21.15.37:36720) 2023-10-06T04:39:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9ba7fc700 1 -- 172.21.15.37:0/3009632916 learned_addr learned my addr 172.21.15.37:0/3009632916 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bb7fe700 1 --2- 172.21.15.37:0/3009632916 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9bc159360 0x7fb9bc0afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9b9ffb700 1 -- 172.21.15.37:0/3009632916 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813045382 0 0) 0x7fb9bc159780 con 0x7fb9bc155500 2023-10-06T04:39:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9b9ffb700 1 -- 172.21.15.37:0/3009632916 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a4003570 con 0x7fb9bc155500 2023-10-06T04:39:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9baffd700 1 -- 172.21.15.37:0/3009632916 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9bc159360 msgr2=0x7fb9bc0afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9baffd700 1 --2- 172.21.15.37:0/3009632916 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9bc159360 0x7fb9bc0afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9baffd700 1 -- 172.21.15.37:0/3009632916 >> v1:172.21.15.37:6789/0 conn(0x7fb9bc155500 legacy=0x7fb9bc0c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9baffd700 1 -- 172.21.15.37:0/3009632916 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc0c8c70 con 0x7fb9bc155130 2023-10-06T04:39:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9baffd700 1 --2- 172.21.15.37:0/3009632916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc155130 0x7fb9bc158e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0098e0 tx=0x7fb9ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971179f49c77c4ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9b9ffb700 1 -- 172.21.15.37:0/3009632916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac011630 con 0x7fb9bc155130 2023-10-06T04:39:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9b9ffb700 1 -- 172.21.15.37:0/3009632916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac011790 con 0x7fb9bc155130 2023-10-06T04:39:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9b9ffb700 1 -- 172.21.15.37:0/3009632916 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac011b10 con 0x7fb9bc155130 2023-10-06T04:39:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 -- 172.21.15.37:0/3009632916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc155130 msgr2=0x7fb9bc158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 --2- 172.21.15.37:0/3009632916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc155130 0x7fb9bc158e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0098e0 tx=0x7fb9ac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 -- 172.21.15.37:0/3009632916 shutdown_connections 2023-10-06T04:39:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 --2- 172.21.15.37:0/3009632916 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9bc159360 0x7fb9bc0afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 --2- 172.21.15.37:0/3009632916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc155130 0x7fb9bc158e20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 -- 172.21.15.37:0/3009632916 >> 172.21.15.37:0/3009632916 conn(0x7fb9bc0ccb50 msgr2=0x7fb9bc06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 -- 172.21.15.37:0/3009632916 shutdown_connections 2023-10-06T04:39:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.417+0000 7fb9bbfff700 1 -- 172.21.15.37:0/3009632916 wait complete. 2023-10-06T04:39:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9bbfff700 1 Processor -- start 2023-10-06T04:39:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9bbfff700 1 -- start start 2023-10-06T04:39:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9bbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc155130 0x7fb9bc0aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9bbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9bc155500 0x7fb9bc1677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9bbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9bc159360 0x7fb9bc154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9bbfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc0990c0 con 0x7fb9bc155130 2023-10-06T04:39:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9bbfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc167ce0 con 0x7fb9bc155500 2023-10-06T04:39:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9bbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc154790 con 0x7fb9bc159360 2023-10-06T04:39:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9baffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc155130 0x7fb9bc0aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9baffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc155130 0x7fb9bc0aa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36954/0 (socket says 172.21.15.37:36954) 2023-10-06T04:39:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9baffd700 1 -- 172.21.15.37:0/1871100000 learned_addr learned my addr 172.21.15.37:0/1871100000 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9ba7fc700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9bc155500 0x7fb9bc1677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9bb7fe700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9bc159360 0x7fb9bc154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9baffd700 1 -- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9bc159360 msgr2=0x7fb9bc154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9baffd700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9bc159360 0x7fb9bc154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9baffd700 1 -- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9bc155500 msgr2=0x7fb9bc1677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9baffd700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9bc155500 0x7fb9bc1677a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9baffd700 1 -- 172.21.15.37:0/1871100000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac009420 con 0x7fb9bc155130 2023-10-06T04:39:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9bb7fe700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9bc159360 0x7fb9bc154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9baffd700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc155130 0x7fb9bc0aa860 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009ed0 tx=0x7fb9ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9a2ffd700 1 -- 172.21.15.37:0/1871100000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac011900 con 0x7fb9bc155130 2023-10-06T04:39:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9bbfff700 1 -- 172.21.15.37:0/1871100000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9bc0988b0 con 0x7fb9bc155130 2023-10-06T04:39:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9a2ffd700 1 -- 172.21.15.37:0/1871100000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac011aa0 con 0x7fb9bc155130 2023-10-06T04:39:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9a2ffd700 1 -- 172.21.15.37:0/1871100000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac01a680 con 0x7fb9bc155130 2023-10-06T04:39:35.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.421+0000 7fb9bbfff700 1 -- 172.21.15.37:0/1871100000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9bc098b00 con 0x7fb9bc155130 2023-10-06T04:39:35.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.425+0000 7fb9bbfff700 1 -- 172.21.15.37:0/1871100000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9bc099d30 con 0x7fb9bc155130 2023-10-06T04:39:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.425+0000 7fb9a2ffd700 1 -- 172.21.15.37:0/1871100000 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb9ac01aab0 con 0x7fb9bc155130 2023-10-06T04:39:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.425+0000 7fb9a2ffd700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb9a8060550 0x7fb9a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.425+0000 7fb9a2ffd700 1 -- 172.21.15.37:0/1871100000 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb9ac07e880 con 0x7fb9bc155130 2023-10-06T04:39:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.425+0000 7fb9ba7fc700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb9a8060550 0x7fb9a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.425+0000 7fb9ba7fc700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb9a8060550 0x7fb9a8062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc1648d0 tx=0x7fb9b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.433+0000 7fb9a2ffd700 1 -- 172.21.15.37:0/1871100000 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb9bc099d30 con 0x7fb9bc155130 2023-10-06T04:39:35.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.589+0000 7fb9bbfff700 1 -- 172.21.15.37:0/1871100000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9bc099d30 con 0x7fb9bc155130 2023-10-06T04:39:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9a2ffd700 1 -- 172.21.15.37:0/1871100000 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fb9bc099d30 con 0x7fb9bc155130 2023-10-06T04:39:35.597 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:35.597 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:15.209829+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:35.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9bbfff700 1 -- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb9a8060550 msgr2=0x7fb9a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9bbfff700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb9a8060550 0x7fb9a8062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc1648d0 tx=0x7fb9b0009040 comp rx=0 tx=0).stop 2023-10-06T04:39:35.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9bbfff700 1 -- 172.21.15.37:0/1871100000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc155130 msgr2=0x7fb9bc0aa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9bbfff700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc155130 0x7fb9bc0aa860 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009ed0 tx=0x7fb9ac017000 comp rx=0 tx=0).stop 2023-10-06T04:39:35.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9bbfff700 1 -- 172.21.15.37:0/1871100000 shutdown_connections 2023-10-06T04:39:35.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9bbfff700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb9a8060550 0x7fb9a8062a00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9bbfff700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9bc155500 0x7fb9bc1677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9bbfff700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9bc159360 0x7fb9bc154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9bbfff700 1 --2- 172.21.15.37:0/1871100000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc155130 0x7fb9bc0aa860 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9bbfff700 1 -- 172.21.15.37:0/1871100000 >> 172.21.15.37:0/1871100000 conn(0x7fb9bc0ccb50 msgr2=0x7fb9bc0c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:35.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9bbfff700 1 -- 172.21.15.37:0/1871100000 shutdown_connections 2023-10-06T04:39:35.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.593+0000 7fb9bbfff700 1 -- 172.21.15.37:0/1871100000 wait complete. 2023-10-06T04:39:35.610 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:08.512565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:09.104711+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:39:12.860905+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:35.611 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20e00e700 1 Processor -- start 2023-10-06T04:39:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20e00e700 1 -- start start 2023-10-06T04:39:35.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20e00e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe2080ce1a0 0x7fe2080af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20e00e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2080cf240 con 0x7fe2080aece0 2023-10-06T04:39:35.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20e00e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2080ce630 con 0x7fe2080cf6d0 2023-10-06T04:39:35.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20e00e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2081594a0 con 0x7fe2080ce1a0 2023-10-06T04:39:35.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20d00c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe2080aece0 0x7fe2080cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36736/0 (socket says 172.21.15.37:36736) 2023-10-06T04:39:35.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20d00c700 1 -- 172.21.15.37:0/3411509769 learned_addr learned my addr 172.21.15.37:0/3411509769 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:35.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20c80b700 1 --2- 172.21.15.37:0/3411509769 >> v2:172.21.15.83:3300/0 conn(0x7fe2080ce1a0 0x7fe2080af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe1fffff700 1 -- 172.21.15.37:0/3411509769 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556521581 0 0) 0x7fe2080cf240 con 0x7fe2080aece0 2023-10-06T04:39:35.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe1fffff700 1 -- 172.21.15.37:0/3411509769 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1f4003570 con 0x7fe2080aece0 2023-10-06T04:39:35.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe1fffff700 1 -- 172.21.15.37:0/3411509769 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3084909140 0 0) 0x7fe1f4003570 con 0x7fe2080aece0 2023-10-06T04:39:35.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20c80b700 1 -- 172.21.15.37:0/3411509769 >> v1:172.21.15.83:6789/0 conn(0x7fe2080cf6d0 legacy=0x7fe2080cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20c80b700 1 -- 172.21.15.37:0/3411509769 >> v1:172.21.15.37:6789/0 conn(0x7fe2080aece0 legacy=0x7fe2080cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20c80b700 1 -- 172.21.15.37:0/3411509769 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2080ce910 con 0x7fe2080ce1a0 2023-10-06T04:39:35.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe20c80b700 1 --2- 172.21.15.37:0/3411509769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2080ce1a0 0x7fe2080af0b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe2040098e0 tx=0x7fe2040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb2ef5cd235f09b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe1fffff700 1 -- 172.21.15.37:0/3411509769 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8001470 con 0x7fe2080ce1a0 2023-10-06T04:39:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe1fffff700 1 -- 172.21.15.37:0/3411509769 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe204011420 con 0x7fe2080ce1a0 2023-10-06T04:39:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.717+0000 7fe1fffff700 1 -- 172.21.15.37:0/3411509769 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2040117c0 con 0x7fe2080ce1a0 2023-10-06T04:39:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.721+0000 7fe20e00e700 1 -- 172.21.15.37:0/3411509769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2080ce1a0 msgr2=0x7fe2080af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.721+0000 7fe20e00e700 1 --2- 172.21.15.37:0/3411509769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2080ce1a0 0x7fe2080af0b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe2040098e0 tx=0x7fe2040091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.721+0000 7fe20e00e700 1 -- 172.21.15.37:0/3411509769 shutdown_connections 2023-10-06T04:39:35.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.721+0000 7fe20e00e700 1 --2- 172.21.15.37:0/3411509769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2080ce1a0 0x7fe2080af0b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.721+0000 7fe20e00e700 1 -- 172.21.15.37:0/3411509769 >> 172.21.15.37:0/3411509769 conn(0x7fe208069d90 msgr2=0x7fe208067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:35.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.721+0000 7fe20e00e700 1 -- 172.21.15.37:0/3411509769 shutdown_connections 2023-10-06T04:39:35.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.721+0000 7fe20e00e700 1 -- 172.21.15.37:0/3411509769 wait complete. 2023-10-06T04:39:35.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.721+0000 7fe20e00e700 1 Processor -- start 2023-10-06T04:39:35.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.721+0000 7fe20e00e700 1 -- start start 2023-10-06T04:39:35.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20e00e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2080aece0 0x7fe20814d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20e00e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2080ce1a0 0x7fe2080b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20e00e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2080cf6d0 0x7fe2080b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20e00e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080b4b40 con 0x7fe2080cf6d0 2023-10-06T04:39:35.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20e00e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080b4e20 con 0x7fe2080aece0 2023-10-06T04:39:35.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20e00e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080b5100 con 0x7fe2080ce1a0 2023-10-06T04:39:35.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20d80d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2080cf6d0 0x7fe2080b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20c80b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2080ce1a0 0x7fe2080b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20d00c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2080aece0 0x7fe20814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20d80d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2080cf6d0 0x7fe2080b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36968/0 (socket says 172.21.15.37:36968) 2023-10-06T04:39:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20c80b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2080ce1a0 0x7fe2080b2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40810/0 (socket says 172.21.15.37:40810) 2023-10-06T04:39:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20d80d700 1 -- 172.21.15.37:0/3432267004 learned_addr learned my addr 172.21.15.37:0/3432267004 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:35.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20d80d700 1 -- 172.21.15.37:0/3432267004 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2080ce1a0 msgr2=0x7fe2080b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20d80d700 1 --2- 172.21.15.37:0/3432267004 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2080ce1a0 0x7fe2080b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20d80d700 1 -- 172.21.15.37:0/3432267004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2080aece0 msgr2=0x7fe20814d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20d80d700 1 --2- 172.21.15.37:0/3432267004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2080aece0 0x7fe20814d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20d80d700 1 -- 172.21.15.37:0/3432267004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe204009420 con 0x7fe2080cf6d0 2023-10-06T04:39:35.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20d80d700 1 --2- 172.21.15.37:0/3432267004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2080cf6d0 0x7fe2080b3160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe20000c8e0 tx=0x7fe2000016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe1fd7fa700 1 -- 172.21.15.37:0/3432267004 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200012630 con 0x7fe2080cf6d0 2023-10-06T04:39:35.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe1fd7fa700 1 -- 172.21.15.37:0/3432267004 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe200012790 con 0x7fe2080cf6d0 2023-10-06T04:39:35.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20e00e700 1 -- 172.21.15.37:0/3432267004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2080b53e0 con 0x7fe2080cf6d0 2023-10-06T04:39:35.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe1fd7fa700 1 -- 172.21.15.37:0/3432267004 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200012b50 con 0x7fe2080cf6d0 2023-10-06T04:39:35.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.725+0000 7fe20e00e700 1 -- 172.21.15.37:0/3432267004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20814db70 con 0x7fe2080cf6d0 2023-10-06T04:39:35.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.729+0000 7fe20e00e700 1 -- 172.21.15.37:0/3432267004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2081595e0 con 0x7fe2080cf6d0 2023-10-06T04:39:35.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.729+0000 7fe1fd7fa700 1 -- 172.21.15.37:0/3432267004 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe200011380 con 0x7fe2080cf6d0 2023-10-06T04:39:35.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.729+0000 7fe1fd7fa700 1 --2- 172.21.15.37:0/3432267004 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe1ec060550 0x7fe1ec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.729+0000 7fe1fd7fa700 1 -- 172.21.15.37:0/3432267004 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe20007cfb0 con 0x7fe2080cf6d0 2023-10-06T04:39:35.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.729+0000 7fe20d00c700 1 --2- 172.21.15.37:0/3432267004 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe1ec060550 0x7fe1ec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.729+0000 7fe20d00c700 1 --2- 172.21.15.37:0/3432267004 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe1ec060550 0x7fe1ec062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80011e0 tx=0x7fe1f8000bc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.733+0000 7fe1fd7fa700 1 -- 172.21.15.37:0/3432267004 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe20004d0b0 con 0x7fe2080cf6d0 2023-10-06T04:39:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 -- 172.21.15.37:0/3432267004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2080708a0 con 0x7fe2080cf6d0 2023-10-06T04:39:35.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe1fd7fa700 1 -- 172.21.15.37:0/3432267004 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2000506d0 con 0x7fe2080cf6d0 2023-10-06T04:39:35.894 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:39:35.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 -- 172.21.15.37:0/3432267004 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe1ec060550 msgr2=0x7fe1ec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 --2- 172.21.15.37:0/3432267004 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe1ec060550 0x7fe1ec062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80011e0 tx=0x7fe1f8000bc0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 -- 172.21.15.37:0/3432267004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2080cf6d0 msgr2=0x7fe2080b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 --2- 172.21.15.37:0/3432267004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2080cf6d0 0x7fe2080b3160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe20000c8e0 tx=0x7fe2000016c0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 -- 172.21.15.37:0/3432267004 shutdown_connections 2023-10-06T04:39:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 --2- 172.21.15.37:0/3432267004 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe1ec060550 0x7fe1ec062a00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 --2- 172.21.15.37:0/3432267004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2080cf6d0 0x7fe2080b3160 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 --2- 172.21.15.37:0/3432267004 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2080ce1a0 0x7fe2080b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 --2- 172.21.15.37:0/3432267004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2080aece0 0x7fe20814d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 -- 172.21.15.37:0/3432267004 >> 172.21.15.37:0/3432267004 conn(0x7fe208069d90 msgr2=0x7fe208067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 -- 172.21.15.37:0/3432267004 shutdown_connections 2023-10-06T04:39:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:35.889+0000 7fe20e00e700 1 -- 172.21.15.37:0/3432267004 wait complete. 2023-10-06T04:39:35.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:36.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.017+0000 7fda76452700 1 Processor -- start 2023-10-06T04:39:36.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.017+0000 7fda76452700 1 -- start start 2023-10-06T04:39:36.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda76452700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda7006e190 0x7fda7006e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda76452700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda7006f140 0x7fda7015b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda76452700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7015ae50 con 0x7fda700c2c60 2023-10-06T04:39:36.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda76452700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda700ad370 con 0x7fda7006e190 2023-10-06T04:39:36.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda76452700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7015b820 con 0x7fda7006f140 2023-10-06T04:39:36.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda75450700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda7006e190 0x7fda7006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda75450700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda7006e190 0x7fda7006e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36980/0 (socket says 172.21.15.37:36980) 2023-10-06T04:39:36.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda75450700 1 -- 172.21.15.37:0/3538723265 learned_addr learned my addr 172.21.15.37:0/3538723265 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:36.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda74c4f700 1 --2- 172.21.15.37:0/3538723265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda7006f140 0x7fda7015b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda75450700 1 -- 172.21.15.37:0/3538723265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda7006f140 msgr2=0x7fda7015b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda75450700 1 --2- 172.21.15.37:0/3538723265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda7006f140 0x7fda7015b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda75450700 1 -- 172.21.15.37:0/3538723265 >> v1:172.21.15.83:6789/0 conn(0x7fda700c2c60 legacy=0x7fda70159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda75450700 1 -- 172.21.15.37:0/3538723265 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda70068760 con 0x7fda7006e190 2023-10-06T04:39:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda67fff700 1 -- 172.21.15.37:0/3538723265 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101840334 0 0) 0x7fda7015ae50 con 0x7fda700c2c60 2023-10-06T04:39:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda75450700 1 --2- 172.21.15.37:0/3538723265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7006e190 0x7fda7006e560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0099b0 tx=0x7fda6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364e9aa66bdca2a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda67fff700 1 -- 172.21.15.37:0/3538723265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c009ea0 con 0x7fda7006e190 2023-10-06T04:39:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda67fff700 1 -- 172.21.15.37:0/3538723265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c00b860 con 0x7fda7006e190 2023-10-06T04:39:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.021+0000 7fda67fff700 1 -- 172.21.15.37:0/3538723265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c00bc00 con 0x7fda7006e190 2023-10-06T04:39:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.025+0000 7fda76452700 1 -- 172.21.15.37:0/3538723265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7006e190 msgr2=0x7fda7006e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.025+0000 7fda76452700 1 --2- 172.21.15.37:0/3538723265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7006e190 0x7fda7006e560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0099b0 tx=0x7fda6c009250 comp rx=0 tx=0).stop 2023-10-06T04:39:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.025+0000 7fda76452700 1 -- 172.21.15.37:0/3538723265 shutdown_connections 2023-10-06T04:39:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.025+0000 7fda76452700 1 --2- 172.21.15.37:0/3538723265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda7006f140 0x7fda7015b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.025+0000 7fda76452700 1 --2- 172.21.15.37:0/3538723265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7006e190 0x7fda7006e560 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.025+0000 7fda76452700 1 -- 172.21.15.37:0/3538723265 >> 172.21.15.37:0/3538723265 conn(0x7fda700c9570 msgr2=0x7fda70067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.025+0000 7fda76452700 1 -- 172.21.15.37:0/3538723265 shutdown_connections 2023-10-06T04:39:36.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.025+0000 7fda76452700 1 -- 172.21.15.37:0/3538723265 wait complete. 2023-10-06T04:39:36.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.025+0000 7fda76452700 1 Processor -- start 2023-10-06T04:39:36.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.025+0000 7fda76452700 1 -- start start 2023-10-06T04:39:36.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda76452700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda7006e190 0x7fda700ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda76452700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7006f140 0x7fda700c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda76452700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda700c2c60 0x7fda70171180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda76452700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda700b08a0 con 0x7fda7006f140 2023-10-06T04:39:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda76452700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda700acee0 con 0x7fda700c2c60 2023-10-06T04:39:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda76452700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda700b0ad0 con 0x7fda7006e190 2023-10-06T04:39:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda74c4f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7006f140 0x7fda700c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda74c4f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7006f140 0x7fda700c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36990/0 (socket says 172.21.15.37:36990) 2023-10-06T04:39:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda74c4f700 1 -- 172.21.15.37:0/3741176542 learned_addr learned my addr 172.21.15.37:0/3741176542 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda75450700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda7006e190 0x7fda700ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda75c51700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda700c2c60 0x7fda70171180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda74c4f700 1 -- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda7006e190 msgr2=0x7fda700ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda74c4f700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda7006e190 0x7fda700ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda74c4f700 1 -- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda700c2c60 msgr2=0x7fda70171180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda74c4f700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda700c2c60 0x7fda70171180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda74c4f700 1 -- 172.21.15.37:0/3741176542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c0094f0 con 0x7fda7006f140 2023-10-06T04:39:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda75c51700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda700c2c60 0x7fda70171180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda75450700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda7006e190 0x7fda700ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda74c4f700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7006f140 0x7fda700c3f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fda6000ec50 tx=0x7fda600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda657fa700 1 -- 172.21.15.37:0/3741176542 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6000c9d0 con 0x7fda7006f140 2023-10-06T04:39:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda657fa700 1 -- 172.21.15.37:0/3741176542 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6000cb30 con 0x7fda7006f140 2023-10-06T04:39:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda76452700 1 -- 172.21.15.37:0/3741176542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda700b0db0 con 0x7fda7006f140 2023-10-06T04:39:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda657fa700 1 -- 172.21.15.37:0/3741176542 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60013470 con 0x7fda7006f140 2023-10-06T04:39:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.029+0000 7fda76452700 1 -- 172.21.15.37:0/3741176542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda700b1370 con 0x7fda7006f140 2023-10-06T04:39:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.033+0000 7fda76452700 1 -- 172.21.15.37:0/3741176542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda700708a0 con 0x7fda7006f140 2023-10-06T04:39:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.033+0000 7fda657fa700 1 -- 172.21.15.37:0/3741176542 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fda600138a0 con 0x7fda7006f140 2023-10-06T04:39:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.033+0000 7fda657fa700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fda54060550 0x7fda54062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.033+0000 7fda657fa700 1 -- 172.21.15.37:0/3741176542 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fda6007cfe0 con 0x7fda7006f140 2023-10-06T04:39:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.033+0000 7fda75450700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fda54060550 0x7fda54062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.033+0000 7fda75450700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fda54060550 0x7fda54062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0099b0 tx=0x7fda6c017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.045+0000 7fda657fa700 1 -- 172.21.15.37:0/3741176542 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fda6004d120 con 0x7fda7006f140 2023-10-06T04:39:36.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.205+0000 7fda76452700 1 -- 172.21.15.37:0/3741176542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda70068a40 con 0x7fda7006f140 2023-10-06T04:39:36.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.205+0000 7fda657fa700 1 -- 172.21.15.37:0/3741176542 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda60050740 con 0x7fda7006f140 2023-10-06T04:39:36.210 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:39:36.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.209+0000 7fda76452700 1 -- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fda54060550 msgr2=0x7fda54062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.209+0000 7fda76452700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fda54060550 0x7fda54062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0099b0 tx=0x7fda6c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:36.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.209+0000 7fda76452700 1 -- 172.21.15.37:0/3741176542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7006f140 msgr2=0x7fda700c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.209+0000 7fda76452700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7006f140 0x7fda700c3f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fda6000ec50 tx=0x7fda600091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.209+0000 7fda76452700 1 -- 172.21.15.37:0/3741176542 shutdown_connections 2023-10-06T04:39:36.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.209+0000 7fda76452700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fda54060550 0x7fda54062a00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.209+0000 7fda76452700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda700c2c60 0x7fda70171180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.209+0000 7fda76452700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7006f140 0x7fda700c3f20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.209+0000 7fda76452700 1 --2- 172.21.15.37:0/3741176542 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda7006e190 0x7fda700ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.209+0000 7fda76452700 1 -- 172.21.15.37:0/3741176542 >> 172.21.15.37:0/3741176542 conn(0x7fda700c9570 msgr2=0x7fda70158140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.209+0000 7fda76452700 1 -- 172.21.15.37:0/3741176542 shutdown_connections 2023-10-06T04:39:36.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.209+0000 7fda76452700 1 -- 172.21.15.37:0/3741176542 wait complete. 2023-10-06T04:39:36.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:36.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb76015d700 1 Processor -- start 2023-10-06T04:39:36.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb76015d700 1 -- start start 2023-10-06T04:39:36.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb76015d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb75806e730 0x7fb7581591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb76015d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7580c8150 con 0x7fb758158dd0 2023-10-06T04:39:36.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb76015d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7580c7540 con 0x7fb75806ed90 2023-10-06T04:39:36.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb76015d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7580c85e0 con 0x7fb75806e730 2023-10-06T04:39:36.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb75def9700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb758158dd0 0x7fb7580c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36744/0 (socket says 172.21.15.37:36744) 2023-10-06T04:39:36.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb75def9700 1 -- 172.21.15.37:0/2209666810 learned_addr learned my addr 172.21.15.37:0/2209666810 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:36.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb75e6fa700 1 --2- 172.21.15.37:0/2209666810 >> v2:172.21.15.37:3300/0 conn(0x7fb75806e730 0x7fb7581591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb75cef7700 1 -- 172.21.15.37:0/2209666810 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652287704 0 0) 0x7fb7580c8150 con 0x7fb758158dd0 2023-10-06T04:39:36.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb75cef7700 1 -- 172.21.15.37:0/2209666810 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb744003570 con 0x7fb758158dd0 2023-10-06T04:39:36.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb75e6fa700 1 -- 172.21.15.37:0/2209666810 >> v1:172.21.15.83:6789/0 conn(0x7fb75806ed90 legacy=0x7fb75806e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb75e6fa700 1 -- 172.21.15.37:0/2209666810 >> v1:172.21.15.37:6789/0 conn(0x7fb758158dd0 legacy=0x7fb7580c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb75e6fa700 1 -- 172.21.15.37:0/2209666810 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7580c7820 con 0x7fb75806e730 2023-10-06T04:39:36.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb75e6fa700 1 --2- 172.21.15.37:0/2209666810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75806e730 0x7fb7581591a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb750009e60 tx=0x7fb750009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c15d71c6b657ada server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb75cef7700 1 -- 172.21.15.37:0/2209666810 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75000e070 con 0x7fb75806e730 2023-10-06T04:39:36.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb75cef7700 1 -- 172.21.15.37:0/2209666810 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75000bb60 con 0x7fb75806e730 2023-10-06T04:39:36.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.337+0000 7fb75cef7700 1 -- 172.21.15.37:0/2209666810 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750012430 con 0x7fb75806e730 2023-10-06T04:39:36.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 -- 172.21.15.37:0/2209666810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75806e730 msgr2=0x7fb7581591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 --2- 172.21.15.37:0/2209666810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75806e730 0x7fb7581591a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb750009e60 tx=0x7fb750009780 comp rx=0 tx=0).stop 2023-10-06T04:39:36.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 -- 172.21.15.37:0/2209666810 shutdown_connections 2023-10-06T04:39:36.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 --2- 172.21.15.37:0/2209666810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75806e730 0x7fb7581591a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 -- 172.21.15.37:0/2209666810 >> 172.21.15.37:0/2209666810 conn(0x7fb7580cc180 msgr2=0x7fb7580cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 -- 172.21.15.37:0/2209666810 shutdown_connections 2023-10-06T04:39:36.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 -- 172.21.15.37:0/2209666810 wait complete. 2023-10-06T04:39:36.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 Processor -- start 2023-10-06T04:39:36.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 -- start start 2023-10-06T04:39:36.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75806e730 0x7fb758143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb75806ed90 0x7fb75815af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb758158dd0 0x7fb758159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758154bb0 con 0x7fb75806e730 2023-10-06T04:39:36.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758159770 con 0x7fb758158dd0 2023-10-06T04:39:36.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb758144350 con 0x7fb75806ed90 2023-10-06T04:39:36.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb75def9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75806e730 0x7fb758143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb75def9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75806e730 0x7fb758143e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37008/0 (socket says 172.21.15.37:37008) 2023-10-06T04:39:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb75def9700 1 -- 172.21.15.37:0/1292919858 learned_addr learned my addr 172.21.15.37:0/1292919858 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb75e6fa700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb758158dd0 0x7fb758159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb75d6f8700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb75806ed90 0x7fb75815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb75def9700 1 -- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb75806ed90 msgr2=0x7fb75815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb75def9700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb75806ed90 0x7fb75815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb75def9700 1 -- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb758158dd0 msgr2=0x7fb758159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb75def9700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb758158dd0 0x7fb758159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb75def9700 1 -- 172.21.15.37:0/1292919858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb750009a20 con 0x7fb75806e730 2023-10-06T04:39:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb75def9700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75806e730 0x7fb758143e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb75400c590 tx=0x7fb754007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb74dffb700 1 -- 172.21.15.37:0/1292919858 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754005b30 con 0x7fb75806e730 2023-10-06T04:39:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb74dffb700 1 -- 172.21.15.37:0/1292919858 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb754005cb0 con 0x7fb75806e730 2023-10-06T04:39:36.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 -- 172.21.15.37:0/1292919858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7580b0300 con 0x7fb75806e730 2023-10-06T04:39:36.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb74dffb700 1 -- 172.21.15.37:0/1292919858 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754007320 con 0x7fb75806e730 2023-10-06T04:39:36.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.341+0000 7fb76015d700 1 -- 172.21.15.37:0/1292919858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7580b08c0 con 0x7fb75806e730 2023-10-06T04:39:36.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.345+0000 7fb74dffb700 1 -- 172.21.15.37:0/1292919858 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb75401b3b0 con 0x7fb75806e730 2023-10-06T04:39:36.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.345+0000 7fb74dffb700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb73c060550 0x7fb73c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.345+0000 7fb76015d700 1 -- 172.21.15.37:0/1292919858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7580b0ae0 con 0x7fb75806e730 2023-10-06T04:39:36.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.345+0000 7fb74dffb700 1 -- 172.21.15.37:0/1292919858 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb75407c100 con 0x7fb75806e730 2023-10-06T04:39:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.345+0000 7fb75d6f8700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb73c060550 0x7fb73c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.345+0000 7fb75d6f8700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb73c060550 0x7fb73c062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb75806ab30 tx=0x7fb748007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.353+0000 7fb74dffb700 1 -- 172.21.15.37:0/1292919858 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb754017080 con 0x7fb75806e730 2023-10-06T04:39:36.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.513+0000 7fb76015d700 1 -- 172.21.15.37:0/1292919858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb758070ee0 con 0x7fb75806e730 2023-10-06T04:39:36.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.513+0000 7fb74dffb700 1 -- 172.21.15.37:0/1292919858 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb75404c200 con 0x7fb75806e730 2023-10-06T04:39:36.518 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:39:36.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.517+0000 7fb76015d700 1 -- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb73c060550 msgr2=0x7fb73c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.517+0000 7fb76015d700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb73c060550 0x7fb73c062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb75806ab30 tx=0x7fb748007ec0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.517+0000 7fb76015d700 1 -- 172.21.15.37:0/1292919858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75806e730 msgr2=0x7fb758143e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.517+0000 7fb76015d700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75806e730 0x7fb758143e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb75400c590 tx=0x7fb754007e00 comp rx=0 tx=0).stop 2023-10-06T04:39:36.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.517+0000 7fb76015d700 1 -- 172.21.15.37:0/1292919858 shutdown_connections 2023-10-06T04:39:36.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.517+0000 7fb76015d700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb73c060550 0x7fb73c062a00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.517+0000 7fb76015d700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb758158dd0 0x7fb758159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.517+0000 7fb76015d700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb75806ed90 0x7fb75815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.517+0000 7fb76015d700 1 --2- 172.21.15.37:0/1292919858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75806e730 0x7fb758143e10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.517+0000 7fb76015d700 1 -- 172.21.15.37:0/1292919858 >> 172.21.15.37:0/1292919858 conn(0x7fb7580cc180 msgr2=0x7fb75806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.517+0000 7fb76015d700 1 -- 172.21.15.37:0/1292919858 shutdown_connections 2023-10-06T04:39:36.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.517+0000 7fb76015d700 1 -- 172.21.15.37:0/1292919858 wait complete. 2023-10-06T04:39:36.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:36.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.645+0000 7f964e771700 1 Processor -- start 2023-10-06T04:39:36.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.645+0000 7f964e771700 1 -- start start 2023-10-06T04:39:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f96481559d0 0x7f96480c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96480cc530 0x7f96480ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9648159f40 con 0x7f964815a3d0 2023-10-06T04:39:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96480c9270 con 0x7f96481559d0 2023-10-06T04:39:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96480c8f90 con 0x7f96480cc530 2023-10-06T04:39:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f963f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f964815a3d0 0x7f96480cbe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36750/0 (socket says 172.21.15.37:36750) 2023-10-06T04:39:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f963f7fe700 1 -- 172.21.15.37:0/822400676 learned_addr learned my addr 172.21.15.37:0/822400676 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964cd0e700 1 --2- 172.21.15.37:0/822400676 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96480cc530 0x7f96480ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f9647fff700 1 --2- 172.21.15.37:0/822400676 >> v2:172.21.15.83:3300/0 conn(0x7f96481559d0 0x7f96480c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f96477fe700 1 -- 172.21.15.37:0/822400676 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173745285 0 0) 0x7f9648159f40 con 0x7f964815a3d0 2023-10-06T04:39:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f96477fe700 1 -- 172.21.15.37:0/822400676 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9634003570 con 0x7f964815a3d0 2023-10-06T04:39:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964cd0e700 1 -- 172.21.15.37:0/822400676 >> v2:172.21.15.83:3300/0 conn(0x7f96481559d0 msgr2=0x7f96480c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964cd0e700 1 --2- 172.21.15.37:0/822400676 >> v2:172.21.15.83:3300/0 conn(0x7f96481559d0 0x7f96480c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964cd0e700 1 -- 172.21.15.37:0/822400676 >> v1:172.21.15.37:6789/0 conn(0x7f964815a3d0 legacy=0x7f96480cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964cd0e700 1 -- 172.21.15.37:0/822400676 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96481598f0 con 0x7f96480cc530 2023-10-06T04:39:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964cd0e700 1 --2- 172.21.15.37:0/822400676 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96480cc530 0x7f96480ca5e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f964000d0d0 tx=0x7f964000b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=142d5125059fba0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f96477fe700 1 -- 172.21.15.37:0/822400676 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640010070 con 0x7f96480cc530 2023-10-06T04:39:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f96477fe700 1 -- 172.21.15.37:0/822400676 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964000b2e0 con 0x7f96480cc530 2023-10-06T04:39:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f96477fe700 1 -- 172.21.15.37:0/822400676 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964000dcd0 con 0x7f96480cc530 2023-10-06T04:39:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 -- 172.21.15.37:0/822400676 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96480cc530 msgr2=0x7f96480ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 --2- 172.21.15.37:0/822400676 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96480cc530 0x7f96480ca5e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f964000d0d0 tx=0x7f964000b990 comp rx=0 tx=0).stop 2023-10-06T04:39:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 -- 172.21.15.37:0/822400676 shutdown_connections 2023-10-06T04:39:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 --2- 172.21.15.37:0/822400676 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96480cc530 0x7f96480ca5e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 --2- 172.21.15.37:0/822400676 >> v2:172.21.15.83:3300/0 conn(0x7f96481559d0 0x7f96480c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 -- 172.21.15.37:0/822400676 >> 172.21.15.37:0/822400676 conn(0x7f96480698d0 msgr2=0x7f96480cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 -- 172.21.15.37:0/822400676 shutdown_connections 2023-10-06T04:39:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.649+0000 7f964e771700 1 -- 172.21.15.37:0/822400676 wait complete. 2023-10-06T04:39:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964e771700 1 Processor -- start 2023-10-06T04:39:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964e771700 1 -- start start 2023-10-06T04:39:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964e771700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96480cc530 0x7f9648163e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964e771700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96481559d0 0x7f964806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964e771700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f964815a3d0 0x7f964806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964e771700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964814f5d0 con 0x7f964815a3d0 2023-10-06T04:39:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964e771700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9648156ad0 con 0x7f96480cc530 2023-10-06T04:39:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964e771700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964814f870 con 0x7f96481559d0 2023-10-06T04:39:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964cd0e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f964815a3d0 0x7f964806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f9647fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96480cc530 0x7f9648163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964cd0e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f964815a3d0 0x7f964806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37024/0 (socket says 172.21.15.37:37024) 2023-10-06T04:39:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964cd0e700 1 -- 172.21.15.37:0/2686893930 learned_addr learned my addr 172.21.15.37:0/2686893930 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f963f7fe700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96481559d0 0x7f964806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964cd0e700 1 -- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96481559d0 msgr2=0x7f964806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964cd0e700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96481559d0 0x7f964806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964cd0e700 1 -- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96480cc530 msgr2=0x7f9648163e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964cd0e700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96480cc530 0x7f9648163e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964cd0e700 1 -- 172.21.15.37:0/2686893930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964000bc30 con 0x7f964815a3d0 2023-10-06T04:39:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964cd0e700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f964815a3d0 0x7f964806c330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f964000d6c0 tx=0x7f964001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f9644ff9700 1 -- 172.21.15.37:0/2686893930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964000ab00 con 0x7f964815a3d0 2023-10-06T04:39:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f9644ff9700 1 -- 172.21.15.37:0/2686893930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964000ac60 con 0x7f964815a3d0 2023-10-06T04:39:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f9644ff9700 1 -- 172.21.15.37:0/2686893930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640028460 con 0x7f964815a3d0 2023-10-06T04:39:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964e771700 1 -- 172.21.15.37:0/2686893930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964814fb50 con 0x7f964815a3d0 2023-10-06T04:39:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.653+0000 7f964e771700 1 -- 172.21.15.37:0/2686893930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96481643a0 con 0x7f964815a3d0 2023-10-06T04:39:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.657+0000 7f964e771700 1 -- 172.21.15.37:0/2686893930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9648150050 con 0x7f964815a3d0 2023-10-06T04:39:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.657+0000 7f9644ff9700 1 -- 172.21.15.37:0/2686893930 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9640003040 con 0x7f964815a3d0 2023-10-06T04:39:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.657+0000 7f9644ff9700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9628060550 0x7f9628062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.657+0000 7f9644ff9700 1 -- 172.21.15.37:0/2686893930 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9640080b70 con 0x7f964815a3d0 2023-10-06T04:39:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.657+0000 7f9647fff700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9628060550 0x7f9628062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.661+0000 7f9647fff700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9628060550 0x7f9628062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9638009d20 tx=0x7f96380091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.665+0000 7f9644ff9700 1 -- 172.21.15.37:0/2686893930 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9640050d10 con 0x7f964815a3d0 2023-10-06T04:39:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.829+0000 7f964e771700 1 -- 172.21.15.37:0/2686893930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9648070ee0 con 0x7f964815a3d0 2023-10-06T04:39:36.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.829+0000 7f9644ff9700 1 -- 172.21.15.37:0/2686893930 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96400230a0 con 0x7f964815a3d0 2023-10-06T04:39:36.836 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:39:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.833+0000 7f964e771700 1 -- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9628060550 msgr2=0x7f9628062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.833+0000 7f964e771700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9628060550 0x7f9628062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9638009d20 tx=0x7f96380091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.833+0000 7f964e771700 1 -- 172.21.15.37:0/2686893930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f964815a3d0 msgr2=0x7f964806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.833+0000 7f964e771700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f964815a3d0 0x7f964806c330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f964000d6c0 tx=0x7f964001a000 comp rx=0 tx=0).stop 2023-10-06T04:39:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.833+0000 7f964e771700 1 -- 172.21.15.37:0/2686893930 shutdown_connections 2023-10-06T04:39:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.833+0000 7f964e771700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9628060550 0x7f9628062a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.833+0000 7f964e771700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f964815a3d0 0x7f964806c330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.833+0000 7f964e771700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96481559d0 0x7f964806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.833+0000 7f964e771700 1 --2- 172.21.15.37:0/2686893930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96480cc530 0x7f9648163e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.833+0000 7f964e771700 1 -- 172.21.15.37:0/2686893930 >> 172.21.15.37:0/2686893930 conn(0x7f96480698d0 msgr2=0x7f964814e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.833+0000 7f964e771700 1 -- 172.21.15.37:0/2686893930 shutdown_connections 2023-10-06T04:39:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.833+0000 7f964e771700 1 -- 172.21.15.37:0/2686893930 wait complete. 2023-10-06T04:39:36.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:39:36.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.961+0000 7fbe415ac700 1 Processor -- start 2023-10-06T04:39:36.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.961+0000 7fbe415ac700 1 -- start start 2023-10-06T04:39:36.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.961+0000 7fbe415ac700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbe3c069b40 0x7fbe3c0b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.961+0000 7fbe415ac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe3c1537d0 0x7fbe3c0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.961+0000 7fbe415ac700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3c0b5a60 con 0x7fbe3c153400 2023-10-06T04:39:36.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.961+0000 7fbe415ac700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3c0b4c60 con 0x7fbe3c069b40 2023-10-06T04:39:36.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.961+0000 7fbe415ac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c15a680 con 0x7fbe3c1537d0 2023-10-06T04:39:36.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe327fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbe3c069b40 0x7fbe3c0b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe3b7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe3c1537d0 0x7fbe3c0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe327fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbe3c069b40 0x7fbe3c0b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:35112/0 (socket says 172.21.15.37:35112) 2023-10-06T04:39:36.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe3b7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe3c1537d0 0x7fbe3c0b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:40868/0 (socket says 172.21.15.37:40868) 2023-10-06T04:39:36.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe3affd700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fbe3c153400 0x7fbe3c069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:49916/0 (socket says 172.21.15.37:49916) 2023-10-06T04:39:36.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe327fc700 1 -- 172.21.15.37:0/1698076439 learned_addr learned my addr 172.21.15.37:0/1698076439 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:36.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe327fc700 1 -- 172.21.15.37:0/1698076439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe3c1537d0 msgr2=0x7fbe3c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe327fc700 1 --2- 172.21.15.37:0/1698076439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe3c1537d0 0x7fbe3c0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe327fc700 1 -- 172.21.15.37:0/1698076439 >> v1:172.21.15.83:6789/0 conn(0x7fbe3c153400 legacy=0x7fbe3c069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe327fc700 1 -- 172.21.15.37:0/1698076439 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c159950 con 0x7fbe3c069b40 2023-10-06T04:39:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe3a7fc700 1 -- 172.21.15.37:0/1698076439 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446256975 0 0) 0x7fbe3c0b5a60 con 0x7fbe3c153400 2023-10-06T04:39:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe3b7fe700 1 --2- 172.21.15.37:0/1698076439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe3c1537d0 0x7fbe3c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe327fc700 1 --2- 172.21.15.37:0/1698076439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe3c069b40 0x7fbe3c0b41e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe240099b0 tx=0x7fbe24009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfeb5de98b1b07c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe3a7fc700 1 -- 172.21.15.37:0/1698076439 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24009ea0 con 0x7fbe3c069b40 2023-10-06T04:39:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe3a7fc700 1 -- 172.21.15.37:0/1698076439 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2400b860 con 0x7fbe3c069b40 2023-10-06T04:39:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe3a7fc700 1 -- 172.21.15.37:0/1698076439 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400bc00 con 0x7fbe3c069b40 2023-10-06T04:39:36.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe415ac700 1 -- 172.21.15.37:0/1698076439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe3c069b40 msgr2=0x7fbe3c0b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe415ac700 1 --2- 172.21.15.37:0/1698076439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe3c069b40 0x7fbe3c0b41e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe240099b0 tx=0x7fbe24009250 comp rx=0 tx=0).stop 2023-10-06T04:39:36.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe415ac700 1 -- 172.21.15.37:0/1698076439 shutdown_connections 2023-10-06T04:39:36.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe415ac700 1 --2- 172.21.15.37:0/1698076439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe3c1537d0 0x7fbe3c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe415ac700 1 --2- 172.21.15.37:0/1698076439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe3c069b40 0x7fbe3c0b41e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe415ac700 1 -- 172.21.15.37:0/1698076439 >> 172.21.15.37:0/1698076439 conn(0x7fbe3c067cf0 msgr2=0x7fbe3c0680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe415ac700 1 -- 172.21.15.37:0/1698076439 shutdown_connections 2023-10-06T04:39:36.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.965+0000 7fbe415ac700 1 -- 172.21.15.37:0/1698076439 wait complete. 2023-10-06T04:39:36.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe415ac700 1 Processor -- start 2023-10-06T04:39:36.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe415ac700 1 -- start start 2023-10-06T04:39:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe415ac700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe3c069b40 0x7fbe3c152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe415ac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe3c153400 0x7fbe3c155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe415ac700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe3c1537d0 0x7fbe3c15e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe415ac700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c1694f0 con 0x7fbe3c1537d0 2023-10-06T04:39:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe415ac700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c169200 con 0x7fbe3c069b40 2023-10-06T04:39:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe415ac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c156530 con 0x7fbe3c153400 2023-10-06T04:39:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe3b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe3c1537d0 0x7fbe3c15e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe3b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe3c1537d0 0x7fbe3c15e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37026/0 (socket says 172.21.15.37:37026) 2023-10-06T04:39:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe327fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe3c153400 0x7fbe3c155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe3b7fe700 1 -- 172.21.15.37:0/2414030309 learned_addr learned my addr 172.21.15.37:0/2414030309 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.969+0000 7fbe3affd700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe3c069b40 0x7fbe3c152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe3b7fe700 1 -- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe3c153400 msgr2=0x7fbe3c155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe3b7fe700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe3c153400 0x7fbe3c155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe3b7fe700 1 -- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe3c069b40 msgr2=0x7fbe3c152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe3b7fe700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe3c069b40 0x7fbe3c152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe3b7fe700 1 -- 172.21.15.37:0/2414030309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe34009a20 con 0x7fbe3c1537d0 2023-10-06T04:39:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe3b7fe700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe3c1537d0 0x7fbe3c15e460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009f20 tx=0x7fbe3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe337fe700 1 -- 172.21.15.37:0/2414030309 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3400cb70 con 0x7fbe3c1537d0 2023-10-06T04:39:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe337fe700 1 -- 172.21.15.37:0/2414030309 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3400f040 con 0x7fbe3c1537d0 2023-10-06T04:39:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe415ac700 1 -- 172.21.15.37:0/2414030309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe240094f0 con 0x7fbe3c1537d0 2023-10-06T04:39:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe337fe700 1 -- 172.21.15.37:0/2414030309 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34014480 con 0x7fbe3c1537d0 2023-10-06T04:39:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe415ac700 1 -- 172.21.15.37:0/2414030309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3c156af0 con 0x7fbe3c1537d0 2023-10-06T04:39:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe415ac700 1 -- 172.21.15.37:0/2414030309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe3c169660 con 0x7fbe3c1537d0 2023-10-06T04:39:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe337fe700 1 -- 172.21.15.37:0/2414030309 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbe34003020 con 0x7fbe3c1537d0 2023-10-06T04:39:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.973+0000 7fbe337fe700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbe1c060550 0x7fbe1c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.977+0000 7fbe337fe700 1 -- 172.21.15.37:0/2414030309 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbe3407d530 con 0x7fbe3c1537d0 2023-10-06T04:39:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.977+0000 7fbe3affd700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbe1c060550 0x7fbe1c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.977+0000 7fbe3affd700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbe1c060550 0x7fbe1c062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c007fd0 tx=0x7fbe2c007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:36.985+0000 7fbe337fe700 1 -- 172.21.15.37:0/2414030309 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbe3404d6b0 con 0x7fbe3c1537d0 2023-10-06T04:39:37.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.145+0000 7fbe415ac700 1 -- 172.21.15.37:0/2414030309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbe3c070ee0 con 0x7fbe3c1537d0 2023-10-06T04:39:37.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe337fe700 1 -- 172.21.15.37:0/2414030309 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbe34050cd0 con 0x7fbe3c1537d0 2023-10-06T04:39:37.153 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:39:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe415ac700 1 -- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbe1c060550 msgr2=0x7fbe1c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe415ac700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbe1c060550 0x7fbe1c062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c007fd0 tx=0x7fbe2c007d50 comp rx=0 tx=0).stop 2023-10-06T04:39:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe415ac700 1 -- 172.21.15.37:0/2414030309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe3c1537d0 msgr2=0x7fbe3c15e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe415ac700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe3c1537d0 0x7fbe3c15e460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009f20 tx=0x7fbe3400b040 comp rx=0 tx=0).stop 2023-10-06T04:39:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe415ac700 1 -- 172.21.15.37:0/2414030309 shutdown_connections 2023-10-06T04:39:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe415ac700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbe1c060550 0x7fbe1c062a00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe415ac700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe3c1537d0 0x7fbe3c15e460 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe415ac700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe3c153400 0x7fbe3c155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe415ac700 1 --2- 172.21.15.37:0/2414030309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe3c069b40 0x7fbe3c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe415ac700 1 -- 172.21.15.37:0/2414030309 >> 172.21.15.37:0/2414030309 conn(0x7fbe3c067cf0 msgr2=0x7fbe3c0cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:37.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe415ac700 1 -- 172.21.15.37:0/2414030309 shutdown_connections 2023-10-06T04:39:37.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.149+0000 7fbe415ac700 1 -- 172.21.15.37:0/2414030309 wait complete. 2023-10-06T04:39:37.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:37.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f6446230700 1 Processor -- start 2023-10-06T04:39:37.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f6446230700 1 -- start start 2023-10-06T04:39:37.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f6446230700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f64400cc120 0x7f644006e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f6446230700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644006e740 0x7f644015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f6446230700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644006dd70 con 0x7f64400cbd50 2023-10-06T04:39:37.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f6446230700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644006eba0 con 0x7f64400cc120 2023-10-06T04:39:37.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f6446230700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64400add50 con 0x7f644006e740 2023-10-06T04:39:37.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f64400cbd50 0x7f64400c9820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36766/0 (socket says 172.21.15.37:36766) 2023-10-06T04:39:37.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643f7fe700 1 -- 172.21.15.37:0/712035625 learned_addr learned my addr 172.21.15.37:0/712035625 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:37.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643ffff700 1 --2- 172.21.15.37:0/712035625 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644006e740 0x7f644015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079171545 0 0) 0x7f644006dd70 con 0x7f64400cbd50 2023-10-06T04:39:37.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643effd700 1 --2- 172.21.15.37:0/712035625 >> v2:172.21.15.83:3300/0 conn(0x7f64400cc120 0x7f644006e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f642c003570 con 0x7f64400cbd50 2023-10-06T04:39:37.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 889093505 0 0) 0x7f642c003570 con 0x7f64400cbd50 2023-10-06T04:39:37.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644006e740 msgr2=0x7f644015cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:37.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 --2- 172.21.15.37:0/712035625 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644006e740 0x7f644015cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 >> v2:172.21.15.83:3300/0 conn(0x7f64400cc120 msgr2=0x7f644006e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:37.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 --2- 172.21.15.37:0/712035625 >> v2:172.21.15.83:3300/0 conn(0x7f64400cc120 0x7f644006e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64400ae030 con 0x7f64400cbd50 2023-10-06T04:39:37.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f64300017f0 con 0x7f64400cbd50 2023-10-06T04:39:37.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 >> v1:172.21.15.37:6789/0 conn(0x7f64400cbd50 legacy=0x7f64400c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 --2- 172.21.15.37:0/712035625 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644006e740 0x7f642c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 --2- 172.21.15.37:0/712035625 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f642c003fe0 0x7f642c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 --2- 172.21.15.37:0/712035625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642c004d50 0x7f642c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644006eba0 con 0x7f642c004d50 2023-10-06T04:39:37.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64400add50 con 0x7f642c003fe0 2023-10-06T04:39:37.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c00ba90 con 0x7f644006e740 2023-10-06T04:39:37.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643effd700 1 --2- 172.21.15.37:0/712035625 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f642c003fe0 0x7f642c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643ffff700 1 --2- 172.21.15.37:0/712035625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642c004d50 0x7f642c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.273+0000 7f643f7fe700 1 --2- 172.21.15.37:0/712035625 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644006e740 0x7f642c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f643ffff700 1 -- 172.21.15.37:0/712035625 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644006e740 msgr2=0x7f642c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:37.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f643ffff700 1 --2- 172.21.15.37:0/712035625 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644006e740 0x7f642c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f643ffff700 1 -- 172.21.15.37:0/712035625 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f642c003fe0 msgr2=0x7f642c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:37.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f643ffff700 1 --2- 172.21.15.37:0/712035625 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f642c003fe0 0x7f642c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f643ffff700 1 -- 172.21.15.37:0/712035625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c003570 con 0x7f642c004d50 2023-10-06T04:39:37.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f643ffff700 1 --2- 172.21.15.37:0/712035625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642c004d50 0x7f642c0051c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6438009c00 tx=0x7f64380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d927956e09ac1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:37.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800e6b0 con 0x7f642c004d50 2023-10-06T04:39:37.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643800e810 con 0x7f642c004d50 2023-10-06T04:39:37.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f643e7fc700 1 -- 172.21.15.37:0/712035625 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800ebd0 con 0x7f642c004d50 2023-10-06T04:39:37.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f6446230700 1 -- 172.21.15.37:0/712035625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642c004d50 msgr2=0x7f642c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f6446230700 1 --2- 172.21.15.37:0/712035625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642c004d50 0x7f642c0051c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6438009c00 tx=0x7f64380091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f643ffff700 1 -- 172.21.15.37:0/712035625 reap_dead start 2023-10-06T04:39:37.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f6446230700 1 -- 172.21.15.37:0/712035625 shutdown_connections 2023-10-06T04:39:37.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f6446230700 1 -- 172.21.15.37:0/712035625 >> 172.21.15.37:0/712035625 conn(0x7f64400667b0 msgr2=0x7f6440066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:37.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f6446230700 1 -- 172.21.15.37:0/712035625 shutdown_connections 2023-10-06T04:39:37.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.277+0000 7f6446230700 1 -- 172.21.15.37:0/712035625 wait complete. 2023-10-06T04:39:37.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f6446230700 1 Processor -- start 2023-10-06T04:39:37.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f6446230700 1 -- start start 2023-10-06T04:39:37.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f6446230700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64400caf00 0x7f64400cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f6446230700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644015ea80 0x7f644015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f6446230700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f644015d1d0 0x7f6440146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f6446230700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644015da00 con 0x7f64400caf00 2023-10-06T04:39:37.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f6446230700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644015dce0 con 0x7f644015d1d0 2023-10-06T04:39:37.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f6446230700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644015dfc0 con 0x7f644015ea80 2023-10-06T04:39:37.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f643f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64400caf00 0x7f64400cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f643f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64400caf00 0x7f64400cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37046/0 (socket says 172.21.15.37:37046) 2023-10-06T04:39:37.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f643f7fe700 1 -- 172.21.15.37:0/3875698651 learned_addr learned my addr 172.21.15.37:0/3875698651 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:37.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f643effd700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644015ea80 0x7f644015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f643ffff700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f644015d1d0 0x7f6440146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f643f7fe700 1 -- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644015ea80 msgr2=0x7f644015cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f643f7fe700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644015ea80 0x7f644015cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f643f7fe700 1 -- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f644015d1d0 msgr2=0x7f6440146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f643f7fe700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f644015d1d0 0x7f6440146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f643f7fe700 1 -- 172.21.15.37:0/3875698651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644015e2a0 con 0x7f64400caf00 2023-10-06T04:39:37.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f643f7fe700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64400caf00 0x7f64400cb2d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6430007c90 tx=0x7f64400c8810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:37.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f64377fe700 1 -- 172.21.15.37:0/3875698651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6430013600 con 0x7f64400caf00 2023-10-06T04:39:37.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f64377fe700 1 -- 172.21.15.37:0/3875698651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6430013780 con 0x7f64400caf00 2023-10-06T04:39:37.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f6446230700 1 -- 172.21.15.37:0/3875698651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644015e580 con 0x7f64400caf00 2023-10-06T04:39:37.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f64377fe700 1 -- 172.21.15.37:0/3875698651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6430013b40 con 0x7f64400caf00 2023-10-06T04:39:37.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.281+0000 7f6446230700 1 -- 172.21.15.37:0/3875698651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644015eef0 con 0x7f64400caf00 2023-10-06T04:39:37.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.285+0000 7f6446230700 1 -- 172.21.15.37:0/3875698651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6440070ee0 con 0x7f64400caf00 2023-10-06T04:39:37.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.285+0000 7f64377fe700 1 -- 172.21.15.37:0/3875698651 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f643001c400 con 0x7f64400caf00 2023-10-06T04:39:37.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.285+0000 7f64377fe700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6420060550 0x7f6420062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.285+0000 7f64377fe700 1 -- 172.21.15.37:0/3875698651 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f643007dd70 con 0x7f64400caf00 2023-10-06T04:39:37.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.285+0000 7f643effd700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6420060550 0x7f6420062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.289+0000 7f643effd700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6420060550 0x7f6420062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6440163340 tx=0x7f64280091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:37.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.293+0000 7f64377fe700 1 -- 172.21.15.37:0/3875698651 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f643004df10 con 0x7f64400caf00 2023-10-06T04:39:37.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.493+0000 7f6446230700 1 -- 172.21.15.37:0/3875698651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64400ae310 con 0x7f64400caf00 2023-10-06T04:39:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.493+0000 7f64377fe700 1 -- 172.21.15.37:0/3875698651 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f6430017090 con 0x7f64400caf00 2023-10-06T04:39:37.500 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:37.500 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3463038764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3463038764},{"type":"v1","addr":"172.21.15.83:6835","nonce":3463038764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3802233690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3802233690},{"type":"v1","addr":"172.21.15.37:6833","nonce":3802233690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1262727325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1262727325},{"type":"v1","addr":"172.21.15.83:6837","nonce":1262727325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:10.126951+0000","modified":"2023-10-06T04:39:29.669009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1742476643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1742476643},{"type":"v1","addr":"172.21.15.37:6835","nonce":1742476643}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:39:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.497+0000 7f6446230700 1 -- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6420060550 msgr2=0x7f6420062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.497+0000 7f6446230700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6420060550 0x7f6420062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6440163340 tx=0x7f64280091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.497+0000 7f6446230700 1 -- 172.21.15.37:0/3875698651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64400caf00 msgr2=0x7f64400cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.497+0000 7f6446230700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64400caf00 0x7f64400cb2d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6430007c90 tx=0x7f64400c8810 comp rx=0 tx=0).stop 2023-10-06T04:39:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.497+0000 7f6446230700 1 -- 172.21.15.37:0/3875698651 shutdown_connections 2023-10-06T04:39:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.497+0000 7f6446230700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6420060550 0x7f6420062a00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.497+0000 7f6446230700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f644015d1d0 0x7f6440146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.497+0000 7f6446230700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f644015ea80 0x7f644015cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.497+0000 7f6446230700 1 --2- 172.21.15.37:0/3875698651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64400caf00 0x7f64400cb2d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.497+0000 7f6446230700 1 -- 172.21.15.37:0/3875698651 >> 172.21.15.37:0/3875698651 conn(0x7f64400667b0 msgr2=0x7f644015bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.497+0000 7f6446230700 1 -- 172.21.15.37:0/3875698651 shutdown_connections 2023-10-06T04:39:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.497+0000 7f6446230700 1 -- 172.21.15.37:0/3875698651 wait complete. 2023-10-06T04:39:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:39:37.515 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:37.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.617+0000 7f59bde14700 1 Processor -- start 2023-10-06T04:39:37.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.617+0000 7f59bde14700 1 -- start start 2023-10-06T04:39:37.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.617+0000 7f59bde14700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80aa7e0 0x7f59b80a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.617+0000 7f59bde14700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59b806ea10 0x7f59b8067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.617+0000 7f59bde14700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b806a1b0 con 0x7f59b80aabb0 2023-10-06T04:39:37.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.617+0000 7f59bde14700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b81592c0 con 0x7f59b806ea10 2023-10-06T04:39:37.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.617+0000 7f59bde14700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80c6ce0 con 0x7f59b80aa7e0 2023-10-06T04:39:37.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.617+0000 7f59b7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f59b80aabb0 0x7f59b80c65d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36774/0 (socket says 172.21.15.37:36774) 2023-10-06T04:39:37.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.617+0000 7f59b7fff700 1 -- 172.21.15.37:0/2926972200 learned_addr learned my addr 172.21.15.37:0/2926972200 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:37.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.617+0000 7f59bd613700 1 --2- 172.21.15.37:0/2926972200 >> v2:172.21.15.37:3300/0 conn(0x7f59b806ea10 0x7f59b8067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.617+0000 7f59bce12700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80aa7e0 0x7f59b80a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469701661 0 0) 0x7f59b806a1b0 con 0x7f59b80aabb0 2023-10-06T04:39:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59a0003570 con 0x7f59b80aabb0 2023-10-06T04:39:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4041768194 0 0) 0x7f59a0003570 con 0x7f59b80aabb0 2023-10-06T04:39:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80aa7e0 msgr2=0x7f59b80a8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80aa7e0 0x7f59b80a8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 >> v2:172.21.15.37:3300/0 conn(0x7f59b806ea10 msgr2=0x7f59b8067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 --2- 172.21.15.37:0/2926972200 >> v2:172.21.15.37:3300/0 conn(0x7f59b806ea10 0x7f59b8067cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80a8f50 con 0x7f59b80aabb0 2023-10-06T04:39:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f59a80017f0 con 0x7f59b80aabb0 2023-10-06T04:39:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59bce12700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80aa7e0 0x7f59b80a8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59bd613700 1 --2- 172.21.15.37:0/2926972200 >> v2:172.21.15.37:3300/0 conn(0x7f59b806ea10 0x7f59b8067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 >> v1:172.21.15.37:6789/0 conn(0x7f59b80aabb0 legacy=0x7f59b80c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a0003a90 0x7f59a0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80aa7e0 0x7f59a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a0004d50 0x7f59a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b81592c0 con 0x7f59a0004d50 2023-10-06T04:39:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80c6ce0 con 0x7f59a0003a90 2023-10-06T04:39:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a000ba60 con 0x7f59b80aa7e0 2023-10-06T04:39:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b7fff700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80aa7e0 0x7f59a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59bce12700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a0003a90 0x7f59a0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59bd613700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a0004d50 0x7f59a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b7fff700 1 -- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a0003a90 msgr2=0x7f59a0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b7fff700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a0003a90 0x7f59a0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b7fff700 1 -- 172.21.15.37:0/2926972200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a0004d50 msgr2=0x7f59a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:37.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b7fff700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a0004d50 0x7f59a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b7fff700 1 -- 172.21.15.37:0/2926972200 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac009420 con 0x7f59b80aa7e0 2023-10-06T04:39:37.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b7fff700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80aa7e0 0x7f59a0004810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f59a800a900 tx=0x7f59a80021d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcf6a713d6cf5d65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:37.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80070d0 con 0x7f59b80aa7e0 2023-10-06T04:39:37.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a8007230 con 0x7f59b80aa7e0 2023-10-06T04:39:37.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59b77fe700 1 -- 172.21.15.37:0/2926972200 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80075d0 con 0x7f59b80aa7e0 2023-10-06T04:39:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59bde14700 1 -- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80aa7e0 msgr2=0x7f59a0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59bde14700 1 --2- 172.21.15.37:0/2926972200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80aa7e0 0x7f59a0004810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f59a800a900 tx=0x7f59a80021d0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59bd613700 1 -- 172.21.15.37:0/2926972200 reap_dead start 2023-10-06T04:39:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59bde14700 1 -- 172.21.15.37:0/2926972200 shutdown_connections 2023-10-06T04:39:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59bde14700 1 -- 172.21.15.37:0/2926972200 >> 172.21.15.37:0/2926972200 conn(0x7f59b80cc030 msgr2=0x7f59b80cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59bde14700 1 -- 172.21.15.37:0/2926972200 shutdown_connections 2023-10-06T04:39:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.621+0000 7f59bde14700 1 -- 172.21.15.37:0/2926972200 wait complete. 2023-10-06T04:39:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59bde14700 1 Processor -- start 2023-10-06T04:39:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59bde14700 1 -- start start 2023-10-06T04:39:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59bde14700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59b81575b0 0x7f59b80ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59bde14700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59b80af1a0 0x7f59b80ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59bde14700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80ab9f0 0x7f59b80ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59bde14700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80b0240 con 0x7f59b80af1a0 2023-10-06T04:39:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59bde14700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80adb30 con 0x7f59b81575b0 2023-10-06T04:39:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59bde14700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80af630 con 0x7f59b80ab9f0 2023-10-06T04:39:37.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59b80af1a0 0x7f59b80ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59b80af1a0 0x7f59b80ad0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37060/0 (socket says 172.21.15.37:37060) 2023-10-06T04:39:37.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59b7fff700 1 -- 172.21.15.37:0/2511785716 learned_addr learned my addr 172.21.15.37:0/2511785716 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:37.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59bd613700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80ab9f0 0x7f59b80ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59bce12700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59b81575b0 0x7f59b80ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59b7fff700 1 -- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80ab9f0 msgr2=0x7f59b80ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59b7fff700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80ab9f0 0x7f59b80ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59b7fff700 1 -- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59b81575b0 msgr2=0x7f59b80ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59b7fff700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59b81575b0 0x7f59b80ab4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59b7fff700 1 -- 172.21.15.37:0/2511785716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80af910 con 0x7f59b80af1a0 2023-10-06T04:39:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59bd613700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80ab9f0 0x7f59b80ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.625+0000 7f59b7fff700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59b80af1a0 0x7f59b80ad0b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59b80aafc0 tx=0x7f59a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.629+0000 7f59b4ff9700 1 -- 172.21.15.37:0/2511785716 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8027470 con 0x7f59b80af1a0 2023-10-06T04:39:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.629+0000 7f59b4ff9700 1 -- 172.21.15.37:0/2511785716 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a80275d0 con 0x7f59b80af1a0 2023-10-06T04:39:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.629+0000 7f59bde14700 1 -- 172.21.15.37:0/2511785716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b80afbf0 con 0x7f59b80af1a0 2023-10-06T04:39:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.629+0000 7f59b4ff9700 1 -- 172.21.15.37:0/2511785716 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8027990 con 0x7f59b80af1a0 2023-10-06T04:39:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.629+0000 7f59bde14700 1 -- 172.21.15.37:0/2511785716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b8157980 con 0x7f59b80af1a0 2023-10-06T04:39:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.629+0000 7f59bde14700 1 -- 172.21.15.37:0/2511785716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b80b03f0 con 0x7f59b80af1a0 2023-10-06T04:39:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.629+0000 7f59b4ff9700 1 -- 172.21.15.37:0/2511785716 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f59a8024070 con 0x7f59b80af1a0 2023-10-06T04:39:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.629+0000 7f59b4ff9700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f59a4060550 0x7f59a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.629+0000 7f59b4ff9700 1 -- 172.21.15.37:0/2511785716 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f59a807ef30 con 0x7f59b80af1a0 2023-10-06T04:39:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.629+0000 7f59bce12700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f59a4060550 0x7f59a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.633+0000 7f59bce12700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f59a4060550 0x7f59a4062a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f59ac006f00 tx=0x7f59ac0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:37.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.637+0000 7f59b4ff9700 1 -- 172.21.15.37:0/2511785716 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f59a804f0d0 con 0x7f59b80af1a0 2023-10-06T04:39:37.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.801+0000 7f59bde14700 1 -- 172.21.15.37:0/2511785716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59b8158db0 con 0x7f59b80af1a0 2023-10-06T04:39:37.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.801+0000 7f59b4ff9700 1 -- 172.21.15.37:0/2511785716 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f59a80526f0 con 0x7f59b80af1a0 2023-10-06T04:39:37.808 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:37.808 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:15.209829+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:37.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.805+0000 7f59bde14700 1 -- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f59a4060550 msgr2=0x7f59a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.805+0000 7f59bde14700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f59a4060550 0x7f59a4062a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f59ac006f00 tx=0x7f59ac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.805+0000 7f59bde14700 1 -- 172.21.15.37:0/2511785716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59b80af1a0 msgr2=0x7f59b80ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.805+0000 7f59bde14700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59b80af1a0 0x7f59b80ad0b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59b80aafc0 tx=0x7f59a8016000 comp rx=0 tx=0).stop 2023-10-06T04:39:37.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.805+0000 7f59bde14700 1 -- 172.21.15.37:0/2511785716 shutdown_connections 2023-10-06T04:39:37.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.805+0000 7f59bde14700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f59a4060550 0x7f59a4062a00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.805+0000 7f59bde14700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59b80ab9f0 0x7f59b80ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.805+0000 7f59bde14700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59b80af1a0 0x7f59b80ad0b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.805+0000 7f59bde14700 1 --2- 172.21.15.37:0/2511785716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59b81575b0 0x7f59b80ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.805+0000 7f59bde14700 1 -- 172.21.15.37:0/2511785716 >> 172.21.15.37:0/2511785716 conn(0x7f59b80cc030 msgr2=0x7f59b80c9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.805+0000 7f59bde14700 1 -- 172.21.15.37:0/2511785716 shutdown_connections 2023-10-06T04:39:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.805+0000 7f59bde14700 1 -- 172.21.15.37:0/2511785716 wait complete. 2023-10-06T04:39:37.823 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:08.512565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:09.104711+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:39:12.860905+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:37.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:37.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.925+0000 7ff001742700 1 Processor -- start 2023-10-06T04:39:37.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.925+0000 7ff001742700 1 -- start start 2023-10-06T04:39:37.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.925+0000 7ff001742700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feffc153400 0x7feffc069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.925+0000 7ff001742700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feffc0b48f0 0x7feffc069970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.925+0000 7ff001742700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feffc0b5a60 con 0x7feffc1537d0 2023-10-06T04:39:37.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.925+0000 7ff001742700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc15a680 con 0x7feffc0b48f0 2023-10-06T04:39:37.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.925+0000 7ff001742700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc159950 con 0x7feffc153400 2023-10-06T04:39:37.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feffb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feffc0b48f0 0x7feffc069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feff3fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7feffc1537d0 0x7feffc0b41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36784/0 (socket says 172.21.15.37:36784) 2023-10-06T04:39:37.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feff3fff700 1 -- 172.21.15.37:0/3230146803 learned_addr learned my addr 172.21.15.37:0/3230146803 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feffaffd700 1 --2- 172.21.15.37:0/3230146803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feffc153400 0x7feffc069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feffb7fe700 1 -- 172.21.15.37:0/3230146803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feffc153400 msgr2=0x7feffc069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feffb7fe700 1 --2- 172.21.15.37:0/3230146803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feffc153400 0x7feffc069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feffb7fe700 1 -- 172.21.15.37:0/3230146803 >> v1:172.21.15.37:6789/0 conn(0x7feffc1537d0 legacy=0x7feffc0b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feffa7fc700 1 -- 172.21.15.37:0/3230146803 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251962257 0 0) 0x7feffc0b5a60 con 0x7feffc1537d0 2023-10-06T04:39:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feffb7fe700 1 -- 172.21.15.37:0/3230146803 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc0b4e50 con 0x7feffc0b48f0 2023-10-06T04:39:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feffb7fe700 1 --2- 172.21.15.37:0/3230146803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0b48f0 0x7feffc069970 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feff4009e60 tx=0x7feff4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa3a322cfc922a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feffa7fc700 1 -- 172.21.15.37:0/3230146803 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff400e070 con 0x7feffc0b48f0 2023-10-06T04:39:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feffa7fc700 1 -- 172.21.15.37:0/3230146803 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff400bc30 con 0x7feffc0b48f0 2023-10-06T04:39:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7feffa7fc700 1 -- 172.21.15.37:0/3230146803 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4012430 con 0x7feffc0b48f0 2023-10-06T04:39:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7ff001742700 1 -- 172.21.15.37:0/3230146803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0b48f0 msgr2=0x7feffc069970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7ff001742700 1 --2- 172.21.15.37:0/3230146803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0b48f0 0x7feffc069970 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feff4009e60 tx=0x7feff4009780 comp rx=0 tx=0).stop 2023-10-06T04:39:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7ff001742700 1 -- 172.21.15.37:0/3230146803 shutdown_connections 2023-10-06T04:39:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7ff001742700 1 --2- 172.21.15.37:0/3230146803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0b48f0 0x7feffc069970 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7ff001742700 1 --2- 172.21.15.37:0/3230146803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feffc153400 0x7feffc069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7ff001742700 1 -- 172.21.15.37:0/3230146803 >> 172.21.15.37:0/3230146803 conn(0x7feffc067cf0 msgr2=0x7feffc0680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7ff001742700 1 -- 172.21.15.37:0/3230146803 shutdown_connections 2023-10-06T04:39:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7ff001742700 1 -- 172.21.15.37:0/3230146803 wait complete. 2023-10-06T04:39:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.929+0000 7ff001742700 1 Processor -- start 2023-10-06T04:39:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7ff001742700 1 -- start start 2023-10-06T04:39:37.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7ff001742700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0b48f0 0x7feffc15e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7ff001742700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feffc153400 0x7feffc15e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7ff001742700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feffc1537d0 0x7feffc153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7ff001742700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc157a50 con 0x7feffc0b48f0 2023-10-06T04:39:37.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7ff001742700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc156ed0 con 0x7feffc1537d0 2023-10-06T04:39:37.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7ff001742700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc1571b0 con 0x7feffc153400 2023-10-06T04:39:37.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feffaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0b48f0 0x7feffc15e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feffaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0b48f0 0x7feffc15e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37080/0 (socket says 172.21.15.37:37080) 2023-10-06T04:39:37.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feffaffd700 1 -- 172.21.15.37:0/3331295939 learned_addr learned my addr 172.21.15.37:0/3331295939 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:37.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feff3fff700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feffc153400 0x7feffc15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feffb7fe700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feffc1537d0 0x7feffc153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feffaffd700 1 -- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feffc153400 msgr2=0x7feffc15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feffaffd700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feffc153400 0x7feffc15e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feffaffd700 1 -- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feffc1537d0 msgr2=0x7feffc153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feffaffd700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feffc1537d0 0x7feffc153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feffaffd700 1 -- 172.21.15.37:0/3331295939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff4009a20 con 0x7feffc0b48f0 2023-10-06T04:39:37.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feffaffd700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0b48f0 0x7feffc15e3e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fefec00d890 tx=0x7fefec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:37.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feff2ffd700 1 -- 172.21.15.37:0/3331295939 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec0125f0 con 0x7feffc0b48f0 2023-10-06T04:39:37.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feff2ffd700 1 -- 172.21.15.37:0/3331295939 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec012750 con 0x7feffc0b48f0 2023-10-06T04:39:37.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7ff001742700 1 -- 172.21.15.37:0/3331295939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc157490 con 0x7feffc0b48f0 2023-10-06T04:39:37.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.933+0000 7feff2ffd700 1 -- 172.21.15.37:0/3331295939 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec012af0 con 0x7feffc0b48f0 2023-10-06T04:39:37.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.937+0000 7ff001742700 1 -- 172.21.15.37:0/3331295939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc154230 con 0x7feffc0b48f0 2023-10-06T04:39:37.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.937+0000 7ff001742700 1 -- 172.21.15.37:0/3331295939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc070ee0 con 0x7feffc0b48f0 2023-10-06T04:39:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.937+0000 7feff2ffd700 1 -- 172.21.15.37:0/3331295939 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fefec01e460 con 0x7feffc0b48f0 2023-10-06T04:39:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.937+0000 7feff2ffd700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fefdc060580 0x7fefdc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.937+0000 7feff2ffd700 1 -- 172.21.15.37:0/3331295939 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fefec07d220 con 0x7feffc0b48f0 2023-10-06T04:39:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.941+0000 7feff3fff700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fefdc060580 0x7fefdc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.941+0000 7feff3fff700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fefdc060580 0x7fefdc062a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feffc0b1d00 tx=0x7fefe4007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:37.945+0000 7feff2ffd700 1 -- 172.21.15.37:0/3331295939 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fefec04d320 con 0x7feffc0b48f0 2023-10-06T04:39:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.105+0000 7ff001742700 1 -- 172.21.15.37:0/3331295939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feffc169040 con 0x7feffc0b48f0 2023-10-06T04:39:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.105+0000 7feff2ffd700 1 -- 172.21.15.37:0/3331295939 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fefec050940 con 0x7feffc0b48f0 2023-10-06T04:39:38.216 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:39:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.109+0000 7ff001742700 1 -- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fefdc060580 msgr2=0x7fefdc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.109+0000 7ff001742700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fefdc060580 0x7fefdc062a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feffc0b1d00 tx=0x7fefe4007d30 comp rx=0 tx=0).stop 2023-10-06T04:39:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.109+0000 7ff001742700 1 -- 172.21.15.37:0/3331295939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0b48f0 msgr2=0x7feffc15e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.109+0000 7ff001742700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0b48f0 0x7feffc15e3e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fefec00d890 tx=0x7fefec008040 comp rx=0 tx=0).stop 2023-10-06T04:39:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.109+0000 7ff001742700 1 -- 172.21.15.37:0/3331295939 shutdown_connections 2023-10-06T04:39:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.109+0000 7ff001742700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fefdc060580 0x7fefdc062a30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.109+0000 7ff001742700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feffc1537d0 0x7feffc153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.109+0000 7ff001742700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feffc153400 0x7feffc15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.109+0000 7ff001742700 1 --2- 172.21.15.37:0/3331295939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0b48f0 0x7feffc15e3e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.109+0000 7ff001742700 1 -- 172.21.15.37:0/3331295939 >> 172.21.15.37:0/3331295939 conn(0x7feffc067cf0 msgr2=0x7feffc069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.109+0000 7ff001742700 1 -- 172.21.15.37:0/3331295939 shutdown_connections 2023-10-06T04:39:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.109+0000 7ff001742700 1 -- 172.21.15.37:0/3331295939 wait complete. 2023-10-06T04:39:38.219 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf8e42700 1 Processor -- start 2023-10-06T04:39:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf8e42700 1 -- start start 2023-10-06T04:39:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf8e42700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf40669e0 0x7f3bf4066db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf8e42700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3bf4158bb0 0x7f3bf4159010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf8e42700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf406aa90 con 0x7f3bf40c8180 2023-10-06T04:39:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf8e42700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf4069c20 con 0x7f3bf4158bb0 2023-10-06T04:39:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf8e42700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf4069e80 con 0x7f3bf40669e0 2023-10-06T04:39:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf2d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3bf4158bb0 0x7f3bf4159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf259c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf40669e0 0x7f3bf4066db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf2d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3bf4158bb0 0x7f3bf4159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:35192/0 (socket says 172.21.15.37:35192) 2023-10-06T04:39:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf2d9d700 1 -- 172.21.15.37:0/1740923486 learned_addr learned my addr 172.21.15.37:0/1740923486 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf2d9d700 1 -- 172.21.15.37:0/1740923486 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf40669e0 msgr2=0x7f3bf4066db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf2d9d700 1 --2- 172.21.15.37:0/1740923486 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf40669e0 0x7f3bf4066db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf2d9d700 1 -- 172.21.15.37:0/1740923486 >> v1:172.21.15.83:6789/0 conn(0x7f3bf40c8180 legacy=0x7f3bf4069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf2d9d700 1 -- 172.21.15.37:0/1740923486 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf406a160 con 0x7f3bf4158bb0 2023-10-06T04:39:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf2d9d700 1 --2- 172.21.15.37:0/1740923486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf4158bb0 0x7f3bf4159010 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009f20 tx=0x7f3bec009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ad4e8bcd4a571d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:38.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.337+0000 7f3bf159a700 1 -- 172.21.15.37:0/1740923486 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00e070 con 0x7f3bf4158bb0 2023-10-06T04:39:38.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.341+0000 7f3bf159a700 1 -- 172.21.15.37:0/1740923486 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec00b9d0 con 0x7f3bf4158bb0 2023-10-06T04:39:38.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.341+0000 7f3bf159a700 1 -- 172.21.15.37:0/1740923486 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0092e0 con 0x7f3bf4158bb0 2023-10-06T04:39:38.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.341+0000 7f3bf8e42700 1 -- 172.21.15.37:0/1740923486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf4158bb0 msgr2=0x7f3bf4159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.341+0000 7f3bf8e42700 1 --2- 172.21.15.37:0/1740923486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf4158bb0 0x7f3bf4159010 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009f20 tx=0x7f3bec009840 comp rx=0 tx=0).stop 2023-10-06T04:39:38.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.341+0000 7f3bf8e42700 1 -- 172.21.15.37:0/1740923486 shutdown_connections 2023-10-06T04:39:38.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.341+0000 7f3bf8e42700 1 --2- 172.21.15.37:0/1740923486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf4158bb0 0x7f3bf4159010 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.341+0000 7f3bf8e42700 1 --2- 172.21.15.37:0/1740923486 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf40669e0 0x7f3bf4066db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.341+0000 7f3bf8e42700 1 -- 172.21.15.37:0/1740923486 >> 172.21.15.37:0/1740923486 conn(0x7f3bf40cdb00 msgr2=0x7f3bf40cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:38.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.341+0000 7f3bf8e42700 1 -- 172.21.15.37:0/1740923486 shutdown_connections 2023-10-06T04:39:38.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.341+0000 7f3bf8e42700 1 -- 172.21.15.37:0/1740923486 wait complete. 2023-10-06T04:39:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.341+0000 7f3bf8e42700 1 Processor -- start 2023-10-06T04:39:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.341+0000 7f3bf8e42700 1 -- start start 2023-10-06T04:39:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf8e42700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf40669e0 0x7f3bf40aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf8e42700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf40c8180 0x7f3bf40c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf8e42700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf4158bb0 0x7f3bf40c1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf8e42700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40c1c50 con 0x7f3bf4158bb0 2023-10-06T04:39:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf8e42700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40c1ec0 con 0x7f3bf40c8180 2023-10-06T04:39:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf8e42700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40c21a0 con 0x7f3bf40669e0 2023-10-06T04:39:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf4158bb0 0x7f3bf40c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf4158bb0 0x7f3bf40c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37092/0 (socket says 172.21.15.37:37092) 2023-10-06T04:39:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf2d9d700 1 -- 172.21.15.37:0/476420509 learned_addr learned my addr 172.21.15.37:0/476420509 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf1d9b700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf40c8180 0x7f3bf40c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf259c700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf40669e0 0x7f3bf40aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf2d9d700 1 -- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf40669e0 msgr2=0x7f3bf40aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf2d9d700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf40669e0 0x7f3bf40aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf2d9d700 1 -- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf40c8180 msgr2=0x7f3bf40c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf2d9d700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf40c8180 0x7f3bf40c11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf2d9d700 1 -- 172.21.15.37:0/476420509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec009ae0 con 0x7f3bf4158bb0 2023-10-06T04:39:38.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf2d9d700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf4158bb0 0x7f3bf40c1710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00b610 tx=0x7f3bec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:38.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bea7fc700 1 -- 172.21.15.37:0/476420509 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec008ad0 con 0x7f3bf4158bb0 2023-10-06T04:39:38.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bea7fc700 1 -- 172.21.15.37:0/476420509 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec008c30 con 0x7f3bf4158bb0 2023-10-06T04:39:38.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf8e42700 1 -- 172.21.15.37:0/476420509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf40c2480 con 0x7f3bf4158bb0 2023-10-06T04:39:38.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bea7fc700 1 -- 172.21.15.37:0/476420509 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec025460 con 0x7f3bf4158bb0 2023-10-06T04:39:38.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf8e42700 1 -- 172.21.15.37:0/476420509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf40c2a40 con 0x7f3bf4158bb0 2023-10-06T04:39:38.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.345+0000 7f3bf8e42700 1 -- 172.21.15.37:0/476420509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf406a440 con 0x7f3bf4158bb0 2023-10-06T04:39:38.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.349+0000 7f3bea7fc700 1 -- 172.21.15.37:0/476420509 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3bec003040 con 0x7f3bf4158bb0 2023-10-06T04:39:38.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.349+0000 7f3bea7fc700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3bd4060550 0x7f3bd4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.349+0000 7f3bea7fc700 1 -- 172.21.15.37:0/476420509 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3bec07e7f0 con 0x7f3bf4158bb0 2023-10-06T04:39:38.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.349+0000 7f3bf259c700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3bd4060550 0x7f3bd4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.349+0000 7f3bf259c700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3bd4060550 0x7f3bd4062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009db0 tx=0x7f3be40091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.357+0000 7f3bea7fc700 1 -- 172.21.15.37:0/476420509 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3bec04e8f0 con 0x7f3bf4158bb0 2023-10-06T04:39:38.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.517+0000 7f3bf8e42700 1 -- 172.21.15.37:0/476420509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3bf40ce950 con 0x7f3bf4158bb0 2023-10-06T04:39:38.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.517+0000 7f3bea7fc700 1 -- 172.21.15.37:0/476420509 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3bec051f10 con 0x7f3bf4158bb0 2023-10-06T04:39:38.524 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:39:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.521+0000 7f3bf8e42700 1 -- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3bd4060550 msgr2=0x7f3bd4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.521+0000 7f3bf8e42700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3bd4060550 0x7f3bd4062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009db0 tx=0x7f3be40091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.521+0000 7f3bf8e42700 1 -- 172.21.15.37:0/476420509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf4158bb0 msgr2=0x7f3bf40c1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.521+0000 7f3bf8e42700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf4158bb0 0x7f3bf40c1710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00b610 tx=0x7f3bec018000 comp rx=0 tx=0).stop 2023-10-06T04:39:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.521+0000 7f3bf8e42700 1 -- 172.21.15.37:0/476420509 shutdown_connections 2023-10-06T04:39:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.521+0000 7f3bf8e42700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3bd4060550 0x7f3bd4062a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.521+0000 7f3bf8e42700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf40c8180 0x7f3bf40c11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.521+0000 7f3bf8e42700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf4158bb0 0x7f3bf40c1710 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.521+0000 7f3bf8e42700 1 --2- 172.21.15.37:0/476420509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf40669e0 0x7f3bf40aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.521+0000 7f3bf8e42700 1 -- 172.21.15.37:0/476420509 >> 172.21.15.37:0/476420509 conn(0x7f3bf40cdb00 msgr2=0x7f3bf40afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.521+0000 7f3bf8e42700 1 -- 172.21.15.37:0/476420509 shutdown_connections 2023-10-06T04:39:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.521+0000 7f3bf8e42700 1 -- 172.21.15.37:0/476420509 wait complete. 2023-10-06T04:39:38.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:38.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29fb02d700 1 Processor -- start 2023-10-06T04:39:38.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29fb02d700 1 -- start start 2023-10-06T04:39:38.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29fb02d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f29f415a440 0x7f29f406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29fb02d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f415ae50 con 0x7f29f406f140 2023-10-06T04:39:38.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29fb02d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f4068760 con 0x7f29f406e190 2023-10-06T04:39:38.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29fb02d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f40ad370 con 0x7f29f415a440 2023-10-06T04:39:38.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29f982a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f29f406f140 0x7f29f4159d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36796/0 (socket says 172.21.15.37:36796) 2023-10-06T04:39:38.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29f982a700 1 -- 172.21.15.37:0/2811943816 learned_addr learned my addr 172.21.15.37:0/2811943816 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:38.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29fa82c700 1 --2- 172.21.15.37:0/2811943816 >> v2:172.21.15.83:3300/0 conn(0x7f29f415a440 0x7f29f406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29f9029700 1 -- 172.21.15.37:0/2811943816 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692326571 0 0) 0x7f29f415ae50 con 0x7f29f406f140 2023-10-06T04:39:38.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29f9029700 1 -- 172.21.15.37:0/2811943816 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e0003570 con 0x7f29f406f140 2023-10-06T04:39:38.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29fa82c700 1 -- 172.21.15.37:0/2811943816 >> v1:172.21.15.83:6789/0 conn(0x7f29f406e190 legacy=0x7f29f415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29f9029700 1 -- 172.21.15.37:0/2811943816 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353633837 0 0) 0x7f29f4068760 con 0x7f29f406e190 2023-10-06T04:39:38.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29fa82c700 1 -- 172.21.15.37:0/2811943816 >> v1:172.21.15.37:6789/0 conn(0x7f29f406f140 legacy=0x7f29f4159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29fa82c700 1 -- 172.21.15.37:0/2811943816 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f4068a40 con 0x7f29f415a440 2023-10-06T04:39:38.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29fa82c700 1 --2- 172.21.15.37:0/2811943816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29f415a440 0x7f29f406e560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009e60 tx=0x7f29ec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55ac7e9208a2aaae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:38.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29f9029700 1 -- 172.21.15.37:0/2811943816 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec00e070 con 0x7f29f415a440 2023-10-06T04:39:38.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29f9029700 1 -- 172.21.15.37:0/2811943816 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec00bb60 con 0x7f29f415a440 2023-10-06T04:39:38.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.649+0000 7f29f9029700 1 -- 172.21.15.37:0/2811943816 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec012430 con 0x7f29f415a440 2023-10-06T04:39:38.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.653+0000 7f29fb02d700 1 -- 172.21.15.37:0/2811943816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29f415a440 msgr2=0x7f29f406e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.653+0000 7f29fb02d700 1 --2- 172.21.15.37:0/2811943816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29f415a440 0x7f29f406e560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009e60 tx=0x7f29ec009780 comp rx=0 tx=0).stop 2023-10-06T04:39:38.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.653+0000 7f29fb02d700 1 -- 172.21.15.37:0/2811943816 shutdown_connections 2023-10-06T04:39:38.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.653+0000 7f29fb02d700 1 --2- 172.21.15.37:0/2811943816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29f415a440 0x7f29f406e560 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.653+0000 7f29fb02d700 1 -- 172.21.15.37:0/2811943816 >> 172.21.15.37:0/2811943816 conn(0x7f29f40c9570 msgr2=0x7f29f4067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:38.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.653+0000 7f29fb02d700 1 -- 172.21.15.37:0/2811943816 shutdown_connections 2023-10-06T04:39:38.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.653+0000 7f29fb02d700 1 -- 172.21.15.37:0/2811943816 wait complete. 2023-10-06T04:39:38.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.653+0000 7f29fb02d700 1 Processor -- start 2023-10-06T04:39:38.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.653+0000 7f29fb02d700 1 -- start start 2023-10-06T04:39:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29fb02d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29f406e190 0x7f29f4155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29fb02d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f406f140 0x7f29f40c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29fb02d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29f415a440 0x7f29f40c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29fb02d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40c3760 con 0x7f29f406f140 2023-10-06T04:39:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29fb02d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40c3130 con 0x7f29f415a440 2023-10-06T04:39:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29fb02d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40a6460 con 0x7f29f406e190 2023-10-06T04:39:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29f982a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f406f140 0x7f29f40c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29f982a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f406f140 0x7f29f40c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37096/0 (socket says 172.21.15.37:37096) 2023-10-06T04:39:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29f982a700 1 -- 172.21.15.37:0/1752765981 learned_addr learned my addr 172.21.15.37:0/1752765981 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29fa02b700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29f406e190 0x7f29f4155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29fa82c700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29f415a440 0x7f29f40c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29f982a700 1 -- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29f406e190 msgr2=0x7f29f4155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29f982a700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29f406e190 0x7f29f4155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29f982a700 1 -- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29f415a440 msgr2=0x7f29f40c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29f982a700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29f415a440 0x7f29f40c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29f982a700 1 -- 172.21.15.37:0/1752765981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec009a20 con 0x7f29f406f140 2023-10-06T04:39:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29fa82c700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29f415a440 0x7f29f40c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29f982a700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f406f140 0x7f29f40c4f90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f29f00011e0 tx=0x7f29f0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29ea7fc700 1 -- 172.21.15.37:0/1752765981 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0005b30 con 0x7f29f406f140 2023-10-06T04:39:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29fb02d700 1 -- 172.21.15.37:0/1752765981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f40a6740 con 0x7f29f406f140 2023-10-06T04:39:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29ea7fc700 1 -- 172.21.15.37:0/1752765981 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f0005c90 con 0x7f29f406f140 2023-10-06T04:39:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29ea7fc700 1 -- 172.21.15.37:0/1752765981 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00072e0 con 0x7f29f406f140 2023-10-06T04:39:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29fb02d700 1 -- 172.21.15.37:0/1752765981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f41559b0 con 0x7f29f406f140 2023-10-06T04:39:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.657+0000 7f29fb02d700 1 -- 172.21.15.37:0/1752765981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f40c3910 con 0x7f29f406f140 2023-10-06T04:39:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.661+0000 7f29ea7fc700 1 -- 172.21.15.37:0/1752765981 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f29f0007650 con 0x7f29f406f140 2023-10-06T04:39:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.661+0000 7f29ea7fc700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f29d8060550 0x7f29d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.661+0000 7f29ea7fc700 1 -- 172.21.15.37:0/1752765981 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f29f007c090 con 0x7f29f406f140 2023-10-06T04:39:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.661+0000 7f29fa02b700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f29d8060550 0x7f29d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.661+0000 7f29fa02b700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f29d8060550 0x7f29d8062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f29e40011e0 tx=0x7f29e4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:38.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.665+0000 7f29ea7fc700 1 -- 172.21.15.37:0/1752765981 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f29f40c3910 con 0x7f29f406f140 2023-10-06T04:39:38.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.829+0000 7f29fb02d700 1 -- 172.21.15.37:0/1752765981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29f40708a0 con 0x7f29f406f140 2023-10-06T04:39:38.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29ea7fc700 1 -- 172.21.15.37:0/1752765981 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29f004c2e0 con 0x7f29f406f140 2023-10-06T04:39:38.836 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:39:38.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29fb02d700 1 -- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f29d8060550 msgr2=0x7f29d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29fb02d700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f29d8060550 0x7f29d8062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f29e40011e0 tx=0x7f29e4009040 comp rx=0 tx=0).stop 2023-10-06T04:39:38.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29fb02d700 1 -- 172.21.15.37:0/1752765981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f406f140 msgr2=0x7f29f40c4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29fb02d700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f406f140 0x7f29f40c4f90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f29f00011e0 tx=0x7f29f0007df0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29fb02d700 1 -- 172.21.15.37:0/1752765981 shutdown_connections 2023-10-06T04:39:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29fb02d700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f29d8060550 0x7f29d8062a00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29fb02d700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29f415a440 0x7f29f40c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29fb02d700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f406f140 0x7f29f40c4f90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29fb02d700 1 --2- 172.21.15.37:0/1752765981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29f406e190 0x7f29f4155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29fb02d700 1 -- 172.21.15.37:0/1752765981 >> 172.21.15.37:0/1752765981 conn(0x7f29f40c9570 msgr2=0x7f29f41578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29fb02d700 1 -- 172.21.15.37:0/1752765981 shutdown_connections 2023-10-06T04:39:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.833+0000 7f29fb02d700 1 -- 172.21.15.37:0/1752765981 wait complete. 2023-10-06T04:39:38.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.957+0000 7fa9dc1e9700 1 Processor -- start 2023-10-06T04:39:38.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.957+0000 7fa9dc1e9700 1 -- start start 2023-10-06T04:39:38.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.957+0000 7fa9dc1e9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9d4069b40 0x7fa9d40b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.957+0000 7fa9dc1e9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9d41537d0 0x7fa9d40b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.957+0000 7fa9dc1e9700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d40b5a60 con 0x7fa9d4153400 2023-10-06T04:39:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.957+0000 7fa9dc1e9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d40b4c60 con 0x7fa9d4069b40 2023-10-06T04:39:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.957+0000 7fa9dc1e9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d415a680 con 0x7fa9d41537d0 2023-10-06T04:39:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9d9784700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9d4069b40 0x7fa9d40b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9d9784700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9d4069b40 0x7fa9d40b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37106/0 (socket says 172.21.15.37:37106) 2023-10-06T04:39:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9d9784700 1 -- 172.21.15.37:0/140138973 learned_addr learned my addr 172.21.15.37:0/140138973 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9da786700 1 --2- 172.21.15.37:0/140138973 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9d41537d0 0x7fa9d40b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9d9784700 1 -- 172.21.15.37:0/140138973 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9d41537d0 msgr2=0x7fa9d40b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9d8f83700 1 -- 172.21.15.37:0/140138973 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306724015 0 0) 0x7fa9d40b5a60 con 0x7fa9d4153400 2023-10-06T04:39:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9d9784700 1 --2- 172.21.15.37:0/140138973 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9d41537d0 0x7fa9d40b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9d9784700 1 -- 172.21.15.37:0/140138973 >> v1:172.21.15.37:6789/0 conn(0x7fa9d4153400 legacy=0x7fa9d4069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9d9784700 1 -- 172.21.15.37:0/140138973 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4159950 con 0x7fa9d4069b40 2023-10-06T04:39:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9d9784700 1 --2- 172.21.15.37:0/140138973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9d4069b40 0x7fa9d40b41e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80099b0 tx=0x7fa9c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2008938c25fbeea0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9d8f83700 1 -- 172.21.15.37:0/140138973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8009ea0 con 0x7fa9d4069b40 2023-10-06T04:39:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9d8f83700 1 -- 172.21.15.37:0/140138973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c800b860 con 0x7fa9d4069b40 2023-10-06T04:39:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9d8f83700 1 -- 172.21.15.37:0/140138973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800bc00 con 0x7fa9d4069b40 2023-10-06T04:39:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/140138973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9d4069b40 msgr2=0x7fa9d40b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9dc1e9700 1 --2- 172.21.15.37:0/140138973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9d4069b40 0x7fa9d40b41e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80099b0 tx=0x7fa9c8009250 comp rx=0 tx=0).stop 2023-10-06T04:39:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/140138973 shutdown_connections 2023-10-06T04:39:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9dc1e9700 1 --2- 172.21.15.37:0/140138973 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9d41537d0 0x7fa9d40b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9dc1e9700 1 --2- 172.21.15.37:0/140138973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9d4069b40 0x7fa9d40b41e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/140138973 >> 172.21.15.37:0/140138973 conn(0x7fa9d4067cf0 msgr2=0x7fa9d40680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/140138973 shutdown_connections 2023-10-06T04:39:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/140138973 wait complete. 2023-10-06T04:39:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9dc1e9700 1 Processor -- start 2023-10-06T04:39:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.961+0000 7fa9dc1e9700 1 -- start start 2023-10-06T04:39:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9dc1e9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9d4069b40 0x7fa9d4168e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9dc1e9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9d4153400 0x7fa9d415d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9dc1e9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9d41537d0 0x7fa9d415ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9dc1e9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d4155820 con 0x7fa9d41537d0 2023-10-06T04:39:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9dc1e9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d415e300 con 0x7fa9d4153400 2023-10-06T04:39:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9dc1e9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d415d3f0 con 0x7fa9d4069b40 2023-10-06T04:39:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9da786700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9d41537d0 0x7fa9d415ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9da786700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9d41537d0 0x7fa9d415ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37114/0 (socket says 172.21.15.37:37114) 2023-10-06T04:39:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9da786700 1 -- 172.21.15.37:0/2196611370 learned_addr learned my addr 172.21.15.37:0/2196611370 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9d9f85700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9d4069b40 0x7fa9d4168e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9d9784700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9d4153400 0x7fa9d415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9da786700 1 -- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9d4069b40 msgr2=0x7fa9d4168e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9da786700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9d4069b40 0x7fa9d4168e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9da786700 1 -- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9d4153400 msgr2=0x7fa9d415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9da786700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9d4153400 0x7fa9d415d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9da786700 1 -- 172.21.15.37:0/2196611370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c80094f0 con 0x7fa9d41537d0 2023-10-06T04:39:38.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9da786700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9d41537d0 0x7fa9d415ddc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009e20 tx=0x7fa9cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:38.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9c5ffb700 1 -- 172.21.15.37:0/2196611370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00cb50 con 0x7fa9d41537d0 2023-10-06T04:39:38.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9c5ffb700 1 -- 172.21.15.37:0/2196611370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc00f040 con 0x7fa9d41537d0 2023-10-06T04:39:38.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9c5ffb700 1 -- 172.21.15.37:0/2196611370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc014480 con 0x7fa9d41537d0 2023-10-06T04:39:38.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/2196611370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d415cac0 con 0x7fa9d41537d0 2023-10-06T04:39:38.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/2196611370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d415d080 con 0x7fa9d41537d0 2023-10-06T04:39:38.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.965+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/2196611370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d415d580 con 0x7fa9d41537d0 2023-10-06T04:39:38.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.969+0000 7fa9c5ffb700 1 -- 172.21.15.37:0/2196611370 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa9cc014830 con 0x7fa9d41537d0 2023-10-06T04:39:38.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.969+0000 7fa9c5ffb700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa9b8060550 0x7fa9b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.969+0000 7fa9c5ffb700 1 -- 172.21.15.37:0/2196611370 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa9cc07d540 con 0x7fa9d41537d0 2023-10-06T04:39:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.969+0000 7fa9d9f85700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa9b8060550 0x7fa9b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.969+0000 7fa9d9f85700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa9b8060550 0x7fa9b8062a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0007fd0 tx=0x7fa9d0007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:38.977+0000 7fa9c5ffb700 1 -- 172.21.15.37:0/2196611370 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa9cc04d790 con 0x7fa9d41537d0 2023-10-06T04:39:39.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.136+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/2196611370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9d4070ee0 con 0x7fa9d41537d0 2023-10-06T04:39:39.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.136+0000 7fa9c5ffb700 1 -- 172.21.15.37:0/2196611370 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9cc050db0 con 0x7fa9d41537d0 2023-10-06T04:39:39.142 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:39:39.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.136+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa9b8060550 msgr2=0x7fa9b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.136+0000 7fa9dc1e9700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa9b8060550 0x7fa9b8062a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0007fd0 tx=0x7fa9d0007d30 comp rx=0 tx=0).stop 2023-10-06T04:39:39.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.136+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/2196611370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9d41537d0 msgr2=0x7fa9d415ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.136+0000 7fa9dc1e9700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9d41537d0 0x7fa9d415ddc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009e20 tx=0x7fa9cc00b040 comp rx=0 tx=0).stop 2023-10-06T04:39:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.136+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/2196611370 shutdown_connections 2023-10-06T04:39:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.136+0000 7fa9dc1e9700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa9b8060550 0x7fa9b8062a00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.136+0000 7fa9dc1e9700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9d4153400 0x7fa9d415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.136+0000 7fa9dc1e9700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9d41537d0 0x7fa9d415ddc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.136+0000 7fa9dc1e9700 1 --2- 172.21.15.37:0/2196611370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9d4069b40 0x7fa9d4168e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.136+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/2196611370 >> 172.21.15.37:0/2196611370 conn(0x7fa9d4067cf0 msgr2=0x7fa9d40ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.140+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/2196611370 shutdown_connections 2023-10-06T04:39:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.140+0000 7fa9dc1e9700 1 -- 172.21.15.37:0/2196611370 wait complete. 2023-10-06T04:39:39.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:39:39.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.260+0000 7fd2be58d700 1 Processor -- start 2023-10-06T04:39:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.260+0000 7fd2be58d700 1 -- start start 2023-10-06T04:39:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.260+0000 7fd2be58d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2b8069b40 0x7fd2b80b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2be58d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b80b5a60 con 0x7fd2b8153400 2023-10-06T04:39:39.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2be58d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b8159950 con 0x7fd2b81537d0 2023-10-06T04:39:39.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2be58d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b815a680 con 0x7fd2b8069b40 2023-10-06T04:39:39.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2b77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2b8069b40 0x7fd2b80b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2b7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd2b8153400 0x7fd2b8069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34278/0 (socket says 172.21.15.37:34278) 2023-10-06T04:39:39.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2b7fff700 1 -- 172.21.15.37:0/2214115556 learned_addr learned my addr 172.21.15.37:0/2214115556 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2b77fe700 1 -- 172.21.15.37:0/2214115556 >> v1:172.21.15.83:6789/0 conn(0x7fd2b81537d0 legacy=0x7fd2b8162c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2b77fe700 1 -- 172.21.15.37:0/2214115556 >> v1:172.21.15.37:6789/0 conn(0x7fd2b8153400 legacy=0x7fd2b8069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2b6ffd700 1 -- 172.21.15.37:0/2214115556 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181321104 0 0) 0x7fd2b80b5a60 con 0x7fd2b8153400 2023-10-06T04:39:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2b77fe700 1 -- 172.21.15.37:0/2214115556 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b80b4e50 con 0x7fd2b8069b40 2023-10-06T04:39:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2b77fe700 1 --2- 172.21.15.37:0/2214115556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b8069b40 0x7fd2b80b41e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0098e0 tx=0x7fd2ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f866e384774d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2b6ffd700 1 -- 172.21.15.37:0/2214115556 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac009e80 con 0x7fd2b8069b40 2023-10-06T04:39:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2b6ffd700 1 -- 172.21.15.37:0/2214115556 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac00b860 con 0x7fd2b8069b40 2023-10-06T04:39:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2b6ffd700 1 -- 172.21.15.37:0/2214115556 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac00bbe0 con 0x7fd2b8069b40 2023-10-06T04:39:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2be58d700 1 -- 172.21.15.37:0/2214115556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b8069b40 msgr2=0x7fd2b80b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2be58d700 1 --2- 172.21.15.37:0/2214115556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b8069b40 0x7fd2b80b41e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0098e0 tx=0x7fd2ac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2be58d700 1 -- 172.21.15.37:0/2214115556 shutdown_connections 2023-10-06T04:39:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2be58d700 1 --2- 172.21.15.37:0/2214115556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b8069b40 0x7fd2b80b41e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2be58d700 1 -- 172.21.15.37:0/2214115556 >> 172.21.15.37:0/2214115556 conn(0x7fd2b8067cf0 msgr2=0x7fd2b80680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2be58d700 1 -- 172.21.15.37:0/2214115556 shutdown_connections 2023-10-06T04:39:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.264+0000 7fd2be58d700 1 -- 172.21.15.37:0/2214115556 wait complete. 2023-10-06T04:39:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2be58d700 1 Processor -- start 2023-10-06T04:39:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2be58d700 1 -- start start 2023-10-06T04:39:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2be58d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8069b40 0x7fd2b81568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2be58d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b8153400 0x7fd2b8157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2be58d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2b81537d0 0x7fd2b8157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2be58d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8156e10 con 0x7fd2b8153400 2023-10-06T04:39:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2be58d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b815d830 con 0x7fd2b8069b40 2023-10-06T04:39:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2be58d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b815db10 con 0x7fd2b81537d0 2023-10-06T04:39:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2b77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b8153400 0x7fd2b8157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2b77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b8153400 0x7fd2b8157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41838/0 (socket says 172.21.15.37:41838) 2023-10-06T04:39:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2b77fe700 1 -- 172.21.15.37:0/1052139491 learned_addr learned my addr 172.21.15.37:0/1052139491 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2b7fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8069b40 0x7fd2b81568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2bcb2a700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2b81537d0 0x7fd2b8157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2b77fe700 1 -- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2b81537d0 msgr2=0x7fd2b8157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2b77fe700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2b81537d0 0x7fd2b8157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2b77fe700 1 -- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8069b40 msgr2=0x7fd2b81568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2b77fe700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8069b40 0x7fd2b81568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2b77fe700 1 -- 172.21.15.37:0/1052139491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac009420 con 0x7fd2b8153400 2023-10-06T04:39:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2b77fe700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b8153400 0x7fd2b8157120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac013000 tx=0x7fd2ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd29ffff700 1 -- 172.21.15.37:0/1052139491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac01f070 con 0x7fd2b8153400 2023-10-06T04:39:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd29ffff700 1 -- 172.21.15.37:0/1052139491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac000c90 con 0x7fd2b8153400 2023-10-06T04:39:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2be58d700 1 -- 172.21.15.37:0/1052139491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b815ddf0 con 0x7fd2b8153400 2023-10-06T04:39:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd29ffff700 1 -- 172.21.15.37:0/1052139491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac025420 con 0x7fd2b8153400 2023-10-06T04:39:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.268+0000 7fd2be58d700 1 -- 172.21.15.37:0/1052139491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b8152050 con 0x7fd2b8153400 2023-10-06T04:39:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.272+0000 7fd2be58d700 1 -- 172.21.15.37:0/1052139491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b8156f80 con 0x7fd2b8153400 2023-10-06T04:39:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.272+0000 7fd29ffff700 1 -- 172.21.15.37:0/1052139491 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd2ac023070 con 0x7fd2b8153400 2023-10-06T04:39:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.272+0000 7fd29ffff700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2a4060550 0x7fd2a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.272+0000 7fd29ffff700 1 -- 172.21.15.37:0/1052139491 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd2ac07e090 con 0x7fd2b8153400 2023-10-06T04:39:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.272+0000 7fd2b7fff700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2a4060550 0x7fd2a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.272+0000 7fd2b7fff700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2a4060550 0x7fd2a4062a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8007fd0 tx=0x7fd2a8007d10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:39.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.280+0000 7fd29ffff700 1 -- 172.21.15.37:0/1052139491 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd2b8156f80 con 0x7fd2b8153400 2023-10-06T04:39:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.440+0000 7fd2be58d700 1 -- 172.21.15.37:0/1052139491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd2b8156f50 con 0x7fd2b8153400 2023-10-06T04:39:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.440+0000 7fd29ffff700 1 -- 172.21.15.37:0/1052139491 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd2ac04e2b0 con 0x7fd2b8153400 2023-10-06T04:39:39.448 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:39:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.444+0000 7fd2be58d700 1 -- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2a4060550 msgr2=0x7fd2a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.444+0000 7fd2be58d700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2a4060550 0x7fd2a4062a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8007fd0 tx=0x7fd2a8007d10 comp rx=0 tx=0).stop 2023-10-06T04:39:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.444+0000 7fd2be58d700 1 -- 172.21.15.37:0/1052139491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b8153400 msgr2=0x7fd2b8157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.444+0000 7fd2be58d700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b8153400 0x7fd2b8157120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac013000 tx=0x7fd2ac017000 comp rx=0 tx=0).stop 2023-10-06T04:39:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.444+0000 7fd2be58d700 1 -- 172.21.15.37:0/1052139491 shutdown_connections 2023-10-06T04:39:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.444+0000 7fd2be58d700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd2a4060550 0x7fd2a4062a00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.444+0000 7fd2be58d700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2b81537d0 0x7fd2b8157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.444+0000 7fd2be58d700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b8153400 0x7fd2b8157120 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.444+0000 7fd2be58d700 1 --2- 172.21.15.37:0/1052139491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8069b40 0x7fd2b81568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.444+0000 7fd2be58d700 1 -- 172.21.15.37:0/1052139491 >> 172.21.15.37:0/1052139491 conn(0x7fd2b8067cf0 msgr2=0x7fd2b8152720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.444+0000 7fd2be58d700 1 -- 172.21.15.37:0/1052139491 shutdown_connections 2023-10-06T04:39:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.444+0000 7fd2be58d700 1 -- 172.21.15.37:0/1052139491 wait complete. 2023-10-06T04:39:39.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.564+0000 7fb2cbfff700 1 Processor -- start 2023-10-06T04:39:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.564+0000 7fb2cbfff700 1 -- start start 2023-10-06T04:39:39.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.564+0000 7fb2cbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb2cc0ad560 0x7fb2cc0ad930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.564+0000 7fb2cbfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2cc0ca810 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.564+0000 7fb2cbfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2cc1570a0 con 0x7fb2cc0caca0 2023-10-06T04:39:39.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.564+0000 7fb2cbfff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2cc0c9c00 con 0x7fb2cc0ad560 2023-10-06T04:39:39.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.564+0000 7fb2ca7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb2cc0cc3f0 0x7fb2cc0c9370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34288/0 (socket says 172.21.15.37:34288) 2023-10-06T04:39:39.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.564+0000 7fb2caffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb2cc0ad560 0x7fb2cc0ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.564+0000 7fb2ca7fc700 1 -- 172.21.15.37:0/1618602085 learned_addr learned my addr 172.21.15.37:0/1618602085 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:39.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2c9ffb700 1 -- 172.21.15.37:0/1618602085 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151747281 0 0) 0x7fb2cc0ca810 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2c9ffb700 1 -- 172.21.15.37:0/1618602085 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2b8003570 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2caffd700 1 -- 172.21.15.37:0/1618602085 >> v1:172.21.15.83:6789/0 conn(0x7fb2cc0caca0 legacy=0x7fb2cc06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2caffd700 1 -- 172.21.15.37:0/1618602085 >> v1:172.21.15.37:6789/0 conn(0x7fb2cc0cc3f0 legacy=0x7fb2cc0c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2caffd700 1 -- 172.21.15.37:0/1618602085 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc0c9ee0 con 0x7fb2cc0ad560 2023-10-06T04:39:39.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2caffd700 1 --2- 172.21.15.37:0/1618602085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2cc0ad560 0x7fb2cc0ad930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0098e0 tx=0x7fb2bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92867cdc2cc70d6f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:39.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2c9ffb700 1 -- 172.21.15.37:0/1618602085 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc00b640 con 0x7fb2cc0ad560 2023-10-06T04:39:39.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2c9ffb700 1 -- 172.21.15.37:0/1618602085 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc00b7a0 con 0x7fb2cc0ad560 2023-10-06T04:39:39.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2c9ffb700 1 -- 172.21.15.37:0/1618602085 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc00bb40 con 0x7fb2cc0ad560 2023-10-06T04:39:39.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2cbfff700 1 -- 172.21.15.37:0/1618602085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2cc0ad560 msgr2=0x7fb2cc0ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2cbfff700 1 --2- 172.21.15.37:0/1618602085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2cc0ad560 0x7fb2cc0ad930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0098e0 tx=0x7fb2bc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2cbfff700 1 -- 172.21.15.37:0/1618602085 shutdown_connections 2023-10-06T04:39:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2cbfff700 1 --2- 172.21.15.37:0/1618602085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2cc0ad560 0x7fb2cc0ad930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2cbfff700 1 -- 172.21.15.37:0/1618602085 >> 172.21.15.37:0/1618602085 conn(0x7fb2cc068780 msgr2=0x7fb2cc0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2cbfff700 1 -- 172.21.15.37:0/1618602085 shutdown_connections 2023-10-06T04:39:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.568+0000 7fb2cbfff700 1 -- 172.21.15.37:0/1618602085 wait complete. 2023-10-06T04:39:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cbfff700 1 Processor -- start 2023-10-06T04:39:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cbfff700 1 -- start start 2023-10-06T04:39:39.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2cc0ad560 0x7fb2cc0c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2cc0caca0 0x7fb2cc146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2cc0cc3f0 0x7fb2cc155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cbfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc169050 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cbfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0c51b0 con 0x7fb2cc0ad560 2023-10-06T04:39:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc168160 con 0x7fb2cc0caca0 2023-10-06T04:39:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2cc0cc3f0 0x7fb2cc155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2cc0cc3f0 0x7fb2cc155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41852/0 (socket says 172.21.15.37:41852) 2023-10-06T04:39:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cb7fe700 1 -- 172.21.15.37:0/2976249850 learned_addr learned my addr 172.21.15.37:0/2976249850 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2caffd700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2cc0ad560 0x7fb2cc0c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2ca7fc700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2cc0caca0 0x7fb2cc146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cb7fe700 1 -- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2cc0caca0 msgr2=0x7fb2cc146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cb7fe700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2cc0caca0 0x7fb2cc146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cb7fe700 1 -- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2cc0ad560 msgr2=0x7fb2cc0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cb7fe700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2cc0ad560 0x7fb2cc0c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cb7fe700 1 -- 172.21.15.37:0/2976249850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc009420 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cb7fe700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2cc0cc3f0 0x7fb2cc155ef0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c560 tx=0x7fb2c4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2c2ffd700 1 -- 172.21.15.37:0/2976249850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4011590 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2c2ffd700 1 -- 172.21.15.37:0/2976249850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c40116f0 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cbfff700 1 -- 172.21.15.37:0/2976249850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2cc168440 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2c2ffd700 1 -- 172.21.15.37:0/2976249850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4011ab0 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.572+0000 7fb2cbfff700 1 -- 172.21.15.37:0/2976249850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2cc168a00 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.576+0000 7fb2c2ffd700 1 -- 172.21.15.37:0/2976249850 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb2c401b3b0 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.576+0000 7fb2cbfff700 1 -- 172.21.15.37:0/2976249850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2cc1691c0 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.576+0000 7fb2c2ffd700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb2ac060550 0x7fb2ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.576+0000 7fb2c2ffd700 1 -- 172.21.15.37:0/2976249850 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb2c407bfc0 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.576+0000 7fb2caffd700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb2ac060550 0x7fb2ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.576+0000 7fb2caffd700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb2ac060550 0x7fb2ac062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0093f0 tx=0x7fb2bc017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.580+0000 7fb2c2ffd700 1 -- 172.21.15.37:0/2976249850 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb2c404c160 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.780+0000 7fb2cbfff700 1 -- 172.21.15.37:0/2976249850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2cc0708a0 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.784+0000 7fb2c2ffd700 1 -- 172.21.15.37:0/2976249850 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7fb2c404f780 con 0x7fb2cc0cc3f0 2023-10-06T04:39:39.789 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:39.789 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3463038764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3463038764},{"type":"v1","addr":"172.21.15.83:6835","nonce":3463038764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3802233690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3802233690},{"type":"v1","addr":"172.21.15.37:6833","nonce":3802233690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1262727325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1262727325},{"type":"v1","addr":"172.21.15.83:6837","nonce":1262727325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:10.126951+0000","modified":"2023-10-06T04:39:29.669009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1742476643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1742476643},{"type":"v1","addr":"172.21.15.37:6835","nonce":1742476643}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:39:39.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.784+0000 7fb2cbfff700 1 -- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb2ac060550 msgr2=0x7fb2ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.784+0000 7fb2cbfff700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb2ac060550 0x7fb2ac062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0093f0 tx=0x7fb2bc017000 comp rx=0 tx=0).stop 2023-10-06T04:39:39.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.784+0000 7fb2cbfff700 1 -- 172.21.15.37:0/2976249850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2cc0cc3f0 msgr2=0x7fb2cc155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.784+0000 7fb2cbfff700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2cc0cc3f0 0x7fb2cc155ef0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c560 tx=0x7fb2c4007ef0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.784+0000 7fb2cbfff700 1 -- 172.21.15.37:0/2976249850 shutdown_connections 2023-10-06T04:39:39.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.784+0000 7fb2cbfff700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb2ac060550 0x7fb2ac062a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.788+0000 7fb2cbfff700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2cc0cc3f0 0x7fb2cc155ef0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.788+0000 7fb2cbfff700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2cc0caca0 0x7fb2cc146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.788+0000 7fb2cbfff700 1 --2- 172.21.15.37:0/2976249850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2cc0ad560 0x7fb2cc0c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.788+0000 7fb2cbfff700 1 -- 172.21.15.37:0/2976249850 >> 172.21.15.37:0/2976249850 conn(0x7fb2cc068780 msgr2=0x7fb2cc069050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:39.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.788+0000 7fb2cbfff700 1 -- 172.21.15.37:0/2976249850 shutdown_connections 2023-10-06T04:39:39.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.788+0000 7fb2cbfff700 1 -- 172.21.15.37:0/2976249850 wait complete. 2023-10-06T04:39:39.794 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:39:39.809 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:39.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.908+0000 7ff38413e700 1 Processor -- start 2023-10-06T04:39:39.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.908+0000 7ff38413e700 1 -- start start 2023-10-06T04:39:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.908+0000 7ff38413e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff37c0cbd50 0x7ff37c0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.908+0000 7ff38413e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff37c0c9820 0x7ff37c0c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.908+0000 7ff38413e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37c06dd70 con 0x7ff37c06e200 2023-10-06T04:39:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.908+0000 7ff38413e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37c0add50 con 0x7ff37c0cbd50 2023-10-06T04:39:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.908+0000 7ff38413e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0ae030 con 0x7ff37c0c9820 2023-10-06T04:39:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.908+0000 7ff3816d9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff37c0c9820 0x7ff37c0c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.908+0000 7ff3816d9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff37c0c9820 0x7ff37c0c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:58052/0 (socket says 172.21.15.37:58052) 2023-10-06T04:39:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.908+0000 7ff3816d9700 1 -- 172.21.15.37:0/1442631793 learned_addr learned my addr 172.21.15.37:0/1442631793 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.908+0000 7ff381eda700 1 --2- 172.21.15.37:0/1442631793 >> v2:172.21.15.83:3300/0 conn(0x7ff37c0cbd50 0x7ff37c0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.908+0000 7ff3816d9700 1 -- 172.21.15.37:0/1442631793 >> v2:172.21.15.83:3300/0 conn(0x7ff37c0cbd50 msgr2=0x7ff37c0cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff3816d9700 1 --2- 172.21.15.37:0/1442631793 >> v2:172.21.15.83:3300/0 conn(0x7ff37c0cbd50 0x7ff37c0cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff3816d9700 1 -- 172.21.15.37:0/1442631793 >> v1:172.21.15.83:6789/0 conn(0x7ff37c06e200 legacy=0x7ff37c06e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff3816d9700 1 -- 172.21.15.37:0/1442631793 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c0ae310 con 0x7ff37c0c9820 2023-10-06T04:39:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff380ed8700 1 -- 172.21.15.37:0/1442631793 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747992598 0 0) 0x7ff37c06dd70 con 0x7ff37c06e200 2023-10-06T04:39:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff3816d9700 1 --2- 172.21.15.37:0/1442631793 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff37c0c9820 0x7ff37c0c9c70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff3700099b0 tx=0x7ff370009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b110f452dbf686b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff380ed8700 1 -- 172.21.15.37:0/1442631793 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370009ea0 con 0x7ff37c0c9820 2023-10-06T04:39:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff380ed8700 1 -- 172.21.15.37:0/1442631793 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37000b860 con 0x7ff37c0c9820 2023-10-06T04:39:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff380ed8700 1 -- 172.21.15.37:0/1442631793 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37000bc00 con 0x7ff37c0c9820 2023-10-06T04:39:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff38413e700 1 -- 172.21.15.37:0/1442631793 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff37c0c9820 msgr2=0x7ff37c0c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff38413e700 1 --2- 172.21.15.37:0/1442631793 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff37c0c9820 0x7ff37c0c9c70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff3700099b0 tx=0x7ff370009250 comp rx=0 tx=0).stop 2023-10-06T04:39:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff38413e700 1 -- 172.21.15.37:0/1442631793 shutdown_connections 2023-10-06T04:39:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff38413e700 1 --2- 172.21.15.37:0/1442631793 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff37c0c9820 0x7ff37c0c9c70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff38413e700 1 --2- 172.21.15.37:0/1442631793 >> v2:172.21.15.83:3300/0 conn(0x7ff37c0cbd50 0x7ff37c0cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff38413e700 1 -- 172.21.15.37:0/1442631793 >> 172.21.15.37:0/1442631793 conn(0x7ff37c0667b0 msgr2=0x7ff37c066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff38413e700 1 -- 172.21.15.37:0/1442631793 shutdown_connections 2023-10-06T04:39:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff38413e700 1 -- 172.21.15.37:0/1442631793 wait complete. 2023-10-06T04:39:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff38413e700 1 Processor -- start 2023-10-06T04:39:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.912+0000 7ff38413e700 1 -- start start 2023-10-06T04:39:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff38413e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37c06e200 0x7ff37c146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff38413e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff37c0c9820 0x7ff37c163530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff38413e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff37c0cbd50 0x7ff37c15db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff38413e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0c1720 con 0x7ff37c0c9820 2023-10-06T04:39:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff38413e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c1469a0 con 0x7ff37c06e200 2023-10-06T04:39:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff38413e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c162490 con 0x7ff37c0cbd50 2023-10-06T04:39:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff3816d9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff37c0c9820 0x7ff37c163530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff3816d9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff37c0c9820 0x7ff37c163530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41864/0 (socket says 172.21.15.37:41864) 2023-10-06T04:39:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff3816d9700 1 -- 172.21.15.37:0/2678669819 learned_addr learned my addr 172.21.15.37:0/2678669819 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff381eda700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37c06e200 0x7ff37c146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff3826db700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff37c0cbd50 0x7ff37c15db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff3816d9700 1 -- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff37c0cbd50 msgr2=0x7ff37c15db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff3816d9700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff37c0cbd50 0x7ff37c15db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff3816d9700 1 -- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37c06e200 msgr2=0x7ff37c146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff3816d9700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37c06e200 0x7ff37c146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff3816d9700 1 -- 172.21.15.37:0/2678669819 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3700094f0 con 0x7ff37c0c9820 2023-10-06T04:39:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff381eda700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37c06e200 0x7ff37c146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff3816d9700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff37c0c9820 0x7ff37c163530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0ae170 tx=0x7ff370017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff36dffb700 1 -- 172.21.15.37:0/2678669819 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37000bbe0 con 0x7ff37c0c9820 2023-10-06T04:39:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff36dffb700 1 -- 172.21.15.37:0/2678669819 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff370011420 con 0x7ff37c0c9820 2023-10-06T04:39:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff38413e700 1 -- 172.21.15.37:0/2678669819 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c162770 con 0x7ff37c0c9820 2023-10-06T04:39:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff36dffb700 1 -- 172.21.15.37:0/2678669819 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700117e0 con 0x7ff37c0c9820 2023-10-06T04:39:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.916+0000 7ff38413e700 1 -- 172.21.15.37:0/2678669819 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37c162d30 con 0x7ff37c0c9820 2023-10-06T04:39:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.920+0000 7ff38413e700 1 -- 172.21.15.37:0/2678669819 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37c070ee0 con 0x7ff37c0c9820 2023-10-06T04:39:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.920+0000 7ff36dffb700 1 -- 172.21.15.37:0/2678669819 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff370011bd0 con 0x7ff37c0c9820 2023-10-06T04:39:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.920+0000 7ff36dffb700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff360060580 0x7ff360062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.920+0000 7ff36dffb700 1 -- 172.21.15.37:0/2678669819 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff37007e810 con 0x7ff37c0c9820 2023-10-06T04:39:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.920+0000 7ff381eda700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff360060580 0x7ff360062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.920+0000 7ff381eda700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff360060580 0x7ff360062a30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff37c160f80 tx=0x7ff378008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:39.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:39.924+0000 7ff36dffb700 1 -- 172.21.15.37:0/2678669819 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff37004e9b0 con 0x7ff37c0c9820 2023-10-06T04:39:40.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.084+0000 7ff38413e700 1 -- 172.21.15.37:0/2678669819 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff37c06da00 con 0x7ff37c0c9820 2023-10-06T04:39:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.088+0000 7ff36dffb700 1 -- 172.21.15.37:0/2678669819 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18659 (secure 0 0 0) 0x7ff370015090 con 0x7ff37c0c9820 2023-10-06T04:39:40.094 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:40.094 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:15.209829+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.088+0000 7ff38413e700 1 -- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff360060580 msgr2=0x7ff360062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.088+0000 7ff38413e700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff360060580 0x7ff360062a30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff37c160f80 tx=0x7ff378008040 comp rx=0 tx=0).stop 2023-10-06T04:39:40.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.088+0000 7ff38413e700 1 -- 172.21.15.37:0/2678669819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff37c0c9820 msgr2=0x7ff37c163530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.088+0000 7ff38413e700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff37c0c9820 0x7ff37c163530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0ae170 tx=0x7ff370017000 comp rx=0 tx=0).stop 2023-10-06T04:39:40.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.088+0000 7ff38413e700 1 -- 172.21.15.37:0/2678669819 shutdown_connections 2023-10-06T04:39:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.088+0000 7ff38413e700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff360060580 0x7ff360062a30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.088+0000 7ff38413e700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff37c0cbd50 0x7ff37c15db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.088+0000 7ff38413e700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff37c0c9820 0x7ff37c163530 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.088+0000 7ff38413e700 1 --2- 172.21.15.37:0/2678669819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37c06e200 0x7ff37c146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.088+0000 7ff38413e700 1 -- 172.21.15.37:0/2678669819 >> 172.21.15.37:0/2678669819 conn(0x7ff37c0667b0 msgr2=0x7ff37c0b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.092+0000 7ff38413e700 1 -- 172.21.15.37:0/2678669819 shutdown_connections 2023-10-06T04:39:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.092+0000 7ff38413e700 1 -- 172.21.15.37:0/2678669819 wait complete. 2023-10-06T04:39:40.109 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:40.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.208+0000 7f5e01deb700 1 Processor -- start 2023-10-06T04:39:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.208+0000 7f5e01deb700 1 -- start start 2023-10-06T04:39:40.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.208+0000 7f5e01deb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5dfc0ac840 0x7f5dfc0acc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.208+0000 7f5e01deb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5dfc0667b0 0x7f5dfc158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.208+0000 7f5e01deb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc0b1df0 con 0x7f5dfc158d40 2023-10-06T04:39:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.208+0000 7f5e01deb700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc0b0950 con 0x7f5dfc0ac840 2023-10-06T04:39:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.208+0000 7f5e01deb700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc066c30 con 0x7f5dfc0667b0 2023-10-06T04:39:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.208+0000 7f5dfb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5dfc0ac840 0x7f5dfc0acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.208+0000 7f5dfb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5dfc0ac840 0x7f5dfc0acc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41866/0 (socket says 172.21.15.37:41866) 2023-10-06T04:39:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5dfb7fe700 1 -- 172.21.15.37:0/182228008 learned_addr learned my addr 172.21.15.37:0/182228008 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5dfaffd700 1 --2- 172.21.15.37:0/182228008 >> v2:172.21.15.83:3300/0 conn(0x7f5dfc0667b0 0x7f5dfc158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5dfb7fe700 1 -- 172.21.15.37:0/182228008 >> v2:172.21.15.83:3300/0 conn(0x7f5dfc0667b0 msgr2=0x7f5dfc158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5dfb7fe700 1 --2- 172.21.15.37:0/182228008 >> v2:172.21.15.83:3300/0 conn(0x7f5dfc0667b0 0x7f5dfc158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5dfb7fe700 1 -- 172.21.15.37:0/182228008 >> v1:172.21.15.83:6789/0 conn(0x7f5dfc158d40 legacy=0x7f5dfc15c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5dfb7fe700 1 -- 172.21.15.37:0/182228008 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc0afd40 con 0x7f5dfc0ac840 2023-10-06T04:39:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5dfb7fe700 1 --2- 172.21.15.37:0/182228008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dfc0ac840 0x7f5dfc0acc10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc06cfb0 tx=0x7f5df0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9ee50961257193 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5dfa7fc700 1 -- 172.21.15.37:0/182228008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0009e70 con 0x7f5dfc0ac840 2023-10-06T04:39:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5dfa7fc700 1 -- 172.21.15.37:0/182228008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df000b860 con 0x7f5dfc0ac840 2023-10-06T04:39:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5dfa7fc700 1 -- 172.21.15.37:0/182228008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df000bc00 con 0x7f5dfc0ac840 2023-10-06T04:39:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5e01deb700 1 -- 172.21.15.37:0/182228008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dfc0ac840 msgr2=0x7f5dfc0acc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5e01deb700 1 --2- 172.21.15.37:0/182228008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dfc0ac840 0x7f5dfc0acc10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc06cfb0 tx=0x7f5df0009250 comp rx=0 tx=0).stop 2023-10-06T04:39:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5e01deb700 1 -- 172.21.15.37:0/182228008 shutdown_connections 2023-10-06T04:39:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5e01deb700 1 --2- 172.21.15.37:0/182228008 >> v2:172.21.15.83:3300/0 conn(0x7f5dfc0667b0 0x7f5dfc158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5e01deb700 1 --2- 172.21.15.37:0/182228008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dfc0ac840 0x7f5dfc0acc10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5e01deb700 1 -- 172.21.15.37:0/182228008 >> 172.21.15.37:0/182228008 conn(0x7f5dfc0ccc60 msgr2=0x7f5dfc06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5e01deb700 1 -- 172.21.15.37:0/182228008 shutdown_connections 2023-10-06T04:39:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.212+0000 7f5e01deb700 1 -- 172.21.15.37:0/182228008 wait complete. 2023-10-06T04:39:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5e01deb700 1 Processor -- start 2023-10-06T04:39:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5e01deb700 1 -- start start 2023-10-06T04:39:40.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5e01deb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dfc0667b0 0x7f5dfc1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5e01deb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dfc0ac840 0x7f5dfc15e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5e01deb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dfc158d40 0x7f5dfc13fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5e01deb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc15ded0 con 0x7f5dfc0667b0 2023-10-06T04:39:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5e01deb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc15d2c0 con 0x7f5dfc158d40 2023-10-06T04:39:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5e01deb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc15d5a0 con 0x7f5dfc0ac840 2023-10-06T04:39:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5dfb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dfc0667b0 0x7f5dfc1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5dfb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dfc0667b0 0x7f5dfc1511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41876/0 (socket says 172.21.15.37:41876) 2023-10-06T04:39:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5dfb7fe700 1 -- 172.21.15.37:0/400695642 learned_addr learned my addr 172.21.15.37:0/400695642 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5dfaffd700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dfc0ac840 0x7f5dfc15e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5dfbfff700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dfc158d40 0x7f5dfc13fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5dfb7fe700 1 -- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dfc0ac840 msgr2=0x7f5dfc15e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5dfb7fe700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dfc0ac840 0x7f5dfc15e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5dfb7fe700 1 -- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dfc158d40 msgr2=0x7f5dfc13fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5dfb7fe700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dfc158d40 0x7f5dfc13fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5dfb7fe700 1 -- 172.21.15.37:0/400695642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00094f0 con 0x7f5dfc0667b0 2023-10-06T04:39:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5dfb7fe700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dfc0667b0 0x7f5dfc1511b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc06da10 tx=0x7f5df0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5de37fe700 1 -- 172.21.15.37:0/400695642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df000bbe0 con 0x7f5dfc0667b0 2023-10-06T04:39:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5de37fe700 1 -- 172.21.15.37:0/400695642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df0011420 con 0x7f5dfc0667b0 2023-10-06T04:39:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5e01deb700 1 -- 172.21.15.37:0/400695642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc15d880 con 0x7f5dfc0667b0 2023-10-06T04:39:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5de37fe700 1 -- 172.21.15.37:0/400695642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00117c0 con 0x7f5dfc0667b0 2023-10-06T04:39:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.216+0000 7f5e01deb700 1 -- 172.21.15.37:0/400695642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc1402b0 con 0x7f5dfc0667b0 2023-10-06T04:39:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.220+0000 7f5e01deb700 1 -- 172.21.15.37:0/400695642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dfc070ee0 con 0x7f5dfc0667b0 2023-10-06T04:39:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.220+0000 7f5de37fe700 1 -- 172.21.15.37:0/400695642 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5df0011bb0 con 0x7f5dfc0667b0 2023-10-06T04:39:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.220+0000 7f5de37fe700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5de8060580 0x7f5de8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.220+0000 7f5de37fe700 1 -- 172.21.15.37:0/400695642 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5df007e080 con 0x7f5dfc0667b0 2023-10-06T04:39:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.220+0000 7f5dfaffd700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5de8060580 0x7f5de8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.224+0000 7f5dfaffd700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5de8060580 0x7f5de8062a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc15c080 tx=0x7f5dec0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.232+0000 7f5de37fe700 1 -- 172.21.15.37:0/400695642 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5df004e220 con 0x7f5dfc0667b0 2023-10-06T04:39:40.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.428+0000 7f5e01deb700 1 -- 172.21.15.37:0/400695642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5dfc0b0020 con 0x7f5dfc0667b0 2023-10-06T04:39:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.428+0000 7f5de37fe700 1 -- 172.21.15.37:0/400695642 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f5df0011e60 con 0x7f5dfc0667b0 2023-10-06T04:39:40.435 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:40.435 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3463038764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3463038764},{"type":"v1","addr":"172.21.15.83:6835","nonce":3463038764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3802233690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3802233690},{"type":"v1","addr":"172.21.15.37:6833","nonce":3802233690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1262727325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1262727325},{"type":"v1","addr":"172.21.15.83:6837","nonce":1262727325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:10.126951+0000","modified":"2023-10-06T04:39:29.669009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1742476643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1742476643},{"type":"v1","addr":"172.21.15.37:6835","nonce":1742476643}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:39:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.432+0000 7f5e01deb700 1 -- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5de8060580 msgr2=0x7f5de8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.432+0000 7f5e01deb700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5de8060580 0x7f5de8062a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc15c080 tx=0x7f5dec0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.432+0000 7f5e01deb700 1 -- 172.21.15.37:0/400695642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dfc0667b0 msgr2=0x7f5dfc1511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.432+0000 7f5e01deb700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dfc0667b0 0x7f5dfc1511b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc06da10 tx=0x7f5df0017000 comp rx=0 tx=0).stop 2023-10-06T04:39:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.432+0000 7f5e01deb700 1 -- 172.21.15.37:0/400695642 shutdown_connections 2023-10-06T04:39:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.432+0000 7f5e01deb700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5de8060580 0x7f5de8062a30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.432+0000 7f5e01deb700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dfc158d40 0x7f5dfc13fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.432+0000 7f5e01deb700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dfc0ac840 0x7f5dfc15e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.432+0000 7f5e01deb700 1 --2- 172.21.15.37:0/400695642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dfc0667b0 0x7f5dfc1511b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.432+0000 7f5e01deb700 1 -- 172.21.15.37:0/400695642 >> 172.21.15.37:0/400695642 conn(0x7f5dfc0ccc60 msgr2=0x7f5dfc06bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.432+0000 7f5e01deb700 1 -- 172.21.15.37:0/400695642 shutdown_connections 2023-10-06T04:39:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.432+0000 7f5e01deb700 1 -- 172.21.15.37:0/400695642 wait complete. 2023-10-06T04:39:40.439 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:39:40.852 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:39:10.126951+0000', 'modified': '2023-10-06T04:39:29.669009+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/1742476643', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 1742476643}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 1742476643}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:39:40.852 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:39:40.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T04:39:40.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.964+0000 7fb7ecc8c700 1 Processor -- start 2023-10-06T04:39:40.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.964+0000 7fb7ecc8c700 1 -- start start 2023-10-06T04:39:40.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.964+0000 7fb7ecc8c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb7e80ca380 0x7fb7e8160170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.964+0000 7fb7ecc8c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e80c79e0 con 0x7fb7e80c6960 2023-10-06T04:39:40.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.964+0000 7fb7ecc8c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e80c1610 con 0x7fb7e8155110 2023-10-06T04:39:40.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.964+0000 7fb7ecc8c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e80c2450 con 0x7fb7e80ca380 2023-10-06T04:39:40.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.964+0000 7fb7e6ffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb7e80c6960 0x7fb7e806d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34294/0 (socket says 172.21.15.37:34294) 2023-10-06T04:39:40.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7e6ffd700 1 -- 172.21.15.37:0/3091484123 learned_addr learned my addr 172.21.15.37:0/3091484123 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:40.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7e7fff700 1 --2- 172.21.15.37:0/3091484123 >> v2:172.21.15.83:3300/0 conn(0x7fb7e80ca380 0x7fb7e8160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7e67fc700 1 -- 172.21.15.37:0/3091484123 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246413467 0 0) 0x7fb7e80c79e0 con 0x7fb7e80c6960 2023-10-06T04:39:40.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7e67fc700 1 -- 172.21.15.37:0/3091484123 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7d4003570 con 0x7fb7e80c6960 2023-10-06T04:39:40.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7e7fff700 1 -- 172.21.15.37:0/3091484123 >> v1:172.21.15.83:6789/0 conn(0x7fb7e8155110 legacy=0x7fb7e80c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7e7fff700 1 -- 172.21.15.37:0/3091484123 >> v1:172.21.15.37:6789/0 conn(0x7fb7e80c6960 legacy=0x7fb7e806d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7e7fff700 1 -- 172.21.15.37:0/3091484123 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e80c6dd0 con 0x7fb7e80ca380 2023-10-06T04:39:40.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7e7fff700 1 --2- 172.21.15.37:0/3091484123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7e80ca380 0x7fb7e8160170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00098e0 tx=0x7fb7e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=849cf866287e530e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:40.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7e67fc700 1 -- 172.21.15.37:0/3091484123 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000b640 con 0x7fb7e80ca380 2023-10-06T04:39:40.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7e67fc700 1 -- 172.21.15.37:0/3091484123 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e000b7a0 con 0x7fb7e80ca380 2023-10-06T04:39:40.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7e67fc700 1 -- 172.21.15.37:0/3091484123 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000bb40 con 0x7fb7e80ca380 2023-10-06T04:39:40.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3091484123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7e80ca380 msgr2=0x7fb7e8160170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7ecc8c700 1 --2- 172.21.15.37:0/3091484123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7e80ca380 0x7fb7e8160170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00098e0 tx=0x7fb7e00091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3091484123 shutdown_connections 2023-10-06T04:39:40.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7ecc8c700 1 --2- 172.21.15.37:0/3091484123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7e80ca380 0x7fb7e8160170 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3091484123 >> 172.21.15.37:0/3091484123 conn(0x7fb7e8068780 msgr2=0x7fb7e80cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:40.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3091484123 shutdown_connections 2023-10-06T04:39:40.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.968+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3091484123 wait complete. 2023-10-06T04:39:40.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.972+0000 7fb7ecc8c700 1 Processor -- start 2023-10-06T04:39:40.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.972+0000 7fb7ecc8c700 1 -- start start 2023-10-06T04:39:40.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7ecc8c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7e80c6960 0x7fb7e813c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7ecc8c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7e80ca380 0x7fb7e80c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7ecc8c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e8155110 0x7fb7e80c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7ecc8c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8148b80 con 0x7fb7e8155110 2023-10-06T04:39:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7ecc8c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80af4e0 con 0x7fb7e80ca380 2023-10-06T04:39:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7ecc8c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8148250 con 0x7fb7e80c6960 2023-10-06T04:39:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e8155110 0x7fb7e80c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e8155110 0x7fb7e80c4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41890/0 (socket says 172.21.15.37:41890) 2023-10-06T04:39:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7e7fff700 1 -- 172.21.15.37:0/3699650886 learned_addr learned my addr 172.21.15.37:0/3699650886 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7e6ffd700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7e80ca380 0x7fb7e80c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7e80c6960 0x7fb7e813c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7e7fff700 1 -- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7e80c6960 msgr2=0x7fb7e813c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7e7fff700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7e80c6960 0x7fb7e813c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7e7fff700 1 -- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7e80ca380 msgr2=0x7fb7e80c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7e7fff700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7e80ca380 0x7fb7e80c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7e7fff700 1 -- 172.21.15.37:0/3699650886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0009420 con 0x7fb7e8155110 2023-10-06T04:39:40.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7e7fff700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e8155110 0x7fb7e80c4ee0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80c5d90 tx=0x7fb7e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:40.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7df7fe700 1 -- 172.21.15.37:0/3699650886 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000bb20 con 0x7fb7e8155110 2023-10-06T04:39:40.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7df7fe700 1 -- 172.21.15.37:0/3699650886 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e0011420 con 0x7fb7e8155110 2023-10-06T04:39:40.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3699650886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e8148530 con 0x7fb7e8155110 2023-10-06T04:39:40.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7df7fe700 1 -- 172.21.15.37:0/3699650886 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00117a0 con 0x7fb7e8155110 2023-10-06T04:39:40.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.976+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3699650886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e813c920 con 0x7fb7e8155110 2023-10-06T04:39:40.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.980+0000 7fb7df7fe700 1 -- 172.21.15.37:0/3699650886 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb7e0011b10 con 0x7fb7e8155110 2023-10-06T04:39:40.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.980+0000 7fb7df7fe700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7c8060550 0x7fb7c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.980+0000 7fb7df7fe700 1 -- 172.21.15.37:0/3699650886 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb7e007e7a0 con 0x7fb7e8155110 2023-10-06T04:39:40.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.980+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7c8060550 0x7fb7c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.980+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7c8060550 0x7fb7c8062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80039e0 tx=0x7fb7d8007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:40.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.980+0000 7fb7f0197740 1 Processor -- start 2023-10-06T04:39:40.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.980+0000 7fb7f0197740 1 -- start start 2023-10-06T04:39:40.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7f0197740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375ae0 0x25f2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7f0197740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375710 0x25f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7f0197740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x25f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7f0197740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x2520f30 con 0x23c0790 2023-10-06T04:39:40.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7f0197740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x251ced0 con 0x2375710 2023-10-06T04:39:40.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7f0197740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x24e30b0 con 0x2375ae0 2023-10-06T04:39:40.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x25f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7e77fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375ae0 0x25f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7e6ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375710 0x25f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7e77fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375ae0 0x25f2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:58090/0 (socket says 172.21.15.37:58090) 2023-10-06T04:39:40.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7e77fe700 1 -- 172.21.15.37:0/3262344060 learned_addr learned my addr 172.21.15.37:0/3262344060 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:40.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7e77fe700 1 -- 172.21.15.37:0/3262344060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375710 msgr2=0x25f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:40.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/3262344060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375710 0x25f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7e77fe700 1 -- 172.21.15.37:0/3262344060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 msgr2=0x25f30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:40.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/3262344060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x25f30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7e77fe700 1 -- 172.21.15.37:0/3262344060 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23c19e0 con 0x2375ae0 2023-10-06T04:39:40.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/3262344060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375ae0 0x25f2630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80028f0 tx=0x7fb7d8015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9968459833c3907c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:40.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7dcff9700 1 -- 172.21.15.37:0/3262344060 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8014450 con 0x2375ae0 2023-10-06T04:39:40.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7dcff9700 1 -- 172.21.15.37:0/3262344060 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d80145b0 con 0x2375ae0 2023-10-06T04:39:40.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7dcff9700 1 -- 172.21.15.37:0/3262344060 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8014930 con 0x2375ae0 2023-10-06T04:39:40.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7f0197740 1 -- 172.21.15.37:0/3262344060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375ae0 msgr2=0x25f2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.984+0000 7fb7f0197740 1 --2- 172.21.15.37:0/3262344060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375ae0 0x25f2630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80028f0 tx=0x7fb7d8015000 comp rx=0 tx=0).stop 2023-10-06T04:39:40.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 -- 172.21.15.37:0/3262344060 shutdown_connections 2023-10-06T04:39:40.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 --2- 172.21.15.37:0/3262344060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375710 0x25f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 --2- 172.21.15.37:0/3262344060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x25f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 --2- 172.21.15.37:0/3262344060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375ae0 0x25f2630 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 -- 172.21.15.37:0/3262344060 >> 172.21.15.37:0/3262344060 conn(0x2375eb0 msgr2=0x25af060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 -- 172.21.15.37:0/3262344060 shutdown_connections 2023-10-06T04:39:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 -- 172.21.15.37:0/3262344060 wait complete. 2023-10-06T04:39:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 -- start start 2023-10-06T04:39:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 Processor -- start 2023-10-06T04:39:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375710 0x25f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375ae0 0x25f7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x25acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x24e2d50 con 0x23c0790 2023-10-06T04:39:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x24bb970 con 0x2375710 2023-10-06T04:39:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x2459430 con 0x2375ae0 2023-10-06T04:39:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 10 client.0 _ll_register_callbacks cb 0x24bfb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:39:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x25acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x25acc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41902/0 (socket says 172.21.15.37:41902) 2023-10-06T04:39:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7e7fff700 1 -- 172.21.15.37:0/2744732259 learned_addr learned my addr 172.21.15.37:0/2744732259 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7e6ffd700 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375ae0 0x25f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375710 0x25f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7e7fff700 1 -- 172.21.15.37:0/2744732259 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375ae0 msgr2=0x25f7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:41.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7e7fff700 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375ae0 0x25f7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7e7fff700 1 -- 172.21.15.37:0/2744732259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375710 msgr2=0x25f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7e7fff700 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375710 0x25f6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7e7fff700 1 -- 172.21.15.37:0/2744732259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e80c1610 con 0x23c0790 2023-10-06T04:39:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7e7fff700 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x25acc60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb7e007c800 tx=0x7fb7e007c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22d3d9fe7a01854 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:39:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7c5ffb700 1 -- 172.21.15.37:0/2744732259 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000fe00 con 0x23c0790 2023-10-06T04:39:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7c5ffb700 1 -- 172.21.15.37:0/2744732259 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb7e0050900 con 0x23c0790 2023-10-06T04:39:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 -- 172.21.15.37:0/2744732259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x24bbcc0 con 0x23c0790 2023-10-06T04:39:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7c5ffb700 1 -- 172.21.15.37:0/2744732259 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7e0052a10 con 0x23c0790 2023-10-06T04:39:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 10 client.4791 fetch_fsmap learned FSMap version 8 2023-10-06T04:39:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7f0197740 1 -- 172.21.15.37:0/2744732259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x24eb370 con 0x23c0790 2023-10-06T04:39:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.988+0000 7fb7c5ffb700 1 -- 172.21.15.37:0/2744732259 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x24bbcc0 con 0x23c0790 2023-10-06T04:39:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7c5ffb700 1 -- 172.21.15.37:0/2744732259 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fb7e0051a50 con 0x23c0790 2023-10-06T04:39:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 10 client.4791 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T04:39:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 10 client.4791 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:39:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 20 client.4791 populate_metadata read hostname 'smithi037' 2023-10-06T04:39:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x25ffdd0 0x26021b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 4 client.4791 mds_command: new command op to 4294 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:39:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 -- 172.21.15.37:0/2744732259 --> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x24bf3e0 con 0x25ffdd0 2023-10-06T04:39:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x25ffdd0 0x26021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7c5ffb700 10 client.4791 ms_handle_connect on v2:172.21.15.37:6834/1742476643 2023-10-06T04:39:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x25ffdd0 0x26021b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37fc403143c49f89 server_cookie=5b399b70d93325d6 in_seq=0 out_seq=0 2023-10-06T04:39:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7c5ffb700 1 -- 172.21.15.37:0/2744732259 <== mds.0 v2:172.21.15.37:6834/1742476643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x24bf3e0 con 0x25ffdd0 2023-10-06T04:39:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7c5ffb700 10 client.4791 handle_command_reply: tid=0 2023-10-06T04:39:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 client.4791 shutdown 2023-10-06T04:39:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 -- 172.21.15.37:0/2744732259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 msgr2=0x25acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x25acc60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb7e007c800 tx=0x7fb7e007c730 comp rx=0 tx=0).stop 2023-10-06T04:39:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 -- 172.21.15.37:0/2744732259 shutdown_connections 2023-10-06T04:39:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x25ffdd0 0x26021b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x25acc60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375ae0 0x25f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7c5ffb700 0 client.4791 ms_handle_reset on v2:172.21.15.37:6834/1742476643 2023-10-06T04:39:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 --2- 172.21.15.37:0/2744732259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375710 0x25f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 -- 172.21.15.37:0/2744732259 >> 172.21.15.37:0/2744732259 conn(0x2375eb0 msgr2=0x25d61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 -- 172.21.15.37:0/2744732259 shutdown_connections 2023-10-06T04:39:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 1 -- 172.21.15.37:0/2744732259 wait complete. 2023-10-06T04:39:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:40.992+0000 7fb7f0197740 20 client.4791 trim_cache size 0 max 16384 2023-10-06T04:39:41.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7f0197740 1 Processor -- start 2023-10-06T04:39:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7f0197740 1 -- start start 2023-10-06T04:39:41.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7f0197740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375710 0x26503e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7f0197740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375ae0 0x2650920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7f0197740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x2650e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7f0197740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x23f2650 con 0x23c0790 2023-10-06T04:39:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7f0197740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x24f0040 con 0x2375ae0 2023-10-06T04:39:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7f0197740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x24f1610 con 0x2375710 2023-10-06T04:39:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x2650e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x2650e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41904/0 (socket says 172.21.15.37:41904) 2023-10-06T04:39:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7e7fff700 1 -- 172.21.15.37:0/788479665 learned_addr learned my addr 172.21.15.37:0/788479665 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7e6ffd700 1 --2- 172.21.15.37:0/788479665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375ae0 0x2650920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/788479665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375710 0x26503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7e7fff700 1 -- 172.21.15.37:0/788479665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375710 msgr2=0x26503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7e7fff700 1 --2- 172.21.15.37:0/788479665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375710 0x26503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7e7fff700 1 -- 172.21.15.37:0/788479665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375ae0 msgr2=0x2650920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7e7fff700 1 --2- 172.21.15.37:0/788479665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375ae0 0x2650920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7e7fff700 1 -- 172.21.15.37:0/788479665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e80cc130 con 0x23c0790 2023-10-06T04:39:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.016+0000 7fb7e6ffd700 1 --2- 172.21.15.37:0/788479665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375ae0 0x2650920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7e7fff700 1 --2- 172.21.15.37:0/788479665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x2650e60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0008010 tx=0x7fb7e0064000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b9d1bb7e0c49e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7dd7fa700 1 -- 172.21.15.37:0/788479665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00557f0 con 0x23c0790 2023-10-06T04:39:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7dd7fa700 1 -- 172.21.15.37:0/788479665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e00520a0 con 0x23c0790 2023-10-06T04:39:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7dd7fa700 1 -- 172.21.15.37:0/788479665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000fe00 con 0x23c0790 2023-10-06T04:39:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7f0197740 1 -- 172.21.15.37:0/788479665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 msgr2=0x2650e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7f0197740 1 --2- 172.21.15.37:0/788479665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x2650e60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0008010 tx=0x7fb7e0064000 comp rx=0 tx=0).stop 2023-10-06T04:39:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7f0197740 1 -- 172.21.15.37:0/788479665 shutdown_connections 2023-10-06T04:39:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7f0197740 1 --2- 172.21.15.37:0/788479665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375ae0 0x2650920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7f0197740 1 --2- 172.21.15.37:0/788479665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x23c0790 0x2650e60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7f0197740 1 --2- 172.21.15.37:0/788479665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x2375710 0x26503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7f0197740 1 -- 172.21.15.37:0/788479665 >> 172.21.15.37:0/788479665 conn(0x2375eb0 msgr2=0x25f5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7f0197740 1 -- 172.21.15.37:0/788479665 shutdown_connections 2023-10-06T04:39:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7f0197740 1 -- 172.21.15.37:0/788479665 wait complete. 2023-10-06T04:39:41.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7f0197740 1 -- start start 2023-10-06T04:39:41.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.020+0000 7fb7f0197740 1 Processor -- start 2023-10-06T04:39:41.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2375710 0x25d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375ae0 0x25d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x23c0790 0x25d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x251fe70 con 0x2375710 2023-10-06T04:39:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x2573270 con 0x2375ae0 2023-10-06T04:39:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x24ebc70 con 0x23c0790 2023-10-06T04:39:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2375710 0x25d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 10 client.0 _ll_register_callbacks cb 0x24e8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:39:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7e6ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375ae0 0x25d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2375710 0x25d00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41906/0 (socket says 172.21.15.37:41906) 2023-10-06T04:39:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7e77fe700 1 -- 172.21.15.37:0/1729467849 learned_addr learned my addr 172.21.15.37:0/1729467849 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7e7fff700 1 --2- 172.21.15.37:0/1729467849 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x23c0790 0x25d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7e77fe700 1 -- 172.21.15.37:0/1729467849 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x23c0790 msgr2=0x25d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/1729467849 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x23c0790 0x25d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7e77fe700 1 -- 172.21.15.37:0/1729467849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375ae0 msgr2=0x25d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/1729467849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375ae0 0x25d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7e77fe700 1 -- 172.21.15.37:0/1729467849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d4003570 con 0x2375710 2023-10-06T04:39:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7e77fe700 1 --2- 172.21.15.37:0/1729467849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2375710 0x25d00c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8023040 tx=0x7fb7d8033250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48338ca63fe0eaa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:39:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7c5ffb700 1 -- 172.21.15.37:0/1729467849 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8031070 con 0x2375710 2023-10-06T04:39:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7c5ffb700 1 -- 172.21.15.37:0/1729467849 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb7d801c040 con 0x2375710 2023-10-06T04:39:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 1 -- 172.21.15.37:0/1729467849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb7d80145b0 con 0x2375710 2023-10-06T04:39:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7c5ffb700 1 -- 172.21.15.37:0/1729467849 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7d8036680 con 0x2375710 2023-10-06T04:39:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 10 client.4797 fetch_fsmap learned FSMap version 8 2023-10-06T04:39:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 1 -- 172.21.15.37:0/1729467849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7fb7e80c1610 con 0x2375710 2023-10-06T04:39:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7c5ffb700 1 -- 172.21.15.37:0/1729467849 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d80145b0 con 0x2375710 2023-10-06T04:39:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7c5ffb700 1 -- 172.21.15.37:0/1729467849 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fb7d80367e0 con 0x2375710 2023-10-06T04:39:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 10 client.4797 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T04:39:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 10 client.4797 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:39:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 20 client.4797 populate_metadata read hostname 'smithi037' 2023-10-06T04:39:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 1 --2- 172.21.15.37:0/1729467849 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x25d1080 0x25d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 4 client.4797 mds_command: new command op to 4294 tid=0[{"prefix": "status"}] 2023-10-06T04:39:41.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7f0197740 1 -- 172.21.15.37:0/1729467849 --> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] -- command(tid 0: {"prefix": "status"}) v1 -- 0x24f1410 con 0x25d1080 2023-10-06T04:39:41.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7e6ffd700 1 --2- 172.21.15.37:0/1729467849 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x25d1080 0x25d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.024+0000 7fb7c5ffb700 10 client.4797 ms_handle_connect on v2:172.21.15.37:6834/1742476643 2023-10-06T04:39:41.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7e6ffd700 1 --2- 172.21.15.37:0/1729467849 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x25d1080 0x25d1450 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd07fc8cba8df6d9 server_cookie=8c69249964217c71 in_seq=0 out_seq=0 2023-10-06T04:39:41.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7c5ffb700 1 -- 172.21.15.37:0/1729467849 <== mds.0 v2:172.21.15.37:6834/1742476643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x24f1410 con 0x25d1080 2023-10-06T04:39:41.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7c5ffb700 10 client.4797 handle_command_reply: tid=0 2023-10-06T04:39:41.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7f0197740 1 client.4797 shutdown 2023-10-06T04:39:41.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7f0197740 1 -- 172.21.15.37:0/1729467849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2375710 msgr2=0x25d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7f0197740 1 --2- 172.21.15.37:0/1729467849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2375710 0x25d00c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8023040 tx=0x7fb7d8033250 comp rx=0 tx=0).stop 2023-10-06T04:39:41.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7f0197740 1 -- 172.21.15.37:0/1729467849 shutdown_connections 2023-10-06T04:39:41.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7f0197740 1 --2- 172.21.15.37:0/1729467849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x2375ae0 0x25d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7f0197740 1 --2- 172.21.15.37:0/1729467849 >> [v2:172.21.15.37:6834/1742476643,v1:172.21.15.37:6835/1742476643] conn(0x25d1080 0x25d1450 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7c5ffb700 0 client.4797 ms_handle_reset on v2:172.21.15.37:6834/1742476643 2023-10-06T04:39:41.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7f0197740 1 --2- 172.21.15.37:0/1729467849 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x23c0790 0x25d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7f0197740 1 --2- 172.21.15.37:0/1729467849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2375710 0x25d00c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7f0197740 1 -- 172.21.15.37:0/1729467849 >> 172.21.15.37:0/1729467849 conn(0x2375eb0 msgr2=0x25ae460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7f0197740 1 -- 172.21.15.37:0/1729467849 shutdown_connections 2023-10-06T04:39:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7f0197740 1 -- 172.21.15.37:0/1729467849 wait complete. 2023-10-06T04:39:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7f0197740 20 client.4797 trim_cache size 0 max 16384 2023-10-06T04:39:41.039 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:39:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "77bb67cc-15eb-432c-9ac1-b724f40102d2", 2023-10-06T04:39:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T04:39:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4294, 2023-10-06T04:39:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T04:39:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T04:39:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T04:39:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 30.260642797999999, 2023-10-06T04:39:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 8, 2023-10-06T04:39:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 28, 2023-10-06T04:39:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 28, 2023-10-06T04:39:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 35.297374146000003 2023-10-06T04:39:41.040 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:39:41.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7c8060550 msgr2=0x7fb7c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7ecc8c700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7c8060550 0x7fb7c8062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80039e0 tx=0x7fb7d8007ec0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3699650886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e8155110 msgr2=0x7fb7e80c4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7ecc8c700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e8155110 0x7fb7e80c4ee0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80c5d90 tx=0x7fb7e0017000 comp rx=0 tx=0).stop 2023-10-06T04:39:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3699650886 shutdown_connections 2023-10-06T04:39:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7ecc8c700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb7c8060550 0x7fb7c8062a00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7ecc8c700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7e80ca380 0x7fb7e80c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7ecc8c700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e8155110 0x7fb7e80c4ee0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7ecc8c700 1 --2- 172.21.15.37:0/3699650886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7e80c6960 0x7fb7e813c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3699650886 >> 172.21.15.37:0/3699650886 conn(0x7fb7e8068780 msgr2=0x7fb7e80cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3699650886 shutdown_connections 2023-10-06T04:39:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.028+0000 7fb7ecc8c700 1 -- 172.21.15.37:0/3699650886 wait complete. 2023-10-06T04:39:41.051 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-06T04:39:41.062 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-06T04:39:41.062 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T04:39:41.062 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-06T04:39:41.062 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-06T04:39:41.063 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-06T04:39:41.063 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-06T04:39:41.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.064 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T04:39:41.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.072 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T04:39:41.090 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2023-10-06T04:39:41.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:39:41.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.091 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:39:41.099 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-06T04:39:41.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T04:39:41.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-10-06T04:39:41.230 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-06T04:39:41.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:39:41.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd23d99d700 1 Processor -- start 2023-10-06T04:39:41.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd23d99d700 1 -- start start 2023-10-06T04:39:41.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd23d99d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2380cc120 0x7fd23806e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd23d99d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23806dd70 con 0x7fd23806e740 2023-10-06T04:39:41.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd23d99d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23806ebc0 con 0x7fd2380cbd50 2023-10-06T04:39:41.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd23d99d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380add50 con 0x7fd2380cc120 2023-10-06T04:39:41.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd2377fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd23806e740 0x7fd23815cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34302/0 (socket says 172.21.15.37:34302) 2023-10-06T04:39:41.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd2377fe700 1 -- 172.21.15.37:0/706435262 learned_addr learned my addr 172.21.15.37:0/706435262 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:41.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd2367fc700 1 --2- 172.21.15.37:0/706435262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2380cc120 0x7fd23806e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd235ffb700 1 -- 172.21.15.37:0/706435262 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371977513 0 0) 0x7fd23806dd70 con 0x7fd23806e740 2023-10-06T04:39:41.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd235ffb700 1 -- 172.21.15.37:0/706435262 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd224003570 con 0x7fd23806e740 2023-10-06T04:39:41.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd2367fc700 1 -- 172.21.15.37:0/706435262 >> v1:172.21.15.83:6789/0 conn(0x7fd2380cbd50 legacy=0x7fd2380c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd2367fc700 1 -- 172.21.15.37:0/706435262 >> v1:172.21.15.37:6789/0 conn(0x7fd23806e740 legacy=0x7fd23815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd235ffb700 1 -- 172.21.15.37:0/706435262 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833028308 0 0) 0x7fd23806ebc0 con 0x7fd2380cbd50 2023-10-06T04:39:41.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd2367fc700 1 -- 172.21.15.37:0/706435262 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2380ae030 con 0x7fd2380cc120 2023-10-06T04:39:41.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd2367fc700 1 --2- 172.21.15.37:0/706435262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2380cc120 0x7fd23806e200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd220009910 tx=0x7fd2200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3c2cafce4318dd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:41.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.332+0000 7fd235ffb700 1 -- 172.21.15.37:0/706435262 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000b680 con 0x7fd2380cc120 2023-10-06T04:39:41.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd235ffb700 1 -- 172.21.15.37:0/706435262 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000b7e0 con 0x7fd2380cc120 2023-10-06T04:39:41.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd235ffb700 1 -- 172.21.15.37:0/706435262 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000bba0 con 0x7fd2380cc120 2023-10-06T04:39:41.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd23d99d700 1 -- 172.21.15.37:0/706435262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2380cc120 msgr2=0x7fd23806e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd23d99d700 1 --2- 172.21.15.37:0/706435262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2380cc120 0x7fd23806e200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd220009910 tx=0x7fd2200091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd23d99d700 1 -- 172.21.15.37:0/706435262 shutdown_connections 2023-10-06T04:39:41.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd23d99d700 1 --2- 172.21.15.37:0/706435262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2380cc120 0x7fd23806e200 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd23d99d700 1 -- 172.21.15.37:0/706435262 >> 172.21.15.37:0/706435262 conn(0x7fd2380667b0 msgr2=0x7fd238066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:41.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd23d99d700 1 -- 172.21.15.37:0/706435262 shutdown_connections 2023-10-06T04:39:41.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd23d99d700 1 -- 172.21.15.37:0/706435262 wait complete. 2023-10-06T04:39:41.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd23d99d700 1 Processor -- start 2023-10-06T04:39:41.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd23d99d700 1 -- start start 2023-10-06T04:39:41.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd23d99d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23806e740 0x7fd238160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd23d99d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380cbd50 0x7fd2380c2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.336+0000 7fd23d99d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2380cc120 0x7fd2380c2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd23d99d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380c1350 con 0x7fd2380cbd50 2023-10-06T04:39:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd23d99d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380c0780 con 0x7fd2380cc120 2023-10-06T04:39:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd23d99d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380c17e0 con 0x7fd23806e740 2023-10-06T04:39:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd2367fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380cbd50 0x7fd2380c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd2367fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380cbd50 0x7fd2380c2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41918/0 (socket says 172.21.15.37:41918) 2023-10-06T04:39:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd2367fc700 1 -- 172.21.15.37:0/2306939987 learned_addr learned my addr 172.21.15.37:0/2306939987 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd236ffd700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23806e740 0x7fd238160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd2377fe700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2380cc120 0x7fd2380c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd2367fc700 1 -- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23806e740 msgr2=0x7fd238160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd2367fc700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23806e740 0x7fd238160060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd2367fc700 1 -- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2380cc120 msgr2=0x7fd2380c2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd2367fc700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2380cc120 0x7fd2380c2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd2367fc700 1 -- 172.21.15.37:0/2306939987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220009420 con 0x7fd2380cbd50 2023-10-06T04:39:41.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd236ffd700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23806e740 0x7fd238160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:41.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd2367fc700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380cbd50 0x7fd2380c2400 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd2380cc840 tx=0x7fd220017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:41.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd22effd700 1 -- 172.21.15.37:0/2306939987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220000cc0 con 0x7fd2380cbd50 2023-10-06T04:39:41.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd22effd700 1 -- 172.21.15.37:0/2306939987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000bb60 con 0x7fd2380cbd50 2023-10-06T04:39:41.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd23d99d700 1 -- 172.21.15.37:0/2306939987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2380c0a20 con 0x7fd2380cbd50 2023-10-06T04:39:41.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd22effd700 1 -- 172.21.15.37:0/2306939987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220027680 con 0x7fd2380cbd50 2023-10-06T04:39:41.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd23d99d700 1 -- 172.21.15.37:0/2306939987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2380c0fe0 con 0x7fd2380cbd50 2023-10-06T04:39:41.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd23d99d700 1 -- 172.21.15.37:0/2306939987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2380c14c0 con 0x7fd2380cbd50 2023-10-06T04:39:41.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.340+0000 7fd22effd700 1 -- 172.21.15.37:0/2306939987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd2200279f0 con 0x7fd2380cbd50 2023-10-06T04:39:41.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.344+0000 7fd22effd700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd218060550 0x7fd218062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.344+0000 7fd22effd700 1 -- 172.21.15.37:0/2306939987 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd22007eb80 con 0x7fd2380cbd50 2023-10-06T04:39:41.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.344+0000 7fd236ffd700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd218060550 0x7fd218062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.344+0000 7fd236ffd700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd218060550 0x7fd218062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd2280011e0 tx=0x7fd228009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.348+0000 7fd22effd700 1 -- 172.21.15.37:0/2306939987 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd22004ed20 con 0x7fd2380cbd50 2023-10-06T04:39:41.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 -- 172.21.15.37:0/2306939987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd238070ee0 con 0x7fd2380cbd50 2023-10-06T04:39:41.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd22effd700 1 -- 172.21.15.37:0/2306939987 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd220015070 con 0x7fd2380cbd50 2023-10-06T04:39:41.557 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:39:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 -- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd218060550 msgr2=0x7fd218062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd218060550 0x7fd218062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd2280011e0 tx=0x7fd228009040 comp rx=0 tx=0).stop 2023-10-06T04:39:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 -- 172.21.15.37:0/2306939987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380cbd50 msgr2=0x7fd2380c2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380cbd50 0x7fd2380c2400 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd2380cc840 tx=0x7fd220017000 comp rx=0 tx=0).stop 2023-10-06T04:39:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 -- 172.21.15.37:0/2306939987 shutdown_connections 2023-10-06T04:39:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd218060550 0x7fd218062a00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2380cc120 0x7fd2380c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380cbd50 0x7fd2380c2400 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 --2- 172.21.15.37:0/2306939987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23806e740 0x7fd238160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 -- 172.21.15.37:0/2306939987 >> 172.21.15.37:0/2306939987 conn(0x7fd2380667b0 msgr2=0x7fd2380b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:41.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 -- 172.21.15.37:0/2306939987 shutdown_connections 2023-10-06T04:39:41.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:41.552+0000 7fd23d99d700 1 -- 172.21.15.37:0/2306939987 wait complete. 2023-10-06T04:39:41.571 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:39:41.572 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:39:41.572 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T04:39:41.572 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:39:41.572 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:39:41.572 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:39:41.572 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:39:41.572 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:39:41.572 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:39:41.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.572 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T04:39:41.577 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:41.578 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:41.578 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:39:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T04:39:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42566sec preferred_lft 42566sec 2023-10-06T04:39:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T04:39:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:41.579 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:41.579 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:41.579 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T04:39:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:e0:81:f4:d2 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T04:39:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:41.580 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:39:41.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.580 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:41.580 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:41.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:39:41.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2023-10-06T04:39:41.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2023-10-06T04:39:41.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:39:41.580 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:41.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.625 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:39:41.636 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T04:39:41.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.637 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T04:39:41.689 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T04:39:41.689 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:39:41.689 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T04:39:41.689 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T04:39:41.689 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T04:39:41.689 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:39:41.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.690 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:41.690 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:41.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:39:41.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:39:41.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:39:41.690 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:41.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.730 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:39:41.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.735 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-10-06T04:39:41.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.741 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:41.741 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:41.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:39:41.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T04:39:41.741 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:41.771 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T04:39:41.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.771 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:41.771 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:41.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T04:39:41.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:39:41.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T04:39:41.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T04:39:41.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T04:39:41.772 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:41.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.874 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:41.875 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:41.875 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T04:39:41.875 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:39:41.875 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:41.903 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T04:39:41.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:41.904 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:39:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:39:41.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:41.912 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:39:41.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:39:41.976 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:41.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:41.991 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:41.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:41.992 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:39:41.998 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T04:39:41.998 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T04:39:42.043 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:39:42.059 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:42.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:42.069 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:42.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:42.069 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:39:42.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T04:39:42.124+0000 7f5101e9f380 -1 init, newargv = 0x559d1bd7de40 newargc=15 2023-10-06T04:39:42.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[40531]: starting ceph client 2023-10-06T04:39:42.140 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[40531]: starting fuse 2023-10-06T04:39:42.889 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:39:42.892 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:39:43.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:39:43.238 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:43.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:43.298 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:43.299 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:43.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:43.300 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:39:43.311 INFO:teuthology.orchestra.run.smithi037.stdout:52 2023-10-06T04:39:43.311 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T04:39:43.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:39:43.311 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T04:39:43.311 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T04:39:43.311 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T04:39:43.311 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T04:39:43.312 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T04:39:43.313 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T04:39:43.313 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T04:39:43.313 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T04:39:43.313 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T04:39:43.313 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T04:39:43.313 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:39:43.313 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T04:39:43.313 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T04:39:43.439 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.40531.asok 2023-10-06T04:39:43.623 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40531.asok 2023-10-06T04:39:43.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:43.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40531.asok status 2023-10-06T04:39:43.718 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:39:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T04:39:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T04:39:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T04:39:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T04:39:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T04:39:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T04:39:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "40531", 2023-10-06T04:39:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T04:39:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T04:39:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T04:39:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4798, 2023-10-06T04:39:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T04:39:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T04:39:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T04:39:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 4798 2023-10-06T04:39:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T04:39:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T04:39:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2023-10-06T04:39:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 270544307 2023-10-06T04:39:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:39:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T04:39:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T04:39:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2023-10-06T04:39:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 270544307 2023-10-06T04:39:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.4798 172.21.15.37:0/270544307", 2023-10-06T04:39:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "172.21.15.37:0/270544307", 2023-10-06T04:39:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T04:39:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 8, 2023-10-06T04:39:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 28, 2023-10-06T04:39:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T04:39:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T04:39:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T04:39:43.722 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:39:43.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:39:43.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f601d700 1 Processor -- start 2023-10-06T04:39:43.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f601d700 1 -- start start 2023-10-06T04:39:43.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f601d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f79f00aa8d0 0x7f79f00c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f601d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79f00cc1a0 0x7f79f00c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f601d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f00ca610 con 0x7f79f00c77f0 2023-10-06T04:39:43.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f601d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f00c9a00 con 0x7f79f00cc1a0 2023-10-06T04:39:43.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f601d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f00c9ce0 con 0x7f79f00aa8d0 2023-10-06T04:39:43.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f481a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79f00cc1a0 0x7f79f00c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f481a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79f00cc1a0 0x7f79f00c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41928/0 (socket says 172.21.15.37:41928) 2023-10-06T04:39:43.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f481a700 1 -- 172.21.15.37:0/1413244428 learned_addr learned my addr 172.21.15.37:0/1413244428 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f501b700 1 --2- 172.21.15.37:0/1413244428 >> v2:172.21.15.83:3300/0 conn(0x7f79f00aa8d0 0x7f79f00c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f481a700 1 -- 172.21.15.37:0/1413244428 >> v2:172.21.15.83:3300/0 conn(0x7f79f00aa8d0 msgr2=0x7f79f00c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f481a700 1 --2- 172.21.15.37:0/1413244428 >> v2:172.21.15.83:3300/0 conn(0x7f79f00aa8d0 0x7f79f00c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f481a700 1 -- 172.21.15.37:0/1413244428 >> v1:172.21.15.83:6789/0 conn(0x7f79f00c77f0 legacy=0x7f79f0159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f481a700 1 -- 172.21.15.37:0/1413244428 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f00c9fc0 con 0x7f79f00cc1a0 2023-10-06T04:39:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.832+0000 7f79f501b700 1 --2- 172.21.15.37:0/1413244428 >> v2:172.21.15.83:3300/0 conn(0x7f79f00aa8d0 0x7f79f00c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79f481a700 1 --2- 172.21.15.37:0/1413244428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f00cc1a0 0x7f79f00c72b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f79f0063720 tx=0x7f79e000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3271f82966efaf8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79e7fff700 1 -- 172.21.15.37:0/1413244428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000dc10 con 0x7f79f00cc1a0 2023-10-06T04:39:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79e7fff700 1 -- 172.21.15.37:0/1413244428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e000dd70 con 0x7f79f00cc1a0 2023-10-06T04:39:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79e7fff700 1 -- 172.21.15.37:0/1413244428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e00106c0 con 0x7f79f00cc1a0 2023-10-06T04:39:43.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79f601d700 1 -- 172.21.15.37:0/1413244428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f00cc1a0 msgr2=0x7f79f00c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79f601d700 1 --2- 172.21.15.37:0/1413244428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f00cc1a0 0x7f79f00c72b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f79f0063720 tx=0x7f79e000b4f0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79f601d700 1 -- 172.21.15.37:0/1413244428 shutdown_connections 2023-10-06T04:39:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79f601d700 1 --2- 172.21.15.37:0/1413244428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f00cc1a0 0x7f79f00c72b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79f601d700 1 --2- 172.21.15.37:0/1413244428 >> v2:172.21.15.83:3300/0 conn(0x7f79f00aa8d0 0x7f79f00c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79f601d700 1 -- 172.21.15.37:0/1413244428 >> 172.21.15.37:0/1413244428 conn(0x7f79f0068780 msgr2=0x7f79f00cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79f601d700 1 -- 172.21.15.37:0/1413244428 shutdown_connections 2023-10-06T04:39:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79f601d700 1 -- 172.21.15.37:0/1413244428 wait complete. 2023-10-06T04:39:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79f601d700 1 Processor -- start 2023-10-06T04:39:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.836+0000 7f79f601d700 1 -- start start 2023-10-06T04:39:43.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f601d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f00aa8d0 0x7f79f0144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f601d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00c77f0 0x7f79f0142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f601d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00cc1a0 0x7f79f016c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f601d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0147f40 con 0x7f79f00aa8d0 2023-10-06T04:39:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f601d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f01438a0 con 0x7f79f00c77f0 2023-10-06T04:39:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f601d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0145420 con 0x7f79f00cc1a0 2023-10-06T04:39:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f501b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f00aa8d0 0x7f79f0144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f501b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f00aa8d0 0x7f79f0144ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41944/0 (socket says 172.21.15.37:41944) 2023-10-06T04:39:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f501b700 1 -- 172.21.15.37:0/2297889513 learned_addr learned my addr 172.21.15.37:0/2297889513 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f581c700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00cc1a0 0x7f79f016c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f481a700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00c77f0 0x7f79f0142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f501b700 1 -- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00cc1a0 msgr2=0x7f79f016c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f501b700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00cc1a0 0x7f79f016c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f501b700 1 -- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00c77f0 msgr2=0x7f79f0142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f501b700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00c77f0 0x7f79f0142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f501b700 1 -- 172.21.15.37:0/2297889513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e000b790 con 0x7f79f00aa8d0 2023-10-06T04:39:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f501b700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f00aa8d0 0x7f79f0144ee0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00c880 tx=0x7f79ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79e57fa700 1 -- 172.21.15.37:0/2297889513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec011600 con 0x7f79f00aa8d0 2023-10-06T04:39:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79e57fa700 1 -- 172.21.15.37:0/2297889513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec011760 con 0x7f79f00aa8d0 2023-10-06T04:39:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f601d700 1 -- 172.21.15.37:0/2297889513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f0142c90 con 0x7f79f00aa8d0 2023-10-06T04:39:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79e57fa700 1 -- 172.21.15.37:0/2297889513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec011b00 con 0x7f79f00aa8d0 2023-10-06T04:39:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.840+0000 7f79f601d700 1 -- 172.21.15.37:0/2297889513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f01432d0 con 0x7f79f00aa8d0 2023-10-06T04:39:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.844+0000 7f79f601d700 1 -- 172.21.15.37:0/2297889513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f00708a0 con 0x7f79f00aa8d0 2023-10-06T04:39:43.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.844+0000 7f79e57fa700 1 -- 172.21.15.37:0/2297889513 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f79ec018350 con 0x7f79f00aa8d0 2023-10-06T04:39:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.844+0000 7f79e57fa700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f79d4060550 0x7f79d4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.844+0000 7f79e57fa700 1 -- 172.21.15.37:0/2297889513 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f79ec07ca50 con 0x7f79f00aa8d0 2023-10-06T04:39:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.844+0000 7f79f481a700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f79d4060550 0x7f79d4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.844+0000 7f79f481a700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f79d4060550 0x7f79d4062a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f79f0063720 tx=0x7f79e001a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:43.852+0000 7f79e57fa700 1 -- 172.21.15.37:0/2297889513 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f79ec050680 con 0x7f79f00aa8d0 2023-10-06T04:39:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.052+0000 7f79f601d700 1 -- 172.21.15.37:0/2297889513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f79f01429a0 con 0x7f79f00aa8d0 2023-10-06T04:39:44.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.052+0000 7f79e57fa700 1 -- 172.21.15.37:0/2297889513 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f79ec050210 con 0x7f79f00aa8d0 2023-10-06T04:39:44.058 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:39:44.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.052+0000 7f79f601d700 1 -- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f79d4060550 msgr2=0x7f79d4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.052+0000 7f79f601d700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f79d4060550 0x7f79d4062a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f79f0063720 tx=0x7f79e001a000 comp rx=0 tx=0).stop 2023-10-06T04:39:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.052+0000 7f79f601d700 1 -- 172.21.15.37:0/2297889513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f00aa8d0 msgr2=0x7f79f0144ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.052+0000 7f79f601d700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f00aa8d0 0x7f79f0144ee0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00c880 tx=0x7f79ec008040 comp rx=0 tx=0).stop 2023-10-06T04:39:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.052+0000 7f79f601d700 1 -- 172.21.15.37:0/2297889513 shutdown_connections 2023-10-06T04:39:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.052+0000 7f79f601d700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f79d4060550 0x7f79d4062a00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.052+0000 7f79f601d700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00c77f0 0x7f79f0142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.052+0000 7f79f601d700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00cc1a0 0x7f79f016c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.052+0000 7f79f601d700 1 --2- 172.21.15.37:0/2297889513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f00aa8d0 0x7f79f0144ee0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.052+0000 7f79f601d700 1 -- 172.21.15.37:0/2297889513 >> 172.21.15.37:0/2297889513 conn(0x7f79f0068780 msgr2=0x7f79f00a9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.056+0000 7f79f601d700 1 -- 172.21.15.37:0/2297889513 shutdown_connections 2023-10-06T04:39:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:44.056+0000 7f79f601d700 1 -- 172.21.15.37:0/2297889513 wait complete. 2023-10-06T04:39:44.071 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:39:44.072 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:39:44.072 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T04:39:44.072 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T04:39:44.072 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T04:39:44.072 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:39:44.072 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:39:44.072 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:39:44.072 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:39:44.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:44.072 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T04:39:44.078 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.078 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42564sec preferred_lft 42564sec 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T04:39:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:e0:81:f4:d2 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T04:39:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.080 INFO:teuthology.orchestra.run.smithi037.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:39:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:7a:01:84:5a:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:39:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::f0f6:45ff:fe62:bcd0/64 scope link 2023-10-06T04:39:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.080 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:39:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:7a:01:84:5a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:39:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a47a:1ff:fe84:5afc/64 scope link 2023-10-06T04:39:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:44.081 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:39:44.093 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T04:39:44.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:44.095 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T04:39:44.103 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T04:39:44.103 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:39:44.103 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T04:39:44.103 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T04:39:44.103 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T04:39:44.103 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:39:44.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:44.104 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:44.104 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:44.104 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:39:44.104 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:39:44.104 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:39:44.104 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:44.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:44.185 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:39:44.190 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:39:44.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:44.191 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-10-06T04:39:44.197 INFO:teuthology.orchestra.run.smithi037.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T04:39:44.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:44.198 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:44.198 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:44.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:39:44.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T04:39:44.198 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:44.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:44.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:39:44.287 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.288 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:39:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 16:10:be:1e:df:45 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:39:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:39:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::1410:beff:fe1e:df45/64 scope link 2023-10-06T04:39:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:44.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:39:44.302 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.303 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:39:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 16:10:be:1e:df:45 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:39:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:39:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::1410:beff:fe1e:df45/64 scope link 2023-10-06T04:39:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:44.304 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T04:39:44.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:44.304 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:44.304 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:44.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T04:39:44.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:39:44.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T04:39:44.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T04:39:44.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T04:39:44.305 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:44.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:44.362 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:39:44.362 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:39:44.362 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.1 up 2023-10-06T04:39:44.362 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:39:44.362 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:39:44.387 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-06T04:39:44.387 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:44.387 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T04:39:44.392 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:39:44.393 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:44.393 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:39:44.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:39:44.413 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:44.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:44.425 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:44.426 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:44.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:44.427 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:39:44.432 INFO:teuthology.orchestra.run.smithi037.stdout:52 2023-10-06T04:39:44.432 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-10-06T04:39:44.432 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-06T04:39:44.474 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:39:44.492 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:44.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:44.506 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:44.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:44.507 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:39:44.512 INFO:teuthology.orchestra.run.smithi037.stdout:52 2023-10-06T04:39:44.557 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi037.stderr:2023-10-06T04:39:44.552+0000 7f44c7553380 -1 init, newargv = 0x56272443bc60 newargc=15 2023-10-06T04:39:44.558 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi037.stderr:ceph-fuse[40675]: starting ceph client 2023-10-06T04:39:44.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi037.stderr:ceph-fuse[40675]: starting fuse 2023-10-06T04:39:45.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:39:45.633 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:45.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:45.692 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:45.692 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:45.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:45.693 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:39:45.700 INFO:teuthology.orchestra.run.smithi037.stdout:52 2023-10-06T04:39:45.700 INFO:teuthology.orchestra.run.smithi037.stdout:53 2023-10-06T04:39:45.701 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-10-06T04:39:45.701 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:39:45.701 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T04:39:45.701 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T04:39:45.701 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T04:39:45.701 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T04:39:45.701 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:39:45.701 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T04:39:45.701 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T04:39:45.702 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T04:39:45.703 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T04:39:45.703 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T04:39:45.703 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T04:39:45.703 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:39:45.703 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.2")) 2023-10-06T04:39:45.703 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T04:39:45.785 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.2.40675.asok 2023-10-06T04:39:45.972 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.40675.asok 2023-10-06T04:39:45.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:45.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.40675.asok status 2023-10-06T04:39:46.071 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:39:46.072 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T04:39:46.072 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T04:39:46.072 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T04:39:46.072 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "2", 2023-10-06T04:39:46.072 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T04:39:46.072 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-06T04:39:46.072 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "40675", 2023-10-06T04:39:46.072 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T04:39:46.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T04:39:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T04:39:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4821, 2023-10-06T04:39:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T04:39:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T04:39:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T04:39:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 4821 2023-10-06T04:39:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T04:39:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T04:39:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.2:0", 2023-10-06T04:39:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3949769579 2023-10-06T04:39:46.074 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:39:46.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:46.074 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T04:39:46.074 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T04:39:46.074 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.2:0", 2023-10-06T04:39:46.074 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3949769579 2023-10-06T04:39:46.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:39:46.074 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.4821 192.168.0.2:0/3949769579", 2023-10-06T04:39:46.074 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.2:0/3949769579", 2023-10-06T04:39:46.074 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T04:39:46.074 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 8, 2023-10-06T04:39:46.074 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 28, 2023-10-06T04:39:46.075 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T04:39:46.075 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T04:39:46.075 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T04:39:46.075 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:39:46.081 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:39:46.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f756a92d700 1 Processor -- start 2023-10-06T04:39:46.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f756a92d700 1 -- start start 2023-10-06T04:39:46.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f756a92d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7564154660 0x7f75640caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f756a92d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f756406e880 0x7f75640cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f756a92d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75640b1040 con 0x7f7564154a30 2023-10-06T04:39:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f756a92d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75640caf90 con 0x7f7564154660 2023-10-06T04:39:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f756a92d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75641582c0 con 0x7f756406e880 2023-10-06T04:39:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f7568eca700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7564154a30 0x7f756406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34310/0 (socket says 172.21.15.37:34310) 2023-10-06T04:39:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f7568eca700 1 -- 172.21.15.37:0/3071328797 learned_addr learned my addr 172.21.15.37:0/3071328797 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f75637fe700 1 --2- 172.21.15.37:0/3071328797 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f756406e880 0x7f75640cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f7563fff700 1 --2- 172.21.15.37:0/3071328797 >> v2:172.21.15.83:3300/0 conn(0x7f7564154660 0x7f75640caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f7562ffd700 1 -- 172.21.15.37:0/3071328797 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280245703 0 0) 0x7f75640b1040 con 0x7f7564154a30 2023-10-06T04:39:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f7562ffd700 1 -- 172.21.15.37:0/3071328797 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7544003570 con 0x7f7564154a30 2023-10-06T04:39:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f75637fe700 1 -- 172.21.15.37:0/3071328797 >> v2:172.21.15.83:3300/0 conn(0x7f7564154660 msgr2=0x7f75640caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f75637fe700 1 --2- 172.21.15.37:0/3071328797 >> v2:172.21.15.83:3300/0 conn(0x7f7564154660 0x7f75640caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f75637fe700 1 -- 172.21.15.37:0/3071328797 >> v1:172.21.15.37:6789/0 conn(0x7f7564154a30 legacy=0x7f756406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f75637fe700 1 -- 172.21.15.37:0/3071328797 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75640c06e0 con 0x7f756406e880 2023-10-06T04:39:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.176+0000 7f7563fff700 1 --2- 172.21.15.37:0/3071328797 >> v2:172.21.15.83:3300/0 conn(0x7f7564154660 0x7f75640caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f75637fe700 1 --2- 172.21.15.37:0/3071328797 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f756406e880 0x7f75640cbb20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f755c009e60 tx=0x7f755c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4789a2ee1c564e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f7562ffd700 1 -- 172.21.15.37:0/3071328797 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c00e070 con 0x7f756406e880 2023-10-06T04:39:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f7562ffd700 1 -- 172.21.15.37:0/3071328797 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c00bab0 con 0x7f756406e880 2023-10-06T04:39:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f7562ffd700 1 -- 172.21.15.37:0/3071328797 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c00be70 con 0x7f756406e880 2023-10-06T04:39:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 -- 172.21.15.37:0/3071328797 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f756406e880 msgr2=0x7f75640cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 --2- 172.21.15.37:0/3071328797 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f756406e880 0x7f75640cbb20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f755c009e60 tx=0x7f755c009780 comp rx=0 tx=0).stop 2023-10-06T04:39:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 -- 172.21.15.37:0/3071328797 shutdown_connections 2023-10-06T04:39:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 --2- 172.21.15.37:0/3071328797 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f756406e880 0x7f75640cbb20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 --2- 172.21.15.37:0/3071328797 >> v2:172.21.15.83:3300/0 conn(0x7f7564154660 0x7f75640caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 -- 172.21.15.37:0/3071328797 >> 172.21.15.37:0/3071328797 conn(0x7f75640667b0 msgr2=0x7f7564066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:46.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 -- 172.21.15.37:0/3071328797 shutdown_connections 2023-10-06T04:39:46.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 -- 172.21.15.37:0/3071328797 wait complete. 2023-10-06T04:39:46.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 Processor -- start 2023-10-06T04:39:46.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 -- start start 2023-10-06T04:39:46.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f756406e880 0x7f75640c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7564154660 0x7f7564146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7564154a30 0x7f756413c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756413bc10 con 0x7f7564154a30 2023-10-06T04:39:46.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75640c9540 con 0x7f756406e880 2023-10-06T04:39:46.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.180+0000 7f756a92d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75640c7d90 con 0x7f7564154660 2023-10-06T04:39:46.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f7568eca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7564154a30 0x7f756413c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f7568eca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7564154a30 0x7f756413c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41956/0 (socket says 172.21.15.37:41956) 2023-10-06T04:39:46.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f7568eca700 1 -- 172.21.15.37:0/2484219695 learned_addr learned my addr 172.21.15.37:0/2484219695 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:46.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f7563fff700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f756406e880 0x7f75640c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f75637fe700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7564154660 0x7f7564146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f7568eca700 1 -- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7564154660 msgr2=0x7f7564146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f7568eca700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7564154660 0x7f7564146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f7568eca700 1 -- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f756406e880 msgr2=0x7f75640c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f7568eca700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f756406e880 0x7f75640c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f7568eca700 1 -- 172.21.15.37:0/2484219695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c009420 con 0x7f7564154a30 2023-10-06T04:39:46.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f7563fff700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f756406e880 0x7f75640c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:46.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f7568eca700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7564154a30 0x7f756413c150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f755400c560 tx=0x7f7554007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:46.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f755bfff700 1 -- 172.21.15.37:0/2484219695 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554005b30 con 0x7f7564154a30 2023-10-06T04:39:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f756a92d700 1 -- 172.21.15.37:0/2484219695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c009a20 con 0x7f7564154a30 2023-10-06T04:39:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f755bfff700 1 -- 172.21.15.37:0/2484219695 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7554005c90 con 0x7f7564154a30 2023-10-06T04:39:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f756a92d700 1 -- 172.21.15.37:0/2484219695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75640c8c10 con 0x7f7564154a30 2023-10-06T04:39:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f755bfff700 1 -- 172.21.15.37:0/2484219695 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554005e00 con 0x7f7564154a30 2023-10-06T04:39:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f756a92d700 1 -- 172.21.15.37:0/2484219695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75640c96d0 con 0x7f7564154a30 2023-10-06T04:39:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.184+0000 7f755bfff700 1 -- 172.21.15.37:0/2484219695 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f75540072e0 con 0x7f7564154a30 2023-10-06T04:39:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.188+0000 7f755bfff700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7548060550 0x7f7548062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.188+0000 7f755bfff700 1 -- 172.21.15.37:0/2484219695 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f755407bae0 con 0x7f7564154a30 2023-10-06T04:39:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.188+0000 7f7563fff700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7548060550 0x7f7548062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.188+0000 7f7563fff700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7548060550 0x7f7548062a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f756414fd60 tx=0x7f754c0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:46.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.196+0000 7f755bfff700 1 -- 172.21.15.37:0/2484219695 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7554080070 con 0x7f7564154a30 2023-10-06T04:39:46.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.392+0000 7f756a92d700 1 -- 172.21.15.37:0/2484219695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7564070ee0 con 0x7f7564154a30 2023-10-06T04:39:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.392+0000 7f755bfff700 1 -- 172.21.15.37:0/2484219695 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f755404bbf0 con 0x7f7564154a30 2023-10-06T04:39:46.400 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:39:46.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.396+0000 7f756a92d700 1 -- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7548060550 msgr2=0x7f7548062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.396+0000 7f756a92d700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7548060550 0x7f7548062a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f756414fd60 tx=0x7f754c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.396+0000 7f756a92d700 1 -- 172.21.15.37:0/2484219695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7564154a30 msgr2=0x7f756413c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.396+0000 7f756a92d700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7564154a30 0x7f756413c150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f755400c560 tx=0x7f7554007dd0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.396+0000 7f756a92d700 1 -- 172.21.15.37:0/2484219695 shutdown_connections 2023-10-06T04:39:46.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.396+0000 7f756a92d700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7548060550 0x7f7548062a00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.396+0000 7f756a92d700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7564154a30 0x7f756413c150 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.396+0000 7f756a92d700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7564154660 0x7f7564146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.396+0000 7f756a92d700 1 --2- 172.21.15.37:0/2484219695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f756406e880 0x7f75640c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.396+0000 7f756a92d700 1 -- 172.21.15.37:0/2484219695 >> 172.21.15.37:0/2484219695 conn(0x7f75640667b0 msgr2=0x7f75640afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:46.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.396+0000 7f756a92d700 1 -- 172.21.15.37:0/2484219695 shutdown_connections 2023-10-06T04:39:46.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:46.396+0000 7f756a92d700 1 -- 172.21.15.37:0/2484219695 wait complete. 2023-10-06T04:39:46.414 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:39:46.415 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:39:46.415 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T04:39:46.415 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T04:39:46.415 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T04:39:46.415 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:39:46.415 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:39:46.415 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:39:46.415 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:39:46.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:46.415 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T04:39:46.423 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:46.423 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:46.424 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:46.424 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:46.424 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:46.424 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:46.424 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:46.424 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:46.424 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:46.424 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:46.424 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:46.424 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:46.424 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:39:46.424 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:46.425 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-06T04:39:46.425 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42567sec preferred_lft 42567sec 2023-10-06T04:39:46.425 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link 2023-10-06T04:39:46.425 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:46.425 INFO:teuthology.orchestra.run.smithi083.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T04:39:46.425 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 02:42:a8:a8:41:25 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:46.425 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T04:39:46.425 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:46.425 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:39:46.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:46.426 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:39:46.426 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:39:46.426 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:39:46.426 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2023-10-06T04:39:46.426 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2023-10-06T04:39:46.426 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:39:46.426 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:39:46.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:46.514 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:39:46.525 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T04:39:46.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:46.527 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T04:39:46.558 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T04:39:46.558 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:39:46.558 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-06T04:39:46.558 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:39:46.558 INFO:teuthology.orchestra.run.smithi083.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T04:39:46.558 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-06T04:39:46.558 INFO:teuthology.orchestra.run.smithi083.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-06T04:39:46.558 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:39:46.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:46.559 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:39:46.559 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:39:46.559 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:39:46.559 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:39:46.559 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:39:46.559 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:39:46.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:46.601 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T04:39:46.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:46.649 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2023-10-06T04:39:46.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:46.656 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:39:46.656 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:39:46.657 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:39:46.657 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T04:39:46.657 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:39:46.682 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T04:39:46.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:46.682 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:39:46.682 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:39:46.682 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T04:39:46.682 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:39:46.682 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T04:39:46.683 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T04:39:46.683 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T04:39:46.683 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:39:46.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:46.804 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:39:46.804 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:39:46.804 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T04:39:46.804 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:39:46.804 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:39:46.831 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-06T04:39:46.832 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:46.832 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T04:39:46.846 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:39:46.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:46.846 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:39:46.895 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2023-10-06T04:39:46.911 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:46.911 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:46.925 INFO:teuthology.orchestra.run.smithi083.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:46.926 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:46.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:46.926 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2023-10-06T04:39:46.933 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T04:39:46.933 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-06T04:39:46.935 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2023-10-06T04:39:46.949 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:46.949 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:47.004 INFO:teuthology.orchestra.run.smithi083.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:47.004 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:47.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:47.005 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2023-10-06T04:39:47.023 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi083.stderr:2023-10-06T04:39:47.017+0000 7fc7b8a30380 -1 init, newargv = 0x56148f8d7fd0 newargc=15 2023-10-06T04:39:47.023 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi083.stderr:ceph-fuse[38350]: starting ceph client 2023-10-06T04:39:47.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi083.stderr:ceph-fuse[38350]: starting fuse 2023-10-06T04:39:48.111 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2023-10-06T04:39:48.127 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:48.127 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:48.185 INFO:teuthology.orchestra.run.smithi083.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:48.186 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:48.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:48.187 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2023-10-06T04:39:48.192 INFO:teuthology.orchestra.run.smithi083.stdout:52 2023-10-06T04:39:48.192 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T04:39:48.192 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:39:48.193 DEBUG:teuthology.orchestra.run.smithi083:> import glob 2023-10-06T04:39:48.193 DEBUG:teuthology.orchestra.run.smithi083:> import re 2023-10-06T04:39:48.193 DEBUG:teuthology.orchestra.run.smithi083:> import os 2023-10-06T04:39:48.193 DEBUG:teuthology.orchestra.run.smithi083:> import subprocess 2023-10-06T04:39:48.193 DEBUG:teuthology.orchestra.run.smithi083:> 2023-10-06T04:39:48.193 DEBUG:teuthology.orchestra.run.smithi083:> def _find_admin_socket(client_name): 2023-10-06T04:39:48.193 DEBUG:teuthology.orchestra.run.smithi083:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-06T04:39:48.193 DEBUG:teuthology.orchestra.run.smithi083:> files = glob.glob(asok_path) 2023-10-06T04:39:48.193 DEBUG:teuthology.orchestra.run.smithi083:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-06T04:39:48.193 DEBUG:teuthology.orchestra.run.smithi083:> 2023-10-06T04:39:48.193 DEBUG:teuthology.orchestra.run.smithi083:> # Given a non-glob path, it better be there 2023-10-06T04:39:48.193 DEBUG:teuthology.orchestra.run.smithi083:> if "*" not in asok_path: 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> assert(len(files) == 1) 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> return files[0] 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> for f in files: 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> contents = proc_f.read() 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> if mountpoint in contents: 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> return f 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> 2023-10-06T04:39:48.194 DEBUG:teuthology.orchestra.run.smithi083:> print(_find_admin_socket("client.1")) 2023-10-06T04:39:48.195 DEBUG:teuthology.orchestra.run.smithi083:> ' 2023-10-06T04:39:48.278 INFO:teuthology.orchestra.run.smithi083.stdout:/var/run/ceph/ceph-client.1.38350.asok 2023-10-06T04:39:48.462 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.38350.asok 2023-10-06T04:39:48.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:48.463 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.38350.asok status 2023-10-06T04:39:48.566 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2023-10-06T04:39:48.568 INFO:teuthology.orchestra.run.smithi083.stdout: "metadata": { 2023-10-06T04:39:48.568 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T04:39:48.568 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T04:39:48.568 INFO:teuthology.orchestra.run.smithi083.stdout: "entity_id": "1", 2023-10-06T04:39:48.569 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": "smithi083", 2023-10-06T04:39:48.569 INFO:teuthology.orchestra.run.smithi083.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-06T04:39:48.570 INFO:teuthology.orchestra.run.smithi083.stdout: "pid": "38350", 2023-10-06T04:39:48.570 INFO:teuthology.orchestra.run.smithi083.stdout: "root": "/" 2023-10-06T04:39:48.570 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2023-10-06T04:39:48.570 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_count": 0, 2023-10-06T04:39:48.572 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_pinned_count": 0, 2023-10-06T04:39:48.572 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4676, 2023-10-06T04:39:48.573 INFO:teuthology.orchestra.run.smithi083.stdout: "inst": { 2023-10-06T04:39:48.574 INFO:teuthology.orchestra.run.smithi083.stdout: "name": { 2023-10-06T04:39:48.574 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "client", 2023-10-06T04:39:48.574 INFO:teuthology.orchestra.run.smithi083.stdout: "num": 4676 2023-10-06T04:39:48.574 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2023-10-06T04:39:48.574 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2023-10-06T04:39:48.575 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2023-10-06T04:39:48.575 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:39:48.575 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2027694637 2023-10-06T04:39:48.575 INFO:teuthology.orchestra.run.smithi083.stdout: } 2023-10-06T04:39:48.575 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2023-10-06T04:39:48.575 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2023-10-06T04:39:48.575 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2023-10-06T04:39:48.575 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:39:48.575 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2027694637 2023-10-06T04:39:48.575 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2023-10-06T04:39:48.575 INFO:teuthology.orchestra.run.smithi083.stdout: "inst_str": "client.4676 192.168.0.1:0/2027694637", 2023-10-06T04:39:48.576 INFO:teuthology.orchestra.run.smithi083.stdout: "addr_str": "192.168.0.1:0/2027694637", 2023-10-06T04:39:48.576 INFO:teuthology.orchestra.run.smithi083.stdout: "inode_count": 1, 2023-10-06T04:39:48.576 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_epoch": 8, 2023-10-06T04:39:48.576 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch": 28, 2023-10-06T04:39:48.576 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch_barrier": 0, 2023-10-06T04:39:48.576 INFO:teuthology.orchestra.run.smithi083.stdout: "blocklisted": false, 2023-10-06T04:39:48.576 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs" 2023-10-06T04:39:48.577 INFO:teuthology.orchestra.run.smithi083.stdout:} 2023-10-06T04:39:48.579 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:39:48.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.688+0000 7f78a8a3d700 1 Processor -- start 2023-10-06T04:39:48.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.688+0000 7f78a8a3d700 1 -- start start 2023-10-06T04:39:48.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78a40b1380 0x7f78a40b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f78a40cb8b0 0x7f78a40ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a40cb110 con 0x7f78a4066840 2023-10-06T04:39:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a40ca500 con 0x7f78a40b1380 2023-10-06T04:39:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a40ca7e0 con 0x7f78a40cb8b0 2023-10-06T04:39:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a259c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f78a4066840 0x7f78a40ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34316/0 (socket says 172.21.15.37:34316) 2023-10-06T04:39:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a259c700 1 -- 172.21.15.37:0/2009754616 learned_addr learned my addr 172.21.15.37:0/2009754616 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a2d9d700 1 --2- 172.21.15.37:0/2009754616 >> v2:172.21.15.37:3300/0 conn(0x7f78a40b1380 0x7f78a40b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a359e700 1 --2- 172.21.15.37:0/2009754616 >> v2:172.21.15.83:3300/0 conn(0x7f78a40cb8b0 0x7f78a40ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a1d9b700 1 -- 172.21.15.37:0/2009754616 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798660116 0 0) 0x7f78a40cb110 con 0x7f78a4066840 2023-10-06T04:39:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a1d9b700 1 -- 172.21.15.37:0/2009754616 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f788c003570 con 0x7f78a4066840 2023-10-06T04:39:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a2d9d700 1 -- 172.21.15.37:0/2009754616 >> v2:172.21.15.83:3300/0 conn(0x7f78a40cb8b0 msgr2=0x7f78a40ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a2d9d700 1 --2- 172.21.15.37:0/2009754616 >> v2:172.21.15.83:3300/0 conn(0x7f78a40cb8b0 0x7f78a40ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a2d9d700 1 -- 172.21.15.37:0/2009754616 >> v1:172.21.15.37:6789/0 conn(0x7f78a4066840 legacy=0x7f78a40ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a2d9d700 1 -- 172.21.15.37:0/2009754616 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40caac0 con 0x7f78a40b1380 2023-10-06T04:39:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a2d9d700 1 --2- 172.21.15.37:0/2009754616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78a40b1380 0x7f78a40b1750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f78a40aeb90 tx=0x7f78980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ec2870c6f63a2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a1d9b700 1 -- 172.21.15.37:0/2009754616 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898011630 con 0x7f78a40b1380 2023-10-06T04:39:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a1d9b700 1 -- 172.21.15.37:0/2009754616 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78980117b0 con 0x7f78a40b1380 2023-10-06T04:39:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a1d9b700 1 -- 172.21.15.37:0/2009754616 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898011b70 con 0x7f78a40b1380 2023-10-06T04:39:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 -- 172.21.15.37:0/2009754616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78a40b1380 msgr2=0x7f78a40b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 --2- 172.21.15.37:0/2009754616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78a40b1380 0x7f78a40b1750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f78a40aeb90 tx=0x7f78980091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 -- 172.21.15.37:0/2009754616 shutdown_connections 2023-10-06T04:39:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 --2- 172.21.15.37:0/2009754616 >> v2:172.21.15.83:3300/0 conn(0x7f78a40cb8b0 0x7f78a40ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 --2- 172.21.15.37:0/2009754616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78a40b1380 0x7f78a40b1750 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 -- 172.21.15.37:0/2009754616 >> 172.21.15.37:0/2009754616 conn(0x7f78a40ccb50 msgr2=0x7f78a406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:48.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 -- 172.21.15.37:0/2009754616 shutdown_connections 2023-10-06T04:39:48.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.692+0000 7f78a8a3d700 1 -- 172.21.15.37:0/2009754616 wait complete. 2023-10-06T04:39:48.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a8a3d700 1 Processor -- start 2023-10-06T04:39:48.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a8a3d700 1 -- start start 2023-10-06T04:39:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a8a3d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78a4066840 0x7f78a4149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a8a3d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78a40b1380 0x7f78a41571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a8a3d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78a40cb8b0 0x7f78a4142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a8a3d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a414e8a0 con 0x7f78a40cb8b0 2023-10-06T04:39:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a8a3d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a414cdf0 con 0x7f78a40b1380 2023-10-06T04:39:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a8a3d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40a5eb0 con 0x7f78a4066840 2023-10-06T04:39:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78a40cb8b0 0x7f78a4142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78a40cb8b0 0x7f78a4142940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41962/0 (socket says 172.21.15.37:41962) 2023-10-06T04:39:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a359e700 1 -- 172.21.15.37:0/1239443329 learned_addr learned my addr 172.21.15.37:0/1239443329 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a2d9d700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78a4066840 0x7f78a4149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a259c700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78a40b1380 0x7f78a41571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a359e700 1 -- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78a4066840 msgr2=0x7f78a4149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a359e700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78a4066840 0x7f78a4149a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a359e700 1 -- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78a40b1380 msgr2=0x7f78a41571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a359e700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78a40b1380 0x7f78a41571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a359e700 1 -- 172.21.15.37:0/1239443329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7898009420 con 0x7f78a40cb8b0 2023-10-06T04:39:48.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a359e700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78a40cb8b0 0x7f78a4142940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f789c00e900 tx=0x7f789c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:48.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f788affd700 1 -- 172.21.15.37:0/1239443329 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c013680 con 0x7f78a40cb8b0 2023-10-06T04:39:48.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f788affd700 1 -- 172.21.15.37:0/1239443329 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c013800 con 0x7f78a40cb8b0 2023-10-06T04:39:48.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a8a3d700 1 -- 172.21.15.37:0/1239443329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a414e5c0 con 0x7f78a40cb8b0 2023-10-06T04:39:48.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f788affd700 1 -- 172.21.15.37:0/1239443329 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c013bc0 con 0x7f78a40cb8b0 2023-10-06T04:39:48.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.696+0000 7f78a8a3d700 1 -- 172.21.15.37:0/1239443329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a414ca80 con 0x7f78a40cb8b0 2023-10-06T04:39:48.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.700+0000 7f78a8a3d700 1 -- 172.21.15.37:0/1239443329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a414cf80 con 0x7f78a40cb8b0 2023-10-06T04:39:48.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.700+0000 7f788affd700 1 -- 172.21.15.37:0/1239443329 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f789c0123d0 con 0x7f78a40cb8b0 2023-10-06T04:39:48.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.700+0000 7f788affd700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7890060550 0x7f7890062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.700+0000 7f788affd700 1 -- 172.21.15.37:0/1239443329 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f789c07cd80 con 0x7f78a40cb8b0 2023-10-06T04:39:48.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.700+0000 7f78a2d9d700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7890060550 0x7f7890062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.704+0000 7f78a2d9d700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7890060550 0x7f7890062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f78a40aeb90 tx=0x7f7898017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.708+0000 7f788affd700 1 -- 172.21.15.37:0/1239443329 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f789c04cf20 con 0x7f78a40cb8b0 2023-10-06T04:39:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.912+0000 7f78a8a3d700 1 -- 172.21.15.37:0/1239443329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f78a40708a0 con 0x7f78a40cb8b0 2023-10-06T04:39:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.912+0000 7f788affd700 1 -- 172.21.15.37:0/1239443329 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f789c017070 con 0x7f78a40cb8b0 2023-10-06T04:39:48.918 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:39:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.912+0000 7f78a8a3d700 1 -- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7890060550 msgr2=0x7f7890062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.912+0000 7f78a8a3d700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7890060550 0x7f7890062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f78a40aeb90 tx=0x7f7898017000 comp rx=0 tx=0).stop 2023-10-06T04:39:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.912+0000 7f78a8a3d700 1 -- 172.21.15.37:0/1239443329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78a40cb8b0 msgr2=0x7f78a4142940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.912+0000 7f78a8a3d700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78a40cb8b0 0x7f78a4142940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f789c00e900 tx=0x7f789c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.916+0000 7f78a8a3d700 1 -- 172.21.15.37:0/1239443329 shutdown_connections 2023-10-06T04:39:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.916+0000 7f78a8a3d700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7890060550 0x7f7890062a00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.916+0000 7f78a8a3d700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78a40b1380 0x7f78a41571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.916+0000 7f78a8a3d700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78a40cb8b0 0x7f78a4142940 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.916+0000 7f78a8a3d700 1 --2- 172.21.15.37:0/1239443329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78a4066840 0x7f78a4149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.916+0000 7f78a8a3d700 1 -- 172.21.15.37:0/1239443329 >> 172.21.15.37:0/1239443329 conn(0x7f78a40ccb50 msgr2=0x7f78a406a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.916+0000 7f78a8a3d700 1 -- 172.21.15.37:0/1239443329 shutdown_connections 2023-10-06T04:39:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:48.916+0000 7f78a8a3d700 1 -- 172.21.15.37:0/1239443329 wait complete. 2023-10-06T04:39:48.932 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:39:48.932 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:39:48.933 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T04:39:48.933 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T04:39:48.933 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T04:39:48.933 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:39:48.933 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:39:48.933 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:39:48.933 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:39:48.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:48.933 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T04:39:48.942 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:48.942 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:48.942 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:48.942 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:48.942 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:48.942 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:48.942 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:48.942 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:48.943 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:48.943 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:48.943 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:39:48.943 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:48.943 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:39:48.943 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:48.943 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-06T04:39:48.943 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42564sec preferred_lft 42564sec 2023-10-06T04:39:48.943 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link 2023-10-06T04:39:48.943 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:48.944 INFO:teuthology.orchestra.run.smithi083.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T04:39:48.944 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 02:42:a8:a8:41:25 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:48.944 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T04:39:48.944 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:48.944 INFO:teuthology.orchestra.run.smithi083.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:39:48.944 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 76:4a:90:d8:2e:c6 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:48.944 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:39:48.944 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:48.944 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::b433:bcff:fefa:a6db/64 scope link 2023-10-06T04:39:48.944 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:48.945 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:39:48.945 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 76:4a:90:d8:2e:c6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:39:48.945 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::744a:90ff:fed8:2ec6/64 scope link 2023-10-06T04:39:48.945 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:48.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:48.945 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:39:48.960 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T04:39:48.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:48.962 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T04:39:48.971 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T04:39:48.971 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:39:48.971 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-06T04:39:48.971 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:39:48.971 INFO:teuthology.orchestra.run.smithi083.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T04:39:48.971 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-06T04:39:48.971 INFO:teuthology.orchestra.run.smithi083.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-06T04:39:48.971 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:39:48.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:48.972 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:39:48.972 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:39:48.972 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:39:48.972 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:39:48.972 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:39:48.972 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:39:49.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:49.056 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T04:39:49.062 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:39:49.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:49.065 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2023-10-06T04:39:49.071 INFO:teuthology.orchestra.run.smithi083.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T04:39:49.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:49.072 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:39:49.072 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:39:49.072 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:39:49.072 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T04:39:49.072 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:39:49.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:49.145 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:39:49.159 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:49.159 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:49.159 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:49.160 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:49.160 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:49.160 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:49.160 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:39:49.160 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether a2:f7:93:76:14:d4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:39:49.160 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:39:49.160 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:49.160 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::a0f7:93ff:fe76:14d4/64 scope link 2023-10-06T04:39:49.161 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:49.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:49.162 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:39:49.173 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:49.173 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:49.173 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:49.173 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:49.174 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:49.174 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:49.174 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:39:49.174 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether a2:f7:93:76:14:d4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:39:49.174 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:39:49.174 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:49.174 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::a0f7:93ff:fe76:14d4/64 scope link 2023-10-06T04:39:49.175 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:49.176 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T04:39:49.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:49.176 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:39:49.176 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:39:49.176 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T04:39:49.177 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:39:49.177 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T04:39:49.177 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T04:39:49.177 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T04:39:49.177 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:39:49.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:49.232 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:39:49.233 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:39:49.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.1 up 2023-10-06T04:39:49.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:39:49.233 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:39:49.259 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-06T04:39:49.260 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:49.260 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T04:39:49.266 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:39:49.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:49.266 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:39:49.320 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2023-10-06T04:39:49.337 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:49.337 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:49.352 INFO:teuthology.orchestra.run.smithi083.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:49.352 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:49.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:49.353 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2023-10-06T04:39:49.357 INFO:teuthology.orchestra.run.smithi083.stdout:52 2023-10-06T04:39:49.358 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-10-06T04:39:49.358 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-06T04:39:49.360 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2023-10-06T04:39:49.376 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:49.377 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:49.433 INFO:teuthology.orchestra.run.smithi083.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:49.434 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:49.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:49.435 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2023-10-06T04:39:49.440 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi083.stderr:2023-10-06T04:39:49.433+0000 7ff52331c380 -1 init, newargv = 0x558fb7cbe9b0 newargc=15 2023-10-06T04:39:49.440 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi083.stderr:ceph-fuse[38463]: starting ceph client 2023-10-06T04:39:49.442 INFO:teuthology.orchestra.run.smithi083.stdout:52 2023-10-06T04:39:49.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi083.stderr:ceph-fuse[38463]: starting fuse 2023-10-06T04:39:50.543 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2023-10-06T04:39:50.562 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:39:50.563 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:39:50.622 INFO:teuthology.orchestra.run.smithi083.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:39:50.622 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:39:50.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:50.623 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2023-10-06T04:39:50.630 INFO:teuthology.orchestra.run.smithi083.stdout:52 2023-10-06T04:39:50.630 INFO:teuthology.orchestra.run.smithi083.stdout:53 2023-10-06T04:39:50.630 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-10-06T04:39:50.631 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:39:50.631 DEBUG:teuthology.orchestra.run.smithi083:> import glob 2023-10-06T04:39:50.631 DEBUG:teuthology.orchestra.run.smithi083:> import re 2023-10-06T04:39:50.631 DEBUG:teuthology.orchestra.run.smithi083:> import os 2023-10-06T04:39:50.631 DEBUG:teuthology.orchestra.run.smithi083:> import subprocess 2023-10-06T04:39:50.631 DEBUG:teuthology.orchestra.run.smithi083:> 2023-10-06T04:39:50.631 DEBUG:teuthology.orchestra.run.smithi083:> def _find_admin_socket(client_name): 2023-10-06T04:39:50.631 DEBUG:teuthology.orchestra.run.smithi083:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-06T04:39:50.631 DEBUG:teuthology.orchestra.run.smithi083:> files = glob.glob(asok_path) 2023-10-06T04:39:50.631 DEBUG:teuthology.orchestra.run.smithi083:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-06T04:39:50.631 DEBUG:teuthology.orchestra.run.smithi083:> 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> # Given a non-glob path, it better be there 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> if "*" not in asok_path: 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> assert(len(files) == 1) 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> return files[0] 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> for f in files: 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> contents = proc_f.read() 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> if mountpoint in contents: 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> return f 2023-10-06T04:39:50.632 DEBUG:teuthology.orchestra.run.smithi083:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T04:39:50.633 DEBUG:teuthology.orchestra.run.smithi083:> 2023-10-06T04:39:50.633 DEBUG:teuthology.orchestra.run.smithi083:> print(_find_admin_socket("client.3")) 2023-10-06T04:39:50.633 DEBUG:teuthology.orchestra.run.smithi083:> ' 2023-10-06T04:39:50.714 INFO:teuthology.orchestra.run.smithi083.stdout:/var/run/ceph/ceph-client.3.38463.asok 2023-10-06T04:39:50.897 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.38463.asok 2023-10-06T04:39:50.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:50.898 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.38463.asok status 2023-10-06T04:39:51.040 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2023-10-06T04:39:51.040 INFO:teuthology.orchestra.run.smithi083.stdout: "metadata": { 2023-10-06T04:39:51.040 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T04:39:51.040 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T04:39:51.040 INFO:teuthology.orchestra.run.smithi083.stdout: "entity_id": "3", 2023-10-06T04:39:51.041 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": "smithi083", 2023-10-06T04:39:51.041 INFO:teuthology.orchestra.run.smithi083.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-06T04:39:51.041 INFO:teuthology.orchestra.run.smithi083.stdout: "pid": "38463", 2023-10-06T04:39:51.041 INFO:teuthology.orchestra.run.smithi083.stdout: "root": "/" 2023-10-06T04:39:51.041 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2023-10-06T04:39:51.041 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_count": 0, 2023-10-06T04:39:51.041 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_pinned_count": 0, 2023-10-06T04:39:51.041 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4685, 2023-10-06T04:39:51.041 INFO:teuthology.orchestra.run.smithi083.stdout: "inst": { 2023-10-06T04:39:51.041 INFO:teuthology.orchestra.run.smithi083.stdout: "name": { 2023-10-06T04:39:51.042 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "client", 2023-10-06T04:39:51.042 INFO:teuthology.orchestra.run.smithi083.stdout: "num": 4685 2023-10-06T04:39:51.042 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2023-10-06T04:39:51.042 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2023-10-06T04:39:51.043 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2023-10-06T04:39:51.043 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.2:0", 2023-10-06T04:39:51.043 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1556792513 2023-10-06T04:39:51.043 INFO:teuthology.orchestra.run.smithi083.stdout: } 2023-10-06T04:39:51.043 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2023-10-06T04:39:51.043 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2023-10-06T04:39:51.043 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2023-10-06T04:39:51.043 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.2:0", 2023-10-06T04:39:51.044 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1556792513 2023-10-06T04:39:51.044 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2023-10-06T04:39:51.044 INFO:teuthology.orchestra.run.smithi083.stdout: "inst_str": "client.4685 192.168.0.2:0/1556792513", 2023-10-06T04:39:51.044 INFO:teuthology.orchestra.run.smithi083.stdout: "addr_str": "192.168.0.2:0/1556792513", 2023-10-06T04:39:51.044 INFO:teuthology.orchestra.run.smithi083.stdout: "inode_count": 1, 2023-10-06T04:39:51.044 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_epoch": 8, 2023-10-06T04:39:51.044 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch": 28, 2023-10-06T04:39:51.045 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch_barrier": 0, 2023-10-06T04:39:51.045 INFO:teuthology.orchestra.run.smithi083.stdout: "blocklisted": false, 2023-10-06T04:39:51.045 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs" 2023-10-06T04:39:51.045 INFO:teuthology.orchestra.run.smithi083.stdout:} 2023-10-06T04:39:51.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:51.049 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T04:39:51.049 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T04:39:51.058 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T04:39:51.058 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T04:39:51.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:51.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:39:51.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:51.116 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T04:39:51.116 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-06T04:39:51.124 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T04:39:51.124 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-06T04:39:51.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:51.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:39:51.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:51.140 DEBUG:teuthology.orchestra.run.smithi083:> stat --file-system '--printf=%T 2023-10-06T04:39:51.140 DEBUG:teuthology.orchestra.run.smithi083:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-06T04:39:51.149 INFO:teuthology.orchestra.run.smithi083.stdout:fuseblk 2023-10-06T04:39:51.149 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-06T04:39:51.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:51.149 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:39:51.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:51.164 DEBUG:teuthology.orchestra.run.smithi083:> stat --file-system '--printf=%T 2023-10-06T04:39:51.164 DEBUG:teuthology.orchestra.run.smithi083:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-06T04:39:51.213 INFO:teuthology.orchestra.run.smithi083.stdout:fuseblk 2023-10-06T04:39:51.214 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-06T04:39:51.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:51.214 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:39:51.231 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T04:39:51.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:51.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.356+0000 7f9ad5b50700 1 Processor -- start 2023-10-06T04:39:51.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.356+0000 7f9ad5b50700 1 -- start start 2023-10-06T04:39:51.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.356+0000 7f9ad5b50700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9ad00ad560 0x7f9ad00ad930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.356+0000 7f9ad5b50700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad00ca810 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.356+0000 7f9ad5b50700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad01570a0 con 0x7f9ad00caca0 2023-10-06T04:39:51.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.356+0000 7f9ad5b50700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad00c9c00 con 0x7f9ad00ad560 2023-10-06T04:39:51.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.356+0000 7f9acffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9ad00cc3f0 0x7f9ad00c9370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60130/0 (socket says 172.21.15.37:60130) 2023-10-06T04:39:51.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9acffff700 1 -- 172.21.15.37:0/1651465897 learned_addr learned my addr 172.21.15.37:0/1651465897 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:51.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9ad4b4e700 1 --2- 172.21.15.37:0/1651465897 >> v2:172.21.15.83:3300/0 conn(0x7f9ad00ad560 0x7f9ad00ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9acf7fe700 1 -- 172.21.15.37:0/1651465897 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107717727 0 0) 0x7f9ad01570a0 con 0x7f9ad00caca0 2023-10-06T04:39:51.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9acf7fe700 1 -- 172.21.15.37:0/1651465897 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab0003570 con 0x7f9ad00caca0 2023-10-06T04:39:51.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9acf7fe700 1 -- 172.21.15.37:0/1651465897 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216846515 0 0) 0x7f9ad00ca810 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9acf7fe700 1 -- 172.21.15.37:0/1651465897 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ad01570a0 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9ad4b4e700 1 -- 172.21.15.37:0/1651465897 >> v1:172.21.15.83:6789/0 conn(0x7f9ad00caca0 legacy=0x7f9ad006d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9acf7fe700 1 -- 172.21.15.37:0/1651465897 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3164563575 0 0) 0x7f9ad01570a0 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9ad4b4e700 1 -- 172.21.15.37:0/1651465897 >> v1:172.21.15.37:6789/0 conn(0x7f9ad00cc3f0 legacy=0x7f9ad00c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9ad4b4e700 1 -- 172.21.15.37:0/1651465897 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad00c9ee0 con 0x7f9ad00ad560 2023-10-06T04:39:51.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9ad4b4e700 1 --2- 172.21.15.37:0/1651465897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad00ad560 0x7f9ad00ad930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80098e0 tx=0x7f9ab80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5de980eaa278ebdc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:51.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9acf7fe700 1 -- 172.21.15.37:0/1651465897 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac00017f0 con 0x7f9ad00ad560 2023-10-06T04:39:51.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9acf7fe700 1 -- 172.21.15.37:0/1651465897 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab8011420 con 0x7f9ad00ad560 2023-10-06T04:39:51.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9acf7fe700 1 -- 172.21.15.37:0/1651465897 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab80117a0 con 0x7f9ad00ad560 2023-10-06T04:39:51.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9ad5b50700 1 -- 172.21.15.37:0/1651465897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad00ad560 msgr2=0x7f9ad00ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9ad5b50700 1 --2- 172.21.15.37:0/1651465897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad00ad560 0x7f9ad00ad930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80098e0 tx=0x7f9ab80091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9ad5b50700 1 -- 172.21.15.37:0/1651465897 shutdown_connections 2023-10-06T04:39:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9ad5b50700 1 --2- 172.21.15.37:0/1651465897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad00ad560 0x7f9ad00ad930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9ad5b50700 1 -- 172.21.15.37:0/1651465897 >> 172.21.15.37:0/1651465897 conn(0x7f9ad0068780 msgr2=0x7f9ad00cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9ad5b50700 1 -- 172.21.15.37:0/1651465897 shutdown_connections 2023-10-06T04:39:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.360+0000 7f9ad5b50700 1 -- 172.21.15.37:0/1651465897 wait complete. 2023-10-06T04:39:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad5b50700 1 Processor -- start 2023-10-06T04:39:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad5b50700 1 -- start start 2023-10-06T04:39:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad5b50700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad00ad560 0x7f9ad00a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad5b50700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ad00caca0 0x7f9ad014b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad5b50700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad00cc3f0 0x7f9ad00a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad5b50700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00a49f0 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad5b50700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00c1fc0 con 0x7f9ad00ad560 2023-10-06T04:39:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad5b50700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00c1690 con 0x7f9ad00caca0 2023-10-06T04:39:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad534f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad00cc3f0 0x7f9ad00a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9acffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ad00caca0 0x7f9ad014b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad4b4e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad00ad560 0x7f9ad00a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad534f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad00cc3f0 0x7f9ad00a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55872/0 (socket says 172.21.15.37:55872) 2023-10-06T04:39:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad534f700 1 -- 172.21.15.37:0/3349141474 learned_addr learned my addr 172.21.15.37:0/3349141474 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad534f700 1 -- 172.21.15.37:0/3349141474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ad00caca0 msgr2=0x7f9ad014b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad534f700 1 --2- 172.21.15.37:0/3349141474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ad00caca0 0x7f9ad014b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad534f700 1 -- 172.21.15.37:0/3349141474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad00ad560 msgr2=0x7f9ad00a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad534f700 1 --2- 172.21.15.37:0/3349141474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad00ad560 0x7f9ad00a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad534f700 1 -- 172.21.15.37:0/3349141474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab8009420 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad534f700 1 --2- 172.21.15.37:0/3349141474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad00cc3f0 0x7f9ad00a44b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800c590 tx=0x7f9ac8007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9accff9700 1 -- 172.21.15.37:0/3349141474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8016070 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9accff9700 1 -- 172.21.15.37:0/3349141474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac8011590 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9ad5b50700 1 -- 172.21.15.37:0/3349141474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad00c1970 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.364+0000 7f9accff9700 1 -- 172.21.15.37:0/3349141474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8011970 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.368+0000 7f9ad5b50700 1 -- 172.21.15.37:0/3349141474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad00c2450 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.368+0000 7f9ad5b50700 1 -- 172.21.15.37:0/3349141474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad00708a0 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.368+0000 7f9accff9700 1 -- 172.21.15.37:0/3349141474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9ac8012420 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.368+0000 7f9accff9700 1 --2- 172.21.15.37:0/3349141474 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9ab4060580 0x7f9ab4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.368+0000 7f9accff9700 1 -- 172.21.15.37:0/3349141474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9ac807c6e0 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.372+0000 7f9ad4b4e700 1 --2- 172.21.15.37:0/3349141474 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9ab4060580 0x7f9ab4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.372+0000 7f9ad4b4e700 1 --2- 172.21.15.37:0/3349141474 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9ab4060580 0x7f9ab4062a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80093f0 tx=0x7f9ab8016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:51.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.380+0000 7f9accff9700 1 -- 172.21.15.37:0/3349141474 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9ac804c7e0 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.536+0000 7f9ad5b50700 1 -- 172.21.15.37:0/3349141474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ad00ca1c0 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9accff9700 1 -- 172.21.15.37:0/3349141474 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f9ac804fe00 con 0x7f9ad00cc3f0 2023-10-06T04:39:51.545 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:51.545 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:15.209829+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:51.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9ad5b50700 1 -- 172.21.15.37:0/3349141474 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9ab4060580 msgr2=0x7f9ab4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9ad5b50700 1 --2- 172.21.15.37:0/3349141474 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9ab4060580 0x7f9ab4062a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80093f0 tx=0x7f9ab8016000 comp rx=0 tx=0).stop 2023-10-06T04:39:51.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9ad5b50700 1 -- 172.21.15.37:0/3349141474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad00cc3f0 msgr2=0x7f9ad00a44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9ad5b50700 1 --2- 172.21.15.37:0/3349141474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad00cc3f0 0x7f9ad00a44b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800c590 tx=0x7f9ac8007d80 comp rx=0 tx=0).stop 2023-10-06T04:39:51.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9ad5b50700 1 -- 172.21.15.37:0/3349141474 shutdown_connections 2023-10-06T04:39:51.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9ad5b50700 1 --2- 172.21.15.37:0/3349141474 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9ab4060580 0x7f9ab4062a30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9ad5b50700 1 --2- 172.21.15.37:0/3349141474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad00cc3f0 0x7f9ad00a44b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9ad5b50700 1 --2- 172.21.15.37:0/3349141474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ad00caca0 0x7f9ad014b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9ad5b50700 1 --2- 172.21.15.37:0/3349141474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad00ad560 0x7f9ad00a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9ad5b50700 1 -- 172.21.15.37:0/3349141474 >> 172.21.15.37:0/3349141474 conn(0x7f9ad0068780 msgr2=0x7f9ad00ac9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:51.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9ad5b50700 1 -- 172.21.15.37:0/3349141474 shutdown_connections 2023-10-06T04:39:51.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.540+0000 7f9ad5b50700 1 -- 172.21.15.37:0/3349141474 wait complete. 2023-10-06T04:39:51.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:08.512565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:09.104711+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:39:12.860905+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:51.560 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:51.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.664+0000 7f6e5b5c8700 1 Processor -- start 2023-10-06T04:39:51.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.664+0000 7f6e5b5c8700 1 -- start start 2023-10-06T04:39:51.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e54069b40 0x7f6e540b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e541537d0 0x7f6e540b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e540b5a60 con 0x7f6e54153400 2023-10-06T04:39:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e540b4c60 con 0x7f6e54069b40 2023-10-06T04:39:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5415a680 con 0x7f6e541537d0 2023-10-06T04:39:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e58b63700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e54069b40 0x7f6e540b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e58b63700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e54069b40 0x7f6e540b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55886/0 (socket says 172.21.15.37:55886) 2023-10-06T04:39:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e58b63700 1 -- 172.21.15.37:0/4064888336 learned_addr learned my addr 172.21.15.37:0/4064888336 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e59b65700 1 --2- 172.21.15.37:0/4064888336 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e541537d0 0x7f6e540b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e58b63700 1 -- 172.21.15.37:0/4064888336 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e541537d0 msgr2=0x7f6e540b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e58b63700 1 --2- 172.21.15.37:0/4064888336 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e541537d0 0x7f6e540b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e58b63700 1 -- 172.21.15.37:0/4064888336 >> v1:172.21.15.83:6789/0 conn(0x7f6e54153400 legacy=0x7f6e54069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e58b63700 1 -- 172.21.15.37:0/4064888336 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e54159950 con 0x7f6e54069b40 2023-10-06T04:39:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e58b63700 1 --2- 172.21.15.37:0/4064888336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e54069b40 0x7f6e540b41e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6e500099b0 tx=0x7f6e50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424ebfae76dafe8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e4bfff700 1 -- 172.21.15.37:0/4064888336 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5000b860 con 0x7f6e54069b40 2023-10-06T04:39:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e4bfff700 1 -- 172.21.15.37:0/4064888336 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5000b9c0 con 0x7f6e54069b40 2023-10-06T04:39:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e4bfff700 1 -- 172.21.15.37:0/4064888336 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5000bd60 con 0x7f6e54069b40 2023-10-06T04:39:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/4064888336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e54069b40 msgr2=0x7f6e540b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 --2- 172.21.15.37:0/4064888336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e54069b40 0x7f6e540b41e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6e500099b0 tx=0x7f6e50009250 comp rx=0 tx=0).stop 2023-10-06T04:39:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/4064888336 shutdown_connections 2023-10-06T04:39:51.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 --2- 172.21.15.37:0/4064888336 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e541537d0 0x7f6e540b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 --2- 172.21.15.37:0/4064888336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e54069b40 0x7f6e540b41e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/4064888336 >> 172.21.15.37:0/4064888336 conn(0x7f6e54067cf0 msgr2=0x7f6e540680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:51.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/4064888336 shutdown_connections 2023-10-06T04:39:51.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.668+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/4064888336 wait complete. 2023-10-06T04:39:51.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e5b5c8700 1 Processor -- start 2023-10-06T04:39:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e5b5c8700 1 -- start start 2023-10-06T04:39:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e5b5c8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e54069b40 0x7f6e5415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e5b5c8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e54153400 0x7f6e5414ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e5b5c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541537d0 0x7f6e5414d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e5b5c8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5414e2b0 con 0x7f6e541537d0 2023-10-06T04:39:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e5b5c8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54169430 con 0x7f6e54069b40 2023-10-06T04:39:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e5b5c8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5414dab0 con 0x7f6e54153400 2023-10-06T04:39:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e59b65700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541537d0 0x7f6e5414d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e59b65700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541537d0 0x7f6e5414d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55888/0 (socket says 172.21.15.37:55888) 2023-10-06T04:39:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e59b65700 1 -- 172.21.15.37:0/3169755979 learned_addr learned my addr 172.21.15.37:0/3169755979 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e59364700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e54069b40 0x7f6e5415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e58b63700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e54153400 0x7f6e5414ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e59b65700 1 -- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e54153400 msgr2=0x7f6e5414ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e59b65700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e54153400 0x7f6e5414ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e59b65700 1 -- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e54069b40 msgr2=0x7f6e5415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e59b65700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e54069b40 0x7f6e5415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e59b65700 1 -- 172.21.15.37:0/3169755979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500094f0 con 0x7f6e541537d0 2023-10-06T04:39:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e58b63700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e54153400 0x7f6e5414ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e59b65700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541537d0 0x7f6e5414d570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c007f80 tx=0x7f6e4c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e497fa700 1 -- 172.21.15.37:0/3169755979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00eca0 con 0x7f6e541537d0 2023-10-06T04:39:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e497fa700 1 -- 172.21.15.37:0/3169755979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c00ee20 con 0x7f6e541537d0 2023-10-06T04:39:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/3169755979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5415e1b0 con 0x7f6e541537d0 2023-10-06T04:39:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e497fa700 1 -- 172.21.15.37:0/3169755979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c014670 con 0x7f6e541537d0 2023-10-06T04:39:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/3169755979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e541690c0 con 0x7f6e541537d0 2023-10-06T04:39:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.672+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/3169755979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e541695c0 con 0x7f6e541537d0 2023-10-06T04:39:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.676+0000 7f6e497fa700 1 -- 172.21.15.37:0/3169755979 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6e4c0149e0 con 0x7f6e541537d0 2023-10-06T04:39:51.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.676+0000 7f6e497fa700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6e38060550 0x7f6e38062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.676+0000 7f6e497fa700 1 -- 172.21.15.37:0/3169755979 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6e4c07d290 con 0x7f6e541537d0 2023-10-06T04:39:51.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.676+0000 7f6e59364700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6e38060550 0x7f6e38062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.676+0000 7f6e59364700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6e38060550 0x7f6e38062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e44003a80 tx=0x7f6e44007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:51.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.684+0000 7f6e497fa700 1 -- 172.21.15.37:0/3169755979 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6e4c04d430 con 0x7f6e541537d0 2023-10-06T04:39:51.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/3169755979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e54070ee0 con 0x7f6e541537d0 2023-10-06T04:39:51.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e497fa700 1 -- 172.21.15.37:0/3169755979 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e4c050a50 con 0x7f6e541537d0 2023-10-06T04:39:51.861 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:39:51.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6e38060550 msgr2=0x7f6e38062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6e38060550 0x7f6e38062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e44003a80 tx=0x7f6e44007ec0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/3169755979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541537d0 msgr2=0x7f6e5414d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541537d0 0x7f6e5414d570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c007f80 tx=0x7f6e4c009860 comp rx=0 tx=0).stop 2023-10-06T04:39:51.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/3169755979 shutdown_connections 2023-10-06T04:39:51.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6e38060550 0x7f6e38062a00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541537d0 0x7f6e5414d570 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e54153400 0x7f6e5414ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 --2- 172.21.15.37:0/3169755979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e54069b40 0x7f6e5415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/3169755979 >> 172.21.15.37:0/3169755979 conn(0x7f6e54067cf0 msgr2=0x7f6e54159b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:51.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/3169755979 shutdown_connections 2023-10-06T04:39:51.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.856+0000 7f6e5b5c8700 1 -- 172.21.15.37:0/3169755979 wait complete. 2023-10-06T04:39:51.876 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:51.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.980+0000 7f905f324700 1 Processor -- start 2023-10-06T04:39:51.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.980+0000 7f905f324700 1 -- start start 2023-10-06T04:39:51.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905f324700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90580ce1a0 0x7f90580af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905f324700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90580cf240 con 0x7f90580aece0 2023-10-06T04:39:51.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905f324700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90580ce630 con 0x7f90580cf6d0 2023-10-06T04:39:51.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905f324700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90581594a0 con 0x7f90580ce1a0 2023-10-06T04:39:51.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905e322700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f90580aece0 0x7f90580cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60136/0 (socket says 172.21.15.37:60136) 2023-10-06T04:39:51.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905e322700 1 -- 172.21.15.37:0/1199828971 learned_addr learned my addr 172.21.15.37:0/1199828971 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:51.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905db21700 1 --2- 172.21.15.37:0/1199828971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90580ce1a0 0x7f90580af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879377371 0 0) 0x7f90580cf240 con 0x7f90580aece0 2023-10-06T04:39:51.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9044003570 con 0x7f90580aece0 2023-10-06T04:39:51.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416889745 0 0) 0x7f90580ce630 con 0x7f90580cf6d0 2023-10-06T04:39:51.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90580cf240 con 0x7f90580cf6d0 2023-10-06T04:39:51.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 18533850 0 0) 0x7f9044003570 con 0x7f90580aece0 2023-10-06T04:39:51.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90580ce1a0 msgr2=0x7f90580af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:51.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 --2- 172.21.15.37:0/1199828971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90580ce1a0 0x7f90580af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 >> v1:172.21.15.83:6789/0 conn(0x7f90580cf6d0 legacy=0x7f90580cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90580ce910 con 0x7f90580aece0 2023-10-06T04:39:51.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f9054001470 con 0x7f90580aece0 2023-10-06T04:39:51.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 >> v1:172.21.15.37:6789/0 conn(0x7f90580aece0 legacy=0x7f90580cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 --2- 172.21.15.37:0/1199828971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9044003c20 0x7f9044004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 --2- 172.21.15.37:0/1199828971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90580ce1a0 0x7f9044004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 --2- 172.21.15.37:0/1199828971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9044004d50 0x7f90440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90581594a0 con 0x7f9044003c20 2023-10-06T04:39:51.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904400bb40 con 0x7f9044004d50 2023-10-06T04:39:51.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904400bd00 con 0x7f90580ce1a0 2023-10-06T04:39:51.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905e322700 1 --2- 172.21.15.37:0/1199828971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9044003c20 0x7f9044004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905db21700 1 --2- 172.21.15.37:0/1199828971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90580ce1a0 0x7f9044004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905eb23700 1 --2- 172.21.15.37:0/1199828971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9044004d50 0x7f90440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905e322700 1 -- 172.21.15.37:0/1199828971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90580ce1a0 msgr2=0x7f9044004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:51.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905e322700 1 --2- 172.21.15.37:0/1199828971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90580ce1a0 0x7f9044004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905e322700 1 -- 172.21.15.37:0/1199828971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9044004d50 msgr2=0x7f90440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:51.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905e322700 1 --2- 172.21.15.37:0/1199828971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9044004d50 0x7f90440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905e322700 1 -- 172.21.15.37:0/1199828971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9044003570 con 0x7f9044003c20 2023-10-06T04:39:51.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905e322700 1 --2- 172.21.15.37:0/1199828971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9044003c20 0x7f9044004010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f905400c2d0 tx=0x7f90580cf1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fa2cb11d31d636 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:51.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905400cc00 con 0x7f9044003c20 2023-10-06T04:39:51.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905400cda0 con 0x7f9044003c20 2023-10-06T04:39:51.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.984+0000 7f905d320700 1 -- 172.21.15.37:0/1199828971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054005b70 con 0x7f9044003c20 2023-10-06T04:39:51.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.988+0000 7f905f324700 1 -- 172.21.15.37:0/1199828971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9044003c20 msgr2=0x7f9044004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.988+0000 7f905f324700 1 --2- 172.21.15.37:0/1199828971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9044003c20 0x7f9044004010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f905400c2d0 tx=0x7f90580cf1b0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.988+0000 7f905eb23700 1 -- 172.21.15.37:0/1199828971 reap_dead start 2023-10-06T04:39:51.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.988+0000 7f905f324700 1 -- 172.21.15.37:0/1199828971 shutdown_connections 2023-10-06T04:39:51.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.988+0000 7f905f324700 1 -- 172.21.15.37:0/1199828971 >> 172.21.15.37:0/1199828971 conn(0x7f9058069d90 msgr2=0x7f9058067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:51.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.988+0000 7f905f324700 1 -- 172.21.15.37:0/1199828971 shutdown_connections 2023-10-06T04:39:51.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.988+0000 7f905f324700 1 -- 172.21.15.37:0/1199828971 wait complete. 2023-10-06T04:39:51.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.988+0000 7f905f324700 1 Processor -- start 2023-10-06T04:39:52.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.988+0000 7f905f324700 1 -- start start 2023-10-06T04:39:52.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905f324700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9044003c20 0x7f90580c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905f324700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90580b5390 0x7f9058149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905f324700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90580d0020 0x7f90580d0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905f324700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90580c7cf0 con 0x7f90580d0020 2023-10-06T04:39:52.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905f324700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9058159dd0 con 0x7f90580b5390 2023-10-06T04:39:52.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905f324700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905815a090 con 0x7f9044003c20 2023-10-06T04:39:52.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905eb23700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90580d0020 0x7f90580d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905e322700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9044003c20 0x7f90580c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905db21700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90580b5390 0x7f9058149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905e322700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9044003c20 0x7f90580c6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:56466/0 (socket says 172.21.15.37:56466) 2023-10-06T04:39:52.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905e322700 1 -- 172.21.15.37:0/2028457684 learned_addr learned my addr 172.21.15.37:0/2028457684 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:52.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905db21700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90580b5390 0x7f9058149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:33106/0 (socket says 172.21.15.37:33106) 2023-10-06T04:39:52.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905e322700 1 -- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90580b5390 msgr2=0x7f9058149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905e322700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90580b5390 0x7f9058149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905e322700 1 -- 172.21.15.37:0/2028457684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90580d0020 msgr2=0x7f90580d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905e322700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90580d0020 0x7f90580d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905e322700 1 -- 172.21.15.37:0/2028457684 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90580d09b0 con 0x7f9044003c20 2023-10-06T04:39:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905eb23700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90580d0020 0x7f90580d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905e322700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9044003c20 0x7f90580c6c70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9054001ed0 tx=0x7f9054015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f904a7fc700 1 -- 172.21.15.37:0/2028457684 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90540070d0 con 0x7f9044003c20 2023-10-06T04:39:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f904a7fc700 1 -- 172.21.15.37:0/2028457684 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9054007230 con 0x7f9044003c20 2023-10-06T04:39:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905f324700 1 -- 172.21.15.37:0/2028457684 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90580c71b0 con 0x7f9044003c20 2023-10-06T04:39:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f904a7fc700 1 -- 172.21.15.37:0/2028457684 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90540075f0 con 0x7f9044003c20 2023-10-06T04:39:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905f324700 1 -- 172.21.15.37:0/2028457684 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90580c7730 con 0x7f9044003c20 2023-10-06T04:39:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.992+0000 7f905f324700 1 -- 172.21.15.37:0/2028457684 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905806a9c0 con 0x7f9044003c20 2023-10-06T04:39:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.996+0000 7f904a7fc700 1 -- 172.21.15.37:0/2028457684 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f905401e430 con 0x7f9044003c20 2023-10-06T04:39:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.996+0000 7f904a7fc700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f903c060580 0x7f903c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.996+0000 7f904a7fc700 1 -- 172.21.15.37:0/2028457684 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f905407d710 con 0x7f9044003c20 2023-10-06T04:39:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.996+0000 7f905db21700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f903c060580 0x7f903c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:51.996+0000 7f905db21700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f903c060580 0x7f903c062a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f905816c3c0 tx=0x7f904c0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.008+0000 7f904a7fc700 1 -- 172.21.15.37:0/2028457684 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f905806a9c0 con 0x7f9044003c20 2023-10-06T04:39:52.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.172+0000 7f905f324700 1 -- 172.21.15.37:0/2028457684 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f905806a9c0 con 0x7f9044003c20 2023-10-06T04:39:52.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f904a7fc700 1 -- 172.21.15.37:0/2028457684 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f905806a9c0 con 0x7f9044003c20 2023-10-06T04:39:52.181 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:39:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f905f324700 1 -- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f903c060580 msgr2=0x7f903c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f905f324700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f903c060580 0x7f903c062a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f905816c3c0 tx=0x7f904c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f905f324700 1 -- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9044003c20 msgr2=0x7f90580c6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f905f324700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9044003c20 0x7f90580c6c70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9054001ed0 tx=0x7f9054015000 comp rx=0 tx=0).stop 2023-10-06T04:39:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f905f324700 1 -- 172.21.15.37:0/2028457684 shutdown_connections 2023-10-06T04:39:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f905f324700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f903c060580 0x7f903c062a30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f905f324700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90580b5390 0x7f9058149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f905f324700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90580d0020 0x7f90580d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f905f324700 1 --2- 172.21.15.37:0/2028457684 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9044003c20 0x7f90580c6c70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f905f324700 1 -- 172.21.15.37:0/2028457684 >> 172.21.15.37:0/2028457684 conn(0x7f9058069d90 msgr2=0x7f90580b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:52.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f905f324700 1 -- 172.21.15.37:0/2028457684 shutdown_connections 2023-10-06T04:39:52.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.176+0000 7f905f324700 1 -- 172.21.15.37:0/2028457684 wait complete. 2023-10-06T04:39:52.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:52.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.300+0000 7f4144a3b700 1 Processor -- start 2023-10-06T04:39:52.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.300+0000 7f4144a3b700 1 -- start start 2023-10-06T04:39:52.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f4144a3b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4140158d20 0x7f41400cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f4144a3b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4140069740 0x7f41400af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f4144a3b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41400cf050 con 0x7f41400cb150 2023-10-06T04:39:52.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f4144a3b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41400d0680 con 0x7f4140158d20 2023-10-06T04:39:52.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f4144a3b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41400ce1a0 con 0x7f4140069740 2023-10-06T04:39:52.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4140069740 0x7f41400af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413f7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4140158d20 0x7f41400cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4140069740 0x7f41400af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:56476/0 (socket says 172.21.15.37:56476) 2023-10-06T04:39:52.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413f7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4140158d20 0x7f41400cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:33108/0 (socket says 172.21.15.37:33108) 2023-10-06T04:39:52.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413ffff700 1 -- 172.21.15.37:0/1262939774 learned_addr learned my addr 172.21.15.37:0/1262939774 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:52.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413effd700 1 --1- 172.21.15.37:0/1262939774 >> v1:172.21.15.83:6789/0 conn(0x7f41400cb150 0x7f4140069030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:38088/0 (socket says 172.21.15.37:38088) 2023-10-06T04:39:52.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413e7fc700 1 -- 172.21.15.37:0/1262939774 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371970551 0 0) 0x7f41400cf050 con 0x7f41400cb150 2023-10-06T04:39:52.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413ffff700 1 -- 172.21.15.37:0/1262939774 >> v2:172.21.15.83:3300/0 conn(0x7f4140158d20 msgr2=0x7f41400cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:52.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413ffff700 1 --2- 172.21.15.37:0/1262939774 >> v2:172.21.15.83:3300/0 conn(0x7f4140158d20 0x7f41400cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413ffff700 1 -- 172.21.15.37:0/1262939774 >> v1:172.21.15.83:6789/0 conn(0x7f41400cb150 legacy=0x7f4140069030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413ffff700 1 -- 172.21.15.37:0/1262939774 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41400ce440 con 0x7f4140069740 2023-10-06T04:39:52.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413ffff700 1 --2- 172.21.15.37:0/1262939774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4140069740 0x7f41400af860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4138009f20 tx=0x7f4138009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e482291ea8c7dfb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413e7fc700 1 -- 172.21.15.37:0/1262939774 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413800e070 con 0x7f4140069740 2023-10-06T04:39:52.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413e7fc700 1 -- 172.21.15.37:0/1262939774 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413800b9d0 con 0x7f4140069740 2023-10-06T04:39:52.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f413e7fc700 1 -- 172.21.15.37:0/1262939774 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380092e0 con 0x7f4140069740 2023-10-06T04:39:52.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f4144a3b700 1 -- 172.21.15.37:0/1262939774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4140069740 msgr2=0x7f41400af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f4144a3b700 1 --2- 172.21.15.37:0/1262939774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4140069740 0x7f41400af860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4138009f20 tx=0x7f4138009840 comp rx=0 tx=0).stop 2023-10-06T04:39:52.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.304+0000 7f4144a3b700 1 -- 172.21.15.37:0/1262939774 shutdown_connections 2023-10-06T04:39:52.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 --2- 172.21.15.37:0/1262939774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4140069740 0x7f41400af860 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 --2- 172.21.15.37:0/1262939774 >> v2:172.21.15.83:3300/0 conn(0x7f4140158d20 0x7f41400cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 -- 172.21.15.37:0/1262939774 >> 172.21.15.37:0/1262939774 conn(0x7f4140068780 msgr2=0x7f41400cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:52.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 -- 172.21.15.37:0/1262939774 shutdown_connections 2023-10-06T04:39:52.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 -- 172.21.15.37:0/1262939774 wait complete. 2023-10-06T04:39:52.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 Processor -- start 2023-10-06T04:39:52.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 -- start start 2023-10-06T04:39:52.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140069740 0x7f41401549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41400cb150 0x7f41401591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4140158d20 0x7f4140159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414015b630 con 0x7f4140158d20 2023-10-06T04:39:52.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414015b8d0 con 0x7f4140069740 2023-10-06T04:39:52.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f4144a3b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414015bbb0 con 0x7f41400cb150 2023-10-06T04:39:52.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f413ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4140158d20 0x7f4140159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f413f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140069740 0x7f41401549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f413effd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41400cb150 0x7f41401591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f413ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4140158d20 0x7f4140159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55910/0 (socket says 172.21.15.37:55910) 2023-10-06T04:39:52.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.308+0000 7f413ffff700 1 -- 172.21.15.37:0/671218604 learned_addr learned my addr 172.21.15.37:0/671218604 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:52.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f413ffff700 1 -- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41400cb150 msgr2=0x7f41401591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f413ffff700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41400cb150 0x7f41401591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f413ffff700 1 -- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140069740 msgr2=0x7f41401549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f413ffff700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140069740 0x7f41401549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f413ffff700 1 -- 172.21.15.37:0/671218604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138009ae0 con 0x7f4140158d20 2023-10-06T04:39:52.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f413effd700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41400cb150 0x7f41401591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:52.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f413ffff700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4140158d20 0x7f4140159b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4138012000 tx=0x7f4138018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f41277fe700 1 -- 172.21.15.37:0/671218604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138008b10 con 0x7f4140158d20 2023-10-06T04:39:52.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f41277fe700 1 -- 172.21.15.37:0/671218604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4138008c90 con 0x7f4140158d20 2023-10-06T04:39:52.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f4144a3b700 1 -- 172.21.15.37:0/671218604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414015be90 con 0x7f4140158d20 2023-10-06T04:39:52.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f41277fe700 1 -- 172.21.15.37:0/671218604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380266b0 con 0x7f4140158d20 2023-10-06T04:39:52.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f4144a3b700 1 -- 172.21.15.37:0/671218604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41401596e0 con 0x7f4140158d20 2023-10-06T04:39:52.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.312+0000 7f4144a3b700 1 -- 172.21.15.37:0/671218604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41400708a0 con 0x7f4140158d20 2023-10-06T04:39:52.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.316+0000 7f41277fe700 1 -- 172.21.15.37:0/671218604 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4138003040 con 0x7f4140158d20 2023-10-06T04:39:52.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.316+0000 7f41277fe700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f412c060580 0x7f412c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.316+0000 7f41277fe700 1 -- 172.21.15.37:0/671218604 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f413807ea90 con 0x7f4140158d20 2023-10-06T04:39:52.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.316+0000 7f413f7fe700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f412c060580 0x7f412c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.316+0000 7f413f7fe700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f412c060580 0x7f412c062a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f41400c9910 tx=0x7f41300091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.320+0000 7f41277fe700 1 -- 172.21.15.37:0/671218604 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f413804ebf0 con 0x7f4140158d20 2023-10-06T04:39:52.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.480+0000 7f4144a3b700 1 -- 172.21.15.37:0/671218604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41400ce720 con 0x7f4140158d20 2023-10-06T04:39:52.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f41277fe700 1 -- 172.21.15.37:0/671218604 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4138052210 con 0x7f4140158d20 2023-10-06T04:39:52.488 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:39:52.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f4144a3b700 1 -- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f412c060580 msgr2=0x7f412c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f4144a3b700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f412c060580 0x7f412c062a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f41400c9910 tx=0x7f41300091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f4144a3b700 1 -- 172.21.15.37:0/671218604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4140158d20 msgr2=0x7f4140159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f4144a3b700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4140158d20 0x7f4140159b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4138012000 tx=0x7f4138018000 comp rx=0 tx=0).stop 2023-10-06T04:39:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f4144a3b700 1 -- 172.21.15.37:0/671218604 shutdown_connections 2023-10-06T04:39:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f4144a3b700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f412c060580 0x7f412c062a30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f4144a3b700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4140158d20 0x7f4140159b30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f4144a3b700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41400cb150 0x7f41401591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f4144a3b700 1 --2- 172.21.15.37:0/671218604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140069740 0x7f41401549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f4144a3b700 1 -- 172.21.15.37:0/671218604 >> 172.21.15.37:0/671218604 conn(0x7f4140068780 msgr2=0x7f41400b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f4144a3b700 1 -- 172.21.15.37:0/671218604 shutdown_connections 2023-10-06T04:39:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.484+0000 7f4144a3b700 1 -- 172.21.15.37:0/671218604 wait complete. 2023-10-06T04:39:52.502 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bdc3c700 1 Processor -- start 2023-10-06T04:39:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bdc3c700 1 -- start start 2023-10-06T04:39:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bdc3c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa2b80ca7a0 0x7fa2b809a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bdc3c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2b8069510 0x7fa2b80cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bdc3c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b809adb0 con 0x7fa2b809b2b0 2023-10-06T04:39:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bdc3c700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b81592a0 con 0x7fa2b8069510 2023-10-06T04:39:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bdc3c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b806b8d0 con 0x7fa2b80ca7a0 2023-10-06T04:39:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bd43b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2b8069510 0x7fa2b80cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2b7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa2b809b2b0 0x7fa2b8068e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60148/0 (socket says 172.21.15.37:60148) 2023-10-06T04:39:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2b7fff700 1 -- 172.21.15.37:0/4007462355 learned_addr learned my addr 172.21.15.37:0/4007462355 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bd43b700 1 --2- 172.21.15.37:0/4007462355 >> v2:172.21.15.37:3300/0 conn(0x7fa2b8069510 0x7fa2b80cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55912/0 (socket says 172.21.15.37:55912) 2023-10-06T04:39:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bcc3a700 1 --2- 172.21.15.37:0/4007462355 >> v2:172.21.15.83:3300/0 conn(0x7fa2b80ca7a0 0x7fa2b809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2b77fe700 1 -- 172.21.15.37:0/4007462355 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242393650 0 0) 0x7fa2b809adb0 con 0x7fa2b809b2b0 2023-10-06T04:39:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2b77fe700 1 -- 172.21.15.37:0/4007462355 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2a0003570 con 0x7fa2b809b2b0 2023-10-06T04:39:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bd43b700 1 -- 172.21.15.37:0/4007462355 >> v2:172.21.15.83:3300/0 conn(0x7fa2b80ca7a0 msgr2=0x7fa2b809a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bd43b700 1 --2- 172.21.15.37:0/4007462355 >> v2:172.21.15.83:3300/0 conn(0x7fa2b80ca7a0 0x7fa2b809a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bd43b700 1 -- 172.21.15.37:0/4007462355 >> v1:172.21.15.37:6789/0 conn(0x7fa2b809b2b0 legacy=0x7fa2b8068e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bd43b700 1 -- 172.21.15.37:0/4007462355 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b806bae0 con 0x7fa2b8069510 2023-10-06T04:39:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2bd43b700 1 --2- 172.21.15.37:0/4007462355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2b8069510 0x7fa2b80cb5f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8064270 tx=0x7fa2b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee821dd1871459b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2b77fe700 1 -- 172.21.15.37:0/4007462355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b000e070 con 0x7fa2b8069510 2023-10-06T04:39:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2b77fe700 1 -- 172.21.15.37:0/4007462355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b000b7a0 con 0x7fa2b8069510 2023-10-06T04:39:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.612+0000 7fa2b77fe700 1 -- 172.21.15.37:0/4007462355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac001470 con 0x7fa2b8069510 2023-10-06T04:39:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/4007462355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2b8069510 msgr2=0x7fa2b80cb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 --2- 172.21.15.37:0/4007462355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2b8069510 0x7fa2b80cb5f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8064270 tx=0x7fa2b0009780 comp rx=0 tx=0).stop 2023-10-06T04:39:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/4007462355 shutdown_connections 2023-10-06T04:39:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 --2- 172.21.15.37:0/4007462355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2b8069510 0x7fa2b80cb5f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 --2- 172.21.15.37:0/4007462355 >> v2:172.21.15.83:3300/0 conn(0x7fa2b80ca7a0 0x7fa2b809a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/4007462355 >> 172.21.15.37:0/4007462355 conn(0x7fa2b80667b0 msgr2=0x7fa2b8066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/4007462355 shutdown_connections 2023-10-06T04:39:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/4007462355 wait complete. 2023-10-06T04:39:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 Processor -- start 2023-10-06T04:39:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 -- start start 2023-10-06T04:39:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2b8069510 0x7fa2b81473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2b809b2b0 0x7fa2b80c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2b80ca7a0 0x7fa2b80cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b8156730 con 0x7fa2b809b2b0 2023-10-06T04:39:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b80c7af0 con 0x7fa2b80ca7a0 2023-10-06T04:39:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bdc3c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b80c7250 con 0x7fa2b8069510 2023-10-06T04:39:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2b7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2b809b2b0 0x7fa2b80c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2b7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2b809b2b0 0x7fa2b80c4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55916/0 (socket says 172.21.15.37:55916) 2023-10-06T04:39:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2b7fff700 1 -- 172.21.15.37:0/3821031641 learned_addr learned my addr 172.21.15.37:0/3821031641 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bd43b700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2b80ca7a0 0x7fa2b80cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2bcc3a700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2b8069510 0x7fa2b81473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2b7fff700 1 -- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2b8069510 msgr2=0x7fa2b81473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2b7fff700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2b8069510 0x7fa2b81473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2b7fff700 1 -- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2b80ca7a0 msgr2=0x7fa2b80cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2b7fff700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2b80ca7a0 0x7fa2b80cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2b7fff700 1 -- 172.21.15.37:0/3821031641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b0009a20 con 0x7fa2b809b2b0 2023-10-06T04:39:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2b7fff700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2b809b2b0 0x7fa2b80c4a60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac001ed0 tx=0x7fa2ac001bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2b4ff9700 1 -- 172.21.15.37:0/3821031641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac007360 con 0x7fa2b809b2b0 2023-10-06T04:39:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.616+0000 7fa2b4ff9700 1 -- 172.21.15.37:0/3821031641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac0074c0 con 0x7fa2b809b2b0 2023-10-06T04:39:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.620+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/3821031641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b80c7530 con 0x7fa2b809b2b0 2023-10-06T04:39:52.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.620+0000 7fa2b4ff9700 1 -- 172.21.15.37:0/3821031641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac004830 con 0x7fa2b809b2b0 2023-10-06T04:39:52.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.620+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/3821031641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b8147910 con 0x7fa2b809b2b0 2023-10-06T04:39:52.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.620+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/3821031641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b80708a0 con 0x7fa2b809b2b0 2023-10-06T04:39:52.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.620+0000 7fa2b4ff9700 1 -- 172.21.15.37:0/3821031641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa2ac004be0 con 0x7fa2b809b2b0 2023-10-06T04:39:52.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.620+0000 7fa2b4ff9700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2a4060550 0x7fa2a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.620+0000 7fa2b4ff9700 1 -- 172.21.15.37:0/3821031641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fa2ac07c4f0 con 0x7fa2b809b2b0 2023-10-06T04:39:52.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.620+0000 7fa2bcc3a700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2a4060550 0x7fa2a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.624+0000 7fa2bcc3a700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2a4060550 0x7fa2a4062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009c90 tx=0x7fa2a8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.628+0000 7fa2b4ff9700 1 -- 172.21.15.37:0/3821031641 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa2ac04abe0 con 0x7fa2b809b2b0 2023-10-06T04:39:52.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.792+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/3821031641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2b806bdc0 con 0x7fa2b809b2b0 2023-10-06T04:39:52.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.792+0000 7fa2b4ff9700 1 -- 172.21.15.37:0/3821031641 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2ac018020 con 0x7fa2b809b2b0 2023-10-06T04:39:52.800 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:39:52.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.796+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2a4060550 msgr2=0x7fa2a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.796+0000 7fa2bdc3c700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2a4060550 0x7fa2a4062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009c90 tx=0x7fa2a8008040 comp rx=0 tx=0).stop 2023-10-06T04:39:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.796+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/3821031641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2b809b2b0 msgr2=0x7fa2b80c4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.796+0000 7fa2bdc3c700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2b809b2b0 0x7fa2b80c4a60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac001ed0 tx=0x7fa2ac001bf0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.796+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/3821031641 shutdown_connections 2023-10-06T04:39:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.796+0000 7fa2bdc3c700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2a4060550 0x7fa2a4062a00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.796+0000 7fa2bdc3c700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2b80ca7a0 0x7fa2b80cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.796+0000 7fa2bdc3c700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2b809b2b0 0x7fa2b80c4a60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.796+0000 7fa2bdc3c700 1 --2- 172.21.15.37:0/3821031641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2b8069510 0x7fa2b81473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.796+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/3821031641 >> 172.21.15.37:0/3821031641 conn(0x7fa2b80667b0 msgr2=0x7fa2b815c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.796+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/3821031641 shutdown_connections 2023-10-06T04:39:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.796+0000 7fa2bdc3c700 1 -- 172.21.15.37:0/3821031641 wait complete. 2023-10-06T04:39:52.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:39:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.916+0000 7fdd766f0700 1 Processor -- start 2023-10-06T04:39:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.916+0000 7fdd766f0700 1 -- start start 2023-10-06T04:39:52.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd700aece0 0x7fdd700af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd700ce1a0 0x7fdd700cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd700cf240 con 0x7fdd700cb130 2023-10-06T04:39:52.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd701594a0 con 0x7fdd700ce1a0 2023-10-06T04:39:52.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700ce630 con 0x7fdd700aece0 2023-10-06T04:39:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd74eed700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd700ce1a0 0x7fdd700cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd74eed700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd700ce1a0 0x7fdd700cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55922/0 (socket says 172.21.15.37:55922) 2023-10-06T04:39:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd74eed700 1 -- 172.21.15.37:0/4024694586 learned_addr learned my addr 172.21.15.37:0/4024694586 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd756ee700 1 --2- 172.21.15.37:0/4024694586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd700aece0 0x7fdd700af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd74eed700 1 -- 172.21.15.37:0/4024694586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd700aece0 msgr2=0x7fdd700af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd74eed700 1 --2- 172.21.15.37:0/4024694586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd700aece0 0x7fdd700af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd74eed700 1 -- 172.21.15.37:0/4024694586 >> v1:172.21.15.83:6789/0 conn(0x7fdd700cb130 legacy=0x7fdd700cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd74eed700 1 -- 172.21.15.37:0/4024694586 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd700ce910 con 0x7fdd700ce1a0 2023-10-06T04:39:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd74eed700 1 --2- 172.21.15.37:0/4024694586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd700ce1a0 0x7fdd700cabf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0099b0 tx=0x7fdd6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8134aa6d4c715a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd67fff700 1 -- 172.21.15.37:0/4024694586 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c00b860 con 0x7fdd700ce1a0 2023-10-06T04:39:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd67fff700 1 -- 172.21.15.37:0/4024694586 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6c00b9c0 con 0x7fdd700ce1a0 2023-10-06T04:39:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd67fff700 1 -- 172.21.15.37:0/4024694586 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c00bd60 con 0x7fdd700ce1a0 2023-10-06T04:39:52.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 -- 172.21.15.37:0/4024694586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd700ce1a0 msgr2=0x7fdd700cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 --2- 172.21.15.37:0/4024694586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd700ce1a0 0x7fdd700cabf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0099b0 tx=0x7fdd6c009250 comp rx=0 tx=0).stop 2023-10-06T04:39:52.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 -- 172.21.15.37:0/4024694586 shutdown_connections 2023-10-06T04:39:52.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 --2- 172.21.15.37:0/4024694586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd700ce1a0 0x7fdd700cabf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 --2- 172.21.15.37:0/4024694586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd700aece0 0x7fdd700af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 -- 172.21.15.37:0/4024694586 >> 172.21.15.37:0/4024694586 conn(0x7fdd70069d90 msgr2=0x7fdd70067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:52.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 -- 172.21.15.37:0/4024694586 shutdown_connections 2023-10-06T04:39:52.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.920+0000 7fdd766f0700 1 -- 172.21.15.37:0/4024694586 wait complete. 2023-10-06T04:39:52.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd766f0700 1 Processor -- start 2023-10-06T04:39:52.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd766f0700 1 -- start start 2023-10-06T04:39:52.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd766f0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd700aece0 0x7fdd700b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd766f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd700cb130 0x7fdd700b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd766f0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd700ce1a0 0x7fdd7015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd766f0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd70169a30 con 0x7fdd700cb130 2023-10-06T04:39:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd766f0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd70169100 con 0x7fdd700aece0 2023-10-06T04:39:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd766f0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd701693e0 con 0x7fdd700ce1a0 2023-10-06T04:39:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd74eed700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd700cb130 0x7fdd700b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd74eed700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd700cb130 0x7fdd700b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55938/0 (socket says 172.21.15.37:55938) 2023-10-06T04:39:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd74eed700 1 -- 172.21.15.37:0/791808531 learned_addr learned my addr 172.21.15.37:0/791808531 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd75eef700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd700ce1a0 0x7fdd7015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd756ee700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd700aece0 0x7fdd700b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd74eed700 1 -- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd700ce1a0 msgr2=0x7fdd7015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd74eed700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd700ce1a0 0x7fdd7015cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd74eed700 1 -- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd700aece0 msgr2=0x7fdd700b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd74eed700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd700aece0 0x7fdd700b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd74eed700 1 -- 172.21.15.37:0/791808531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c0094f0 con 0x7fdd700cb130 2023-10-06T04:39:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.924+0000 7fdd75eef700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd700ce1a0 0x7fdd7015cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.928+0000 7fdd74eed700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd700cb130 0x7fdd700b18e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdd70088820 tx=0x7fdd6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.928+0000 7fdd657fa700 1 -- 172.21.15.37:0/791808531 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c01a420 con 0x7fdd700cb130 2023-10-06T04:39:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.928+0000 7fdd657fa700 1 -- 172.21.15.37:0/791808531 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6c01a5a0 con 0x7fdd700cb130 2023-10-06T04:39:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.928+0000 7fdd766f0700 1 -- 172.21.15.37:0/791808531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd701696c0 con 0x7fdd700cb130 2023-10-06T04:39:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.928+0000 7fdd657fa700 1 -- 172.21.15.37:0/791808531 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c01a960 con 0x7fdd700cb130 2023-10-06T04:39:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.928+0000 7fdd766f0700 1 -- 172.21.15.37:0/791808531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd70156570 con 0x7fdd700cb130 2023-10-06T04:39:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.928+0000 7fdd766f0700 1 -- 172.21.15.37:0/791808531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd70169be0 con 0x7fdd700cb130 2023-10-06T04:39:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.928+0000 7fdd657fa700 1 -- 172.21.15.37:0/791808531 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdd6c01ad10 con 0x7fdd700cb130 2023-10-06T04:39:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.928+0000 7fdd657fa700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdd54060550 0x7fdd54062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.932+0000 7fdd657fa700 1 -- 172.21.15.37:0/791808531 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fdd6c07e630 con 0x7fdd700cb130 2023-10-06T04:39:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.932+0000 7fdd756ee700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdd54060550 0x7fdd54062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.932+0000 7fdd756ee700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdd54060550 0x7fdd54062a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdd60006fd0 tx=0x7fdd60008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:52.936+0000 7fdd657fa700 1 -- 172.21.15.37:0/791808531 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdd70169be0 con 0x7fdd700cb130 2023-10-06T04:39:53.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.096+0000 7fdd766f0700 1 -- 172.21.15.37:0/791808531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdd700708a0 con 0x7fdd700cb130 2023-10-06T04:39:53.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.096+0000 7fdd657fa700 1 -- 172.21.15.37:0/791808531 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdd6c04e790 con 0x7fdd700cb130 2023-10-06T04:39:53.104 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:39:53.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.100+0000 7fdd766f0700 1 -- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdd54060550 msgr2=0x7fdd54062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.100+0000 7fdd766f0700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdd54060550 0x7fdd54062a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdd60006fd0 tx=0x7fdd60008040 comp rx=0 tx=0).stop 2023-10-06T04:39:53.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.100+0000 7fdd766f0700 1 -- 172.21.15.37:0/791808531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd700cb130 msgr2=0x7fdd700b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.100+0000 7fdd766f0700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd700cb130 0x7fdd700b18e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdd70088820 tx=0x7fdd6c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:53.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.100+0000 7fdd766f0700 1 -- 172.21.15.37:0/791808531 shutdown_connections 2023-10-06T04:39:53.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.100+0000 7fdd766f0700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdd54060550 0x7fdd54062a00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.100+0000 7fdd766f0700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd700ce1a0 0x7fdd7015cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.100+0000 7fdd766f0700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd700cb130 0x7fdd700b18e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.100+0000 7fdd766f0700 1 --2- 172.21.15.37:0/791808531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd700aece0 0x7fdd700b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.100+0000 7fdd766f0700 1 -- 172.21.15.37:0/791808531 >> 172.21.15.37:0/791808531 conn(0x7fdd70069d90 msgr2=0x7fdd700c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:53.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.100+0000 7fdd766f0700 1 -- 172.21.15.37:0/791808531 shutdown_connections 2023-10-06T04:39:53.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.100+0000 7fdd766f0700 1 -- 172.21.15.37:0/791808531 wait complete. 2023-10-06T04:39:53.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:53.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.216+0000 7f765bfff700 1 Processor -- start 2023-10-06T04:39:53.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765bfff700 1 -- start start 2023-10-06T04:39:53.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f765c0aa7e0 0x7f765c0a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765bfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c06a1b0 con 0x7f765c06ea10 2023-10-06T04:39:53.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765bfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c0a8f50 con 0x7f765c0aabb0 2023-10-06T04:39:53.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765bfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c1592c0 con 0x7f765c0aa7e0 2023-10-06T04:39:53.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f765c06ea10 0x7f765c067cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60154/0 (socket says 172.21.15.37:60154) 2023-10-06T04:39:53.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765b7fe700 1 -- 172.21.15.37:0/4262050592 learned_addr learned my addr 172.21.15.37:0/4262050592 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:53.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765affd700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f765c0aa7e0 0x7f765c0a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670107633 0 0) 0x7f765c06a1b0 con 0x7f765c06ea10 2023-10-06T04:39:53.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7644003570 con 0x7f765c06ea10 2023-10-06T04:39:53.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3789743971 0 0) 0x7f7644003570 con 0x7f765c06ea10 2023-10-06T04:39:53.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f765c0aa7e0 msgr2=0x7f765c0a8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:53.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f765c0aa7e0 0x7f765c0a8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 >> v1:172.21.15.83:6789/0 conn(0x7f765c0aabb0 legacy=0x7f765c0c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c0c6f00 con 0x7f765c06ea10 2023-10-06T04:39:53.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f7654001470 con 0x7f765c06ea10 2023-10-06T04:39:53.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 >> v1:172.21.15.37:6789/0 conn(0x7f765c06ea10 legacy=0x7f765c067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7644003a90 0x7f7644003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7644004810 0x7f7644004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f765c0aa7e0 0x7f76440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c1592c0 con 0x7f7644004810 2023-10-06T04:39:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764400bb40 con 0x7f7644003a90 2023-10-06T04:39:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764400bd00 con 0x7f765c0aa7e0 2023-10-06T04:39:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765a7fc700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7644004810 0x7f7644004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765b7fe700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f765c0aa7e0 0x7f76440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765affd700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7644003a90 0x7f7644003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765a7fc700 1 -- 172.21.15.37:0/4262050592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f765c0aa7e0 msgr2=0x7f76440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765a7fc700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f765c0aa7e0 0x7f76440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765a7fc700 1 -- 172.21.15.37:0/4262050592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7644003a90 msgr2=0x7f7644003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765a7fc700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7644003a90 0x7f7644003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765a7fc700 1 -- 172.21.15.37:0/4262050592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644003570 con 0x7f7644004810 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765affd700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7644003a90 0x7f7644003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f765a7fc700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7644004810 0x7f7644004c80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f764c002070 tx=0x7f764c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f35b20d3fc4fe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c0019e0 con 0x7f7644004810 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c00c8b0 con 0x7f7644004810 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.220+0000 7f7659ffb700 1 -- 172.21.15.37:0/4262050592 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c00cc50 con 0x7f7644004810 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.224+0000 7f765bfff700 1 -- 172.21.15.37:0/4262050592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7644004810 msgr2=0x7f7644004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.224+0000 7f765bfff700 1 --2- 172.21.15.37:0/4262050592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7644004810 0x7f7644004c80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f764c002070 tx=0x7f764c0016d0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.224+0000 7f765b7fe700 1 -- 172.21.15.37:0/4262050592 reap_dead start 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.224+0000 7f765bfff700 1 -- 172.21.15.37:0/4262050592 shutdown_connections 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.224+0000 7f765bfff700 1 -- 172.21.15.37:0/4262050592 >> 172.21.15.37:0/4262050592 conn(0x7f765c0cc030 msgr2=0x7f765c0cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.224+0000 7f765bfff700 1 -- 172.21.15.37:0/4262050592 shutdown_connections 2023-10-06T04:39:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.224+0000 7f765bfff700 1 -- 172.21.15.37:0/4262050592 wait complete. 2023-10-06T04:39:53.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.224+0000 7f765bfff700 1 Processor -- start 2023-10-06T04:39:53.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.224+0000 7f765bfff700 1 -- start start 2023-10-06T04:39:53.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7644004810 0x7f765c14a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f765c16a3c0 0x7f765c169300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f765c169840 0x7f765c0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765bfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c15a3d0 con 0x7f765c169840 2023-10-06T04:39:53.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765bfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c15a990 con 0x7f765c16a3c0 2023-10-06T04:39:53.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765bfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c169e00 con 0x7f7644004810 2023-10-06T04:39:53.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f765c169840 0x7f765c0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765affd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7644004810 0x7f765c14a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f765c169840 0x7f765c0b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55958/0 (socket says 172.21.15.37:55958) 2023-10-06T04:39:53.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765b7fe700 1 -- 172.21.15.37:0/3725560998 learned_addr learned my addr 172.21.15.37:0/3725560998 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:53.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765a7fc700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f765c16a3c0 0x7f765c169300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765b7fe700 1 -- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7644004810 msgr2=0x7f765c14a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765b7fe700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7644004810 0x7f765c14a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765b7fe700 1 -- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f765c16a3c0 msgr2=0x7f765c169300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765b7fe700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f765c16a3c0 0x7f765c169300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765b7fe700 1 -- 172.21.15.37:0/3725560998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c16a0e0 con 0x7f765c169840 2023-10-06T04:39:53.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765affd700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7644004810 0x7f765c14a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:53.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765a7fc700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f765c16a3c0 0x7f765c169300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:53.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765b7fe700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f765c169840 0x7f765c0b1080 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f765c06ee30 tx=0x7f7654001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f7642ffd700 1 -- 172.21.15.37:0/3725560998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76540114c0 con 0x7f765c169840 2023-10-06T04:39:53.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f7642ffd700 1 -- 172.21.15.37:0/3725560998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7654011620 con 0x7f765c169840 2023-10-06T04:39:53.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f7642ffd700 1 -- 172.21.15.37:0/3725560998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76540119a0 con 0x7f765c169840 2023-10-06T04:39:53.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765bfff700 1 -- 172.21.15.37:0/3725560998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c15a620 con 0x7f765c169840 2023-10-06T04:39:53.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765bfff700 1 -- 172.21.15.37:0/3725560998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c14aae0 con 0x7f765c169840 2023-10-06T04:39:53.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.228+0000 7f765bfff700 1 -- 172.21.15.37:0/3725560998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765c15ab20 con 0x7f765c169840 2023-10-06T04:39:53.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.232+0000 7f7642ffd700 1 -- 172.21.15.37:0/3725560998 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f765401d3b0 con 0x7f765c169840 2023-10-06T04:39:53.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.232+0000 7f7642ffd700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7648060550 0x7f7648062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.232+0000 7f7642ffd700 1 -- 172.21.15.37:0/3725560998 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f765407c630 con 0x7f765c169840 2023-10-06T04:39:53.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.232+0000 7f765affd700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7648060550 0x7f7648062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.232+0000 7f765affd700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7648060550 0x7f7648062a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f765c0cbcc0 tx=0x7f7650008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.236+0000 7f7642ffd700 1 -- 172.21.15.37:0/3725560998 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f765404bbe0 con 0x7f765c169840 2023-10-06T04:39:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.400+0000 7f765bfff700 1 -- 172.21.15.37:0/3725560998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f765c0708a0 con 0x7f765c169840 2023-10-06T04:39:53.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.400+0000 7f7642ffd700 1 -- 172.21.15.37:0/3725560998 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18755 (secure 0 0 0) 0x7f76540502d0 con 0x7f765c169840 2023-10-06T04:39:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:53.409 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:52.800356+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.404+0000 7f765bfff700 1 -- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7648060550 msgr2=0x7f7648062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.404+0000 7f765bfff700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7648060550 0x7f7648062a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f765c0cbcc0 tx=0x7f7650008040 comp rx=0 tx=0).stop 2023-10-06T04:39:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.404+0000 7f765bfff700 1 -- 172.21.15.37:0/3725560998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f765c169840 msgr2=0x7f765c0b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.404+0000 7f765bfff700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f765c169840 0x7f765c0b1080 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f765c06ee30 tx=0x7f7654001da0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.404+0000 7f765bfff700 1 -- 172.21.15.37:0/3725560998 shutdown_connections 2023-10-06T04:39:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.404+0000 7f765bfff700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7648060550 0x7f7648062a00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.404+0000 7f765bfff700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f765c16a3c0 0x7f765c169300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.404+0000 7f765bfff700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f765c169840 0x7f765c0b1080 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.404+0000 7f765bfff700 1 --2- 172.21.15.37:0/3725560998 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7644004810 0x7f765c14a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.404+0000 7f765bfff700 1 -- 172.21.15.37:0/3725560998 >> 172.21.15.37:0/3725560998 conn(0x7f765c0cc030 msgr2=0x7f765c158540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.404+0000 7f765bfff700 1 -- 172.21.15.37:0/3725560998 shutdown_connections 2023-10-06T04:39:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.404+0000 7f765bfff700 1 -- 172.21.15.37:0/3725560998 wait complete. 2023-10-06T04:39:53.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:08.512565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:09.104711+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:39:12.860905+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:53.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.528+0000 7f59a6637700 1 Processor -- start 2023-10-06T04:39:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.528+0000 7f59a6637700 1 -- start start 2023-10-06T04:39:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.528+0000 7f59a6637700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f59a006a9e0 0x7f59a00b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.528+0000 7f59a6637700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59a00b35d0 0x7f59a006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.528+0000 7f59a6637700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a015a060 con 0x7f59a006d310 2023-10-06T04:39:53.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.528+0000 7f59a6637700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a0159240 con 0x7f59a00b35d0 2023-10-06T04:39:53.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.528+0000 7f59a6637700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a006d790 con 0x7f59a006a9e0 2023-10-06T04:39:53.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.528+0000 7f59a4e34700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59a00b35d0 0x7f59a006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.528+0000 7f59a4e34700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59a00b35d0 0x7f59a006cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55962/0 (socket says 172.21.15.37:55962) 2023-10-06T04:39:53.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.528+0000 7f59a4e34700 1 -- 172.21.15.37:0/3565311460 learned_addr learned my addr 172.21.15.37:0/3565311460 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:53.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.528+0000 7f59a5635700 1 --2- 172.21.15.37:0/3565311460 >> v2:172.21.15.83:3300/0 conn(0x7f59a006a9e0 0x7f59a00b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a4e34700 1 -- 172.21.15.37:0/3565311460 >> v2:172.21.15.83:3300/0 conn(0x7f59a006a9e0 msgr2=0x7f59a00b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:53.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a4e34700 1 --2- 172.21.15.37:0/3565311460 >> v2:172.21.15.83:3300/0 conn(0x7f59a006a9e0 0x7f59a00b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a4e34700 1 -- 172.21.15.37:0/3565311460 >> v1:172.21.15.83:6789/0 conn(0x7f59a006d310 legacy=0x7f59a015c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a4e34700 1 -- 172.21.15.37:0/3565311460 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a0159450 con 0x7f59a00b35d0 2023-10-06T04:39:53.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a4e34700 1 --2- 172.21.15.37:0/3565311460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a00b35d0 0x7f59a006cdd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f59a0068af0 tx=0x7f5994009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629aaaee262ee02f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f599ffff700 1 -- 172.21.15.37:0/3565311460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5994009e70 con 0x7f59a00b35d0 2023-10-06T04:39:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f599ffff700 1 -- 172.21.15.37:0/3565311460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599400b860 con 0x7f59a00b35d0 2023-10-06T04:39:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f599ffff700 1 -- 172.21.15.37:0/3565311460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400bc00 con 0x7f59a00b35d0 2023-10-06T04:39:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a6637700 1 -- 172.21.15.37:0/3565311460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a00b35d0 msgr2=0x7f59a006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a6637700 1 --2- 172.21.15.37:0/3565311460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a00b35d0 0x7f59a006cdd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f59a0068af0 tx=0x7f5994009250 comp rx=0 tx=0).stop 2023-10-06T04:39:53.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a6637700 1 -- 172.21.15.37:0/3565311460 shutdown_connections 2023-10-06T04:39:53.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a6637700 1 --2- 172.21.15.37:0/3565311460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a00b35d0 0x7f59a006cdd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a6637700 1 --2- 172.21.15.37:0/3565311460 >> v2:172.21.15.83:3300/0 conn(0x7f59a006a9e0 0x7f59a00b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a6637700 1 -- 172.21.15.37:0/3565311460 >> 172.21.15.37:0/3565311460 conn(0x7f59a00ce400 msgr2=0x7f59a00af390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:53.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a6637700 1 -- 172.21.15.37:0/3565311460 shutdown_connections 2023-10-06T04:39:53.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.532+0000 7f59a6637700 1 -- 172.21.15.37:0/3565311460 wait complete. 2023-10-06T04:39:53.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.536+0000 7f59a6637700 1 Processor -- start 2023-10-06T04:39:53.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.536+0000 7f59a6637700 1 -- start start 2023-10-06T04:39:53.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a6637700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a006a9e0 0x7f59a0149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a6637700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59a006d310 0x7f59a00a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a6637700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a00b35d0 0x7f59a00a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a6637700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a0149a50 con 0x7f59a006a9e0 2023-10-06T04:39:53.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a6637700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00a5c30 con 0x7f59a00b35d0 2023-10-06T04:39:53.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a6637700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a0156dd0 con 0x7f59a006d310 2023-10-06T04:39:53.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a5635700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a006a9e0 0x7f59a0149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a5635700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a006a9e0 0x7f59a0149510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55964/0 (socket says 172.21.15.37:55964) 2023-10-06T04:39:53.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a5635700 1 -- 172.21.15.37:0/2415628102 learned_addr learned my addr 172.21.15.37:0/2415628102 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:53.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a5e36700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a00b35d0 0x7f59a00a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a4e34700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59a006d310 0x7f59a00a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a5635700 1 -- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59a006d310 msgr2=0x7f59a00a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a5635700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59a006d310 0x7f59a00a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a5635700 1 -- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a00b35d0 msgr2=0x7f59a00a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a5635700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a00b35d0 0x7f59a00a49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a5635700 1 -- 172.21.15.37:0/2415628102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59940094f0 con 0x7f59a006a9e0 2023-10-06T04:39:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a5635700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a006a9e0 0x7f59a0149510 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f599000ecb0 tx=0x7f59900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f599d7fa700 1 -- 172.21.15.37:0/2415628102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599000c850 con 0x7f59a006a9e0 2023-10-06T04:39:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f599d7fa700 1 -- 172.21.15.37:0/2415628102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599000c9b0 con 0x7f59a006a9e0 2023-10-06T04:39:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f599d7fa700 1 -- 172.21.15.37:0/2415628102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599000cd50 con 0x7f59a006a9e0 2023-10-06T04:39:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a6637700 1 -- 172.21.15.37:0/2415628102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a00a5020 con 0x7f59a006a9e0 2023-10-06T04:39:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a6637700 1 -- 172.21.15.37:0/2415628102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a00a55e0 con 0x7f59a006a9e0 2023-10-06T04:39:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.540+0000 7f59a6637700 1 -- 172.21.15.37:0/2415628102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a00b1bd0 con 0x7f59a006a9e0 2023-10-06T04:39:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.544+0000 7f599d7fa700 1 -- 172.21.15.37:0/2415628102 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5990013680 con 0x7f59a006a9e0 2023-10-06T04:39:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.544+0000 7f599d7fa700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f598c060550 0x7f598c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.544+0000 7f599d7fa700 1 -- 172.21.15.37:0/2415628102 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f599007cde0 con 0x7f59a006a9e0 2023-10-06T04:39:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.544+0000 7f59a4e34700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f598c060550 0x7f598c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.544+0000 7f59a4e34700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f598c060550 0x7f598c062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f59a0068af0 tx=0x7f5994017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.548+0000 7f599d7fa700 1 -- 172.21.15.37:0/2415628102 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f59a00b1bd0 con 0x7f59a006a9e0 2023-10-06T04:39:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.708+0000 7f59a6637700 1 -- 172.21.15.37:0/2415628102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59a00b1bd0 con 0x7f59a006a9e0 2023-10-06T04:39:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.708+0000 7f599d7fa700 1 -- 172.21.15.37:0/2415628102 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59a00b1bd0 con 0x7f59a006a9e0 2023-10-06T04:39:53.714 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:39:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.708+0000 7f59a6637700 1 -- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f598c060550 msgr2=0x7f598c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.708+0000 7f59a6637700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f598c060550 0x7f598c062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f59a0068af0 tx=0x7f5994017000 comp rx=0 tx=0).stop 2023-10-06T04:39:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.708+0000 7f59a6637700 1 -- 172.21.15.37:0/2415628102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a006a9e0 msgr2=0x7f59a0149510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.708+0000 7f59a6637700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a006a9e0 0x7f59a0149510 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f599000ecb0 tx=0x7f59900091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.708+0000 7f59a6637700 1 -- 172.21.15.37:0/2415628102 shutdown_connections 2023-10-06T04:39:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.708+0000 7f59a6637700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f598c060550 0x7f598c062a00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.708+0000 7f59a6637700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a00b35d0 0x7f59a00a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.708+0000 7f59a6637700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59a006d310 0x7f59a00a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.708+0000 7f59a6637700 1 --2- 172.21.15.37:0/2415628102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a006a9e0 0x7f59a0149510 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.708+0000 7f59a6637700 1 -- 172.21.15.37:0/2415628102 >> 172.21.15.37:0/2415628102 conn(0x7f59a00ce400 msgr2=0x7f59a00ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.712+0000 7f59a6637700 1 -- 172.21.15.37:0/2415628102 shutdown_connections 2023-10-06T04:39:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.712+0000 7f59a6637700 1 -- 172.21.15.37:0/2415628102 wait complete. 2023-10-06T04:39:53.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:53.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2862cc7700 1 Processor -- start 2023-10-06T04:39:53.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2862cc7700 1 -- start start 2023-10-06T04:39:53.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2862cc7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285c06b610 0x7f285c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2862cc7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f285c0c7da0 0x7f285c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2862cc7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285c06b180 con 0x7f285c155b70 2023-10-06T04:39:53.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2862cc7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c06ba60 con 0x7f285c0c7da0 2023-10-06T04:39:53.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2862cc7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0cb920 con 0x7f285c06b610 2023-10-06T04:39:53.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2861264700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f285c0c7da0 0x7f285c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2860a63700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f285c155b70 0x7f285c0cb210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:38124/0 (socket says 172.21.15.37:38124) 2023-10-06T04:39:53.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2860a63700 1 -- 172.21.15.37:0/2605442329 learned_addr learned my addr 172.21.15.37:0/2605442329 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:53.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f285bfff700 1 --2- 172.21.15.37:0/2605442329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285c06b610 0x7f285c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f285b7fe700 1 -- 172.21.15.37:0/2605442329 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665118548 0 0) 0x7f285c06b180 con 0x7f285c155b70 2023-10-06T04:39:53.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f285b7fe700 1 -- 172.21.15.37:0/2605442329 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2848003570 con 0x7f285c155b70 2023-10-06T04:39:53.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2861264700 1 -- 172.21.15.37:0/2605442329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285c06b610 msgr2=0x7f285c155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:53.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2861264700 1 --2- 172.21.15.37:0/2605442329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285c06b610 0x7f285c155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.832+0000 7f2861264700 1 -- 172.21.15.37:0/2605442329 >> v1:172.21.15.83:6789/0 conn(0x7f285c155b70 legacy=0x7f285c0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f2861264700 1 -- 172.21.15.37:0/2605442329 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c06aba0 con 0x7f285c0c7da0 2023-10-06T04:39:53.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f2861264700 1 --2- 172.21.15.37:0/2605442329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0c7da0 0x7f285c0c8220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f28540098e0 tx=0x7f28540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72ec43c41f22605 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f285b7fe700 1 -- 172.21.15.37:0/2605442329 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854011630 con 0x7f285c0c7da0 2023-10-06T04:39:53.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f285b7fe700 1 -- 172.21.15.37:0/2605442329 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2854011790 con 0x7f285c0c7da0 2023-10-06T04:39:53.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f285b7fe700 1 -- 172.21.15.37:0/2605442329 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854011b30 con 0x7f285c0c7da0 2023-10-06T04:39:53.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f2862cc7700 1 -- 172.21.15.37:0/2605442329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0c7da0 msgr2=0x7f285c0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f2862cc7700 1 --2- 172.21.15.37:0/2605442329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0c7da0 0x7f285c0c8220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f28540098e0 tx=0x7f28540091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f2862cc7700 1 -- 172.21.15.37:0/2605442329 shutdown_connections 2023-10-06T04:39:53.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f2862cc7700 1 --2- 172.21.15.37:0/2605442329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0c7da0 0x7f285c0c8220 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f2862cc7700 1 --2- 172.21.15.37:0/2605442329 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285c06b610 0x7f285c155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f2862cc7700 1 -- 172.21.15.37:0/2605442329 >> 172.21.15.37:0/2605442329 conn(0x7f285c0cc180 msgr2=0x7f285c0cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:53.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f2862cc7700 1 -- 172.21.15.37:0/2605442329 shutdown_connections 2023-10-06T04:39:53.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f2862cc7700 1 -- 172.21.15.37:0/2605442329 wait complete. 2023-10-06T04:39:53.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f2862cc7700 1 Processor -- start 2023-10-06T04:39:53.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.836+0000 7f2862cc7700 1 -- start start 2023-10-06T04:39:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2862cc7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285c06b610 0x7f285c14cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2862cc7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0c7da0 0x7f285c0aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2862cc7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f285c155b70 0x7f285c14f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2862cc7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c14d010 con 0x7f285c0c7da0 2023-10-06T04:39:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2862cc7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0b09a0 con 0x7f285c155b70 2023-10-06T04:39:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2862cc7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0af900 con 0x7f285c06b610 2023-10-06T04:39:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f285bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0c7da0 0x7f285c0aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f285bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0c7da0 0x7f285c0aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55986/0 (socket says 172.21.15.37:55986) 2023-10-06T04:39:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f285bfff700 1 -- 172.21.15.37:0/1999287591 learned_addr learned my addr 172.21.15.37:0/1999287591 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2861264700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f285c155b70 0x7f285c14f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2860a63700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285c06b610 0x7f285c14cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f285bfff700 1 -- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285c06b610 msgr2=0x7f285c14cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f285bfff700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285c06b610 0x7f285c14cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f285bfff700 1 -- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f285c155b70 msgr2=0x7f285c14f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f285bfff700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f285c155b70 0x7f285c14f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f285bfff700 1 -- 172.21.15.37:0/1999287591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2854009420 con 0x7f285c0c7da0 2023-10-06T04:39:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2860a63700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285c06b610 0x7f285c14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f285bfff700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0c7da0 0x7f285c0aef20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f284400ec80 tx=0x7f28440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2858ff9700 1 -- 172.21.15.37:0/1999287591 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284400c850 con 0x7f285c0c7da0 2023-10-06T04:39:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2858ff9700 1 -- 172.21.15.37:0/1999287591 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284400c9b0 con 0x7f285c0c7da0 2023-10-06T04:39:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2862cc7700 1 -- 172.21.15.37:0/1999287591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c0afbe0 con 0x7f285c0c7da0 2023-10-06T04:39:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2858ff9700 1 -- 172.21.15.37:0/1999287591 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284400cd50 con 0x7f285c0c7da0 2023-10-06T04:39:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.840+0000 7f2862cc7700 1 -- 172.21.15.37:0/1999287591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c0b01a0 con 0x7f285c0c7da0 2023-10-06T04:39:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.844+0000 7f2862cc7700 1 -- 172.21.15.37:0/1999287591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c070ee0 con 0x7f285c0c7da0 2023-10-06T04:39:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.844+0000 7f2858ff9700 1 -- 172.21.15.37:0/1999287591 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2844013680 con 0x7f285c0c7da0 2023-10-06T04:39:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.844+0000 7f2858ff9700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f283c060550 0x7f283c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.844+0000 7f2858ff9700 1 -- 172.21.15.37:0/1999287591 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f284407d240 con 0x7f285c0c7da0 2023-10-06T04:39:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.844+0000 7f2860a63700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f283c060550 0x7f283c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.844+0000 7f2860a63700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f283c060550 0x7f283c062a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f285c1531c0 tx=0x7f284c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:53.852+0000 7f2858ff9700 1 -- 172.21.15.37:0/1999287591 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f284404d3a0 con 0x7f285c0c7da0 2023-10-06T04:39:54.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.008+0000 7f2862cc7700 1 -- 172.21.15.37:0/1999287591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f285c0cbb80 con 0x7f285c0c7da0 2023-10-06T04:39:54.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.008+0000 7f2858ff9700 1 -- 172.21.15.37:0/1999287591 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f28440509c0 con 0x7f285c0c7da0 2023-10-06T04:39:54.016 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:39:54.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.012+0000 7f2862cc7700 1 -- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f283c060550 msgr2=0x7f283c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.012+0000 7f2862cc7700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f283c060550 0x7f283c062a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f285c1531c0 tx=0x7f284c009040 comp rx=0 tx=0).stop 2023-10-06T04:39:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.012+0000 7f2862cc7700 1 -- 172.21.15.37:0/1999287591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0c7da0 msgr2=0x7f285c0aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.012+0000 7f2862cc7700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0c7da0 0x7f285c0aef20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f284400ec80 tx=0x7f28440091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.012+0000 7f2862cc7700 1 -- 172.21.15.37:0/1999287591 shutdown_connections 2023-10-06T04:39:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.012+0000 7f2862cc7700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f283c060550 0x7f283c062a00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.012+0000 7f2862cc7700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f285c155b70 0x7f285c14f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.012+0000 7f2862cc7700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0c7da0 0x7f285c0aef20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.012+0000 7f2862cc7700 1 --2- 172.21.15.37:0/1999287591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285c06b610 0x7f285c14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.012+0000 7f2862cc7700 1 -- 172.21.15.37:0/1999287591 >> 172.21.15.37:0/1999287591 conn(0x7f285c0cc180 msgr2=0x7f285c0c9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.012+0000 7f2862cc7700 1 -- 172.21.15.37:0/1999287591 shutdown_connections 2023-10-06T04:39:54.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.012+0000 7f2862cc7700 1 -- 172.21.15.37:0/1999287591 wait complete. 2023-10-06T04:39:54.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.132+0000 7fae0b59e700 1 Processor -- start 2023-10-06T04:39:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.132+0000 7fae0b59e700 1 -- start start 2023-10-06T04:39:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae0c069910 0x7fae0c0c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fae0c0c5dd0 0x7fae0c069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0c0b1590 con 0x7fae0c0ae830 2023-10-06T04:39:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c06ae90 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0c6d90 con 0x7fae0c069910 2023-10-06T04:39:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae09d9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fae0c0c5dd0 0x7fae0c069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae09d9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fae0c0c5dd0 0x7fae0c069ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:33188/0 (socket says 172.21.15.37:33188) 2023-10-06T04:39:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae09d9b700 1 -- 172.21.15.37:0/2242159148 learned_addr learned my addr 172.21.15.37:0/2242159148 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0ad9d700 1 --1- 172.21.15.37:0/2242159148 >> v1:172.21.15.83:6789/0 conn(0x7fae0c0ae830 0x7fae0c156700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:38132/0 (socket says 172.21.15.37:38132) 2023-10-06T04:39:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0a59c700 1 --2- 172.21.15.37:0/2242159148 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae0c069910 0x7fae0c0c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae09d9b700 1 -- 172.21.15.37:0/2242159148 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae0c069910 msgr2=0x7fae0c0c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae09d9b700 1 --2- 172.21.15.37:0/2242159148 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae0c069910 0x7fae0c0c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae09d9b700 1 -- 172.21.15.37:0/2242159148 >> v1:172.21.15.83:6789/0 conn(0x7fae0c0ae830 legacy=0x7fae0c156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae09d9b700 1 -- 172.21.15.37:0/2242159148 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c0b0fd0 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae09d9b700 1 --2- 172.21.15.37:0/2242159148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0c0c5dd0 0x7fae0c069ce0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fadf40099b0 tx=0x7fadf4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a3d5935da63be5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0959a700 1 -- 172.21.15.37:0/2242159148 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4009ea0 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0959a700 1 -- 172.21.15.37:0/2242159148 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf400b8f0 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0959a700 1 -- 172.21.15.37:0/2242159148 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf400bc90 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 -- 172.21.15.37:0/2242159148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0c0c5dd0 msgr2=0x7fae0c069ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 --2- 172.21.15.37:0/2242159148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0c0c5dd0 0x7fae0c069ce0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fadf40099b0 tx=0x7fadf4009250 comp rx=0 tx=0).stop 2023-10-06T04:39:54.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 -- 172.21.15.37:0/2242159148 shutdown_connections 2023-10-06T04:39:54.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 --2- 172.21.15.37:0/2242159148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0c0c5dd0 0x7fae0c069ce0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 --2- 172.21.15.37:0/2242159148 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae0c069910 0x7fae0c0c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 -- 172.21.15.37:0/2242159148 >> 172.21.15.37:0/2242159148 conn(0x7fae0c068760 msgr2=0x7fae0c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 -- 172.21.15.37:0/2242159148 shutdown_connections 2023-10-06T04:39:54.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.136+0000 7fae0b59e700 1 -- 172.21.15.37:0/2242159148 wait complete. 2023-10-06T04:39:54.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0b59e700 1 Processor -- start 2023-10-06T04:39:54.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0b59e700 1 -- start start 2023-10-06T04:39:54.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae0c069910 0x7fae0c167610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0b59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0c0ae830 0x7fae0c1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae0c0c5dd0 0x7fae0c0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0b59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c156a10 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0b59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c167cb0 con 0x7fae0c0ae830 2023-10-06T04:39:54.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c167f90 con 0x7fae0c069910 2023-10-06T04:39:54.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae0c0c5dd0 0x7fae0c0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae0c0c5dd0 0x7fae0c0ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55996/0 (socket says 172.21.15.37:55996) 2023-10-06T04:39:54.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0ad9d700 1 -- 172.21.15.37:0/2982881435 learned_addr learned my addr 172.21.15.37:0/2982881435 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:54.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae09d9b700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0c0ae830 0x7fae0c1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0a59c700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae0c069910 0x7fae0c167610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0ad9d700 1 -- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae0c069910 msgr2=0x7fae0c167610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0ad9d700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae0c069910 0x7fae0c167610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0ad9d700 1 -- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0c0ae830 msgr2=0x7fae0c1564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0ad9d700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0c0ae830 0x7fae0c1564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0ad9d700 1 -- 172.21.15.37:0/2982881435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf40094f0 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0a59c700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae0c069910 0x7fae0c167610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:54.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0ad9d700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae0c0c5dd0 0x7fae0c0ad540 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fae0400cd00 tx=0x7fae04001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae027fc700 1 -- 172.21.15.37:0/2982881435 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04005df0 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae027fc700 1 -- 172.21.15.37:0/2982881435 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0400a960 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0b59e700 1 -- 172.21.15.37:0/2982881435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c168270 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae027fc700 1 -- 172.21.15.37:0/2982881435 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0400ad00 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.140+0000 7fae0b59e700 1 -- 172.21.15.37:0/2982881435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c0c38b0 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.144+0000 7fae0b59e700 1 -- 172.21.15.37:0/2982881435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0c0c2540 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.144+0000 7fae027fc700 1 -- 172.21.15.37:0/2982881435 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fae04007300 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.144+0000 7fae027fc700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fadec060580 0x7fadec062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.144+0000 7fae027fc700 1 -- 172.21.15.37:0/2982881435 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fae0407cdd0 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.144+0000 7fae0a59c700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fadec060580 0x7fadec062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.144+0000 7fae0a59c700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fadec060580 0x7fadec062a30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fadfc006f00 tx=0x7fadfc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.152+0000 7fae027fc700 1 -- 172.21.15.37:0/2982881435 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fae0c0c2540 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 -- 172.21.15.37:0/2982881435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae0c0c2540 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae027fc700 1 -- 172.21.15.37:0/2982881435 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae0c0c2540 con 0x7fae0c0c5dd0 2023-10-06T04:39:54.322 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:39:54.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 -- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fadec060580 msgr2=0x7fadec062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fadec060580 0x7fadec062a30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fadfc006f00 tx=0x7fadfc008040 comp rx=0 tx=0).stop 2023-10-06T04:39:54.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 -- 172.21.15.37:0/2982881435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae0c0c5dd0 msgr2=0x7fae0c0ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae0c0c5dd0 0x7fae0c0ad540 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fae0400cd00 tx=0x7fae04001b10 comp rx=0 tx=0).stop 2023-10-06T04:39:54.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 -- 172.21.15.37:0/2982881435 shutdown_connections 2023-10-06T04:39:54.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fadec060580 0x7fadec062a30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0c0ae830 0x7fae0c1564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae0c0c5dd0 0x7fae0c0ad540 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 --2- 172.21.15.37:0/2982881435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae0c069910 0x7fae0c167610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 -- 172.21.15.37:0/2982881435 >> 172.21.15.37:0/2982881435 conn(0x7fae0c068760 msgr2=0x7fae0c154b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 -- 172.21.15.37:0/2982881435 shutdown_connections 2023-10-06T04:39:54.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.316+0000 7fae0b59e700 1 -- 172.21.15.37:0/2982881435 wait complete. 2023-10-06T04:39:54.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:54.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5758e700 1 Processor -- start 2023-10-06T04:39:54.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5758e700 1 -- start start 2023-10-06T04:39:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5758e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faa50158d20 0x7faa500cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5758e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa500cb150 0x7faa50069030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5758e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa500cf050 con 0x7faa50069570 2023-10-06T04:39:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5758e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa500d0680 con 0x7faa50158d20 2023-10-06T04:39:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5758e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa500699f0 con 0x7faa500cb150 2023-10-06T04:39:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa56d8d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faa50069570 0x7faa5015c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60166/0 (socket says 172.21.15.37:60166) 2023-10-06T04:39:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa56d8d700 1 -- 172.21.15.37:0/2805290697 learned_addr learned my addr 172.21.15.37:0/2805290697 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa55d8b700 1 --2- 172.21.15.37:0/2805290697 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa500cb150 0x7faa50069030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5658c700 1 --2- 172.21.15.37:0/2805290697 >> v2:172.21.15.83:3300/0 conn(0x7faa50158d20 0x7faa500cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5558a700 1 -- 172.21.15.37:0/2805290697 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764641169 0 0) 0x7faa500cf050 con 0x7faa50069570 2023-10-06T04:39:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5558a700 1 -- 172.21.15.37:0/2805290697 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa3c003570 con 0x7faa50069570 2023-10-06T04:39:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5658c700 1 -- 172.21.15.37:0/2805290697 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa500cb150 msgr2=0x7faa50069030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5658c700 1 --2- 172.21.15.37:0/2805290697 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa500cb150 0x7faa50069030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5658c700 1 -- 172.21.15.37:0/2805290697 >> v1:172.21.15.37:6789/0 conn(0x7faa50069570 legacy=0x7faa5015c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5658c700 1 -- 172.21.15.37:0/2805290697 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500ce1a0 con 0x7faa50158d20 2023-10-06T04:39:54.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5658c700 1 --2- 172.21.15.37:0/2805290697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa50158d20 0x7faa500cac10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009910 tx=0x7faa4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a105518ac44623e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5558a700 1 -- 172.21.15.37:0/2805290697 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c011630 con 0x7faa50158d20 2023-10-06T04:39:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5558a700 1 -- 172.21.15.37:0/2805290697 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c011790 con 0x7faa50158d20 2023-10-06T04:39:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.448+0000 7faa5558a700 1 -- 172.21.15.37:0/2805290697 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c011b10 con 0x7faa50158d20 2023-10-06T04:39:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.452+0000 7faa5758e700 1 -- 172.21.15.37:0/2805290697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa50158d20 msgr2=0x7faa500cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.452+0000 7faa5758e700 1 --2- 172.21.15.37:0/2805290697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa50158d20 0x7faa500cac10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009910 tx=0x7faa4c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.452+0000 7faa5758e700 1 -- 172.21.15.37:0/2805290697 shutdown_connections 2023-10-06T04:39:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.452+0000 7faa5758e700 1 --2- 172.21.15.37:0/2805290697 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa500cb150 0x7faa50069030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.452+0000 7faa5758e700 1 --2- 172.21.15.37:0/2805290697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa50158d20 0x7faa500cac10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.452+0000 7faa5758e700 1 -- 172.21.15.37:0/2805290697 >> 172.21.15.37:0/2805290697 conn(0x7faa50068780 msgr2=0x7faa500cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.452+0000 7faa5758e700 1 -- 172.21.15.37:0/2805290697 shutdown_connections 2023-10-06T04:39:54.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.452+0000 7faa5758e700 1 -- 172.21.15.37:0/2805290697 wait complete. 2023-10-06T04:39:54.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5758e700 1 Processor -- start 2023-10-06T04:39:54.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5758e700 1 -- start start 2023-10-06T04:39:54.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5758e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa50069570 0x7faa500b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5758e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa500cb150 0x7faa500c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5758e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa50158d20 0x7faa5015cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5758e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa500c71b0 con 0x7faa50069570 2023-10-06T04:39:54.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5758e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa500c73f0 con 0x7faa500cb150 2023-10-06T04:39:54.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5758e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa500c76d0 con 0x7faa50158d20 2023-10-06T04:39:54.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5658c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa50069570 0x7faa500b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5658c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa50069570 0x7faa500b4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56000/0 (socket says 172.21.15.37:56000) 2023-10-06T04:39:54.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5658c700 1 -- 172.21.15.37:0/2534990546 learned_addr learned my addr 172.21.15.37:0/2534990546 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:54.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa55d8b700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa500cb150 0x7faa500c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa56d8d700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa50158d20 0x7faa5015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5658c700 1 -- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa50158d20 msgr2=0x7faa5015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5658c700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa50158d20 0x7faa5015cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5658c700 1 -- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa500cb150 msgr2=0x7faa500c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5658c700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa500cb150 0x7faa500c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5658c700 1 -- 172.21.15.37:0/2534990546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c009420 con 0x7faa50069570 2023-10-06T04:39:54.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5658c700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa50069570 0x7faa500b4be0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009f00 tx=0x7faa4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa467fc700 1 -- 172.21.15.37:0/2534990546 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c011900 con 0x7faa50069570 2023-10-06T04:39:54.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa467fc700 1 -- 172.21.15.37:0/2534990546 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c011a80 con 0x7faa50069570 2023-10-06T04:39:54.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5758e700 1 -- 172.21.15.37:0/2534990546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa500c79b0 con 0x7faa50069570 2023-10-06T04:39:54.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa467fc700 1 -- 172.21.15.37:0/2534990546 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c01a680 con 0x7faa50069570 2023-10-06T04:39:54.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5758e700 1 -- 172.21.15.37:0/2534990546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa501597f0 con 0x7faa50069570 2023-10-06T04:39:54.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.456+0000 7faa5758e700 1 -- 172.21.15.37:0/2534990546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa500708a0 con 0x7faa50069570 2023-10-06T04:39:54.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.460+0000 7faa467fc700 1 -- 172.21.15.37:0/2534990546 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faa4c01aa70 con 0x7faa50069570 2023-10-06T04:39:54.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.460+0000 7faa467fc700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faa34060550 0x7faa34062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.460+0000 7faa467fc700 1 -- 172.21.15.37:0/2534990546 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7faa4c07efd0 con 0x7faa50069570 2023-10-06T04:39:54.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.460+0000 7faa55d8b700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faa34060550 0x7faa34062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.460+0000 7faa55d8b700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faa34060550 0x7faa34062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa5015d710 tx=0x7faa400091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.464+0000 7faa467fc700 1 -- 172.21.15.37:0/2534990546 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faa4c052ba0 con 0x7faa50069570 2023-10-06T04:39:54.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.628+0000 7faa5758e700 1 -- 172.21.15.37:0/2534990546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faa500ce440 con 0x7faa50069570 2023-10-06T04:39:54.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.628+0000 7faa467fc700 1 -- 172.21.15.37:0/2534990546 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7faa4c0340a0 con 0x7faa50069570 2023-10-06T04:39:54.634 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:39:54.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.628+0000 7faa5758e700 1 -- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faa34060550 msgr2=0x7faa34062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.628+0000 7faa5758e700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faa34060550 0x7faa34062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa5015d710 tx=0x7faa400091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.628+0000 7faa5758e700 1 -- 172.21.15.37:0/2534990546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa50069570 msgr2=0x7faa500b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.628+0000 7faa5758e700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa50069570 0x7faa500b4be0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009f00 tx=0x7faa4c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.628+0000 7faa5758e700 1 -- 172.21.15.37:0/2534990546 shutdown_connections 2023-10-06T04:39:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.628+0000 7faa5758e700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faa34060550 0x7faa34062a00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.628+0000 7faa5758e700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa500cb150 0x7faa500c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.628+0000 7faa5758e700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa50158d20 0x7faa5015cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.632+0000 7faa5758e700 1 --2- 172.21.15.37:0/2534990546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa50069570 0x7faa500b4be0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.632+0000 7faa5758e700 1 -- 172.21.15.37:0/2534990546 >> 172.21.15.37:0/2534990546 conn(0x7faa50068780 msgr2=0x7faa500b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.632+0000 7faa5758e700 1 -- 172.21.15.37:0/2534990546 shutdown_connections 2023-10-06T04:39:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.632+0000 7faa5758e700 1 -- 172.21.15.37:0/2534990546 wait complete. 2023-10-06T04:39:54.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:39:54.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.752+0000 7f38f343a700 1 Processor -- start 2023-10-06T04:39:54.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.752+0000 7f38f343a700 1 -- start start 2023-10-06T04:39:54.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f343a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f38ec069b40 0x7f38ec0b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f343a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec1537d0 0x7f38ec0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f343a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ec0b5a60 con 0x7f38ec153400 2023-10-06T04:39:54.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f343a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ec0b4c60 con 0x7f38ec069b40 2023-10-06T04:39:54.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f343a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec15a680 con 0x7f38ec1537d0 2023-10-06T04:39:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f09d5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f38ec069b40 0x7f38ec0b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f19d7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec1537d0 0x7f38ec0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f11d6700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f38ec153400 0x7f38ec069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:38138/0 (socket says 172.21.15.37:38138) 2023-10-06T04:39:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f09d5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f38ec069b40 0x7f38ec0b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:33224/0 (socket says 172.21.15.37:33224) 2023-10-06T04:39:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f19d7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec1537d0 0x7f38ec0b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:56614/0 (socket says 172.21.15.37:56614) 2023-10-06T04:39:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f11d6700 1 -- 172.21.15.37:0/3160235569 learned_addr learned my addr 172.21.15.37:0/3160235569 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f09d5700 1 -- 172.21.15.37:0/3160235569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec1537d0 msgr2=0x7f38ec0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f09d5700 1 --2- 172.21.15.37:0/3160235569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec1537d0 0x7f38ec0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f09d5700 1 -- 172.21.15.37:0/3160235569 >> v1:172.21.15.83:6789/0 conn(0x7f38ec153400 legacy=0x7f38ec069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f09d5700 1 -- 172.21.15.37:0/3160235569 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec159950 con 0x7f38ec069b40 2023-10-06T04:39:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f19d7700 1 --2- 172.21.15.37:0/3160235569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec1537d0 0x7f38ec0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f09d5700 1 --2- 172.21.15.37:0/3160235569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38ec069b40 0x7f38ec0b41e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f38e80098e0 tx=0x7f38e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c72ee9d9153d0087 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38e3fff700 1 -- 172.21.15.37:0/3160235569 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800b640 con 0x7f38ec069b40 2023-10-06T04:39:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38e3fff700 1 -- 172.21.15.37:0/3160235569 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e800b7a0 con 0x7f38ec069b40 2023-10-06T04:39:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38e3fff700 1 -- 172.21.15.37:0/3160235569 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800bb40 con 0x7f38ec069b40 2023-10-06T04:39:54.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.756+0000 7f38f343a700 1 -- 172.21.15.37:0/3160235569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38ec069b40 msgr2=0x7f38ec0b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 --2- 172.21.15.37:0/3160235569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38ec069b40 0x7f38ec0b41e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f38e80098e0 tx=0x7f38e80091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 -- 172.21.15.37:0/3160235569 shutdown_connections 2023-10-06T04:39:54.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 --2- 172.21.15.37:0/3160235569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec1537d0 0x7f38ec0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 --2- 172.21.15.37:0/3160235569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38ec069b40 0x7f38ec0b41e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 -- 172.21.15.37:0/3160235569 >> 172.21.15.37:0/3160235569 conn(0x7f38ec067cf0 msgr2=0x7f38ec0680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 -- 172.21.15.37:0/3160235569 shutdown_connections 2023-10-06T04:39:54.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 -- 172.21.15.37:0/3160235569 wait complete. 2023-10-06T04:39:54.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 Processor -- start 2023-10-06T04:39:54.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 -- start start 2023-10-06T04:39:54.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec069b40 0x7f38ec15d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec153400 0x7f38ec14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38ec1537d0 0x7f38ec155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec157130 con 0x7f38ec153400 2023-10-06T04:39:54.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec15b700 con 0x7f38ec1537d0 2023-10-06T04:39:54.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f343a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec15b9e0 con 0x7f38ec069b40 2023-10-06T04:39:54.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f09d5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec153400 0x7f38ec14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f19d7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38ec1537d0 0x7f38ec155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f09d5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec153400 0x7f38ec14f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56010/0 (socket says 172.21.15.37:56010) 2023-10-06T04:39:54.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f11d6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec069b40 0x7f38ec15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.760+0000 7f38f09d5700 1 -- 172.21.15.37:0/4278580555 learned_addr learned my addr 172.21.15.37:0/4278580555 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:54.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38f11d6700 1 -- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38ec1537d0 msgr2=0x7f38ec155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38f11d6700 1 --2- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38ec1537d0 0x7f38ec155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38f11d6700 1 -- 172.21.15.37:0/4278580555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec153400 msgr2=0x7f38ec14f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38f11d6700 1 --2- 172.21.15.37:0/4278580555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec153400 0x7f38ec14f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38f11d6700 1 -- 172.21.15.37:0/4278580555 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e4009a20 con 0x7f38ec069b40 2023-10-06T04:39:54.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38f11d6700 1 --2- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec069b40 0x7f38ec15d620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00c7c0 tx=0x7f38dc007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38e17fa700 1 -- 172.21.15.37:0/4278580555 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc005b30 con 0x7f38ec069b40 2023-10-06T04:39:54.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38e17fa700 1 -- 172.21.15.37:0/4278580555 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38dc005cb0 con 0x7f38ec069b40 2023-10-06T04:39:54.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38f343a700 1 -- 172.21.15.37:0/4278580555 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e8009420 con 0x7f38ec069b40 2023-10-06T04:39:54.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38e17fa700 1 -- 172.21.15.37:0/4278580555 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc004a80 con 0x7f38ec069b40 2023-10-06T04:39:54.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38f343a700 1 -- 172.21.15.37:0/4278580555 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ec15bfa0 con 0x7f38ec069b40 2023-10-06T04:39:54.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38f343a700 1 -- 172.21.15.37:0/4278580555 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ec1572a0 con 0x7f38ec069b40 2023-10-06T04:39:54.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.764+0000 7f38e17fa700 1 -- 172.21.15.37:0/4278580555 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f38dc005030 con 0x7f38ec069b40 2023-10-06T04:39:54.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.768+0000 7f38e17fa700 1 --2- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f38d0060550 0x7f38d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.768+0000 7f38e17fa700 1 -- 172.21.15.37:0/4278580555 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f38dc07c470 con 0x7f38ec069b40 2023-10-06T04:39:54.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.768+0000 7f38f09d5700 1 --2- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f38d0060550 0x7f38d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.768+0000 7f38f09d5700 1 --2- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f38d0060550 0x7f38d0062a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f38ec16c730 tx=0x7f38e8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.776+0000 7f38e17fa700 1 -- 172.21.15.37:0/4278580555 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f38ec1572a0 con 0x7f38ec069b40 2023-10-06T04:39:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.940+0000 7f38f343a700 1 -- 172.21.15.37:0/4278580555 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f38ec1572a0 con 0x7f38ec069b40 2023-10-06T04:39:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38e17fa700 1 -- 172.21.15.37:0/4278580555 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f38ec1572a0 con 0x7f38ec069b40 2023-10-06T04:39:54.949 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:39:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38f343a700 1 -- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f38d0060550 msgr2=0x7f38d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38f343a700 1 --2- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f38d0060550 0x7f38d0062a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f38ec16c730 tx=0x7f38e8017000 comp rx=0 tx=0).stop 2023-10-06T04:39:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38f343a700 1 -- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec069b40 msgr2=0x7f38ec15d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38f343a700 1 --2- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec069b40 0x7f38ec15d620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00c7c0 tx=0x7f38dc007eb0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38f343a700 1 -- 172.21.15.37:0/4278580555 shutdown_connections 2023-10-06T04:39:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38f343a700 1 --2- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f38d0060550 0x7f38d0062a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38f343a700 1 --2- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38ec1537d0 0x7f38ec155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38f343a700 1 --2- 172.21.15.37:0/4278580555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec153400 0x7f38ec14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38f343a700 1 --2- 172.21.15.37:0/4278580555 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38ec069b40 0x7f38ec15d620 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38f343a700 1 -- 172.21.15.37:0/4278580555 >> 172.21.15.37:0/4278580555 conn(0x7f38ec067cf0 msgr2=0x7f38ec0b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38f343a700 1 -- 172.21.15.37:0/4278580555 shutdown_connections 2023-10-06T04:39:54.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:54.944+0000 7f38f343a700 1 -- 172.21.15.37:0/4278580555 wait complete. 2023-10-06T04:39:54.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:55.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.068+0000 7f9bb8ae1700 1 Processor -- start 2023-10-06T04:39:55.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.068+0000 7f9bb8ae1700 1 -- start start 2023-10-06T04:39:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.068+0000 7f9bb8ae1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9bb4158d10 0x7f9bb40c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.068+0000 7f9bb8ae1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bb40ae7b0 0x7f9bb40c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.068+0000 7f9bb8ae1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb40adc10 con 0x7f9bb41590e0 2023-10-06T04:39:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.068+0000 7f9bb8ae1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb40b1dd0 con 0x7f9bb4158d10 2023-10-06T04:39:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.068+0000 7f9bb8ae1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40ad600 con 0x7f9bb40ae7b0 2023-10-06T04:39:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bb40ae7b0 0x7f9bb40c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb37fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9bb4158d10 0x7f9bb40c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb2ffd700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f9bb41590e0 0x7f9bb40ae0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:38142/0 (socket says 172.21.15.37:38142) 2023-10-06T04:39:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bb40ae7b0 0x7f9bb40c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:56620/0 (socket says 172.21.15.37:56620) 2023-10-06T04:39:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb2ffd700 1 -- 172.21.15.37:0/3829489750 learned_addr learned my addr 172.21.15.37:0/3829489750 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:55.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb3fff700 1 -- 172.21.15.37:0/3829489750 >> v2:172.21.15.83:3300/0 conn(0x7f9bb4158d10 msgr2=0x7f9bb40c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:55.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb27fc700 1 -- 172.21.15.37:0/3829489750 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373335700 0 0) 0x7f9bb40adc10 con 0x7f9bb41590e0 2023-10-06T04:39:55.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb3fff700 1 --2- 172.21.15.37:0/3829489750 >> v2:172.21.15.83:3300/0 conn(0x7f9bb4158d10 0x7f9bb40c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb3fff700 1 -- 172.21.15.37:0/3829489750 >> v1:172.21.15.83:6789/0 conn(0x7f9bb41590e0 legacy=0x7f9bb40ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb3fff700 1 -- 172.21.15.37:0/3829489750 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb40cbb40 con 0x7f9bb40ae7b0 2023-10-06T04:39:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb3fff700 1 --2- 172.21.15.37:0/3829489750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bb40ae7b0 0x7f9bb40c94d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009e60 tx=0x7f9bac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d610b070eb203fbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb27fc700 1 -- 172.21.15.37:0/3829489750 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00bb60 con 0x7f9bb40ae7b0 2023-10-06T04:39:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb27fc700 1 -- 172.21.15.37:0/3829489750 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00bcc0 con 0x7f9bb40ae7b0 2023-10-06T04:39:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb27fc700 1 -- 172.21.15.37:0/3829489750 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac0116b0 con 0x7f9bb40ae7b0 2023-10-06T04:39:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/3829489750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bb40ae7b0 msgr2=0x7f9bb40c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb8ae1700 1 --2- 172.21.15.37:0/3829489750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bb40ae7b0 0x7f9bb40c94d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009e60 tx=0x7f9bac009780 comp rx=0 tx=0).stop 2023-10-06T04:39:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/3829489750 shutdown_connections 2023-10-06T04:39:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb8ae1700 1 --2- 172.21.15.37:0/3829489750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bb40ae7b0 0x7f9bb40c94d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb8ae1700 1 --2- 172.21.15.37:0/3829489750 >> v2:172.21.15.83:3300/0 conn(0x7f9bb4158d10 0x7f9bb40c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/3829489750 >> 172.21.15.37:0/3829489750 conn(0x7f9bb40ccb50 msgr2=0x7f9bb406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:55.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/3829489750 shutdown_connections 2023-10-06T04:39:55.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.072+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/3829489750 wait complete. 2023-10-06T04:39:55.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb8ae1700 1 Processor -- start 2023-10-06T04:39:55.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb8ae1700 1 -- start start 2023-10-06T04:39:55.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb8ae1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bb40ae7b0 0x7f9bb4153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb8ae1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bb4158d10 0x7f9bb41514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb8ae1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bb41590e0 0x7f9bb4156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb8ae1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41679a0 con 0x7f9bb41590e0 2023-10-06T04:39:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb8ae1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb4168800 con 0x7f9bb40ae7b0 2023-10-06T04:39:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb8ae1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb4167bf0 con 0x7f9bb4158d10 2023-10-06T04:39:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bb41590e0 0x7f9bb4156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bb40ae7b0 0x7f9bb4153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bb41590e0 0x7f9bb4156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56022/0 (socket says 172.21.15.37:56022) 2023-10-06T04:39:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb3fff700 1 -- 172.21.15.37:0/171087232 learned_addr learned my addr 172.21.15.37:0/171087232 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb2ffd700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bb4158d10 0x7f9bb41514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb3fff700 1 -- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bb4158d10 msgr2=0x7f9bb41514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb3fff700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bb4158d10 0x7f9bb41514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb3fff700 1 -- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bb40ae7b0 msgr2=0x7f9bb4153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb3fff700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bb40ae7b0 0x7f9bb4153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb3fff700 1 -- 172.21.15.37:0/171087232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac009a20 con 0x7f9bb41590e0 2023-10-06T04:39:55.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb37fe700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bb40ae7b0 0x7f9bb4153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:55.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb3fff700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bb41590e0 0x7f9bb4156cb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40ad740 tx=0x7f9bac01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9b9b7fe700 1 -- 172.21.15.37:0/171087232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac019610 con 0x7f9bb41590e0 2023-10-06T04:39:55.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9b9b7fe700 1 -- 172.21.15.37:0/171087232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac01e070 con 0x7f9bb41590e0 2023-10-06T04:39:55.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/171087232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb4167ed0 con 0x7f9bb41590e0 2023-10-06T04:39:55.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.076+0000 7f9b9b7fe700 1 -- 172.21.15.37:0/171087232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac0199e0 con 0x7f9bb41590e0 2023-10-06T04:39:55.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.080+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/171087232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb4168490 con 0x7f9bb41590e0 2023-10-06T04:39:55.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.080+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/171087232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb40708a0 con 0x7f9bb41590e0 2023-10-06T04:39:55.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.080+0000 7f9b9b7fe700 1 -- 172.21.15.37:0/171087232 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9bac003040 con 0x7f9bb41590e0 2023-10-06T04:39:55.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.080+0000 7f9b9b7fe700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9ba0060580 0x7f9ba0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.080+0000 7f9b9b7fe700 1 -- 172.21.15.37:0/171087232 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f9bac081320 con 0x7f9bb41590e0 2023-10-06T04:39:55.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.080+0000 7f9bb37fe700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9ba0060580 0x7f9ba0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.080+0000 7f9bb37fe700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9ba0060580 0x7f9ba0062a30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4011480 tx=0x7f9ba40091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.088+0000 7f9b9b7fe700 1 -- 172.21.15.37:0/171087232 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9bac051480 con 0x7f9bb41590e0 2023-10-06T04:39:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.252+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/171087232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bb40ad8a0 con 0x7f9bb41590e0 2023-10-06T04:39:55.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9b9b7fe700 1 -- 172.21.15.37:0/171087232 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18755 (secure 0 0 0) 0x7f9bac054aa0 con 0x7f9bb41590e0 2023-10-06T04:39:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:55.262 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:52.800356+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9ba0060580 msgr2=0x7f9ba0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9bb8ae1700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9ba0060580 0x7f9ba0062a30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4011480 tx=0x7f9ba40091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/171087232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bb41590e0 msgr2=0x7f9bb4156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9bb8ae1700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bb41590e0 0x7f9bb4156cb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40ad740 tx=0x7f9bac01b000 comp rx=0 tx=0).stop 2023-10-06T04:39:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/171087232 shutdown_connections 2023-10-06T04:39:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9bb8ae1700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9ba0060580 0x7f9ba0062a30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9bb8ae1700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bb41590e0 0x7f9bb4156cb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9bb8ae1700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bb4158d10 0x7f9bb41514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9bb8ae1700 1 --2- 172.21.15.37:0/171087232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bb40ae7b0 0x7f9bb4153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/171087232 >> 172.21.15.37:0/171087232 conn(0x7f9bb40ccb50 msgr2=0x7f9bb40aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:55.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/171087232 shutdown_connections 2023-10-06T04:39:55.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.256+0000 7f9bb8ae1700 1 -- 172.21.15.37:0/171087232 wait complete. 2023-10-06T04:39:55.279 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:08.512565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:09.104711+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:39:12.860905+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:55.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12dc40700 1 Processor -- start 2023-10-06T04:39:55.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12dc40700 1 -- start start 2023-10-06T04:39:55.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12dc40700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb1280c5dd0 0x7fb1280c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12dc40700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb128069ce0 0x7fb128156e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12dc40700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1280b1590 con 0x7fb128069910 2023-10-06T04:39:55.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12dc40700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12806ae90 con 0x7fb1280c5dd0 2023-10-06T04:39:55.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12dc40700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280c6d90 con 0x7fb128069ce0 2023-10-06T04:39:55.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12d43f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb128069ce0 0x7fb128156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb127fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb1280c5dd0 0x7fb1280c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12cc3e700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fb128069910 0x7fb128156700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:38150/0 (socket says 172.21.15.37:38150) 2023-10-06T04:39:55.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12cc3e700 1 -- 172.21.15.37:0/555735752 learned_addr learned my addr 172.21.15.37:0/555735752 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:55.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12d43f700 1 -- 172.21.15.37:0/555735752 >> v2:172.21.15.83:3300/0 conn(0x7fb1280c5dd0 msgr2=0x7fb1280c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:55.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12d43f700 1 --2- 172.21.15.37:0/555735752 >> v2:172.21.15.83:3300/0 conn(0x7fb1280c5dd0 0x7fb1280c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12d43f700 1 -- 172.21.15.37:0/555735752 >> v1:172.21.15.83:6789/0 conn(0x7fb128069910 legacy=0x7fb128156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.388+0000 7fb12d43f700 1 -- 172.21.15.37:0/555735752 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280b0fd0 con 0x7fb128069ce0 2023-10-06T04:39:55.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb12d43f700 1 --2- 172.21.15.37:0/555735752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb128069ce0 0x7fb128156e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb120009e60 tx=0x7fb120009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8d814d6c1237a11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb1277fe700 1 -- 172.21.15.37:0/555735752 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000e070 con 0x7fb128069ce0 2023-10-06T04:39:55.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb1277fe700 1 -- 172.21.15.37:0/555735752 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12000bbf0 con 0x7fb128069ce0 2023-10-06T04:39:55.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb1277fe700 1 -- 172.21.15.37:0/555735752 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120012430 con 0x7fb128069ce0 2023-10-06T04:39:55.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb12dc40700 1 -- 172.21.15.37:0/555735752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb128069ce0 msgr2=0x7fb128156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb12dc40700 1 --2- 172.21.15.37:0/555735752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb128069ce0 0x7fb128156e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb120009e60 tx=0x7fb120009780 comp rx=0 tx=0).stop 2023-10-06T04:39:55.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb12dc40700 1 -- 172.21.15.37:0/555735752 shutdown_connections 2023-10-06T04:39:55.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb12dc40700 1 --2- 172.21.15.37:0/555735752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb128069ce0 0x7fb128156e10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb12dc40700 1 --2- 172.21.15.37:0/555735752 >> v2:172.21.15.83:3300/0 conn(0x7fb1280c5dd0 0x7fb1280c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb12dc40700 1 -- 172.21.15.37:0/555735752 >> 172.21.15.37:0/555735752 conn(0x7fb128068760 msgr2=0x7fb1280cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:55.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb12dc40700 1 -- 172.21.15.37:0/555735752 shutdown_connections 2023-10-06T04:39:55.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb12dc40700 1 -- 172.21.15.37:0/555735752 wait complete. 2023-10-06T04:39:55.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb12dc40700 1 Processor -- start 2023-10-06T04:39:55.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.392+0000 7fb12dc40700 1 -- start start 2023-10-06T04:39:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12dc40700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb128069910 0x7fb12815e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12dc40700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb128069ce0 0x7fb12815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12dc40700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1280c5dd0 0x7fb12814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12dc40700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12815ea20 con 0x7fb128069910 2023-10-06T04:39:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12dc40700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280c4230 con 0x7fb1280c5dd0 2023-10-06T04:39:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12dc40700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12815e740 con 0x7fb128069ce0 2023-10-06T04:39:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12cc3e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb128069910 0x7fb12815e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12d43f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1280c5dd0 0x7fb12814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb127fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb128069ce0 0x7fb12815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12d43f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1280c5dd0 0x7fb12814eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:33268/0 (socket says 172.21.15.37:33268) 2023-10-06T04:39:55.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12d43f700 1 -- 172.21.15.37:0/2554762004 learned_addr learned my addr 172.21.15.37:0/2554762004 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:55.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12d43f700 1 -- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb128069ce0 msgr2=0x7fb12815bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12d43f700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb128069ce0 0x7fb12815bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12d43f700 1 -- 172.21.15.37:0/2554762004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb128069910 msgr2=0x7fb12815e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12d43f700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb128069910 0x7fb12815e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12d43f700 1 -- 172.21.15.37:0/2554762004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120009a20 con 0x7fb1280c5dd0 2023-10-06T04:39:55.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb127fff700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb128069ce0 0x7fb12815bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:55.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12cc3e700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb128069910 0x7fb12815e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:55.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12d43f700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1280c5dd0 0x7fb12814eea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb12000b6c0 tx=0x7fb120019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb124ff9700 1 -- 172.21.15.37:0/2554762004 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120027470 con 0x7fb1280c5dd0 2023-10-06T04:39:55.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb124ff9700 1 -- 172.21.15.37:0/2554762004 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1200275d0 con 0x7fb1280c5dd0 2023-10-06T04:39:55.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12dc40700 1 -- 172.21.15.37:0/2554762004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1280c3be0 con 0x7fb1280c5dd0 2023-10-06T04:39:55.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb124ff9700 1 -- 172.21.15.37:0/2554762004 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120027990 con 0x7fb1280c5dd0 2023-10-06T04:39:55.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12dc40700 1 -- 172.21.15.37:0/2554762004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12815c0c0 con 0x7fb1280c5dd0 2023-10-06T04:39:55.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.396+0000 7fb12dc40700 1 -- 172.21.15.37:0/2554762004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1280c3a40 con 0x7fb1280c5dd0 2023-10-06T04:39:55.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.400+0000 7fb124ff9700 1 -- 172.21.15.37:0/2554762004 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb120024070 con 0x7fb1280c5dd0 2023-10-06T04:39:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.400+0000 7fb124ff9700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb108060550 0x7fb108062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.400+0000 7fb12cc3e700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb108060550 0x7fb108062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.400+0000 7fb124ff9700 1 -- 172.21.15.37:0/2554762004 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb12007f420 con 0x7fb1280c5dd0 2023-10-06T04:39:55.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.400+0000 7fb12cc3e700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb108060550 0x7fb108062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1100017e0 tx=0x7fb110007eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.408+0000 7fb124ff9700 1 -- 172.21.15.37:0/2554762004 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb1280c3a40 con 0x7fb1280c5dd0 2023-10-06T04:39:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.572+0000 7fb12dc40700 1 -- 172.21.15.37:0/2554762004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1280c3a40 con 0x7fb1280c5dd0 2023-10-06T04:39:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb124ff9700 1 -- 172.21.15.37:0/2554762004 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1280c3a40 con 0x7fb1280c5dd0 2023-10-06T04:39:55.580 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:39:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb12dc40700 1 -- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb108060550 msgr2=0x7fb108062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb12dc40700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb108060550 0x7fb108062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1100017e0 tx=0x7fb110007eb0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb12dc40700 1 -- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1280c5dd0 msgr2=0x7fb12814eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb12dc40700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1280c5dd0 0x7fb12814eea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb12000b6c0 tx=0x7fb120019000 comp rx=0 tx=0).stop 2023-10-06T04:39:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb12dc40700 1 -- 172.21.15.37:0/2554762004 shutdown_connections 2023-10-06T04:39:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb12dc40700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb108060550 0x7fb108062a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb12dc40700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1280c5dd0 0x7fb12814eea0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb12dc40700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb128069ce0 0x7fb12815bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb12dc40700 1 --2- 172.21.15.37:0/2554762004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb128069910 0x7fb12815e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb12dc40700 1 -- 172.21.15.37:0/2554762004 >> 172.21.15.37:0/2554762004 conn(0x7fb128068760 msgr2=0x7fb128152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb12dc40700 1 -- 172.21.15.37:0/2554762004 shutdown_connections 2023-10-06T04:39:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.576+0000 7fb12dc40700 1 -- 172.21.15.37:0/2554762004 wait complete. 2023-10-06T04:39:55.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.708+0000 7f550b377700 1 Processor -- start 2023-10-06T04:39:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.708+0000 7f550b377700 1 -- start start 2023-10-06T04:39:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f550406e190 0x7f550406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f550406f140 0x7f550415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550415ae50 con 0x7f55040c2c60 2023-10-06T04:39:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55040ad370 con 0x7f550406e190 2023-10-06T04:39:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550415b820 con 0x7f550406f140 2023-10-06T04:39:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550a375700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f550406e190 0x7f550406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550a375700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f550406e190 0x7f550406e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56032/0 (socket says 172.21.15.37:56032) 2023-10-06T04:39:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550a375700 1 -- 172.21.15.37:0/2866139686 learned_addr learned my addr 172.21.15.37:0/2866139686 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f5509b74700 1 --2- 172.21.15.37:0/2866139686 >> v2:172.21.15.83:3300/0 conn(0x7f550406f140 0x7f550415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550a375700 1 -- 172.21.15.37:0/2866139686 >> v2:172.21.15.83:3300/0 conn(0x7f550406f140 msgr2=0x7f550415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550a375700 1 --2- 172.21.15.37:0/2866139686 >> v2:172.21.15.83:3300/0 conn(0x7f550406f140 0x7f550415b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550a375700 1 -- 172.21.15.37:0/2866139686 >> v1:172.21.15.83:6789/0 conn(0x7f55040c2c60 legacy=0x7f5504159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550a375700 1 -- 172.21.15.37:0/2866139686 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5504068760 con 0x7f550406e190 2023-10-06T04:39:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f5509b74700 1 --2- 172.21.15.37:0/2866139686 >> v2:172.21.15.83:3300/0 conn(0x7f550406f140 0x7f550415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550a375700 1 --2- 172.21.15.37:0/2866139686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550406e190 0x7f550406e560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f550406b000 tx=0x7f5500009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8799b757db431c6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f5509373700 1 -- 172.21.15.37:0/2866139686 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000b860 con 0x7f550406e190 2023-10-06T04:39:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f5509373700 1 -- 172.21.15.37:0/2866139686 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550000b9c0 con 0x7f550406e190 2023-10-06T04:39:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f5509373700 1 -- 172.21.15.37:0/2866139686 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000bd80 con 0x7f550406e190 2023-10-06T04:39:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 -- 172.21.15.37:0/2866139686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550406e190 msgr2=0x7f550406e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 --2- 172.21.15.37:0/2866139686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550406e190 0x7f550406e560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f550406b000 tx=0x7f5500009250 comp rx=0 tx=0).stop 2023-10-06T04:39:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 -- 172.21.15.37:0/2866139686 shutdown_connections 2023-10-06T04:39:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 --2- 172.21.15.37:0/2866139686 >> v2:172.21.15.83:3300/0 conn(0x7f550406f140 0x7f550415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 --2- 172.21.15.37:0/2866139686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550406e190 0x7f550406e560 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 -- 172.21.15.37:0/2866139686 >> 172.21.15.37:0/2866139686 conn(0x7f55040c9570 msgr2=0x7f5504067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 -- 172.21.15.37:0/2866139686 shutdown_connections 2023-10-06T04:39:55.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.712+0000 7f550b377700 1 -- 172.21.15.37:0/2866139686 wait complete. 2023-10-06T04:39:55.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550b377700 1 Processor -- start 2023-10-06T04:39:55.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550b377700 1 -- start start 2023-10-06T04:39:55.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550b377700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550406e190 0x7f5504169ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550b377700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f550406f140 0x7f550414a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550b377700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55040c2c60 0x7f55040cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550b377700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55040afca0 con 0x7f550406e190 2023-10-06T04:39:55.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550b377700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550416a000 con 0x7f55040c2c60 2023-10-06T04:39:55.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550b377700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55040af090 con 0x7f550406f140 2023-10-06T04:39:55.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550a375700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550406e190 0x7f5504169ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550a375700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550406e190 0x7f5504169ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56036/0 (socket says 172.21.15.37:56036) 2023-10-06T04:39:55.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550a375700 1 -- 172.21.15.37:0/826331784 learned_addr learned my addr 172.21.15.37:0/826331784 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:55.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f5509b74700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f550406f140 0x7f550414a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550ab76700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55040c2c60 0x7f55040cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550a375700 1 -- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f550406f140 msgr2=0x7f550414a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550a375700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f550406f140 0x7f550414a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550a375700 1 -- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55040c2c60 msgr2=0x7f55040cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550a375700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55040c2c60 0x7f55040cab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550a375700 1 -- 172.21.15.37:0/826331784 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55000094f0 con 0x7f550406e190 2023-10-06T04:39:55.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550a375700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550406e190 0x7f5504169ac0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5500006f50 tx=0x7f5500017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f54fa7fc700 1 -- 172.21.15.37:0/826331784 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500002f30 con 0x7f550406e190 2023-10-06T04:39:55.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f54fa7fc700 1 -- 172.21.15.37:0/826331784 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5500011ae0 con 0x7f550406e190 2023-10-06T04:39:55.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f54fa7fc700 1 -- 172.21.15.37:0/826331784 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500011e80 con 0x7f550406e190 2023-10-06T04:39:55.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550b377700 1 -- 172.21.15.37:0/826331784 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55040af370 con 0x7f550406e190 2023-10-06T04:39:55.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.716+0000 7f550b377700 1 -- 172.21.15.37:0/826331784 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55040af930 con 0x7f550406e190 2023-10-06T04:39:55.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.720+0000 7f54fa7fc700 1 -- 172.21.15.37:0/826331784 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5500023070 con 0x7f550406e190 2023-10-06T04:39:55.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.720+0000 7f550b377700 1 -- 172.21.15.37:0/826331784 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55040708a0 con 0x7f550406e190 2023-10-06T04:39:55.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.720+0000 7f54fa7fc700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f54e8060550 0x7f54e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.720+0000 7f54fa7fc700 1 -- 172.21.15.37:0/826331784 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f550007e020 con 0x7f550406e190 2023-10-06T04:39:55.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.720+0000 7f5509b74700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f54e8060550 0x7f54e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.720+0000 7f5509b74700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f54e8060550 0x7f54e8062a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f54f4006fd0 tx=0x7f54f4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.728+0000 7f54fa7fc700 1 -- 172.21.15.37:0/826331784 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f550004e180 con 0x7f550406e190 2023-10-06T04:39:55.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.888+0000 7f550b377700 1 -- 172.21.15.37:0/826331784 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5504068a40 con 0x7f550406e190 2023-10-06T04:39:55.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.888+0000 7f54fa7fc700 1 -- 172.21.15.37:0/826331784 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5500015020 con 0x7f550406e190 2023-10-06T04:39:55.895 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:39:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.892+0000 7f550b377700 1 -- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f54e8060550 msgr2=0x7f54e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.892+0000 7f550b377700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f54e8060550 0x7f54e8062a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f54f4006fd0 tx=0x7f54f4008040 comp rx=0 tx=0).stop 2023-10-06T04:39:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.892+0000 7f550b377700 1 -- 172.21.15.37:0/826331784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550406e190 msgr2=0x7f5504169ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.892+0000 7f550b377700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550406e190 0x7f5504169ac0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5500006f50 tx=0x7f5500017000 comp rx=0 tx=0).stop 2023-10-06T04:39:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.892+0000 7f550b377700 1 -- 172.21.15.37:0/826331784 shutdown_connections 2023-10-06T04:39:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.892+0000 7f550b377700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f54e8060550 0x7f54e8062a00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.892+0000 7f550b377700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55040c2c60 0x7f55040cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.892+0000 7f550b377700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f550406f140 0x7f550414a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.892+0000 7f550b377700 1 --2- 172.21.15.37:0/826331784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550406e190 0x7f5504169ac0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.892+0000 7f550b377700 1 -- 172.21.15.37:0/826331784 >> 172.21.15.37:0/826331784 conn(0x7f55040c9570 msgr2=0x7f5504158680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:55.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.892+0000 7f550b377700 1 -- 172.21.15.37:0/826331784 shutdown_connections 2023-10-06T04:39:55.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:55.892+0000 7f550b377700 1 -- 172.21.15.37:0/826331784 wait complete. 2023-10-06T04:39:55.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:56.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.020+0000 7f4785165700 1 Processor -- start 2023-10-06T04:39:56.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.020+0000 7f4785165700 1 -- start start 2023-10-06T04:39:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.020+0000 7f4785165700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f47800c68f0 0x7f47800c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.020+0000 7f4785165700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4780159820 0x7f4780159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.020+0000 7f4785165700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47800ad700 con 0x7f47800669c0 2023-10-06T04:39:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.020+0000 7f4785165700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47800ad9e0 con 0x7f47800c68f0 2023-10-06T04:39:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.020+0000 7f4785165700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47800adcc0 con 0x7f4780159820 2023-10-06T04:39:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.020+0000 7f4784964700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4780159820 0x7f4780159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.020+0000 7f477ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f47800c68f0 0x7f47800c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.020+0000 7f477f7fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f47800669c0 0x7f47800ace20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:38156/0 (socket says 172.21.15.37:38156) 2023-10-06T04:39:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.020+0000 7f4784964700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4780159820 0x7f4780159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:56658/0 (socket says 172.21.15.37:56658) 2023-10-06T04:39:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.020+0000 7f477f7fe700 1 -- 172.21.15.37:0/1708989914 learned_addr learned my addr 172.21.15.37:0/1708989914 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:56.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4784964700 1 -- 172.21.15.37:0/1708989914 >> v2:172.21.15.83:3300/0 conn(0x7f47800c68f0 msgr2=0x7f47800c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:56.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4784964700 1 --2- 172.21.15.37:0/1708989914 >> v2:172.21.15.83:3300/0 conn(0x7f47800c68f0 0x7f47800c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4784964700 1 -- 172.21.15.37:0/1708989914 >> v1:172.21.15.83:6789/0 conn(0x7f47800669c0 legacy=0x7f47800ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4784964700 1 -- 172.21.15.37:0/1708989914 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47800adfa0 con 0x7f4780159820 2023-10-06T04:39:56.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4784964700 1 --2- 172.21.15.37:0/1708989914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4780159820 0x7f4780159c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4778009e60 tx=0x7f4778009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccef7cf0ca2c91b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f477effd700 1 -- 172.21.15.37:0/1708989914 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477800e070 con 0x7f4780159820 2023-10-06T04:39:56.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f477effd700 1 -- 172.21.15.37:0/1708989914 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477800bbf0 con 0x7f4780159820 2023-10-06T04:39:56.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f477effd700 1 -- 172.21.15.37:0/1708989914 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4778012430 con 0x7f4780159820 2023-10-06T04:39:56.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4785165700 1 -- 172.21.15.37:0/1708989914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4780159820 msgr2=0x7f4780159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4785165700 1 --2- 172.21.15.37:0/1708989914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4780159820 0x7f4780159c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4778009e60 tx=0x7f4778009780 comp rx=0 tx=0).stop 2023-10-06T04:39:56.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4785165700 1 -- 172.21.15.37:0/1708989914 shutdown_connections 2023-10-06T04:39:56.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4785165700 1 --2- 172.21.15.37:0/1708989914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4780159820 0x7f4780159c80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4785165700 1 --2- 172.21.15.37:0/1708989914 >> v2:172.21.15.83:3300/0 conn(0x7f47800c68f0 0x7f47800c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4785165700 1 -- 172.21.15.37:0/1708989914 >> 172.21.15.37:0/1708989914 conn(0x7f47800c9570 msgr2=0x7f4780067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:56.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4785165700 1 -- 172.21.15.37:0/1708989914 shutdown_connections 2023-10-06T04:39:56.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.024+0000 7f4785165700 1 -- 172.21.15.37:0/1708989914 wait complete. 2023-10-06T04:39:56.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f4785165700 1 Processor -- start 2023-10-06T04:39:56.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f4785165700 1 -- start start 2023-10-06T04:39:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f4785165700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800669c0 0x7f478014a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f4785165700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47800c68f0 0x7f47800afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f4785165700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4780159820 0x7f47800b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f4785165700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478014b2a0 con 0x7f47800669c0 2023-10-06T04:39:56.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f4785165700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47800bf690 con 0x7f4780159820 2023-10-06T04:39:56.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f4785165700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47800bf970 con 0x7f47800c68f0 2023-10-06T04:39:56.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f477ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800669c0 0x7f478014a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f477ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800669c0 0x7f478014a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56048/0 (socket says 172.21.15.37:56048) 2023-10-06T04:39:56.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f477ffff700 1 -- 172.21.15.37:0/37704706 learned_addr learned my addr 172.21.15.37:0/37704706 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:56.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f477f7fe700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47800c68f0 0x7f47800afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f4784964700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4780159820 0x7f47800b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f477ffff700 1 -- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47800c68f0 msgr2=0x7f47800afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f477ffff700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47800c68f0 0x7f47800afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f477ffff700 1 -- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4780159820 msgr2=0x7f47800b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f477ffff700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4780159820 0x7f47800b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.028+0000 7f477ffff700 1 -- 172.21.15.37:0/37704706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4778009a20 con 0x7f47800669c0 2023-10-06T04:39:56.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.032+0000 7f477ffff700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800669c0 0x7f478014a550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f477000ec80 tx=0x7f47700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.032+0000 7f4767fff700 1 -- 172.21.15.37:0/37704706 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000c850 con 0x7f47800669c0 2023-10-06T04:39:56.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.032+0000 7f4767fff700 1 -- 172.21.15.37:0/37704706 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000c9b0 con 0x7f47800669c0 2023-10-06T04:39:56.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.032+0000 7f4785165700 1 -- 172.21.15.37:0/37704706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47800bfc50 con 0x7f47800669c0 2023-10-06T04:39:56.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.032+0000 7f4767fff700 1 -- 172.21.15.37:0/37704706 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000cd50 con 0x7f47800669c0 2023-10-06T04:39:56.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.032+0000 7f4785165700 1 -- 172.21.15.37:0/37704706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47800c0210 con 0x7f47800669c0 2023-10-06T04:39:56.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.032+0000 7f4785165700 1 -- 172.21.15.37:0/37704706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47800708a0 con 0x7f47800669c0 2023-10-06T04:39:56.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.032+0000 7f4767fff700 1 -- 172.21.15.37:0/37704706 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4770013680 con 0x7f47800669c0 2023-10-06T04:39:56.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.036+0000 7f4767fff700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f476c060550 0x7f476c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.036+0000 7f4767fff700 1 -- 172.21.15.37:0/37704706 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f477007cf00 con 0x7f47800669c0 2023-10-06T04:39:56.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.036+0000 7f477f7fe700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f476c060550 0x7f476c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.036+0000 7f477f7fe700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f476c060550 0x7f476c062a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f478014c890 tx=0x7f4774007eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.040+0000 7f4767fff700 1 -- 172.21.15.37:0/37704706 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f477004d060 con 0x7f47800669c0 2023-10-06T04:39:56.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 -- 172.21.15.37:0/37704706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4780066de0 con 0x7f47800669c0 2023-10-06T04:39:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4767fff700 1 -- 172.21.15.37:0/37704706 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4770050680 con 0x7f47800669c0 2023-10-06T04:39:56.209 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:39:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 -- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f476c060550 msgr2=0x7f476c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f476c060550 0x7f476c062a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f478014c890 tx=0x7f4774007eb0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 -- 172.21.15.37:0/37704706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800669c0 msgr2=0x7f478014a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800669c0 0x7f478014a550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f477000ec80 tx=0x7f47700091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 -- 172.21.15.37:0/37704706 shutdown_connections 2023-10-06T04:39:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f476c060550 0x7f476c062a00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4780159820 0x7f47800b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47800c68f0 0x7f47800afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 --2- 172.21.15.37:0/37704706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800669c0 0x7f478014a550 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 -- 172.21.15.37:0/37704706 >> 172.21.15.37:0/37704706 conn(0x7f47800c9570 msgr2=0x7f478006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:56.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 -- 172.21.15.37:0/37704706 shutdown_connections 2023-10-06T04:39:56.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.204+0000 7f4785165700 1 -- 172.21.15.37:0/37704706 wait complete. 2023-10-06T04:39:56.224 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:56.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.332+0000 7fdf055e2700 1 Processor -- start 2023-10-06T04:39:56.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.332+0000 7fdf055e2700 1 -- start start 2023-10-06T04:39:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf00156960 0x7fdf0006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf00156d30 0x7fdf0006ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0006cf50 con 0x7fdf000cca30 2023-10-06T04:39:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0006c390 con 0x7fdf00156960 2023-10-06T04:39:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000c28f0 con 0x7fdf00156d30 2023-10-06T04:39:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdefffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf00156960 0x7fdf0006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdefffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf00156960 0x7fdf0006bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56058/0 (socket says 172.21.15.37:56058) 2023-10-06T04:39:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdefffff700 1 -- 172.21.15.37:0/3937833619 learned_addr learned my addr 172.21.15.37:0/3937833619 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdeff7fe700 1 --2- 172.21.15.37:0/3937833619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf00156d30 0x7fdf0006ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdefffff700 1 -- 172.21.15.37:0/3937833619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf00156d30 msgr2=0x7fdf0006ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdefffff700 1 --2- 172.21.15.37:0/3937833619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf00156d30 0x7fdf0006ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdefffff700 1 -- 172.21.15.37:0/3937833619 >> v1:172.21.15.83:6789/0 conn(0x7fdf000cca30 legacy=0x7fdf000cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdefffff700 1 -- 172.21.15.37:0/3937833619 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf000c2b90 con 0x7fdf00156960 2023-10-06T04:39:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdefffff700 1 --2- 172.21.15.37:0/3937833619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00156960 0x7fdf0006bd80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdef00099a0 tx=0x7fdef0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b5ef725822469c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdefeffd700 1 -- 172.21.15.37:0/3937833619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0009e90 con 0x7fdf00156960 2023-10-06T04:39:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdefeffd700 1 -- 172.21.15.37:0/3937833619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef000b760 con 0x7fdf00156960 2023-10-06T04:39:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdefeffd700 1 -- 172.21.15.37:0/3937833619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef000bb20 con 0x7fdf00156960 2023-10-06T04:39:56.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 -- 172.21.15.37:0/3937833619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00156960 msgr2=0x7fdf0006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 --2- 172.21.15.37:0/3937833619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00156960 0x7fdf0006bd80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdef00099a0 tx=0x7fdef0009250 comp rx=0 tx=0).stop 2023-10-06T04:39:56.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 -- 172.21.15.37:0/3937833619 shutdown_connections 2023-10-06T04:39:56.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 --2- 172.21.15.37:0/3937833619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf00156d30 0x7fdf0006ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 --2- 172.21.15.37:0/3937833619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00156960 0x7fdf0006bd80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 -- 172.21.15.37:0/3937833619 >> 172.21.15.37:0/3937833619 conn(0x7fdf000667b0 msgr2=0x7fdf00066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:56.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 -- 172.21.15.37:0/3937833619 shutdown_connections 2023-10-06T04:39:56.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.336+0000 7fdf055e2700 1 -- 172.21.15.37:0/3937833619 wait complete. 2023-10-06T04:39:56.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdf055e2700 1 Processor -- start 2023-10-06T04:39:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdf055e2700 1 -- start start 2023-10-06T04:39:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdf055e2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf000cca30 0x7fdf001581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdf055e2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00156960 0x7fdf000c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdf055e2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf00156d30 0x7fdf00159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdf055e2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf00158730 con 0x7fdf00156960 2023-10-06T04:39:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdf055e2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf00157730 con 0x7fdf000cca30 2023-10-06T04:39:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdf055e2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000c7690 con 0x7fdf00156d30 2023-10-06T04:39:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdeff7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00156960 0x7fdf000c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdeff7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00156960 0x7fdf000c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56062/0 (socket says 172.21.15.37:56062) 2023-10-06T04:39:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdeff7fe700 1 -- 172.21.15.37:0/216571331 learned_addr learned my addr 172.21.15.37:0/216571331 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdefffff700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf000cca30 0x7fdf001581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdf04de1700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf00156d30 0x7fdf00159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdeff7fe700 1 -- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf00156d30 msgr2=0x7fdf00159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdeff7fe700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf00156d30 0x7fdf00159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdeff7fe700 1 -- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf000cca30 msgr2=0x7fdf001581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdeff7fe700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf000cca30 0x7fdf001581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdeff7fe700 1 -- 172.21.15.37:0/216571331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef0009490 con 0x7fdf00156960 2023-10-06T04:39:56.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdefffff700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf000cca30 0x7fdf001581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdeff7fe700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00156960 0x7fdf000c5dd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdee800e950 tx=0x7fdee80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.340+0000 7fdef7fff700 1 -- 172.21.15.37:0/216571331 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8013680 con 0x7fdf00156960 2023-10-06T04:39:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.344+0000 7fdef7fff700 1 -- 172.21.15.37:0/216571331 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee80137e0 con 0x7fdf00156960 2023-10-06T04:39:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.344+0000 7fdf055e2700 1 -- 172.21.15.37:0/216571331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf001579f0 con 0x7fdf00156960 2023-10-06T04:39:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.344+0000 7fdef7fff700 1 -- 172.21.15.37:0/216571331 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8013ba0 con 0x7fdf00156960 2023-10-06T04:39:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.344+0000 7fdf055e2700 1 -- 172.21.15.37:0/216571331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf000c6310 con 0x7fdf00156960 2023-10-06T04:39:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.344+0000 7fdf055e2700 1 -- 172.21.15.37:0/216571331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf000708a0 con 0x7fdf00156960 2023-10-06T04:39:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.344+0000 7fdef7fff700 1 -- 172.21.15.37:0/216571331 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdee801c450 con 0x7fdf00156960 2023-10-06T04:39:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.344+0000 7fdef7fff700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdee0060550 0x7fdee0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.344+0000 7fdef7fff700 1 -- 172.21.15.37:0/216571331 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fdee807cce0 con 0x7fdf00156960 2023-10-06T04:39:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.348+0000 7fdefffff700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdee0060550 0x7fdee0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.348+0000 7fdefffff700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdee0060550 0x7fdee0062a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdef00099a0 tx=0x7fdef0016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.352+0000 7fdef7fff700 1 -- 172.21.15.37:0/216571331 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdee804ce40 con 0x7fdf00156960 2023-10-06T04:39:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.512+0000 7fdf055e2700 1 -- 172.21.15.37:0/216571331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf000c2e70 con 0x7fdf00156960 2023-10-06T04:39:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.512+0000 7fdef7fff700 1 -- 172.21.15.37:0/216571331 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdee8050460 con 0x7fdf00156960 2023-10-06T04:39:56.518 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:39:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.516+0000 7fdf055e2700 1 -- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdee0060550 msgr2=0x7fdee0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.516+0000 7fdf055e2700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdee0060550 0x7fdee0062a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdef00099a0 tx=0x7fdef0016000 comp rx=0 tx=0).stop 2023-10-06T04:39:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.516+0000 7fdf055e2700 1 -- 172.21.15.37:0/216571331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00156960 msgr2=0x7fdf000c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.516+0000 7fdf055e2700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00156960 0x7fdf000c5dd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdee800e950 tx=0x7fdee80091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.516+0000 7fdf055e2700 1 -- 172.21.15.37:0/216571331 shutdown_connections 2023-10-06T04:39:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.516+0000 7fdf055e2700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdee0060550 0x7fdee0062a00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.516+0000 7fdf055e2700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf00156d30 0x7fdf00159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.516+0000 7fdf055e2700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00156960 0x7fdf000c5dd0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.516+0000 7fdf055e2700 1 --2- 172.21.15.37:0/216571331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf000cca30 0x7fdf001581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.516+0000 7fdf055e2700 1 -- 172.21.15.37:0/216571331 >> 172.21.15.37:0/216571331 conn(0x7fdf000667b0 msgr2=0x7fdf00150f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.516+0000 7fdf055e2700 1 -- 172.21.15.37:0/216571331 shutdown_connections 2023-10-06T04:39:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.516+0000 7fdf055e2700 1 -- 172.21.15.37:0/216571331 wait complete. 2023-10-06T04:39:56.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:39:56.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.644+0000 7f47d0c46700 1 Processor -- start 2023-10-06T04:39:56.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.644+0000 7f47d0c46700 1 -- start start 2023-10-06T04:39:56.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.644+0000 7f47d0c46700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47cc0669c0 0x7f47cc0c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.644+0000 7f47d0c46700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0ad700 con 0x7f47cc0c68f0 2023-10-06T04:39:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.644+0000 7f47d0c46700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0ad9e0 con 0x7f47cc159820 2023-10-06T04:39:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.644+0000 7f47d0c46700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0adcc0 con 0x7f47cc0669c0 2023-10-06T04:39:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.644+0000 7f47cb7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f47cc0c68f0 0x7f47cc0ace20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60182/0 (socket says 172.21.15.37:60182) 2023-10-06T04:39:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.644+0000 7f47cb7fe700 1 -- 172.21.15.37:0/486145922 learned_addr learned my addr 172.21.15.37:0/486145922 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.644+0000 7f47caffd700 1 --2- 172.21.15.37:0/486145922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47cc0669c0 0x7f47cc0c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47ca7fc700 1 -- 172.21.15.37:0/486145922 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877993758 0 0) 0x7f47cc0ad700 con 0x7f47cc0c68f0 2023-10-06T04:39:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47ca7fc700 1 -- 172.21.15.37:0/486145922 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b4003570 con 0x7f47cc0c68f0 2023-10-06T04:39:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47ca7fc700 1 -- 172.21.15.37:0/486145922 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988691133 0 0) 0x7f47cc0ad9e0 con 0x7f47cc159820 2023-10-06T04:39:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47ca7fc700 1 -- 172.21.15.37:0/486145922 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47cc0ad700 con 0x7f47cc159820 2023-10-06T04:39:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47caffd700 1 -- 172.21.15.37:0/486145922 >> v1:172.21.15.83:6789/0 conn(0x7f47cc159820 legacy=0x7f47cc159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47caffd700 1 -- 172.21.15.37:0/486145922 >> v1:172.21.15.37:6789/0 conn(0x7f47cc0c68f0 legacy=0x7f47cc0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47ca7fc700 1 -- 172.21.15.37:0/486145922 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3859518210 0 0) 0x7f47b4003570 con 0x7f47cc0c68f0 2023-10-06T04:39:56.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47caffd700 1 -- 172.21.15.37:0/486145922 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0adfa0 con 0x7f47cc0669c0 2023-10-06T04:39:56.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47caffd700 1 --2- 172.21.15.37:0/486145922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47cc0669c0 0x7f47cc0c6cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009910 tx=0x7f47c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa7fb2e641797d37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47ca7fc700 1 -- 172.21.15.37:0/486145922 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0017f0 con 0x7f47cc0669c0 2023-10-06T04:39:56.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47ca7fc700 1 -- 172.21.15.37:0/486145922 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c0011420 con 0x7f47cc0669c0 2023-10-06T04:39:56.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47ca7fc700 1 -- 172.21.15.37:0/486145922 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c00117a0 con 0x7f47cc0669c0 2023-10-06T04:39:56.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47d0c46700 1 -- 172.21.15.37:0/486145922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47cc0669c0 msgr2=0x7f47cc0c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47d0c46700 1 --2- 172.21.15.37:0/486145922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47cc0669c0 0x7f47cc0c6cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009910 tx=0x7f47c00091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47d0c46700 1 -- 172.21.15.37:0/486145922 shutdown_connections 2023-10-06T04:39:56.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47d0c46700 1 --2- 172.21.15.37:0/486145922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47cc0669c0 0x7f47cc0c6cc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47d0c46700 1 -- 172.21.15.37:0/486145922 >> 172.21.15.37:0/486145922 conn(0x7f47cc0c9570 msgr2=0x7f47cc067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:56.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47d0c46700 1 -- 172.21.15.37:0/486145922 shutdown_connections 2023-10-06T04:39:56.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.648+0000 7f47d0c46700 1 -- 172.21.15.37:0/486145922 wait complete. 2023-10-06T04:39:56.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47d0c46700 1 Processor -- start 2023-10-06T04:39:56.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47d0c46700 1 -- start start 2023-10-06T04:39:56.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47d0c46700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc0669c0 0x7f47cc166db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47d0c46700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc0c68f0 0x7f47cc156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47d0c46700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47cc159820 0x7f47cc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47d0c46700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc157220 con 0x7f47cc0c68f0 2023-10-06T04:39:56.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47d0c46700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc167f60 con 0x7f47cc0669c0 2023-10-06T04:39:56.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47d0c46700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc1673e0 con 0x7f47cc159820 2023-10-06T04:39:56.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47caffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc0c68f0 0x7f47cc156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47caffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc0c68f0 0x7f47cc156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56066/0 (socket says 172.21.15.37:56066) 2023-10-06T04:39:56.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47caffd700 1 -- 172.21.15.37:0/962366849 learned_addr learned my addr 172.21.15.37:0/962366849 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:56.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47cb7fe700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc0669c0 0x7f47cc166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47cbfff700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47cc159820 0x7f47cc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47caffd700 1 -- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47cc159820 msgr2=0x7f47cc06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47caffd700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47cc159820 0x7f47cc06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47caffd700 1 -- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc0669c0 msgr2=0x7f47cc166db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47caffd700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc0669c0 0x7f47cc166db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47caffd700 1 -- 172.21.15.37:0/962366849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c0009420 con 0x7f47cc0c68f0 2023-10-06T04:39:56.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47cb7fe700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc0669c0 0x7f47cc166db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:56.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47caffd700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc0c68f0 0x7f47cc156ce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009f00 tx=0x7f47c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47b37fe700 1 -- 172.21.15.37:0/962366849 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c001cbd0 con 0x7f47cc0c68f0 2023-10-06T04:39:56.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47b37fe700 1 -- 172.21.15.37:0/962366849 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c001cd30 con 0x7f47cc0c68f0 2023-10-06T04:39:56.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47d0c46700 1 -- 172.21.15.37:0/962366849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc1676c0 con 0x7f47cc0c68f0 2023-10-06T04:39:56.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47b37fe700 1 -- 172.21.15.37:0/962366849 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c001cea0 con 0x7f47cc0c68f0 2023-10-06T04:39:56.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47d0c46700 1 -- 172.21.15.37:0/962366849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc167c80 con 0x7f47cc0c68f0 2023-10-06T04:39:56.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47d0c46700 1 -- 172.21.15.37:0/962366849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc0c31a0 con 0x7f47cc0c68f0 2023-10-06T04:39:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.652+0000 7f47b37fe700 1 -- 172.21.15.37:0/962366849 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f47c001a910 con 0x7f47cc0c68f0 2023-10-06T04:39:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.656+0000 7f47b37fe700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f47b8060550 0x7f47b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.656+0000 7f47b37fe700 1 -- 172.21.15.37:0/962366849 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f47c007e6a0 con 0x7f47cc0c68f0 2023-10-06T04:39:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.656+0000 7f47cb7fe700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f47b8060550 0x7f47b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.656+0000 7f47cb7fe700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f47b8060550 0x7f47b8062a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f47bc001920 tx=0x7f47bc000f40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.664+0000 7f47b37fe700 1 -- 172.21.15.37:0/962366849 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f47cc0c31a0 con 0x7f47cc0c68f0 2023-10-06T04:39:56.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.820+0000 7f47d0c46700 1 -- 172.21.15.37:0/962366849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f47cc0c31a0 con 0x7f47cc0c68f0 2023-10-06T04:39:56.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.820+0000 7f47b37fe700 1 -- 172.21.15.37:0/962366849 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f47cc0c31a0 con 0x7f47cc0c68f0 2023-10-06T04:39:56.827 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:39:56.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.824+0000 7f47d0c46700 1 -- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f47b8060550 msgr2=0x7f47b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.824+0000 7f47d0c46700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f47b8060550 0x7f47b8062a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f47bc001920 tx=0x7f47bc000f40 comp rx=0 tx=0).stop 2023-10-06T04:39:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.824+0000 7f47d0c46700 1 -- 172.21.15.37:0/962366849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc0c68f0 msgr2=0x7f47cc156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.824+0000 7f47d0c46700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc0c68f0 0x7f47cc156ce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009f00 tx=0x7f47c0016000 comp rx=0 tx=0).stop 2023-10-06T04:39:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.824+0000 7f47d0c46700 1 -- 172.21.15.37:0/962366849 shutdown_connections 2023-10-06T04:39:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.824+0000 7f47d0c46700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f47b8060550 0x7f47b8062a00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.824+0000 7f47d0c46700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47cc159820 0x7f47cc06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.824+0000 7f47d0c46700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc0c68f0 0x7f47cc156ce0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.824+0000 7f47d0c46700 1 --2- 172.21.15.37:0/962366849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc0669c0 0x7f47cc166db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.824+0000 7f47d0c46700 1 -- 172.21.15.37:0/962366849 >> 172.21.15.37:0/962366849 conn(0x7f47cc0c9570 msgr2=0x7f47cc06de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.824+0000 7f47d0c46700 1 -- 172.21.15.37:0/962366849 shutdown_connections 2023-10-06T04:39:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.824+0000 7f47d0c46700 1 -- 172.21.15.37:0/962366849 wait complete. 2023-10-06T04:39:56.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 Processor -- start 2023-10-06T04:39:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 -- start start 2023-10-06T04:39:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae2c06dbf0 0x7fae2c0aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fae2c0cc0d0 0x7fae2c0c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2c15e0e0 con 0x7fae2c15d240 2023-10-06T04:39:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c15d7b0 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c15da90 con 0x7fae2c06dbf0 2023-10-06T04:39:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae31bb8700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fae2c15d240 0x7fae2c06d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60190/0 (socket says 172.21.15.37:60190) 2023-10-06T04:39:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae31bb8700 1 -- 172.21.15.37:0/159465567 learned_addr learned my addr 172.21.15.37:0/159465567 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae323b9700 1 --2- 172.21.15.37:0/159465567 >> v2:172.21.15.37:3300/0 conn(0x7fae2c0cc0d0 0x7fae2c0c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae313b7700 1 --2- 172.21.15.37:0/159465567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae2c06dbf0 0x7fae2c0aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae30bb6700 1 -- 172.21.15.37:0/159465567 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452017913 0 0) 0x7fae2c15e0e0 con 0x7fae2c15d240 2023-10-06T04:39:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae30bb6700 1 -- 172.21.15.37:0/159465567 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae14003570 con 0x7fae2c15d240 2023-10-06T04:39:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae323b9700 1 -- 172.21.15.37:0/159465567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae2c06dbf0 msgr2=0x7fae2c0aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae323b9700 1 --2- 172.21.15.37:0/159465567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae2c06dbf0 0x7fae2c0aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae323b9700 1 -- 172.21.15.37:0/159465567 >> v1:172.21.15.37:6789/0 conn(0x7fae2c15d240 legacy=0x7fae2c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae323b9700 1 -- 172.21.15.37:0/159465567 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c15dd70 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae323b9700 1 --2- 172.21.15.37:0/159465567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c0cc0d0 0x7fae2c0c61c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0098e0 tx=0x7fae1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6512be65cedaa9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae30bb6700 1 -- 172.21.15.37:0/159465567 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c011630 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae30bb6700 1 -- 172.21.15.37:0/159465567 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c011790 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae30bb6700 1 -- 172.21.15.37:0/159465567 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c011b30 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 -- 172.21.15.37:0/159465567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c0cc0d0 msgr2=0x7fae2c0c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 --2- 172.21.15.37:0/159465567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c0cc0d0 0x7fae2c0c61c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0098e0 tx=0x7fae1c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 -- 172.21.15.37:0/159465567 shutdown_connections 2023-10-06T04:39:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 --2- 172.21.15.37:0/159465567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c0cc0d0 0x7fae2c0c61c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 --2- 172.21.15.37:0/159465567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae2c06dbf0 0x7fae2c0aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 -- 172.21.15.37:0/159465567 >> 172.21.15.37:0/159465567 conn(0x7fae2c068780 msgr2=0x7fae2c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 -- 172.21.15.37:0/159465567 shutdown_connections 2023-10-06T04:39:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.948+0000 7fae32bba700 1 -- 172.21.15.37:0/159465567 wait complete. 2023-10-06T04:39:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae32bba700 1 Processor -- start 2023-10-06T04:39:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae32bba700 1 -- start start 2023-10-06T04:39:56.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae32bba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae2c06dbf0 0x7fae2c1703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae32bba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c0cc0d0 0x7fae2c16d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae32bba700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae2c15d240 0x7fae2c0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae32bba700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c158370 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae32bba700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c158ef0 con 0x7fae2c15d240 2023-10-06T04:39:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae32bba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c1708f0 con 0x7fae2c06dbf0 2023-10-06T04:39:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae313b7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c0cc0d0 0x7fae2c16d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae313b7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c0cc0d0 0x7fae2c16d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56092/0 (socket says 172.21.15.37:56092) 2023-10-06T04:39:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae313b7700 1 -- 172.21.15.37:0/3909258005 learned_addr learned my addr 172.21.15.37:0/3909258005 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae31bb8700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae2c06dbf0 0x7fae2c1703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae323b9700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae2c15d240 0x7fae2c0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae313b7700 1 -- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae2c06dbf0 msgr2=0x7fae2c1703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae313b7700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae2c06dbf0 0x7fae2c1703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae313b7700 1 -- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae2c15d240 msgr2=0x7fae2c0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae313b7700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae2c15d240 0x7fae2c0c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae313b7700 1 -- 172.21.15.37:0/3909258005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c009420 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae313b7700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c0cc0d0 0x7fae2c16d510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fae24009f20 tx=0x7fae2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae21ffb700 1 -- 172.21.15.37:0/3909258005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2400cc80 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae21ffb700 1 -- 172.21.15.37:0/3909258005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2400f040 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae21ffb700 1 -- 172.21.15.37:0/3909258005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae24014480 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae32bba700 1 -- 172.21.15.37:0/3909258005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c1585c0 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.952+0000 7fae32bba700 1 -- 172.21.15.37:0/3909258005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c158b80 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.956+0000 7fae32bba700 1 -- 172.21.15.37:0/3909258005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c0708a0 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.956+0000 7fae21ffb700 1 -- 172.21.15.37:0/3909258005 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fae240147f0 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.956+0000 7fae21ffb700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fae18060550 0x7fae18062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.956+0000 7fae21ffb700 1 -- 172.21.15.37:0/3909258005 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fae2407d7d0 con 0x7fae2c0cc0d0 2023-10-06T04:39:56.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.956+0000 7fae31bb8700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fae18060550 0x7fae18062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.956+0000 7fae31bb8700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fae18060550 0x7fae18062a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fae280058d0 tx=0x7fae28009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:56.968+0000 7fae21ffb700 1 -- 172.21.15.37:0/3909258005 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fae2404d890 con 0x7fae2c0cc0d0 2023-10-06T04:39:57.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.128+0000 7fae32bba700 1 -- 172.21.15.37:0/3909258005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae2c159030 con 0x7fae2c0cc0d0 2023-10-06T04:39:57.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.132+0000 7fae21ffb700 1 -- 172.21.15.37:0/3909258005 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18755 (secure 0 0 0) 0x7fae24050eb0 con 0x7fae2c0cc0d0 2023-10-06T04:39:57.138 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:39:57.138 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:52.800356+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.136+0000 7fae32bba700 1 -- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fae18060550 msgr2=0x7fae18062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.136+0000 7fae32bba700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fae18060550 0x7fae18062a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fae280058d0 tx=0x7fae28009040 comp rx=0 tx=0).stop 2023-10-06T04:39:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.136+0000 7fae32bba700 1 -- 172.21.15.37:0/3909258005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c0cc0d0 msgr2=0x7fae2c16d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.136+0000 7fae32bba700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c0cc0d0 0x7fae2c16d510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fae24009f20 tx=0x7fae2400b040 comp rx=0 tx=0).stop 2023-10-06T04:39:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.136+0000 7fae32bba700 1 -- 172.21.15.37:0/3909258005 shutdown_connections 2023-10-06T04:39:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.136+0000 7fae32bba700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fae18060550 0x7fae18062a00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.136+0000 7fae32bba700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae2c15d240 0x7fae2c0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.136+0000 7fae32bba700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c0cc0d0 0x7fae2c16d510 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.136+0000 7fae32bba700 1 --2- 172.21.15.37:0/3909258005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae2c06dbf0 0x7fae2c1703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.136+0000 7fae32bba700 1 -- 172.21.15.37:0/3909258005 >> 172.21.15.37:0/3909258005 conn(0x7fae2c068780 msgr2=0x7fae2c15ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:57.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.136+0000 7fae32bba700 1 -- 172.21.15.37:0/3909258005 shutdown_connections 2023-10-06T04:39:57.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.136+0000 7fae32bba700 1 -- 172.21.15.37:0/3909258005 wait complete. 2023-10-06T04:39:57.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:08.512565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:09.104711+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:39:12.860905+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:57.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:57.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.264+0000 7fd85f59e700 1 Processor -- start 2023-10-06T04:39:57.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.264+0000 7fd85f59e700 1 -- start start 2023-10-06T04:39:57.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd860069030 0x7fd860069480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd8600af860 0x7fd8600afce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8600cf050 con 0x7fd860158d20 2023-10-06T04:39:57.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8600d0680 con 0x7fd8600af860 2023-10-06T04:39:57.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600699c0 con 0x7fd860069030 2023-10-06T04:39:57.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85e59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd860158d20 0x7fd8600cac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60196/0 (socket says 172.21.15.37:60196) 2023-10-06T04:39:57.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85e59c700 1 -- 172.21.15.37:0/532614950 learned_addr learned my addr 172.21.15.37:0/532614950 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:57.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85dd9b700 1 --2- 172.21.15.37:0/532614950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd860069030 0x7fd860069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85ed9d700 1 --2- 172.21.15.37:0/532614950 >> v2:172.21.15.83:3300/0 conn(0x7fd8600af860 0x7fd8600afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85d59a700 1 -- 172.21.15.37:0/532614950 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825020499 0 0) 0x7fd8600cf050 con 0x7fd860158d20 2023-10-06T04:39:57.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85d59a700 1 -- 172.21.15.37:0/532614950 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd848003570 con 0x7fd860158d20 2023-10-06T04:39:57.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85dd9b700 1 -- 172.21.15.37:0/532614950 >> v2:172.21.15.83:3300/0 conn(0x7fd8600af860 msgr2=0x7fd8600afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:57.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85dd9b700 1 --2- 172.21.15.37:0/532614950 >> v2:172.21.15.83:3300/0 conn(0x7fd8600af860 0x7fd8600afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85dd9b700 1 -- 172.21.15.37:0/532614950 >> v1:172.21.15.37:6789/0 conn(0x7fd860158d20 legacy=0x7fd8600cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85dd9b700 1 -- 172.21.15.37:0/532614950 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8600ce1a0 con 0x7fd860069030 2023-10-06T04:39:57.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85ed9d700 1 --2- 172.21.15.37:0/532614950 >> v2:172.21.15.83:3300/0 conn(0x7fd8600af860 0x7fd8600afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:57.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85dd9b700 1 --2- 172.21.15.37:0/532614950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd860069030 0x7fd860069480 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd8540098e0 tx=0x7fd8540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adaa1e24c09c2360 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:57.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85d59a700 1 -- 172.21.15.37:0/532614950 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854011630 con 0x7fd860069030 2023-10-06T04:39:57.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85d59a700 1 -- 172.21.15.37:0/532614950 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd854011790 con 0x7fd860069030 2023-10-06T04:39:57.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85d59a700 1 -- 172.21.15.37:0/532614950 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854011b10 con 0x7fd860069030 2023-10-06T04:39:57.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 -- 172.21.15.37:0/532614950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd860069030 msgr2=0x7fd860069480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 --2- 172.21.15.37:0/532614950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd860069030 0x7fd860069480 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd8540098e0 tx=0x7fd8540091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 -- 172.21.15.37:0/532614950 shutdown_connections 2023-10-06T04:39:57.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 --2- 172.21.15.37:0/532614950 >> v2:172.21.15.83:3300/0 conn(0x7fd8600af860 0x7fd8600afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 --2- 172.21.15.37:0/532614950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd860069030 0x7fd860069480 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 -- 172.21.15.37:0/532614950 >> 172.21.15.37:0/532614950 conn(0x7fd860068780 msgr2=0x7fd8600cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 -- 172.21.15.37:0/532614950 shutdown_connections 2023-10-06T04:39:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.268+0000 7fd85f59e700 1 -- 172.21.15.37:0/532614950 wait complete. 2023-10-06T04:39:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85f59e700 1 Processor -- start 2023-10-06T04:39:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85f59e700 1 -- start start 2023-10-06T04:39:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd860069030 0x7fd8600b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8600af860 0x7fd860153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd860158d20 0x7fd860154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85f59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8601543d0 con 0x7fd8600af860 2023-10-06T04:39:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85f59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd860154670 con 0x7fd860069030 2023-10-06T04:39:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600b4310 con 0x7fd860158d20 2023-10-06T04:39:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8600af860 0x7fd860153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8600af860 0x7fd860153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56104/0 (socket says 172.21.15.37:56104) 2023-10-06T04:39:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85dd9b700 1 -- 172.21.15.37:0/2410797154 learned_addr learned my addr 172.21.15.37:0/2410797154 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:57.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85e59c700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd860069030 0x7fd8600b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85ed9d700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd860158d20 0x7fd860154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85dd9b700 1 -- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd860158d20 msgr2=0x7fd860154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85dd9b700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd860158d20 0x7fd860154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85dd9b700 1 -- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd860069030 msgr2=0x7fd8600b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85dd9b700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd860069030 0x7fd8600b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.272+0000 7fd85dd9b700 1 -- 172.21.15.37:0/2410797154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd858009a20 con 0x7fd8600af860 2023-10-06T04:39:57.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.276+0000 7fd85dd9b700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8600af860 0x7fd860153550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd860069b00 tx=0x7fd854017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:57.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.276+0000 7fd84e7fc700 1 -- 172.21.15.37:0/2410797154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854011900 con 0x7fd8600af860 2023-10-06T04:39:57.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.276+0000 7fd84e7fc700 1 -- 172.21.15.37:0/2410797154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd854011a80 con 0x7fd8600af860 2023-10-06T04:39:57.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.276+0000 7fd85f59e700 1 -- 172.21.15.37:0/2410797154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd854009420 con 0x7fd8600af860 2023-10-06T04:39:57.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.276+0000 7fd84e7fc700 1 -- 172.21.15.37:0/2410797154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85401a680 con 0x7fd8600af860 2023-10-06T04:39:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.276+0000 7fd85f59e700 1 -- 172.21.15.37:0/2410797154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8600b48d0 con 0x7fd8600af860 2023-10-06T04:39:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.276+0000 7fd85f59e700 1 -- 172.21.15.37:0/2410797154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd860154800 con 0x7fd8600af860 2023-10-06T04:39:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.276+0000 7fd84e7fc700 1 -- 172.21.15.37:0/2410797154 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd85401aa70 con 0x7fd8600af860 2023-10-06T04:39:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.276+0000 7fd84e7fc700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd840060550 0x7fd840062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.276+0000 7fd84e7fc700 1 -- 172.21.15.37:0/2410797154 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fd85407e870 con 0x7fd8600af860 2023-10-06T04:39:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.276+0000 7fd85e59c700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd840060550 0x7fd840062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.280+0000 7fd85e59c700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd840060550 0x7fd840062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd850007fd0 tx=0x7fd850009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:57.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.288+0000 7fd84e7fc700 1 -- 172.21.15.37:0/2410797154 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd85404e9f0 con 0x7fd8600af860 2023-10-06T04:39:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.452+0000 7fd85f59e700 1 -- 172.21.15.37:0/2410797154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8600708a0 con 0x7fd8600af860 2023-10-06T04:39:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.452+0000 7fd84e7fc700 1 -- 172.21.15.37:0/2410797154 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd854052010 con 0x7fd8600af860 2023-10-06T04:39:57.458 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:39:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.452+0000 7fd85f59e700 1 -- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd840060550 msgr2=0x7fd840062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.452+0000 7fd85f59e700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd840060550 0x7fd840062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd850007fd0 tx=0x7fd850009040 comp rx=0 tx=0).stop 2023-10-06T04:39:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.452+0000 7fd85f59e700 1 -- 172.21.15.37:0/2410797154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8600af860 msgr2=0x7fd860153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.452+0000 7fd85f59e700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8600af860 0x7fd860153550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd860069b00 tx=0x7fd854017000 comp rx=0 tx=0).stop 2023-10-06T04:39:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.452+0000 7fd85f59e700 1 -- 172.21.15.37:0/2410797154 shutdown_connections 2023-10-06T04:39:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.452+0000 7fd85f59e700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd840060550 0x7fd840062a00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.456+0000 7fd85f59e700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd860158d20 0x7fd860154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.456+0000 7fd85f59e700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8600af860 0x7fd860153550 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.456+0000 7fd85f59e700 1 --2- 172.21.15.37:0/2410797154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd860069030 0x7fd8600b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.456+0000 7fd85f59e700 1 -- 172.21.15.37:0/2410797154 >> 172.21.15.37:0/2410797154 conn(0x7fd860068780 msgr2=0x7fd8601578c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.456+0000 7fd85f59e700 1 -- 172.21.15.37:0/2410797154 shutdown_connections 2023-10-06T04:39:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.456+0000 7fd85f59e700 1 -- 172.21.15.37:0/2410797154 wait complete. 2023-10-06T04:39:57.472 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:57.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.580+0000 7f4275f05700 1 Processor -- start 2023-10-06T04:39:57.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.580+0000 7f4275f05700 1 -- start start 2023-10-06T04:39:57.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f427006ae60 0x7f427006d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f427006dbb0 0x7f42700c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427006e010 con 0x7f4270155200 2023-10-06T04:39:57.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42700c7dd0 con 0x7f427006ae60 2023-10-06T04:39:57.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42701555d0 con 0x7f427006dbb0 2023-10-06T04:39:57.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f426ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f427006ae60 0x7f427006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f426ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f427006ae60 0x7f427006d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56118/0 (socket says 172.21.15.37:56118) 2023-10-06T04:39:57.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f426ffff700 1 -- 172.21.15.37:0/2209459271 learned_addr learned my addr 172.21.15.37:0/2209459271 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:57.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275704700 1 --2- 172.21.15.37:0/2209459271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f427006dbb0 0x7f42700c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f426ffff700 1 -- 172.21.15.37:0/2209459271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f427006dbb0 msgr2=0x7f42700c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:57.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f426ffff700 1 --2- 172.21.15.37:0/2209459271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f427006dbb0 0x7f42700c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f426ffff700 1 -- 172.21.15.37:0/2209459271 >> v1:172.21.15.83:6789/0 conn(0x7f4270155200 legacy=0x7f4270159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f426ffff700 1 -- 172.21.15.37:0/2209459271 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700c6d30 con 0x7f427006ae60 2023-10-06T04:39:57.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f426ffff700 1 --2- 172.21.15.37:0/2209459271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f427006ae60 0x7f427006d670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f42600099b0 tx=0x7f4260009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2253e463da1f95c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:57.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f426f7fe700 1 -- 172.21.15.37:0/2209459271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260009ea0 con 0x7f427006ae60 2023-10-06T04:39:57.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f426f7fe700 1 -- 172.21.15.37:0/2209459271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426000b860 con 0x7f427006ae60 2023-10-06T04:39:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f426f7fe700 1 -- 172.21.15.37:0/2209459271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000bc00 con 0x7f427006ae60 2023-10-06T04:39:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 -- 172.21.15.37:0/2209459271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f427006ae60 msgr2=0x7f427006d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 --2- 172.21.15.37:0/2209459271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f427006ae60 0x7f427006d670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f42600099b0 tx=0x7f4260009250 comp rx=0 tx=0).stop 2023-10-06T04:39:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 -- 172.21.15.37:0/2209459271 shutdown_connections 2023-10-06T04:39:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 --2- 172.21.15.37:0/2209459271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f427006dbb0 0x7f42700c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 --2- 172.21.15.37:0/2209459271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f427006ae60 0x7f427006d670 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 -- 172.21.15.37:0/2209459271 >> 172.21.15.37:0/2209459271 conn(0x7f4270068760 msgr2=0x7f42700cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 -- 172.21.15.37:0/2209459271 shutdown_connections 2023-10-06T04:39:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.584+0000 7f4275f05700 1 -- 172.21.15.37:0/2209459271 wait complete. 2023-10-06T04:39:57.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275f05700 1 Processor -- start 2023-10-06T04:39:57.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275f05700 1 -- start start 2023-10-06T04:39:57.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275f05700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f427006dbb0 0x7f4270149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275f05700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4270155200 0x7f4270149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275f05700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f427014c900 0x7f42700c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275f05700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427014d070 con 0x7f427014c900 2023-10-06T04:39:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275f05700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4270157e70 con 0x7f4270155200 2023-10-06T04:39:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275f05700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427014cd90 con 0x7f427006dbb0 2023-10-06T04:39:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275704700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f427014c900 0x7f42700c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275704700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f427014c900 0x7f42700c3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56124/0 (socket says 172.21.15.37:56124) 2023-10-06T04:39:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275704700 1 -- 172.21.15.37:0/3784475481 learned_addr learned my addr 172.21.15.37:0/3784475481 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:57.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f426ffff700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4270155200 0x7f4270149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4274f03700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f427006dbb0 0x7f4270149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275704700 1 -- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f427006dbb0 msgr2=0x7f4270149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275704700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f427006dbb0 0x7f4270149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275704700 1 -- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4270155200 msgr2=0x7f4270149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275704700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4270155200 0x7f4270149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275704700 1 -- 172.21.15.37:0/3784475481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42600094f0 con 0x7f427014c900 2023-10-06T04:39:57.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f4275704700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f427014c900 0x7f42700c3f00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4268009e20 tx=0x7f426800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:57.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.588+0000 7f426cff9700 1 -- 172.21.15.37:0/3784475481 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800caa0 con 0x7f427014c900 2023-10-06T04:39:57.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.592+0000 7f426cff9700 1 -- 172.21.15.37:0/3784475481 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426800f040 con 0x7f427014c900 2023-10-06T04:39:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.592+0000 7f4275f05700 1 -- 172.21.15.37:0/3784475481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4270157820 con 0x7f427014c900 2023-10-06T04:39:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.592+0000 7f426cff9700 1 -- 172.21.15.37:0/3784475481 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800ce70 con 0x7f427014c900 2023-10-06T04:39:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.592+0000 7f4275f05700 1 -- 172.21.15.37:0/3784475481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427014a490 con 0x7f427014c900 2023-10-06T04:39:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.592+0000 7f4275f05700 1 -- 172.21.15.37:0/3784475481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42700708a0 con 0x7f427014c900 2023-10-06T04:39:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.592+0000 7f426cff9700 1 -- 172.21.15.37:0/3784475481 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4268014690 con 0x7f427014c900 2023-10-06T04:39:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.592+0000 7f426cff9700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f425c060550 0x7f425c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.592+0000 7f426cff9700 1 -- 172.21.15.37:0/3784475481 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f426807d4e0 con 0x7f427014c900 2023-10-06T04:39:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.596+0000 7f4274f03700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f425c060550 0x7f425c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.596+0000 7f4274f03700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f425c060550 0x7f425c062a00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42640039f0 tx=0x7f4264007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.604+0000 7f426cff9700 1 -- 172.21.15.37:0/3784475481 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f42680510e0 con 0x7f427014c900 2023-10-06T04:39:57.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.760+0000 7f4275f05700 1 -- 172.21.15.37:0/3784475481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4270157fb0 con 0x7f427014c900 2023-10-06T04:39:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.760+0000 7f426cff9700 1 -- 172.21.15.37:0/3784475481 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4268050c70 con 0x7f427014c900 2023-10-06T04:39:57.767 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:39:57.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.764+0000 7f4275f05700 1 -- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f425c060550 msgr2=0x7f425c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.764+0000 7f4275f05700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f425c060550 0x7f425c062a00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42640039f0 tx=0x7f4264007ec0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.764+0000 7f4275f05700 1 -- 172.21.15.37:0/3784475481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f427014c900 msgr2=0x7f42700c3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.764+0000 7f4275f05700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f427014c900 0x7f42700c3f00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4268009e20 tx=0x7f426800b040 comp rx=0 tx=0).stop 2023-10-06T04:39:57.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.764+0000 7f4275f05700 1 -- 172.21.15.37:0/3784475481 shutdown_connections 2023-10-06T04:39:57.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.764+0000 7f4275f05700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f425c060550 0x7f425c062a00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.764+0000 7f4275f05700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4270155200 0x7f4270149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.764+0000 7f4275f05700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f427014c900 0x7f42700c3f00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.764+0000 7f4275f05700 1 --2- 172.21.15.37:0/3784475481 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f427006dbb0 0x7f4270149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.764+0000 7f4275f05700 1 -- 172.21.15.37:0/3784475481 >> 172.21.15.37:0/3784475481 conn(0x7f4270068760 msgr2=0x7f427014d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:57.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.764+0000 7f4275f05700 1 -- 172.21.15.37:0/3784475481 shutdown_connections 2023-10-06T04:39:57.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.764+0000 7f4275f05700 1 -- 172.21.15.37:0/3784475481 wait complete. 2023-10-06T04:39:57.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:57.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.900+0000 7f6859b12700 1 Processor -- start 2023-10-06T04:39:57.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.900+0000 7f6859b12700 1 -- start start 2023-10-06T04:39:57.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.900+0000 7f6859b12700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f685406a9e0 0x7f68540b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.900+0000 7f6859b12700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f685406d4e0 0x7f6854068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.900+0000 7f6859b12700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685415a060 con 0x7f68540b35d0 2023-10-06T04:39:57.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.900+0000 7f6859b12700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6854159240 con 0x7f685406a9e0 2023-10-06T04:39:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6859b12700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6854159450 con 0x7f685406d4e0 2023-10-06T04:39:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6858b10700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f685406a9e0 0x7f68540b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6853fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f68540b35d0 0x7f685406cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60204/0 (socket says 172.21.15.37:60204) 2023-10-06T04:39:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6853fff700 1 -- 172.21.15.37:0/921970064 learned_addr learned my addr 172.21.15.37:0/921970064 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6859311700 1 --2- 172.21.15.37:0/921970064 >> v2:172.21.15.83:3300/0 conn(0x7f685406d4e0 0x7f6854068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f68537fe700 1 -- 172.21.15.37:0/921970064 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562180361 0 0) 0x7f685415a060 con 0x7f68540b35d0 2023-10-06T04:39:57.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f68537fe700 1 -- 172.21.15.37:0/921970064 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6840003570 con 0x7f68540b35d0 2023-10-06T04:39:57.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6858b10700 1 -- 172.21.15.37:0/921970064 >> v2:172.21.15.83:3300/0 conn(0x7f685406d4e0 msgr2=0x7f6854068fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:57.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6858b10700 1 --2- 172.21.15.37:0/921970064 >> v2:172.21.15.83:3300/0 conn(0x7f685406d4e0 0x7f6854068fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6858b10700 1 -- 172.21.15.37:0/921970064 >> v1:172.21.15.37:6789/0 conn(0x7f68540b35d0 legacy=0x7f685406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6858b10700 1 -- 172.21.15.37:0/921970064 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854159730 con 0x7f685406a9e0 2023-10-06T04:39:57.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6858b10700 1 --2- 172.21.15.37:0/921970064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f685406a9e0 0x7f68540b3090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f68540cd850 tx=0x7f6844009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19af03747b5bf92c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:57.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f68537fe700 1 -- 172.21.15.37:0/921970064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400e070 con 0x7f685406a9e0 2023-10-06T04:39:57.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f68537fe700 1 -- 172.21.15.37:0/921970064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684400bab0 con 0x7f685406a9e0 2023-10-06T04:39:57.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f68537fe700 1 -- 172.21.15.37:0/921970064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400be70 con 0x7f685406a9e0 2023-10-06T04:39:57.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6859b12700 1 -- 172.21.15.37:0/921970064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f685406a9e0 msgr2=0x7f68540b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6859b12700 1 --2- 172.21.15.37:0/921970064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f685406a9e0 0x7f68540b3090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f68540cd850 tx=0x7f6844009780 comp rx=0 tx=0).stop 2023-10-06T04:39:57.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6859b12700 1 -- 172.21.15.37:0/921970064 shutdown_connections 2023-10-06T04:39:57.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6859b12700 1 --2- 172.21.15.37:0/921970064 >> v2:172.21.15.83:3300/0 conn(0x7f685406d4e0 0x7f6854068fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6859b12700 1 --2- 172.21.15.37:0/921970064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f685406a9e0 0x7f68540b3090 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6859b12700 1 -- 172.21.15.37:0/921970064 >> 172.21.15.37:0/921970064 conn(0x7f68540ce400 msgr2=0x7f68540af390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:57.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6859b12700 1 -- 172.21.15.37:0/921970064 shutdown_connections 2023-10-06T04:39:57.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.904+0000 7f6859b12700 1 -- 172.21.15.37:0/921970064 wait complete. 2023-10-06T04:39:57.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6859b12700 1 Processor -- start 2023-10-06T04:39:57.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6859b12700 1 -- start start 2023-10-06T04:39:57.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6859b12700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f685406a9e0 0x7f6854169d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6859b12700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f685406d4e0 0x7f685416a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6859b12700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68540b35d0 0x7f6854144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6859b12700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685416b730 con 0x7f685406d4e0 2023-10-06T04:39:57.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6859b12700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685416a880 con 0x7f685406a9e0 2023-10-06T04:39:57.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6859b12700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685416ab20 con 0x7f68540b35d0 2023-10-06T04:39:57.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6853fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f685406d4e0 0x7f685416a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6853fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f685406d4e0 0x7f685416a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56136/0 (socket says 172.21.15.37:56136) 2023-10-06T04:39:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6853fff700 1 -- 172.21.15.37:0/2090914961 learned_addr learned my addr 172.21.15.37:0/2090914961 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6858b10700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f685406a9e0 0x7f6854169d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6859311700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68540b35d0 0x7f6854144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6853fff700 1 -- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68540b35d0 msgr2=0x7f6854144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6853fff700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68540b35d0 0x7f6854144b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6853fff700 1 -- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f685406a9e0 msgr2=0x7f6854169d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6853fff700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f685406a9e0 0x7f6854169d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6853fff700 1 -- 172.21.15.37:0/2090914961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6844009a20 con 0x7f685406d4e0 2023-10-06T04:39:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6858b10700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f685406a9e0 0x7f6854169d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6853fff700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f685406d4e0 0x7f685416a340 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f683c00c590 tx=0x7f683c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6850ff9700 1 -- 172.21.15.37:0/2090914961 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c005cd0 con 0x7f685406d4e0 2023-10-06T04:39:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6850ff9700 1 -- 172.21.15.37:0/2090914961 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c005e50 con 0x7f685406d4e0 2023-10-06T04:39:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6850ff9700 1 -- 172.21.15.37:0/2090914961 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c007320 con 0x7f685406d4e0 2023-10-06T04:39:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6859b12700 1 -- 172.21.15.37:0/2090914961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685416ae00 con 0x7f685406d4e0 2023-10-06T04:39:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.908+0000 7f6859b12700 1 -- 172.21.15.37:0/2090914961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685416b3c0 con 0x7f685406d4e0 2023-10-06T04:39:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.912+0000 7f6859b12700 1 -- 172.21.15.37:0/2090914961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685416b8a0 con 0x7f685406d4e0 2023-10-06T04:39:57.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.912+0000 7f6850ff9700 1 -- 172.21.15.37:0/2090914961 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f683c01b3b0 con 0x7f685406d4e0 2023-10-06T04:39:57.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.912+0000 7f6850ff9700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6834060550 0x7f6834062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.912+0000 7f6850ff9700 1 -- 172.21.15.37:0/2090914961 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f683c07c300 con 0x7f685406d4e0 2023-10-06T04:39:57.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.912+0000 7f6858b10700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6834060550 0x7f6834062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.912+0000 7f6858b10700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6834060550 0x7f6834062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f68440097c0 tx=0x7f6844019000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:57.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:57.920+0000 7f6850ff9700 1 -- 172.21.15.37:0/2090914961 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f683c04c460 con 0x7f685406d4e0 2023-10-06T04:39:58.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.080+0000 7f6859b12700 1 -- 172.21.15.37:0/2090914961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68540708a0 con 0x7f685406d4e0 2023-10-06T04:39:58.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6850ff9700 1 -- 172.21.15.37:0/2090914961 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f683c04fa80 con 0x7f685406d4e0 2023-10-06T04:39:58.088 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:39:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6859b12700 1 -- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6834060550 msgr2=0x7f6834062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6859b12700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6834060550 0x7f6834062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f68440097c0 tx=0x7f6844019000 comp rx=0 tx=0).stop 2023-10-06T04:39:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6859b12700 1 -- 172.21.15.37:0/2090914961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f685406d4e0 msgr2=0x7f685416a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6859b12700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f685406d4e0 0x7f685416a340 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f683c00c590 tx=0x7f683c007e00 comp rx=0 tx=0).stop 2023-10-06T04:39:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6859b12700 1 -- 172.21.15.37:0/2090914961 shutdown_connections 2023-10-06T04:39:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6859b12700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6834060550 0x7f6834062a00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6859b12700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68540b35d0 0x7f6854144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6859b12700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f685406d4e0 0x7f685416a340 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6859b12700 1 --2- 172.21.15.37:0/2090914961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f685406a9e0 0x7f6854169d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6859b12700 1 -- 172.21.15.37:0/2090914961 >> 172.21.15.37:0/2090914961 conn(0x7f68540ce400 msgr2=0x7f68541584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6859b12700 1 -- 172.21.15.37:0/2090914961 shutdown_connections 2023-10-06T04:39:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.084+0000 7f6859b12700 1 -- 172.21.15.37:0/2090914961 wait complete. 2023-10-06T04:39:58.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:58.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ec46c700 1 Processor -- start 2023-10-06T04:39:58.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ec46c700 1 -- start start 2023-10-06T04:39:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ec46c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8e4153400 0x7ff8e4069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ec46c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e40b48f0 0x7ff8e4069970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ec46c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e40b5a60 con 0x7ff8e41537d0 2023-10-06T04:39:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ec46c700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e415a680 con 0x7ff8e4153400 2023-10-06T04:39:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ec46c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e4159950 con 0x7ff8e40b48f0 2023-10-06T04:39:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ea208700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8e4153400 0x7ff8e4069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ea208700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8e4153400 0x7ff8e4069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56140/0 (socket says 172.21.15.37:56140) 2023-10-06T04:39:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ea208700 1 -- 172.21.15.37:0/383343014 learned_addr learned my addr 172.21.15.37:0/383343014 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8eaa09700 1 --2- 172.21.15.37:0/383343014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e40b48f0 0x7ff8e4069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ea208700 1 -- 172.21.15.37:0/383343014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e40b48f0 msgr2=0x7ff8e4069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ea208700 1 --2- 172.21.15.37:0/383343014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e40b48f0 0x7ff8e4069970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ea208700 1 -- 172.21.15.37:0/383343014 >> v1:172.21.15.83:6789/0 conn(0x7ff8e41537d0 legacy=0x7ff8e40b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ea208700 1 -- 172.21.15.37:0/383343014 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e40b4e50 con 0x7ff8e4153400 2023-10-06T04:39:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.212+0000 7ff8ea208700 1 --2- 172.21.15.37:0/383343014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e4153400 0x7ff8e4069430 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff8e415a7c0 tx=0x7ff8d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caab40efb7beb41b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8e9206700 1 -- 172.21.15.37:0/383343014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8009e70 con 0x7ff8e4153400 2023-10-06T04:39:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8e9206700 1 -- 172.21.15.37:0/383343014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d800b860 con 0x7ff8e4153400 2023-10-06T04:39:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8e9206700 1 -- 172.21.15.37:0/383343014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800bc20 con 0x7ff8e4153400 2023-10-06T04:39:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 -- 172.21.15.37:0/383343014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e4153400 msgr2=0x7ff8e4069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 --2- 172.21.15.37:0/383343014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e4153400 0x7ff8e4069430 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff8e415a7c0 tx=0x7ff8d8009250 comp rx=0 tx=0).stop 2023-10-06T04:39:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 -- 172.21.15.37:0/383343014 shutdown_connections 2023-10-06T04:39:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 --2- 172.21.15.37:0/383343014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e40b48f0 0x7ff8e4069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 --2- 172.21.15.37:0/383343014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e4153400 0x7ff8e4069430 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 -- 172.21.15.37:0/383343014 >> 172.21.15.37:0/383343014 conn(0x7ff8e4067cf0 msgr2=0x7ff8e40680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 -- 172.21.15.37:0/383343014 shutdown_connections 2023-10-06T04:39:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 -- 172.21.15.37:0/383343014 wait complete. 2023-10-06T04:39:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 Processor -- start 2023-10-06T04:39:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 -- start start 2023-10-06T04:39:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8e40b48f0 0x7ff8e4154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e4153400 0x7ff8e416c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e41537d0 0x7ff8e4156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e415e190 con 0x7ff8e4153400 2023-10-06T04:39:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e415d2e0 con 0x7ff8e40b48f0 2023-10-06T04:39:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.216+0000 7ff8ec46c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e415d580 con 0x7ff8e41537d0 2023-10-06T04:39:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8e9a07700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e4153400 0x7ff8e416c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8ea208700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8e40b48f0 0x7ff8e4154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8ea208700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8e40b48f0 0x7ff8e4154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:33362/0 (socket says 172.21.15.37:33362) 2023-10-06T04:39:58.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8eaa09700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e41537d0 0x7ff8e4156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8ea208700 1 -- 172.21.15.37:0/3922719316 learned_addr learned my addr 172.21.15.37:0/3922719316 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:58.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8e9a07700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e4153400 0x7ff8e416c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56156/0 (socket says 172.21.15.37:56156) 2023-10-06T04:39:58.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8e9a07700 1 -- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e41537d0 msgr2=0x7ff8e4156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8e9a07700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e41537d0 0x7ff8e4156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8e9a07700 1 -- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8e40b48f0 msgr2=0x7ff8e4154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8e9a07700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8e40b48f0 0x7ff8e4154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8e9a07700 1 -- 172.21.15.37:0/3922719316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d80094f0 con 0x7ff8e4153400 2023-10-06T04:39:58.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8ea208700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8e40b48f0 0x7ff8e4154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:58.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8e9a07700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e4153400 0x7ff8e416c790 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000c490 tx=0x7ff8e0007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:58.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8d67fc700 1 -- 172.21.15.37:0/3922719316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e000ce40 con 0x7ff8e4153400 2023-10-06T04:39:58.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8d67fc700 1 -- 172.21.15.37:0/3922719316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e0011590 con 0x7ff8e4153400 2023-10-06T04:39:58.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8ec46c700 1 -- 172.21.15.37:0/3922719316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e415d860 con 0x7ff8e4153400 2023-10-06T04:39:58.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8d67fc700 1 -- 172.21.15.37:0/3922719316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0011950 con 0x7ff8e4153400 2023-10-06T04:39:58.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8ec46c700 1 -- 172.21.15.37:0/3922719316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e415de20 con 0x7ff8e4153400 2023-10-06T04:39:58.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.220+0000 7ff8ec46c700 1 -- 172.21.15.37:0/3922719316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e4070ee0 con 0x7ff8e4153400 2023-10-06T04:39:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.224+0000 7ff8d67fc700 1 -- 172.21.15.37:0/3922719316 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff8e0011cc0 con 0x7ff8e4153400 2023-10-06T04:39:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.224+0000 7ff8d67fc700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8c8060550 0x7ff8c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.224+0000 7ff8d67fc700 1 -- 172.21.15.37:0/3922719316 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7ff8e007bf20 con 0x7ff8e4153400 2023-10-06T04:39:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.224+0000 7ff8ea208700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8c8060550 0x7ff8c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.224+0000 7ff8ea208700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8c8060550 0x7ff8c8062a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff8e415e9d0 tx=0x7ff8d8016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:58.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.232+0000 7ff8d67fc700 1 -- 172.21.15.37:0/3922719316 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff8e004c080 con 0x7ff8e4153400 2023-10-06T04:39:58.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.396+0000 7ff8ec46c700 1 -- 172.21.15.37:0/3922719316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8e415e2d0 con 0x7ff8e4153400 2023-10-06T04:39:58.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.396+0000 7ff8d67fc700 1 -- 172.21.15.37:0/3922719316 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff8e415e2d0 con 0x7ff8e4153400 2023-10-06T04:39:58.401 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:39:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.400+0000 7ff8ec46c700 1 -- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8c8060550 msgr2=0x7ff8c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.400+0000 7ff8ec46c700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8c8060550 0x7ff8c8062a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff8e415e9d0 tx=0x7ff8d8016000 comp rx=0 tx=0).stop 2023-10-06T04:39:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.400+0000 7ff8ec46c700 1 -- 172.21.15.37:0/3922719316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e4153400 msgr2=0x7ff8e416c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.400+0000 7ff8ec46c700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e4153400 0x7ff8e416c790 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000c490 tx=0x7ff8e0007ec0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.400+0000 7ff8ec46c700 1 -- 172.21.15.37:0/3922719316 shutdown_connections 2023-10-06T04:39:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.400+0000 7ff8ec46c700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8c8060550 0x7ff8c8062a00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.400+0000 7ff8ec46c700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e41537d0 0x7ff8e4156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.400+0000 7ff8ec46c700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e4153400 0x7ff8e416c790 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.400+0000 7ff8ec46c700 1 --2- 172.21.15.37:0/3922719316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8e40b48f0 0x7ff8e4154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.400+0000 7ff8ec46c700 1 -- 172.21.15.37:0/3922719316 >> 172.21.15.37:0/3922719316 conn(0x7ff8e4067cf0 msgr2=0x7ff8e4069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.400+0000 7ff8ec46c700 1 -- 172.21.15.37:0/3922719316 shutdown_connections 2023-10-06T04:39:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.400+0000 7ff8ec46c700 1 -- 172.21.15.37:0/3922719316 wait complete. 2023-10-06T04:39:58.422 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:39:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.524+0000 7efc246b5700 1 Processor -- start 2023-10-06T04:39:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.524+0000 7efc246b5700 1 -- start start 2023-10-06T04:39:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efc1c0aacd0 0x7efc1c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc1c0b01e0 0x7efc1c0b0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1c0b0b90 con 0x7efc1c156050 2023-10-06T04:39:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1c15a6c0 con 0x7efc1c0b01e0 2023-10-06T04:39:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1c0ae980 con 0x7efc1c0aacd0 2023-10-06T04:39:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc21c50700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc1c0b01e0 0x7efc1c0b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc21c50700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc1c0b01e0 0x7efc1c0b0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56172/0 (socket says 172.21.15.37:56172) 2023-10-06T04:39:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc21c50700 1 -- 172.21.15.37:0/1099072930 learned_addr learned my addr 172.21.15.37:0/1099072930 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc22451700 1 --2- 172.21.15.37:0/1099072930 >> v2:172.21.15.83:3300/0 conn(0x7efc1c0aacd0 0x7efc1c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc22451700 1 -- 172.21.15.37:0/1099072930 >> v2:172.21.15.37:3300/0 conn(0x7efc1c0b01e0 msgr2=0x7efc1c0b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc22451700 1 --2- 172.21.15.37:0/1099072930 >> v2:172.21.15.37:3300/0 conn(0x7efc1c0b01e0 0x7efc1c0b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc22451700 1 -- 172.21.15.37:0/1099072930 >> v1:172.21.15.83:6789/0 conn(0x7efc1c156050 legacy=0x7efc1c156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc22451700 1 -- 172.21.15.37:0/1099072930 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c156c80 con 0x7efc1c0aacd0 2023-10-06T04:39:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc22451700 1 --2- 172.21.15.37:0/1099072930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc1c0aacd0 0x7efc1c15a180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efc1c06af40 tx=0x7efc180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8231ae890eaedfb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc2144f700 1 -- 172.21.15.37:0/1099072930 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18011630 con 0x7efc1c0aacd0 2023-10-06T04:39:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc2144f700 1 -- 172.21.15.37:0/1099072930 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc18011790 con 0x7efc1c0aacd0 2023-10-06T04:39:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc2144f700 1 -- 172.21.15.37:0/1099072930 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18011b30 con 0x7efc1c0aacd0 2023-10-06T04:39:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 -- 172.21.15.37:0/1099072930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc1c0aacd0 msgr2=0x7efc1c15a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 --2- 172.21.15.37:0/1099072930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc1c0aacd0 0x7efc1c15a180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efc1c06af40 tx=0x7efc180091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 -- 172.21.15.37:0/1099072930 shutdown_connections 2023-10-06T04:39:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 --2- 172.21.15.37:0/1099072930 >> v2:172.21.15.37:3300/0 conn(0x7efc1c0b01e0 0x7efc1c0b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 --2- 172.21.15.37:0/1099072930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc1c0aacd0 0x7efc1c15a180 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 -- 172.21.15.37:0/1099072930 >> 172.21.15.37:0/1099072930 conn(0x7efc1c067cf0 msgr2=0x7efc1c0680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 -- 172.21.15.37:0/1099072930 shutdown_connections 2023-10-06T04:39:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.528+0000 7efc246b5700 1 -- 172.21.15.37:0/1099072930 wait complete. 2023-10-06T04:39:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc246b5700 1 Processor -- start 2023-10-06T04:39:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc246b5700 1 -- start start 2023-10-06T04:39:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc246b5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc1c0aacd0 0x7efc1c14d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc246b5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc1c0b01e0 0x7efc1c14c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc246b5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc1c156050 0x7efc1c14c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc246b5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c0a9eb0 con 0x7efc1c0aacd0 2023-10-06T04:39:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc246b5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c0a44b0 con 0x7efc1c0b01e0 2023-10-06T04:39:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc246b5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c0a4790 con 0x7efc1c156050 2023-10-06T04:39:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc22451700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc1c0aacd0 0x7efc1c14d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc22451700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc1c0aacd0 0x7efc1c14d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56184/0 (socket says 172.21.15.37:56184) 2023-10-06T04:39:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc22451700 1 -- 172.21.15.37:0/1835792012 learned_addr learned my addr 172.21.15.37:0/1835792012 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc21c50700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc1c0b01e0 0x7efc1c14c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc22c52700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc1c156050 0x7efc1c14c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc22451700 1 -- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc1c156050 msgr2=0x7efc1c14c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc22451700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc1c156050 0x7efc1c14c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc22451700 1 -- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc1c0b01e0 msgr2=0x7efc1c14c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc22451700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc1c0b01e0 0x7efc1c14c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.532+0000 7efc22451700 1 -- 172.21.15.37:0/1835792012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc18009420 con 0x7efc1c0aacd0 2023-10-06T04:39:58.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.536+0000 7efc22451700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc1c0aacd0 0x7efc1c14d340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0aeac0 tx=0x7efc18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:58.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.536+0000 7efc127fc700 1 -- 172.21.15.37:0/1835792012 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18000d10 con 0x7efc1c0aacd0 2023-10-06T04:39:58.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.536+0000 7efc127fc700 1 -- 172.21.15.37:0/1835792012 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc18011b10 con 0x7efc1c0aacd0 2023-10-06T04:39:58.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.536+0000 7efc246b5700 1 -- 172.21.15.37:0/1835792012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c0a4a70 con 0x7efc1c0aacd0 2023-10-06T04:39:58.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.536+0000 7efc127fc700 1 -- 172.21.15.37:0/1835792012 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18025640 con 0x7efc1c0aacd0 2023-10-06T04:39:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.536+0000 7efc246b5700 1 -- 172.21.15.37:0/1835792012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c14d880 con 0x7efc1c0aacd0 2023-10-06T04:39:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.536+0000 7efc246b5700 1 -- 172.21.15.37:0/1835792012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c070ee0 con 0x7efc1c0aacd0 2023-10-06T04:39:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.536+0000 7efc127fc700 1 -- 172.21.15.37:0/1835792012 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efc18025a30 con 0x7efc1c0aacd0 2023-10-06T04:39:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.536+0000 7efc127fc700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efc00060550 0x7efc00062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.536+0000 7efc127fc700 1 -- 172.21.15.37:0/1835792012 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7efc1807e4f0 con 0x7efc1c0aacd0 2023-10-06T04:39:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.536+0000 7efc21c50700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efc00060550 0x7efc00062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.540+0000 7efc21c50700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efc00060550 0x7efc00062a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0c8090 tx=0x7efc0c009250 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.544+0000 7efc127fc700 1 -- 172.21.15.37:0/1835792012 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efc1804e650 con 0x7efc1c0aacd0 2023-10-06T04:39:58.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.704+0000 7efc246b5700 1 -- 172.21.15.37:0/1835792012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efc1c156f60 con 0x7efc1c0aacd0 2023-10-06T04:39:58.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc127fc700 1 -- 172.21.15.37:0/1835792012 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7efc18051c70 con 0x7efc1c0aacd0 2023-10-06T04:39:58.713 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:39:58.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc246b5700 1 -- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efc00060550 msgr2=0x7efc00062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc246b5700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efc00060550 0x7efc00062a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0c8090 tx=0x7efc0c009250 comp rx=0 tx=0).stop 2023-10-06T04:39:58.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc246b5700 1 -- 172.21.15.37:0/1835792012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc1c0aacd0 msgr2=0x7efc1c14d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc246b5700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc1c0aacd0 0x7efc1c14d340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0aeac0 tx=0x7efc18017000 comp rx=0 tx=0).stop 2023-10-06T04:39:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc246b5700 1 -- 172.21.15.37:0/1835792012 shutdown_connections 2023-10-06T04:39:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc246b5700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efc00060550 0x7efc00062a00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc246b5700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc1c0b01e0 0x7efc1c14c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc246b5700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc1c156050 0x7efc1c14c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc246b5700 1 --2- 172.21.15.37:0/1835792012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc1c0aacd0 0x7efc1c14d340 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc246b5700 1 -- 172.21.15.37:0/1835792012 >> 172.21.15.37:0/1835792012 conn(0x7efc1c067cf0 msgr2=0x7efc1c157250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc246b5700 1 -- 172.21.15.37:0/1835792012 shutdown_connections 2023-10-06T04:39:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.708+0000 7efc246b5700 1 -- 172.21.15.37:0/1835792012 wait complete. 2023-10-06T04:39:58.734 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_auto_repair.TestMDSAutoRepair) MDS should verify/fix backtrace on fetch dirfrag 2023-10-06T04:39:58.734 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_auto_repair.TestMDSAutoRepair) 2023-10-06T04:39:58.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_backtrace_repair' 2023-10-06T04:39:58.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.832+0000 7f3e5359e700 1 Processor -- start 2023-10-06T04:39:58.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5359e700 1 -- start start 2023-10-06T04:39:58.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5359e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e540b1380 0x7f3e540b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5359e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3e54066840 0x7f3e540ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5359e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e540cb110 con 0x7f3e540cb8b0 2023-10-06T04:39:58.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5359e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e540ca500 con 0x7f3e540b1380 2023-10-06T04:39:58.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5359e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e540ca7e0 con 0x7f3e54066840 2023-10-06T04:39:58.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e540b1380 0x7f3e540b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e52d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3e540cb8b0 0x7f3e540ad3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60216/0 (socket says 172.21.15.37:60216) 2023-10-06T04:39:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e52d9d700 1 -- 172.21.15.37:0/947935666 learned_addr learned my addr 172.21.15.37:0/947935666 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:39:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e51d9b700 1 --2- 172.21.15.37:0/947935666 >> v2:172.21.15.83:3300/0 conn(0x7f3e54066840 0x7f3e540ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5259c700 1 -- 172.21.15.37:0/947935666 >> v2:172.21.15.83:3300/0 conn(0x7f3e54066840 msgr2=0x7f3e540ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5259c700 1 --2- 172.21.15.37:0/947935666 >> v2:172.21.15.83:3300/0 conn(0x7f3e54066840 0x7f3e540ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5259c700 1 -- 172.21.15.37:0/947935666 >> v1:172.21.15.37:6789/0 conn(0x7f3e540cb8b0 legacy=0x7f3e540ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5259c700 1 -- 172.21.15.37:0/947935666 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e540caac0 con 0x7f3e540b1380 2023-10-06T04:39:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5159a700 1 -- 172.21.15.37:0/947935666 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998157396 0 0) 0x7f3e540cb110 con 0x7f3e540cb8b0 2023-10-06T04:39:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e51d9b700 1 --2- 172.21.15.37:0/947935666 >> v2:172.21.15.83:3300/0 conn(0x7f3e54066840 0x7f3e540ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5259c700 1 --2- 172.21.15.37:0/947935666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e540b1380 0x7f3e540b1750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e54066ff0 tx=0x7f3e440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f09fda655d67f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5159a700 1 -- 172.21.15.37:0/947935666 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400b740 con 0x7f3e540b1380 2023-10-06T04:39:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5159a700 1 -- 172.21.15.37:0/947935666 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400b8a0 con 0x7f3e540b1380 2023-10-06T04:39:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.836+0000 7f3e5159a700 1 -- 172.21.15.37:0/947935666 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400bc40 con 0x7f3e540b1380 2023-10-06T04:39:58.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.840+0000 7f3e5359e700 1 -- 172.21.15.37:0/947935666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e540b1380 msgr2=0x7f3e540b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.840+0000 7f3e5359e700 1 --2- 172.21.15.37:0/947935666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e540b1380 0x7f3e540b1750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e54066ff0 tx=0x7f3e440091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.840+0000 7f3e5359e700 1 -- 172.21.15.37:0/947935666 shutdown_connections 2023-10-06T04:39:58.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.840+0000 7f3e5359e700 1 --2- 172.21.15.37:0/947935666 >> v2:172.21.15.83:3300/0 conn(0x7f3e54066840 0x7f3e540ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.840+0000 7f3e5359e700 1 --2- 172.21.15.37:0/947935666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e540b1380 0x7f3e540b1750 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.840+0000 7f3e5359e700 1 -- 172.21.15.37:0/947935666 >> 172.21.15.37:0/947935666 conn(0x7f3e540ccb50 msgr2=0x7f3e5406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:58.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.840+0000 7f3e5359e700 1 -- 172.21.15.37:0/947935666 shutdown_connections 2023-10-06T04:39:58.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.840+0000 7f3e5359e700 1 -- 172.21.15.37:0/947935666 wait complete. 2023-10-06T04:39:58.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.840+0000 7f3e5359e700 1 Processor -- start 2023-10-06T04:39:58.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.840+0000 7f3e5359e700 1 -- start start 2023-10-06T04:39:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e54066840 0x7f3e5414f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e540b1380 0x7f3e54158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e540cb8b0 0x7f3e54159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e54150070 con 0x7f3e54066840 2023-10-06T04:39:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e54150ed0 con 0x7f3e540cb8b0 2023-10-06T04:39:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e541502c0 con 0x7f3e540b1380 2023-10-06T04:39:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e54066840 0x7f3e5414f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e54066840 0x7f3e5414f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56200/0 (socket says 172.21.15.37:56200) 2023-10-06T04:39:58.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5259c700 1 -- 172.21.15.37:0/2910803618 learned_addr learned my addr 172.21.15.37:0/2910803618 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:39:58.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e51d9b700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e540b1380 0x7f3e54158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e52d9d700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e540cb8b0 0x7f3e54159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5259c700 1 -- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e540b1380 msgr2=0x7f3e54158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5259c700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e540b1380 0x7f3e54158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5259c700 1 -- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e540cb8b0 msgr2=0x7f3e54159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5259c700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e540cb8b0 0x7f3e54159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5259c700 1 -- 172.21.15.37:0/2910803618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e44009420 con 0x7f3e54066840 2023-10-06T04:39:58.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5259c700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e54066840 0x7f3e5414f610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400b0e0 tx=0x7f3e44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:58.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e427fc700 1 -- 172.21.15.37:0/2910803618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44000d10 con 0x7f3e54066840 2023-10-06T04:39:58.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e427fc700 1 -- 172.21.15.37:0/2910803618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400bc20 con 0x7f3e54066840 2023-10-06T04:39:58.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5359e700 1 -- 172.21.15.37:0/2910803618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e541505a0 con 0x7f3e54066840 2023-10-06T04:39:58.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e427fc700 1 -- 172.21.15.37:0/2910803618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44011670 con 0x7f3e54066840 2023-10-06T04:39:58.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5359e700 1 -- 172.21.15.37:0/2910803618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e54150b60 con 0x7f3e54066840 2023-10-06T04:39:58.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.844+0000 7f3e5359e700 1 -- 172.21.15.37:0/2910803618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e540708a0 con 0x7f3e54066840 2023-10-06T04:39:58.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.848+0000 7f3e427fc700 1 -- 172.21.15.37:0/2910803618 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3e440119e0 con 0x7f3e54066840 2023-10-06T04:39:58.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.848+0000 7f3e427fc700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3e34060550 0x7f3e34062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:58.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.848+0000 7f3e427fc700 1 -- 172.21.15.37:0/2910803618 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f3e4407e510 con 0x7f3e54066840 2023-10-06T04:39:58.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.848+0000 7f3e51d9b700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3e34060550 0x7f3e34062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:58.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.848+0000 7f3e51d9b700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3e34060550 0x7f3e34062a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e48006f00 tx=0x7f3e48008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:58.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:58.856+0000 7f3e427fc700 1 -- 172.21.15.37:0/2910803618 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3e4404e670 con 0x7f3e54066840 2023-10-06T04:39:59.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.076+0000 7f3e5359e700 1 -- 172.21.15.37:0/2910803618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_backtrace_repair"]} v 0) v1 -- 0x7f3e540a6ea0 con 0x7f3e54066840 2023-10-06T04:39:59.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.872+0000 7f3e427fc700 1 -- 172.21.15.37:0/2910803618 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_backtrace_repair"]}]=0 v66) v1 ==== 151+0+0 (secure 0 0 0) 0x7f3e44051c90 con 0x7f3e54066840 2023-10-06T04:39:59.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.876+0000 7f3e5359e700 1 -- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3e34060550 msgr2=0x7f3e34062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.876+0000 7f3e5359e700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3e34060550 0x7f3e34062a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e48006f00 tx=0x7f3e48008040 comp rx=0 tx=0).stop 2023-10-06T04:39:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.876+0000 7f3e5359e700 1 -- 172.21.15.37:0/2910803618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e54066840 msgr2=0x7f3e5414f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.876+0000 7f3e5359e700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e54066840 0x7f3e5414f610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400b0e0 tx=0x7f3e44017000 comp rx=0 tx=0).stop 2023-10-06T04:39:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.876+0000 7f3e5359e700 1 -- 172.21.15.37:0/2910803618 shutdown_connections 2023-10-06T04:39:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.876+0000 7f3e5359e700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3e34060550 0x7f3e34062a00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.876+0000 7f3e5359e700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e540cb8b0 0x7f3e54159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.876+0000 7f3e5359e700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e540b1380 0x7f3e54158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.876+0000 7f3e5359e700 1 --2- 172.21.15.37:0/2910803618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e54066840 0x7f3e5414f610 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.876+0000 7f3e5359e700 1 -- 172.21.15.37:0/2910803618 >> 172.21.15.37:0/2910803618 conn(0x7f3e540ccb50 msgr2=0x7f3e541571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.876+0000 7f3e5359e700 1 -- 172.21.15.37:0/2910803618 shutdown_connections 2023-10-06T04:39:59.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:39:59.876+0000 7f3e5359e700 1 -- 172.21.15.37:0/2910803618 wait complete. 2023-10-06T04:39:59.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T04:40:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.024+0000 7f2a69a64700 1 Processor -- start 2023-10-06T04:40:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.024+0000 7f2a69a64700 1 -- start start 2023-10-06T04:40:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69a64700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2a6406e190 0x7f2a6406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69a64700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a6406f140 0x7f2a6415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69a64700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a640c2c60 0x7f2a64159d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69a64700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a640ad370 con 0x7f2a640c2c60 2023-10-06T04:40:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69a64700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6415ae50 con 0x7f2a6406e190 2023-10-06T04:40:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69a64700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6415b820 con 0x7f2a6406f140 2023-10-06T04:40:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69263700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a640c2c60 0x7f2a64159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a63fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a6406f140 0x7f2a6415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a68a62700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2a6406e190 0x7f2a6406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69263700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a640c2c60 0x7f2a64159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47158/0 (socket says 172.21.15.37:47158) 2023-10-06T04:40:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a63fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a6406f140 0x7f2a6415b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:33264/0 (socket says 172.21.15.37:33264) 2023-10-06T04:40:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69263700 1 -- 172.21.15.37:0/1202433524 learned_addr learned my addr 172.21.15.37:0/1202433524 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69263700 1 -- 172.21.15.37:0/1202433524 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a6406f140 msgr2=0x7f2a6415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69263700 1 --2- 172.21.15.37:0/1202433524 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a6406f140 0x7f2a6415b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69263700 1 -- 172.21.15.37:0/1202433524 >> v2:172.21.15.83:3300/0 conn(0x7f2a6406e190 msgr2=0x7f2a6406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69263700 1 --2- 172.21.15.37:0/1202433524 >> v2:172.21.15.83:3300/0 conn(0x7f2a6406e190 0x7f2a6406e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69263700 1 -- 172.21.15.37:0/1202433524 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a64068760 con 0x7f2a640c2c60 2023-10-06T04:40:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a68a62700 1 --2- 172.21.15.37:0/1202433524 >> v2:172.21.15.83:3300/0 conn(0x7f2a6406e190 0x7f2a6406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a69263700 1 --2- 172.21.15.37:0/1202433524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a640c2c60 0x7f2a64159d30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2a6406eb70 tx=0x7f2a5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afa1f668a5f46ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a637fe700 1 -- 172.21.15.37:0/1202433524 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c00e070 con 0x7f2a640c2c60 2023-10-06T04:40:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a637fe700 1 -- 172.21.15.37:0/1202433524 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c00b970 con 0x7f2a640c2c60 2023-10-06T04:40:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.028+0000 7f2a637fe700 1 -- 172.21.15.37:0/1202433524 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0092e0 con 0x7f2a640c2c60 2023-10-06T04:40:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.032+0000 7f2a69a64700 1 -- 172.21.15.37:0/1202433524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a640c2c60 msgr2=0x7f2a64159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.032+0000 7f2a69a64700 1 --2- 172.21.15.37:0/1202433524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a640c2c60 0x7f2a64159d30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2a6406eb70 tx=0x7f2a5c009840 comp rx=0 tx=0).stop 2023-10-06T04:40:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.032+0000 7f2a69a64700 1 -- 172.21.15.37:0/1202433524 shutdown_connections 2023-10-06T04:40:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.032+0000 7f2a69a64700 1 --2- 172.21.15.37:0/1202433524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a640c2c60 0x7f2a64159d30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.032+0000 7f2a69a64700 1 --2- 172.21.15.37:0/1202433524 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a6406f140 0x7f2a6415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.032+0000 7f2a69a64700 1 --2- 172.21.15.37:0/1202433524 >> v2:172.21.15.83:3300/0 conn(0x7f2a6406e190 0x7f2a6406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.032+0000 7f2a69a64700 1 -- 172.21.15.37:0/1202433524 >> 172.21.15.37:0/1202433524 conn(0x7f2a640c9570 msgr2=0x7f2a64067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.032+0000 7f2a69a64700 1 -- 172.21.15.37:0/1202433524 shutdown_connections 2023-10-06T04:40:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.032+0000 7f2a69a64700 1 -- 172.21.15.37:0/1202433524 wait complete. 2023-10-06T04:40:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.032+0000 7f2a69a64700 1 Processor -- start 2023-10-06T04:40:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.032+0000 7f2a69a64700 1 -- start start 2023-10-06T04:40:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a69a64700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a6406e190 0x7f2a640c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a69a64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a6406f140 0x7f2a640aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a69a64700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a640c2c60 0x7f2a640c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a69a64700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640c7650 con 0x7f2a6406f140 2023-10-06T04:40:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a69a64700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640af5a0 con 0x7f2a6406e190 2023-10-06T04:40:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a69a64700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640af880 con 0x7f2a640c2c60 2023-10-06T04:40:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a63fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a6406f140 0x7f2a640aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a68a62700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a6406e190 0x7f2a640c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a69263700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a640c2c60 0x7f2a640c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a63fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a6406f140 0x7f2a640aef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47162/0 (socket says 172.21.15.37:47162) 2023-10-06T04:40:00.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a68a62700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a6406e190 0x7f2a640c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:36198/0 (socket says 172.21.15.37:36198) 2023-10-06T04:40:00.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a63fff700 1 -- 172.21.15.37:0/3836473709 learned_addr learned my addr 172.21.15.37:0/3836473709 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a63fff700 1 -- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a640c2c60 msgr2=0x7f2a640c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a63fff700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a640c2c60 0x7f2a640c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a63fff700 1 -- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a6406e190 msgr2=0x7f2a640c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a63fff700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a6406e190 0x7f2a640c3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a63fff700 1 -- 172.21.15.37:0/3836473709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58009420 con 0x7f2a6406f140 2023-10-06T04:40:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a68a62700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a6406e190 0x7f2a640c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a69263700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a640c2c60 0x7f2a640c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a63fff700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a6406f140 0x7f2a640aef10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000ec50 tx=0x7f2a500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a60ff9700 1 -- 172.21.15.37:0/3836473709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5000c850 con 0x7f2a6406f140 2023-10-06T04:40:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a60ff9700 1 -- 172.21.15.37:0/3836473709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5000c9b0 con 0x7f2a6406f140 2023-10-06T04:40:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a69a64700 1 -- 172.21.15.37:0/3836473709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c009ae0 con 0x7f2a6406f140 2023-10-06T04:40:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a60ff9700 1 -- 172.21.15.37:0/3836473709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5000cd50 con 0x7f2a6406f140 2023-10-06T04:40:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.036+0000 7f2a69a64700 1 -- 172.21.15.37:0/3836473709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a640afe40 con 0x7f2a6406f140 2023-10-06T04:40:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.040+0000 7f2a69a64700 1 -- 172.21.15.37:0/3836473709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a640708a0 con 0x7f2a6406f140 2023-10-06T04:40:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.040+0000 7f2a60ff9700 1 -- 172.21.15.37:0/3836473709 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2a50013680 con 0x7f2a6406f140 2023-10-06T04:40:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.040+0000 7f2a60ff9700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2a48060550 0x7f2a48062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.040+0000 7f2a60ff9700 1 -- 172.21.15.37:0/3836473709 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f2a5007cfc0 con 0x7f2a6406f140 2023-10-06T04:40:00.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.040+0000 7f2a68a62700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2a48060550 0x7f2a48062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.040+0000 7f2a68a62700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2a48060550 0x7f2a48062a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2a58011600 tx=0x7f2a580091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.048+0000 7f2a60ff9700 1 -- 172.21.15.37:0/3836473709 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2a5004d080 con 0x7f2a6406f140 2023-10-06T04:40:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.212+0000 7f2a69a64700 1 -- 172.21.15.37:0/3836473709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2a64068a40 con 0x7f2a6406f140 2023-10-06T04:40:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.220+0000 7f2a60ff9700 1 -- 172.21.15.37:0/3836473709 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2a500506a0 con 0x7f2a6406f140 2023-10-06T04:40:00.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.224+0000 7f2a69a64700 1 -- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2a48060550 msgr2=0x7f2a48062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.224+0000 7f2a69a64700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2a48060550 0x7f2a48062a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2a58011600 tx=0x7f2a580091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.224+0000 7f2a69a64700 1 -- 172.21.15.37:0/3836473709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a6406f140 msgr2=0x7f2a640aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.224+0000 7f2a69a64700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a6406f140 0x7f2a640aef10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000ec50 tx=0x7f2a500091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.224+0000 7f2a69a64700 1 -- 172.21.15.37:0/3836473709 shutdown_connections 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.224+0000 7f2a69a64700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2a48060550 0x7f2a48062a00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.224+0000 7f2a69a64700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a640c2c60 0x7f2a640c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.224+0000 7f2a69a64700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a6406f140 0x7f2a640aef10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.224+0000 7f2a69a64700 1 --2- 172.21.15.37:0/3836473709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a6406e190 0x7f2a640c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.224+0000 7f2a69a64700 1 -- 172.21.15.37:0/3836473709 >> 172.21.15.37:0/3836473709 conn(0x7f2a640c9570 msgr2=0x7f2a64158600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.224+0000 7f2a69a64700 1 -- 172.21.15.37:0/3836473709 shutdown_connections 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.224+0000 7f2a69a64700 1 -- 172.21.15.37:0/3836473709 wait complete. 2023-10-06T04:40:00.243 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:40:00.243 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:40:00.261 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:40:00.279 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:40:00.279 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T04:40:00.280 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:40:00.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:00.319 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T04:40:00.320 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:40:00.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:00.320 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:40:00.326 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi083.front.sepia.ceph.com... 2023-10-06T04:40:00.326 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:40:00.326 DEBUG:teuthology.orchestra.run.smithi083:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-06T04:40:00.358 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T04:40:00.358 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:40:00.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:00.359 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T04:40:00.389 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T04:40:00.389 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:40:00.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-06T04:40:00.405 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T04:40:00.407 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:40:00.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:00.408 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T04:40:00.459 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi083.front.sepia.ceph.com... 2023-10-06T04:40:00.459 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:40:00.459 DEBUG:teuthology.orchestra.run.smithi083:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-06T04:40:00.474 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T04:40:00.475 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:40:00.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:00.475 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T04:40:00.525 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T04:40:00.526 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:00.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.636+0000 7fab0733e700 1 Processor -- start 2023-10-06T04:40:00.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.636+0000 7fab0733e700 1 -- start start 2023-10-06T04:40:00.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fab00159e70 0x7fab000690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab000d02e0 0x7fab00069610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab000cdbb0 con 0x7fab00158a90 2023-10-06T04:40:00.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000cad50 con 0x7fab000d02e0 2023-10-06T04:40:00.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000cb030 con 0x7fab00159e70 2023-10-06T04:40:00.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0633c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fab00158a90 0x7fab0015d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40442/0 (socket says 172.21.15.37:40442) 2023-10-06T04:40:00.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0633c700 1 -- 172.21.15.37:0/3381399997 learned_addr learned my addr 172.21.15.37:0/3381399997 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:00.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab06b3d700 1 --2- 172.21.15.37:0/3381399997 >> v2:172.21.15.37:3300/0 conn(0x7fab000d02e0 0x7fab00069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab05b3b700 1 --2- 172.21.15.37:0/3381399997 >> v2:172.21.15.83:3300/0 conn(0x7fab00159e70 0x7fab000690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0533a700 1 -- 172.21.15.37:0/3381399997 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913505615 0 0) 0x7fab000cdbb0 con 0x7fab00158a90 2023-10-06T04:40:00.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0533a700 1 -- 172.21.15.37:0/3381399997 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae8003570 con 0x7fab00158a90 2023-10-06T04:40:00.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab06b3d700 1 -- 172.21.15.37:0/3381399997 >> v2:172.21.15.83:3300/0 conn(0x7fab00159e70 msgr2=0x7fab000690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:00.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab06b3d700 1 --2- 172.21.15.37:0/3381399997 >> v2:172.21.15.83:3300/0 conn(0x7fab00159e70 0x7fab000690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab06b3d700 1 -- 172.21.15.37:0/3381399997 >> v1:172.21.15.37:6789/0 conn(0x7fab00158a90 legacy=0x7fab0015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab06b3d700 1 -- 172.21.15.37:0/3381399997 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab000cb310 con 0x7fab000d02e0 2023-10-06T04:40:00.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab05b3b700 1 --2- 172.21.15.37:0/3381399997 >> v2:172.21.15.83:3300/0 conn(0x7fab00159e70 0x7fab000690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:00.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab06b3d700 1 --2- 172.21.15.37:0/3381399997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab000d02e0 0x7fab00069610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009e60 tx=0x7faaf8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b124415ac215af8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0533a700 1 -- 172.21.15.37:0/3381399997 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800e070 con 0x7fab000d02e0 2023-10-06T04:40:00.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0533a700 1 -- 172.21.15.37:0/3381399997 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf800ba70 con 0x7fab000d02e0 2023-10-06T04:40:00.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0533a700 1 -- 172.21.15.37:0/3381399997 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800be30 con 0x7fab000d02e0 2023-10-06T04:40:00.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 -- 172.21.15.37:0/3381399997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab000d02e0 msgr2=0x7fab00069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 --2- 172.21.15.37:0/3381399997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab000d02e0 0x7fab00069610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009e60 tx=0x7faaf8009780 comp rx=0 tx=0).stop 2023-10-06T04:40:00.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 -- 172.21.15.37:0/3381399997 shutdown_connections 2023-10-06T04:40:00.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 --2- 172.21.15.37:0/3381399997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab000d02e0 0x7fab00069610 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 --2- 172.21.15.37:0/3381399997 >> v2:172.21.15.83:3300/0 conn(0x7fab00159e70 0x7fab000690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 -- 172.21.15.37:0/3381399997 >> 172.21.15.37:0/3381399997 conn(0x7fab00068780 msgr2=0x7fab000cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:00.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 -- 172.21.15.37:0/3381399997 shutdown_connections 2023-10-06T04:40:00.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.640+0000 7fab0733e700 1 -- 172.21.15.37:0/3381399997 wait complete. 2023-10-06T04:40:00.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0733e700 1 Processor -- start 2023-10-06T04:40:00.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0733e700 1 -- start start 2023-10-06T04:40:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0733e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab000d02e0 0x7fab000c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0733e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab00158a90 0x7fab0015a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0733e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab00159e70 0x7fab00155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0733e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab000b4230 con 0x7fab000d02e0 2023-10-06T04:40:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0733e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0015acb0 con 0x7fab00158a90 2023-10-06T04:40:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0733e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab000b3940 con 0x7fab00159e70 2023-10-06T04:40:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0633c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab000d02e0 0x7fab000c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0633c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab000d02e0 0x7fab000c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47190/0 (socket says 172.21.15.37:47190) 2023-10-06T04:40:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab06b3d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab00159e70 0x7fab00155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0633c700 1 -- 172.21.15.37:0/1342166284 learned_addr learned my addr 172.21.15.37:0/1342166284 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:00.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab05b3b700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab00158a90 0x7fab0015a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0633c700 1 -- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab00159e70 msgr2=0x7fab00155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0633c700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab00159e70 0x7fab00155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0633c700 1 -- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab00158a90 msgr2=0x7fab0015a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0633c700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab00158a90 0x7fab0015a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0633c700 1 -- 172.21.15.37:0/1342166284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf4009420 con 0x7fab000d02e0 2023-10-06T04:40:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7fab0633c700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab000d02e0 0x7fab000c7530 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c7f0 tx=0x7faaf0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7faafe7fc700 1 -- 172.21.15.37:0/1342166284 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0005cd0 con 0x7fab000d02e0 2023-10-06T04:40:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.644+0000 7faafe7fc700 1 -- 172.21.15.37:0/1342166284 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf0005e50 con 0x7fab000d02e0 2023-10-06T04:40:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.648+0000 7fab0733e700 1 -- 172.21.15.37:0/1342166284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf8009a20 con 0x7fab000d02e0 2023-10-06T04:40:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.648+0000 7faafe7fc700 1 -- 172.21.15.37:0/1342166284 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0007320 con 0x7fab000d02e0 2023-10-06T04:40:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.648+0000 7fab0733e700 1 -- 172.21.15.37:0/1342166284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab000b3ec0 con 0x7fab000d02e0 2023-10-06T04:40:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.648+0000 7fab0733e700 1 -- 172.21.15.37:0/1342166284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab000708a0 con 0x7fab000d02e0 2023-10-06T04:40:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.648+0000 7faafe7fc700 1 -- 172.21.15.37:0/1342166284 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faaf001b3b0 con 0x7fab000d02e0 2023-10-06T04:40:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.648+0000 7faafe7fc700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faaec060550 0x7faaec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.648+0000 7faafe7fc700 1 -- 172.21.15.37:0/1342166284 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7faaf007c360 con 0x7fab000d02e0 2023-10-06T04:40:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.648+0000 7fab05b3b700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faaec060550 0x7faaec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.648+0000 7fab05b3b700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faaec060550 0x7faaec062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fab000c8e30 tx=0x7faaf40091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.652+0000 7faafe7fc700 1 -- 172.21.15.37:0/1342166284 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faaf004c4c0 con 0x7fab000d02e0 2023-10-06T04:40:00.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.852+0000 7fab0733e700 1 -- 172.21.15.37:0/1342166284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab00158050 con 0x7fab000d02e0 2023-10-06T04:40:00.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7faafe7fc700 1 -- 172.21.15.37:0/1342166284 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7faaf004fae0 con 0x7fab000d02e0 2023-10-06T04:40:00.860 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:00.860 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3463038764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3463038764},{"type":"v1","addr":"172.21.15.83:6835","nonce":3463038764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3802233690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3802233690},{"type":"v1","addr":"172.21.15.37:6833","nonce":3802233690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1262727325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1262727325},{"type":"v1","addr":"172.21.15.83:6837","nonce":1262727325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:10.126951+0000","modified":"2023-10-06T04:39:29.669009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1742476643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1742476643},{"type":"v1","addr":"172.21.15.37:6835","nonce":1742476643}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:40:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7fab0733e700 1 -- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faaec060550 msgr2=0x7faaec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7fab0733e700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faaec060550 0x7faaec062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fab000c8e30 tx=0x7faaf40091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7fab0733e700 1 -- 172.21.15.37:0/1342166284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab000d02e0 msgr2=0x7fab000c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7fab0733e700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab000d02e0 0x7fab000c7530 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c7f0 tx=0x7faaf0007e00 comp rx=0 tx=0).stop 2023-10-06T04:40:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7fab0733e700 1 -- 172.21.15.37:0/1342166284 shutdown_connections 2023-10-06T04:40:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7fab0733e700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faaec060550 0x7faaec062a00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7fab0733e700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab00158a90 0x7fab0015a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7fab0733e700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab00159e70 0x7fab00155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7fab0733e700 1 --2- 172.21.15.37:0/1342166284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab000d02e0 0x7fab000c7530 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7fab0733e700 1 -- 172.21.15.37:0/1342166284 >> 172.21.15.37:0/1342166284 conn(0x7fab00068780 msgr2=0x7fab000ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7fab0733e700 1 -- 172.21.15.37:0/1342166284 shutdown_connections 2023-10-06T04:40:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.856+0000 7fab0733e700 1 -- 172.21.15.37:0/1342166284 wait complete. 2023-10-06T04:40:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:40:00.875 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:00.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.976+0000 7f01d7fff700 1 Processor -- start 2023-10-06T04:40:00.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.976+0000 7f01d7fff700 1 -- start start 2023-10-06T04:40:00.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.976+0000 7f01d7fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f01d80ad560 0x7f01d80ad930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.976+0000 7f01d7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01d80caca0 0x7f01d80cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.976+0000 7f01d7fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d80ca810 con 0x7f01d80cc3f0 2023-10-06T04:40:00.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.976+0000 7f01d7fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d81570a0 con 0x7f01d80caca0 2023-10-06T04:40:00.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.976+0000 7f01d7fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d80c9c00 con 0x7f01d80ad560 2023-10-06T04:40:00.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01d80caca0 0x7f01d80cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01d80caca0 0x7f01d80cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47202/0 (socket says 172.21.15.37:47202) 2023-10-06T04:40:00.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d77fe700 1 -- 172.21.15.37:0/1123308685 learned_addr learned my addr 172.21.15.37:0/1123308685 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:00.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d6ffd700 1 --2- 172.21.15.37:0/1123308685 >> v2:172.21.15.83:3300/0 conn(0x7f01d80ad560 0x7f01d80ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d77fe700 1 -- 172.21.15.37:0/1123308685 >> v2:172.21.15.83:3300/0 conn(0x7f01d80ad560 msgr2=0x7f01d80ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:00.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d77fe700 1 --2- 172.21.15.37:0/1123308685 >> v2:172.21.15.83:3300/0 conn(0x7f01d80ad560 0x7f01d80ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d77fe700 1 -- 172.21.15.37:0/1123308685 >> v1:172.21.15.37:6789/0 conn(0x7f01d80cc3f0 legacy=0x7f01d80c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d77fe700 1 -- 172.21.15.37:0/1123308685 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d80c9ee0 con 0x7f01d80caca0 2023-10-06T04:40:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d6ffd700 1 --2- 172.21.15.37:0/1123308685 >> v2:172.21.15.83:3300/0 conn(0x7f01d80ad560 0x7f01d80ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d77fe700 1 --2- 172.21.15.37:0/1123308685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d80caca0 0x7f01d80cb120 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009f20 tx=0x7f01d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7994c4504577b5ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d67fc700 1 -- 172.21.15.37:0/1123308685 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d000e070 con 0x7f01d80caca0 2023-10-06T04:40:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d67fc700 1 -- 172.21.15.37:0/1123308685 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d000ba40 con 0x7f01d80caca0 2023-10-06T04:40:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d67fc700 1 -- 172.21.15.37:0/1123308685 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d00092e0 con 0x7f01d80caca0 2023-10-06T04:40:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d7fff700 1 -- 172.21.15.37:0/1123308685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d80caca0 msgr2=0x7f01d80cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d7fff700 1 --2- 172.21.15.37:0/1123308685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d80caca0 0x7f01d80cb120 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009f20 tx=0x7f01d0009840 comp rx=0 tx=0).stop 2023-10-06T04:40:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d7fff700 1 -- 172.21.15.37:0/1123308685 shutdown_connections 2023-10-06T04:40:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d7fff700 1 --2- 172.21.15.37:0/1123308685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d80caca0 0x7f01d80cb120 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d7fff700 1 --2- 172.21.15.37:0/1123308685 >> v2:172.21.15.83:3300/0 conn(0x7f01d80ad560 0x7f01d80ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d7fff700 1 -- 172.21.15.37:0/1123308685 >> 172.21.15.37:0/1123308685 conn(0x7f01d8068780 msgr2=0x7f01d80cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d7fff700 1 -- 172.21.15.37:0/1123308685 shutdown_connections 2023-10-06T04:40:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.980+0000 7f01d7fff700 1 -- 172.21.15.37:0/1123308685 wait complete. 2023-10-06T04:40:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d7fff700 1 Processor -- start 2023-10-06T04:40:00.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d7fff700 1 -- start start 2023-10-06T04:40:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d80ad560 0x7f01d80c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d7fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01d80caca0 0x7f01d80ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d7fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01d80cc3f0 0x7f01d806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d7fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8153c60 con 0x7f01d80ad560 2023-10-06T04:40:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d7fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80aee40 con 0x7f01d80caca0 2023-10-06T04:40:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d7fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80af120 con 0x7f01d80cc3f0 2023-10-06T04:40:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d80ad560 0x7f01d80c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d80ad560 0x7f01d80c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47204/0 (socket says 172.21.15.37:47204) 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d6ffd700 1 -- 172.21.15.37:0/2310429298 learned_addr learned my addr 172.21.15.37:0/2310429298 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d77fe700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01d80cc3f0 0x7f01d806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01cffff700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01d80caca0 0x7f01d80ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d6ffd700 1 -- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01d80cc3f0 msgr2=0x7f01d806d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d6ffd700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01d80cc3f0 0x7f01d806d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d6ffd700 1 -- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01d80caca0 msgr2=0x7f01d80ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d6ffd700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01d80caca0 0x7f01d80ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d6ffd700 1 -- 172.21.15.37:0/2310429298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d0009ae0 con 0x7f01d80ad560 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d77fe700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01d80cc3f0 0x7f01d806d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d6ffd700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d80ad560 0x7f01d80c4d00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f01c800e8d0 tx=0x7f01c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01ceffd700 1 -- 172.21.15.37:0/2310429298 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c800ee70 con 0x7f01d80ad560 2023-10-06T04:40:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d7fff700 1 -- 172.21.15.37:0/2310429298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d80af400 con 0x7f01d80ad560 2023-10-06T04:40:00.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01ceffd700 1 -- 172.21.15.37:0/2310429298 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c800c5e0 con 0x7f01d80ad560 2023-10-06T04:40:00.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01ceffd700 1 -- 172.21.15.37:0/2310429298 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c800c980 con 0x7f01d80ad560 2023-10-06T04:40:00.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.984+0000 7f01d7fff700 1 -- 172.21.15.37:0/2310429298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d81537f0 con 0x7f01d80ad560 2023-10-06T04:40:00.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.988+0000 7f01d7fff700 1 -- 172.21.15.37:0/2310429298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d8153a10 con 0x7f01d80ad560 2023-10-06T04:40:00.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.988+0000 7f01ceffd700 1 -- 172.21.15.37:0/2310429298 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f01c8013410 con 0x7f01d80ad560 2023-10-06T04:40:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.988+0000 7f01ceffd700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f01b8060550 0x7f01b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.988+0000 7f01ceffd700 1 -- 172.21.15.37:0/2310429298 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f01c807cba0 con 0x7f01d80ad560 2023-10-06T04:40:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.988+0000 7f01cffff700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f01b8060550 0x7f01b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.988+0000 7f01cffff700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f01b8060550 0x7f01b8062a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f01d8069c80 tx=0x7f01c0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:00.992+0000 7f01ceffd700 1 -- 172.21.15.37:0/2310429298 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f01c804cc60 con 0x7f01d80ad560 2023-10-06T04:40:01.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.157+0000 7f01d7fff700 1 -- 172.21.15.37:0/2310429298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01d80708a0 con 0x7f01d80ad560 2023-10-06T04:40:01.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.157+0000 7f01ceffd700 1 -- 172.21.15.37:0/2310429298 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18755 (secure 0 0 0) 0x7f01c8050280 con 0x7f01d80ad560 2023-10-06T04:40:01.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:01.163 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:52.800356+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:01.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.161+0000 7f01d7fff700 1 -- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f01b8060550 msgr2=0x7f01b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.161+0000 7f01d7fff700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f01b8060550 0x7f01b8062a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f01d8069c80 tx=0x7f01c0009040 comp rx=0 tx=0).stop 2023-10-06T04:40:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.161+0000 7f01d7fff700 1 -- 172.21.15.37:0/2310429298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d80ad560 msgr2=0x7f01d80c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.161+0000 7f01d7fff700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d80ad560 0x7f01d80c4d00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f01c800e8d0 tx=0x7f01c8008040 comp rx=0 tx=0).stop 2023-10-06T04:40:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.161+0000 7f01d7fff700 1 -- 172.21.15.37:0/2310429298 shutdown_connections 2023-10-06T04:40:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.161+0000 7f01d7fff700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f01b8060550 0x7f01b8062a00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.161+0000 7f01d7fff700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01d80caca0 0x7f01d80ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.161+0000 7f01d7fff700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01d80cc3f0 0x7f01d806d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.161+0000 7f01d7fff700 1 --2- 172.21.15.37:0/2310429298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d80ad560 0x7f01d80c4d00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.161+0000 7f01d7fff700 1 -- 172.21.15.37:0/2310429298 >> 172.21.15.37:0/2310429298 conn(0x7f01d8068780 msgr2=0x7f01d80c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.161+0000 7f01d7fff700 1 -- 172.21.15.37:0/2310429298 shutdown_connections 2023-10-06T04:40:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.161+0000 7f01d7fff700 1 -- 172.21.15.37:0/2310429298 wait complete. 2023-10-06T04:40:01.178 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:08.512565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:09.104711+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:39:12.860905+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:40:01.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:40:01.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee952a700 1 Processor -- start 2023-10-06T04:40:01.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee952a700 1 -- start start 2023-10-06T04:40:01.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee952a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ee406f140 0x7f7ee406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee952a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ee40c2c60 0x7f7ee4159d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee952a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee415ae50 con 0x7f7ee406e190 2023-10-06T04:40:01.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee952a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee40ad370 con 0x7f7ee406f140 2023-10-06T04:40:01.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee952a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4068760 con 0x7f7ee40c2c60 2023-10-06T04:40:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ee406f140 0x7f7ee406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee3fff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f7ee406e190 0x7f7ee415b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:40954/0 (socket says 172.21.15.37:40954) 2023-10-06T04:40:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee3fff700 1 -- 172.21.15.37:0/1366762006 learned_addr learned my addr 172.21.15.37:0/1366762006 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee8d29700 1 --2- 172.21.15.37:0/1366762006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ee40c2c60 0x7f7ee4159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee2ffd700 1 -- 172.21.15.37:0/1366762006 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858827718 0 0) 0x7f7ee415ae50 con 0x7f7ee406e190 2023-10-06T04:40:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee8d29700 1 -- 172.21.15.37:0/1366762006 >> v2:172.21.15.37:3300/0 conn(0x7f7ee406f140 msgr2=0x7f7ee406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee8d29700 1 --2- 172.21.15.37:0/1366762006 >> v2:172.21.15.37:3300/0 conn(0x7f7ee406f140 0x7f7ee406e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee8d29700 1 -- 172.21.15.37:0/1366762006 >> v1:172.21.15.83:6789/0 conn(0x7f7ee406e190 legacy=0x7f7ee415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.289+0000 7f7ee8d29700 1 -- 172.21.15.37:0/1366762006 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee4068a40 con 0x7f7ee40c2c60 2023-10-06T04:40:01.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.293+0000 7f7ee8d29700 1 --2- 172.21.15.37:0/1366762006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ee40c2c60 0x7f7ee4159d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40098e0 tx=0x7f7ed40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb55ee97fff28378 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.293+0000 7f7ee2ffd700 1 -- 172.21.15.37:0/1366762006 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400b640 con 0x7f7ee40c2c60 2023-10-06T04:40:01.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.293+0000 7f7ee2ffd700 1 -- 172.21.15.37:0/1366762006 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed400b7a0 con 0x7f7ee40c2c60 2023-10-06T04:40:01.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.293+0000 7f7ee2ffd700 1 -- 172.21.15.37:0/1366762006 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400bb40 con 0x7f7ee40c2c60 2023-10-06T04:40:01.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.293+0000 7f7ee952a700 1 -- 172.21.15.37:0/1366762006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ee40c2c60 msgr2=0x7f7ee4159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.293+0000 7f7ee952a700 1 --2- 172.21.15.37:0/1366762006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ee40c2c60 0x7f7ee4159d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40098e0 tx=0x7f7ed40091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.293+0000 7f7ee952a700 1 -- 172.21.15.37:0/1366762006 shutdown_connections 2023-10-06T04:40:01.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.293+0000 7f7ee952a700 1 --2- 172.21.15.37:0/1366762006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ee40c2c60 0x7f7ee4159d30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.293+0000 7f7ee952a700 1 --2- 172.21.15.37:0/1366762006 >> v2:172.21.15.37:3300/0 conn(0x7f7ee406f140 0x7f7ee406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.293+0000 7f7ee952a700 1 -- 172.21.15.37:0/1366762006 >> 172.21.15.37:0/1366762006 conn(0x7f7ee40c9570 msgr2=0x7f7ee4067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:01.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.293+0000 7f7ee952a700 1 -- 172.21.15.37:0/1366762006 shutdown_connections 2023-10-06T04:40:01.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.293+0000 7f7ee952a700 1 -- 172.21.15.37:0/1366762006 wait complete. 2023-10-06T04:40:01.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee952a700 1 Processor -- start 2023-10-06T04:40:01.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee952a700 1 -- start start 2023-10-06T04:40:01.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee952a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee406e190 0x7f7ee4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee952a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ee406f140 0x7f7ee4166990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee952a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ee40c2c60 0x7f7ee40a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee952a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4155440 con 0x7f7ee406e190 2023-10-06T04:40:01.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee952a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4166ed0 con 0x7f7ee40c2c60 2023-10-06T04:40:01.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee952a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40c3130 con 0x7f7ee406f140 2023-10-06T04:40:01.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee406e190 0x7f7ee4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee406e190 0x7f7ee4154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47220/0 (socket says 172.21.15.37:47220) 2023-10-06T04:40:01.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee3fff700 1 -- 172.21.15.37:0/3603033749 learned_addr learned my addr 172.21.15.37:0/3603033749 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:01.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee37fe700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ee406f140 0x7f7ee4166990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee8d29700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ee40c2c60 0x7f7ee40a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee3fff700 1 -- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ee406f140 msgr2=0x7f7ee4166990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee3fff700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ee406f140 0x7f7ee4166990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee3fff700 1 -- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ee40c2c60 msgr2=0x7f7ee40a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee3fff700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ee40c2c60 0x7f7ee40a6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee3fff700 1 -- 172.21.15.37:0/3603033749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4009420 con 0x7f7ee406e190 2023-10-06T04:40:01.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee8d29700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ee40c2c60 0x7f7ee40a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:01.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee3fff700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee406e190 0x7f7ee4154f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00cd80 tx=0x7f7edc001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7edbfff700 1 -- 172.21.15.37:0/3603033749 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc00ab10 con 0x7f7ee406e190 2023-10-06T04:40:01.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7edbfff700 1 -- 172.21.15.37:0/3603033749 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc00ac70 con 0x7f7ee406e190 2023-10-06T04:40:01.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7edbfff700 1 -- 172.21.15.37:0/3603033749 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0070f0 con 0x7f7ee406e190 2023-10-06T04:40:01.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee952a700 1 -- 172.21.15.37:0/3603033749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee40c3cb0 con 0x7f7ee406e190 2023-10-06T04:40:01.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.297+0000 7f7ee952a700 1 -- 172.21.15.37:0/3603033749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee40c3660 con 0x7f7ee406e190 2023-10-06T04:40:01.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.301+0000 7f7edbfff700 1 -- 172.21.15.37:0/3603033749 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7edc0074e0 con 0x7f7ee406e190 2023-10-06T04:40:01.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.301+0000 7f7ee952a700 1 -- 172.21.15.37:0/3603033749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee40708a0 con 0x7f7ee406e190 2023-10-06T04:40:01.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.301+0000 7f7edbfff700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7ec4060550 0x7f7ec4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.301+0000 7f7edbfff700 1 -- 172.21.15.37:0/3603033749 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f7edc07d220 con 0x7f7ee406e190 2023-10-06T04:40:01.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.301+0000 7f7ee37fe700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7ec4060550 0x7f7ec4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.301+0000 7f7ee37fe700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7ec4060550 0x7f7ec4062a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40c2bf0 tx=0x7f7ecc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.305+0000 7f7edbfff700 1 -- 172.21.15.37:0/3603033749 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7edc04d360 con 0x7f7ee406e190 2023-10-06T04:40:01.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.465+0000 7f7ee952a700 1 -- 172.21.15.37:0/3603033749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ee41580a0 con 0x7f7ee406e190 2023-10-06T04:40:01.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.465+0000 7f7edbfff700 1 -- 172.21.15.37:0/3603033749 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7edc050980 con 0x7f7ee406e190 2023-10-06T04:40:01.471 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:40:01.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.469+0000 7f7ee952a700 1 -- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7ec4060550 msgr2=0x7f7ec4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.469+0000 7f7ee952a700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7ec4060550 0x7f7ec4062a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40c2bf0 tx=0x7f7ecc008040 comp rx=0 tx=0).stop 2023-10-06T04:40:01.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.469+0000 7f7ee952a700 1 -- 172.21.15.37:0/3603033749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee406e190 msgr2=0x7f7ee4154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.469+0000 7f7ee952a700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee406e190 0x7f7ee4154f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00cd80 tx=0x7f7edc001ae0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.469+0000 7f7ee952a700 1 -- 172.21.15.37:0/3603033749 shutdown_connections 2023-10-06T04:40:01.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.469+0000 7f7ee952a700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7ec4060550 0x7f7ec4062a00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.469+0000 7f7ee952a700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ee40c2c60 0x7f7ee40a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.469+0000 7f7ee952a700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ee406f140 0x7f7ee4166990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.469+0000 7f7ee952a700 1 --2- 172.21.15.37:0/3603033749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee406e190 0x7f7ee4154f00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.469+0000 7f7ee952a700 1 -- 172.21.15.37:0/3603033749 >> 172.21.15.37:0/3603033749 conn(0x7f7ee40c9570 msgr2=0x7f7ee41582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.469+0000 7f7ee952a700 1 -- 172.21.15.37:0/3603033749 shutdown_connections 2023-10-06T04:40:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.469+0000 7f7ee952a700 1 -- 172.21.15.37:0/3603033749 wait complete. 2023-10-06T04:40:01.485 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:40:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.593+0000 7facfe1a7700 1 Processor -- start 2023-10-06T04:40:01.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.593+0000 7facfe1a7700 1 -- start start 2023-10-06T04:40:01.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfe1a7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facf806e190 0x7facf806e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfe1a7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7facf80c7240 0x7facf815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfe1a7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf80c6db0 con 0x7facf815cf30 2023-10-06T04:40:01.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfe1a7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf806f350 con 0x7facf80c7240 2023-10-06T04:40:01.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfe1a7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf815d3b0 con 0x7facf806e190 2023-10-06T04:40:01.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfc9a4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7facf80c7240 0x7facf815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfc9a4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7facf80c7240 0x7facf815c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47232/0 (socket says 172.21.15.37:47232) 2023-10-06T04:40:01.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfc9a4700 1 -- 172.21.15.37:0/3915474893 learned_addr learned my addr 172.21.15.37:0/3915474893 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:01.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfd1a5700 1 --2- 172.21.15.37:0/3915474893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facf806e190 0x7facf806e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfc9a4700 1 -- 172.21.15.37:0/3915474893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facf806e190 msgr2=0x7facf806e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfc9a4700 1 --2- 172.21.15.37:0/3915474893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facf806e190 0x7facf806e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfc9a4700 1 -- 172.21.15.37:0/3915474893 >> v1:172.21.15.83:6789/0 conn(0x7facf815cf30 legacy=0x7facf81587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfc9a4700 1 -- 172.21.15.37:0/3915474893 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf815d5d0 con 0x7facf80c7240 2023-10-06T04:40:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facebfff700 1 -- 172.21.15.37:0/3915474893 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987902173 0 0) 0x7facf80c6db0 con 0x7facf815cf30 2023-10-06T04:40:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facfc9a4700 1 --2- 172.21.15.37:0/3915474893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf80c7240 0x7facf815c9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7facec0099e0 tx=0x7facec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ac2121a6b66d68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facebfff700 1 -- 172.21.15.37:0/3915474893 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec00b820 con 0x7facf80c7240 2023-10-06T04:40:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facebfff700 1 -- 172.21.15.37:0/3915474893 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec00b980 con 0x7facf80c7240 2023-10-06T04:40:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.597+0000 7facebfff700 1 -- 172.21.15.37:0/3915474893 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec00bd20 con 0x7facf80c7240 2023-10-06T04:40:01.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.601+0000 7facfe1a7700 1 -- 172.21.15.37:0/3915474893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf80c7240 msgr2=0x7facf815c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.601+0000 7facfe1a7700 1 --2- 172.21.15.37:0/3915474893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf80c7240 0x7facf815c9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7facec0099e0 tx=0x7facec009250 comp rx=0 tx=0).stop 2023-10-06T04:40:01.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.601+0000 7facfe1a7700 1 -- 172.21.15.37:0/3915474893 shutdown_connections 2023-10-06T04:40:01.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.601+0000 7facfe1a7700 1 --2- 172.21.15.37:0/3915474893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf80c7240 0x7facf815c9f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.601+0000 7facfe1a7700 1 --2- 172.21.15.37:0/3915474893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facf806e190 0x7facf806e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.601+0000 7facfe1a7700 1 -- 172.21.15.37:0/3915474893 >> 172.21.15.37:0/3915474893 conn(0x7facf80c9570 msgr2=0x7facf8067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:01.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.601+0000 7facfe1a7700 1 -- 172.21.15.37:0/3915474893 shutdown_connections 2023-10-06T04:40:01.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.601+0000 7facfe1a7700 1 -- 172.21.15.37:0/3915474893 wait complete. 2023-10-06T04:40:01.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.601+0000 7facfe1a7700 1 Processor -- start 2023-10-06T04:40:01.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.601+0000 7facfe1a7700 1 -- start start 2023-10-06T04:40:01.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfe1a7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facf806e190 0x7facf80c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfe1a7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facf80c7240 0x7facf80af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfe1a7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf815cf30 0x7facf8150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfe1a7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf816c1a0 con 0x7facf815cf30 2023-10-06T04:40:01.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfe1a7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf816c480 con 0x7facf806e190 2023-10-06T04:40:01.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfe1a7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf816c760 con 0x7facf80c7240 2023-10-06T04:40:01.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfd9a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf815cf30 0x7facf8150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfd9a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf815cf30 0x7facf8150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47244/0 (socket says 172.21.15.37:47244) 2023-10-06T04:40:01.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfd9a6700 1 -- 172.21.15.37:0/2205434949 learned_addr learned my addr 172.21.15.37:0/2205434949 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:01.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfc9a4700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facf80c7240 0x7facf80af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfd1a5700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facf806e190 0x7facf80c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfd9a6700 1 -- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facf80c7240 msgr2=0x7facf80af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfd9a6700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facf80c7240 0x7facf80af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfd9a6700 1 -- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facf806e190 msgr2=0x7facf80c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfd9a6700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facf806e190 0x7facf80c3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfd9a6700 1 -- 172.21.15.37:0/2205434949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec0094f0 con 0x7facf815cf30 2023-10-06T04:40:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfd1a5700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facf806e190 0x7facf80c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfd9a6700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf815cf30 0x7facf8150540 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7facf000c890 tx=0x7facf0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7face97fa700 1 -- 172.21.15.37:0/2205434949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0012630 con 0x7facf815cf30 2023-10-06T04:40:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7face97fa700 1 -- 172.21.15.37:0/2205434949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf00127b0 con 0x7facf815cf30 2023-10-06T04:40:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfe1a7700 1 -- 172.21.15.37:0/2205434949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf816ca40 con 0x7facf815cf30 2023-10-06T04:40:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7face97fa700 1 -- 172.21.15.37:0/2205434949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0012b70 con 0x7facf815cf30 2023-10-06T04:40:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.605+0000 7facfe1a7700 1 -- 172.21.15.37:0/2205434949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf8169840 con 0x7facf815cf30 2023-10-06T04:40:01.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.609+0000 7facfe1a7700 1 -- 172.21.15.37:0/2205434949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf816cf40 con 0x7facf815cf30 2023-10-06T04:40:01.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.609+0000 7face97fa700 1 -- 172.21.15.37:0/2205434949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7facf0003030 con 0x7facf815cf30 2023-10-06T04:40:01.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.609+0000 7face97fa700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7facdc060550 0x7facdc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.609+0000 7face97fa700 1 -- 172.21.15.37:0/2205434949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7facf007cc10 con 0x7facf815cf30 2023-10-06T04:40:01.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.609+0000 7facfd1a5700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7facdc060550 0x7facdc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.609+0000 7facfd1a5700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7facdc060550 0x7facdc062a00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7facf4009d80 tx=0x7facf4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.617+0000 7face97fa700 1 -- 172.21.15.37:0/2205434949 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7facf004cd70 con 0x7facf815cf30 2023-10-06T04:40:01.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.777+0000 7facfe1a7700 1 -- 172.21.15.37:0/2205434949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7facf80708a0 con 0x7facf815cf30 2023-10-06T04:40:01.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.777+0000 7face97fa700 1 -- 172.21.15.37:0/2205434949 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7facf0050390 con 0x7facf815cf30 2023-10-06T04:40:01.784 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:40:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.781+0000 7facfe1a7700 1 -- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7facdc060550 msgr2=0x7facdc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.781+0000 7facfe1a7700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7facdc060550 0x7facdc062a00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7facf4009d80 tx=0x7facf4008040 comp rx=0 tx=0).stop 2023-10-06T04:40:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.781+0000 7facfe1a7700 1 -- 172.21.15.37:0/2205434949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf815cf30 msgr2=0x7facf8150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.781+0000 7facfe1a7700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf815cf30 0x7facf8150540 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7facf000c890 tx=0x7facf0001630 comp rx=0 tx=0).stop 2023-10-06T04:40:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.781+0000 7facfe1a7700 1 -- 172.21.15.37:0/2205434949 shutdown_connections 2023-10-06T04:40:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.781+0000 7facfe1a7700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7facdc060550 0x7facdc062a00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.781+0000 7facfe1a7700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf815cf30 0x7facf8150540 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.781+0000 7facfe1a7700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facf80c7240 0x7facf80af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.781+0000 7facfe1a7700 1 --2- 172.21.15.37:0/2205434949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facf806e190 0x7facf80c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.781+0000 7facfe1a7700 1 -- 172.21.15.37:0/2205434949 >> 172.21.15.37:0/2205434949 conn(0x7facf80c9570 msgr2=0x7facf806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.781+0000 7facfe1a7700 1 -- 172.21.15.37:0/2205434949 shutdown_connections 2023-10-06T04:40:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.781+0000 7facfe1a7700 1 -- 172.21.15.37:0/2205434949 wait complete. 2023-10-06T04:40:01.798 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:40:01.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 Processor -- start 2023-10-06T04:40:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 -- start start 2023-10-06T04:40:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4184150130 0x7f41840cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4184155ed0 0x7f41840ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41840c9360 con 0x7f41840cac40 2023-10-06T04:40:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4184156440 con 0x7f4184155ed0 2023-10-06T04:40:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4184156720 con 0x7f4184150130 2023-10-06T04:40:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4182ffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f41840cac40 0x7f418414fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40458/0 (socket says 172.21.15.37:40458) 2023-10-06T04:40:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4182ffd700 1 -- 172.21.15.37:0/2320584405 learned_addr learned my addr 172.21.15.37:0/2320584405 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f41837fe700 1 --2- 172.21.15.37:0/2320584405 >> v2:172.21.15.37:3300/0 conn(0x7f4184155ed0 0x7f41840ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f417a7fc700 1 --2- 172.21.15.37:0/2320584405 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4184150130 0x7f41840cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f41827fc700 1 -- 172.21.15.37:0/2320584405 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668552657 0 0) 0x7f41840c9360 con 0x7f41840cac40 2023-10-06T04:40:01.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f41827fc700 1 -- 172.21.15.37:0/2320584405 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4170003570 con 0x7f41840cac40 2023-10-06T04:40:01.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f41837fe700 1 -- 172.21.15.37:0/2320584405 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4184150130 msgr2=0x7f41840cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:01.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f41837fe700 1 --2- 172.21.15.37:0/2320584405 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4184150130 0x7f41840cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f41837fe700 1 -- 172.21.15.37:0/2320584405 >> v1:172.21.15.37:6789/0 conn(0x7f41840cac40 legacy=0x7f418414fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f41837fe700 1 -- 172.21.15.37:0/2320584405 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4184156a00 con 0x7f4184155ed0 2023-10-06T04:40:01.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f41837fe700 1 --2- 172.21.15.37:0/2320584405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4184155ed0 0x7f41840ad540 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f417c009e60 tx=0x7f417c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6da3c1e47dc6931 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f41827fc700 1 -- 172.21.15.37:0/2320584405 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00e070 con 0x7f4184155ed0 2023-10-06T04:40:01.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f41827fc700 1 -- 172.21.15.37:0/2320584405 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c00bab0 con 0x7f4184155ed0 2023-10-06T04:40:01.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f41827fc700 1 -- 172.21.15.37:0/2320584405 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00be30 con 0x7f4184155ed0 2023-10-06T04:40:01.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 -- 172.21.15.37:0/2320584405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4184155ed0 msgr2=0x7f41840ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 --2- 172.21.15.37:0/2320584405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4184155ed0 0x7f41840ad540 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f417c009e60 tx=0x7f417c009780 comp rx=0 tx=0).stop 2023-10-06T04:40:01.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 -- 172.21.15.37:0/2320584405 shutdown_connections 2023-10-06T04:40:01.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 --2- 172.21.15.37:0/2320584405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4184155ed0 0x7f41840ad540 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 --2- 172.21.15.37:0/2320584405 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4184150130 0x7f41840cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 -- 172.21.15.37:0/2320584405 >> 172.21.15.37:0/2320584405 conn(0x7f4184068760 msgr2=0x7f41840cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:01.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 -- 172.21.15.37:0/2320584405 shutdown_connections 2023-10-06T04:40:01.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.909+0000 7f4183fff700 1 -- 172.21.15.37:0/2320584405 wait complete. 2023-10-06T04:40:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f4183fff700 1 Processor -- start 2023-10-06T04:40:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f4183fff700 1 -- start start 2023-10-06T04:40:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f4183fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41840cac40 0x7f418414f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f4183fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4184150130 0x7f4184151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f4183fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4184155ed0 0x7f41841515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f4183fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184157be0 con 0x7f4184150130 2023-10-06T04:40:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f4183fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184157ec0 con 0x7f41840cac40 2023-10-06T04:40:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f4183fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41841581a0 con 0x7f4184155ed0 2023-10-06T04:40:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f417a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4184150130 0x7f4184151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f417a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4184150130 0x7f4184151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47256/0 (socket says 172.21.15.37:47256) 2023-10-06T04:40:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f417a7fc700 1 -- 172.21.15.37:0/1619156531 learned_addr learned my addr 172.21.15.37:0/1619156531 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f41837fe700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4184155ed0 0x7f41841515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f4182ffd700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41840cac40 0x7f418414f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f417a7fc700 1 -- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4184155ed0 msgr2=0x7f41841515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f417a7fc700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4184155ed0 0x7f41841515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f417a7fc700 1 -- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41840cac40 msgr2=0x7f418414f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f417a7fc700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41840cac40 0x7f418414f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f417a7fc700 1 -- 172.21.15.37:0/1619156531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c009a20 con 0x7f4184150130 2023-10-06T04:40:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f4182ffd700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41840cac40 0x7f418414f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f417a7fc700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4184150130 0x7f4184151080 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f416c00ec80 tx=0x7f416c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f417b7fe700 1 -- 172.21.15.37:0/1619156531 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c00c9d0 con 0x7f4184150130 2023-10-06T04:40:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f417b7fe700 1 -- 172.21.15.37:0/1619156531 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c00cb50 con 0x7f4184150130 2023-10-06T04:40:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f4183fff700 1 -- 172.21.15.37:0/1619156531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4184158480 con 0x7f4184150130 2023-10-06T04:40:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f417b7fe700 1 -- 172.21.15.37:0/1619156531 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c013470 con 0x7f4184150130 2023-10-06T04:40:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.913+0000 7f4183fff700 1 -- 172.21.15.37:0/1619156531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4184156f20 con 0x7f4184150130 2023-10-06T04:40:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.917+0000 7f4183fff700 1 -- 172.21.15.37:0/1619156531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4184158980 con 0x7f4184150130 2023-10-06T04:40:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.917+0000 7f417b7fe700 1 -- 172.21.15.37:0/1619156531 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f416c013860 con 0x7f4184150130 2023-10-06T04:40:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.917+0000 7f417b7fe700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4164060550 0x7f4164062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.917+0000 7f417b7fe700 1 -- 172.21.15.37:0/1619156531 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f416c07d090 con 0x7f4184150130 2023-10-06T04:40:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.917+0000 7f4182ffd700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4164060550 0x7f4164062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.917+0000 7f4182ffd700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4164060550 0x7f4164062a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f418406b180 tx=0x7f4174009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:01.921+0000 7f417b7fe700 1 -- 172.21.15.37:0/1619156531 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f416c04d1f0 con 0x7f4184150130 2023-10-06T04:40:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.081+0000 7f4183fff700 1 -- 172.21.15.37:0/1619156531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41840708a0 con 0x7f4184150130 2023-10-06T04:40:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.081+0000 7f417b7fe700 1 -- 172.21.15.37:0/1619156531 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f416c050810 con 0x7f4184150130 2023-10-06T04:40:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:40:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.081+0000 7f4183fff700 1 -- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4164060550 msgr2=0x7f4164062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.085+0000 7f4183fff700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4164060550 0x7f4164062a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f418406b180 tx=0x7f4174009040 comp rx=0 tx=0).stop 2023-10-06T04:40:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.085+0000 7f4183fff700 1 -- 172.21.15.37:0/1619156531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4184150130 msgr2=0x7f4184151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.085+0000 7f4183fff700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4184150130 0x7f4184151080 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f416c00ec80 tx=0x7f416c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.085+0000 7f4183fff700 1 -- 172.21.15.37:0/1619156531 shutdown_connections 2023-10-06T04:40:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.085+0000 7f4183fff700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4164060550 0x7f4164062a00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.085+0000 7f4183fff700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4184155ed0 0x7f41841515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.085+0000 7f4183fff700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4184150130 0x7f4184151080 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.085+0000 7f4183fff700 1 --2- 172.21.15.37:0/1619156531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41840cac40 0x7f418414f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.085+0000 7f4183fff700 1 -- 172.21.15.37:0/1619156531 >> 172.21.15.37:0/1619156531 conn(0x7f4184068760 msgr2=0x7f41840c1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.085+0000 7f4183fff700 1 -- 172.21.15.37:0/1619156531 shutdown_connections 2023-10-06T04:40:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.085+0000 7f4183fff700 1 -- 172.21.15.37:0/1619156531 wait complete. 2023-10-06T04:40:02.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:40:02.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.209+0000 7f5552543700 1 Processor -- start 2023-10-06T04:40:02.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.209+0000 7f5552543700 1 -- start start 2023-10-06T04:40:02.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.209+0000 7f5552543700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f554c0aece0 0x7f554c0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.209+0000 7f5552543700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c0cf240 con 0x7f554c0cf6d0 2023-10-06T04:40:02.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5552543700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c0ce630 con 0x7f554c0ce1a0 2023-10-06T04:40:02.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5552543700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c1594a0 con 0x7f554c0aece0 2023-10-06T04:40:02.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5551d42700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f554c0cf6d0 0x7f554c0cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40464/0 (socket says 172.21.15.37:40464) 2023-10-06T04:40:02.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5551d42700 1 -- 172.21.15.37:0/3065232050 learned_addr learned my addr 172.21.15.37:0/3065232050 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:02.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5551541700 1 --2- 172.21.15.37:0/3065232050 >> v2:172.21.15.37:3300/0 conn(0x7f554c0aece0 0x7f554c0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5543fff700 1 -- 172.21.15.37:0/3065232050 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733748296 0 0) 0x7f554c0cf240 con 0x7f554c0cf6d0 2023-10-06T04:40:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5543fff700 1 -- 172.21.15.37:0/3065232050 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5538003570 con 0x7f554c0cf6d0 2023-10-06T04:40:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5543fff700 1 -- 172.21.15.37:0/3065232050 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097041114 0 0) 0x7f554c0ce630 con 0x7f554c0ce1a0 2023-10-06T04:40:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5543fff700 1 -- 172.21.15.37:0/3065232050 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f554c0cf240 con 0x7f554c0ce1a0 2023-10-06T04:40:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5551541700 1 -- 172.21.15.37:0/3065232050 >> v1:172.21.15.83:6789/0 conn(0x7f554c0ce1a0 legacy=0x7f554c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5551541700 1 -- 172.21.15.37:0/3065232050 >> v1:172.21.15.37:6789/0 conn(0x7f554c0cf6d0 legacy=0x7f554c0cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5551541700 1 -- 172.21.15.37:0/3065232050 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0ce910 con 0x7f554c0aece0 2023-10-06T04:40:02.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5551541700 1 --2- 172.21.15.37:0/3065232050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554c0aece0 0x7f554c0af0b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f553c0098e0 tx=0x7f553c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d8a0faab026566 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5543fff700 1 -- 172.21.15.37:0/3065232050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c011630 con 0x7f554c0aece0 2023-10-06T04:40:02.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5543fff700 1 -- 172.21.15.37:0/3065232050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c011790 con 0x7f554c0aece0 2023-10-06T04:40:02.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5543fff700 1 -- 172.21.15.37:0/3065232050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c011b30 con 0x7f554c0aece0 2023-10-06T04:40:02.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5552543700 1 -- 172.21.15.37:0/3065232050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554c0aece0 msgr2=0x7f554c0af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5552543700 1 --2- 172.21.15.37:0/3065232050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554c0aece0 0x7f554c0af0b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f553c0098e0 tx=0x7f553c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5552543700 1 -- 172.21.15.37:0/3065232050 shutdown_connections 2023-10-06T04:40:02.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5552543700 1 --2- 172.21.15.37:0/3065232050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554c0aece0 0x7f554c0af0b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5552543700 1 -- 172.21.15.37:0/3065232050 >> 172.21.15.37:0/3065232050 conn(0x7f554c069d90 msgr2=0x7f554c067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:02.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5552543700 1 -- 172.21.15.37:0/3065232050 shutdown_connections 2023-10-06T04:40:02.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5552543700 1 -- 172.21.15.37:0/3065232050 wait complete. 2023-10-06T04:40:02.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5552543700 1 Processor -- start 2023-10-06T04:40:02.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.213+0000 7f5552543700 1 -- start start 2023-10-06T04:40:02.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5552543700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f554c0aece0 0x7f554c141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5552543700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f554c0ce1a0 0x7f554c0b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5552543700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554c0cf6d0 0x7f554c0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5552543700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c159fb0 con 0x7f554c0cf6d0 2023-10-06T04:40:02.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5552543700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c15a440 con 0x7f554c0ce1a0 2023-10-06T04:40:02.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5552543700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0b41d0 con 0x7f554c0aece0 2023-10-06T04:40:02.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5551d42700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554c0cf6d0 0x7f554c0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5551d42700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554c0cf6d0 0x7f554c0b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47282/0 (socket says 172.21.15.37:47282) 2023-10-06T04:40:02.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5551d42700 1 -- 172.21.15.37:0/352869554 learned_addr learned my addr 172.21.15.37:0/352869554 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:02.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5551541700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f554c0aece0 0x7f554c141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5550d40700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f554c0ce1a0 0x7f554c0b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5551d42700 1 -- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f554c0aece0 msgr2=0x7f554c141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5551d42700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f554c0aece0 0x7f554c141f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5551d42700 1 -- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f554c0ce1a0 msgr2=0x7f554c0b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5551d42700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f554c0ce1a0 0x7f554c0b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5551d42700 1 -- 172.21.15.37:0/352869554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c009420 con 0x7f554c0cf6d0 2023-10-06T04:40:02.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5551d42700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554c0cf6d0 0x7f554c0b1e00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f554400cc20 tx=0x7f5544001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f55417fa700 1 -- 172.21.15.37:0/352869554 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400a8b0 con 0x7f554c0cf6d0 2023-10-06T04:40:02.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f55417fa700 1 -- 172.21.15.37:0/352869554 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554400aa10 con 0x7f554c0cf6d0 2023-10-06T04:40:02.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f55417fa700 1 -- 172.21.15.37:0/352869554 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400add0 con 0x7f554c0cf6d0 2023-10-06T04:40:02.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5552543700 1 -- 172.21.15.37:0/352869554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c16a240 con 0x7f554c0cf6d0 2023-10-06T04:40:02.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.217+0000 7f5552543700 1 -- 172.21.15.37:0/352869554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c159960 con 0x7f554c0cf6d0 2023-10-06T04:40:02.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.221+0000 7f5552543700 1 -- 172.21.15.37:0/352869554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c15a160 con 0x7f554c0cf6d0 2023-10-06T04:40:02.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.221+0000 7f55417fa700 1 -- 172.21.15.37:0/352869554 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5544007300 con 0x7f554c0cf6d0 2023-10-06T04:40:02.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.221+0000 7f55417fa700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5530060550 0x7f5530062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.221+0000 7f55417fa700 1 -- 172.21.15.37:0/352869554 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f554407cf50 con 0x7f554c0cf6d0 2023-10-06T04:40:02.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.221+0000 7f5551541700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5530060550 0x7f5530062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.225+0000 7f5551541700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5530060550 0x7f5530062a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f553c0093f0 tx=0x7f553c017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.229+0000 7f55417fa700 1 -- 172.21.15.37:0/352869554 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f554c15a160 con 0x7f554c0cf6d0 2023-10-06T04:40:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.389+0000 7f5552543700 1 -- 172.21.15.37:0/352869554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f554c0708a0 con 0x7f554c0cf6d0 2023-10-06T04:40:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f55417fa700 1 -- 172.21.15.37:0/352869554 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f554404d130 con 0x7f554c0cf6d0 2023-10-06T04:40:02.396 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f5552543700 1 -- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5530060550 msgr2=0x7f5530062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f5552543700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5530060550 0x7f5530062a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f553c0093f0 tx=0x7f553c017000 comp rx=0 tx=0).stop 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f5552543700 1 -- 172.21.15.37:0/352869554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554c0cf6d0 msgr2=0x7f554c0b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f5552543700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554c0cf6d0 0x7f554c0b1e00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f554400cc20 tx=0x7f5544001a40 comp rx=0 tx=0).stop 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f5552543700 1 -- 172.21.15.37:0/352869554 shutdown_connections 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f5552543700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5530060550 0x7f5530062a00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f5552543700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f554c0ce1a0 0x7f554c0b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f5552543700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554c0cf6d0 0x7f554c0b1e00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f5552543700 1 --2- 172.21.15.37:0/352869554 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f554c0aece0 0x7f554c141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f5552543700 1 -- 172.21.15.37:0/352869554 >> 172.21.15.37:0/352869554 conn(0x7f554c069d90 msgr2=0x7f554c0af790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f5552543700 1 -- 172.21.15.37:0/352869554 shutdown_connections 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.393+0000 7f5552543700 1 -- 172.21.15.37:0/352869554 wait complete. 2023-10-06T04:40:02.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:40:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.517+0000 7f92224c0700 1 Processor -- start 2023-10-06T04:40:02.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.517+0000 7f92224c0700 1 -- start start 2023-10-06T04:40:02.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f921c069910 0x7f921c0c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f921c0c5dd0 0x7f921c069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c0b1590 con 0x7f921c0ae830 2023-10-06T04:40:02.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921c06ae90 con 0x7f921c0c5dd0 2023-10-06T04:40:02.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0c6d90 con 0x7f921c069910 2023-10-06T04:40:02.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9221cbf700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f921c0ae830 0x7f921c156700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40474/0 (socket says 172.21.15.37:40474) 2023-10-06T04:40:02.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9221cbf700 1 -- 172.21.15.37:0/1624683235 learned_addr learned my addr 172.21.15.37:0/1624683235 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:02.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9220cbd700 1 --2- 172.21.15.37:0/1624683235 >> v2:172.21.15.83:3300/0 conn(0x7f921c0c5dd0 0x7f921c069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92214be700 1 --2- 172.21.15.37:0/1624683235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f921c069910 0x7f921c0c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9213fff700 1 -- 172.21.15.37:0/1624683235 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654738645 0 0) 0x7f921c0b1590 con 0x7f921c0ae830 2023-10-06T04:40:02.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9213fff700 1 -- 172.21.15.37:0/1624683235 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9208003570 con 0x7f921c0ae830 2023-10-06T04:40:02.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9220cbd700 1 -- 172.21.15.37:0/1624683235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f921c069910 msgr2=0x7f921c0c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:02.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9220cbd700 1 --2- 172.21.15.37:0/1624683235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f921c069910 0x7f921c0c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9220cbd700 1 -- 172.21.15.37:0/1624683235 >> v1:172.21.15.37:6789/0 conn(0x7f921c0ae830 legacy=0x7f921c156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9220cbd700 1 -- 172.21.15.37:0/1624683235 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0b0fd0 con 0x7f921c0c5dd0 2023-10-06T04:40:02.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9220cbd700 1 --2- 172.21.15.37:0/1624683235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f921c0c5dd0 0x7f921c069ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f920c0098e0 tx=0x7f920c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4961a365acd77db5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9213fff700 1 -- 172.21.15.37:0/1624683235 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c011630 con 0x7f921c0c5dd0 2023-10-06T04:40:02.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9213fff700 1 -- 172.21.15.37:0/1624683235 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c011790 con 0x7f921c0c5dd0 2023-10-06T04:40:02.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f9213fff700 1 -- 172.21.15.37:0/1624683235 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c011b30 con 0x7f921c0c5dd0 2023-10-06T04:40:02.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 -- 172.21.15.37:0/1624683235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f921c0c5dd0 msgr2=0x7f921c069ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 --2- 172.21.15.37:0/1624683235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f921c0c5dd0 0x7f921c069ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f920c0098e0 tx=0x7f920c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 -- 172.21.15.37:0/1624683235 shutdown_connections 2023-10-06T04:40:02.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 --2- 172.21.15.37:0/1624683235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f921c0c5dd0 0x7f921c069ce0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 --2- 172.21.15.37:0/1624683235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f921c069910 0x7f921c0c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 -- 172.21.15.37:0/1624683235 >> 172.21.15.37:0/1624683235 conn(0x7f921c068760 msgr2=0x7f921c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:02.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 -- 172.21.15.37:0/1624683235 shutdown_connections 2023-10-06T04:40:02.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.521+0000 7f92224c0700 1 -- 172.21.15.37:0/1624683235 wait complete. 2023-10-06T04:40:02.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.525+0000 7f92224c0700 1 Processor -- start 2023-10-06T04:40:02.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.525+0000 7f92224c0700 1 -- start start 2023-10-06T04:40:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.525+0000 7f92224c0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f921c069910 0x7f921c146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.525+0000 7f92224c0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921c0ae830 0x7f921c166e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.525+0000 7f92224c0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f921c0c5dd0 0x7f921c0c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.525+0000 7f92224c0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c16a480 con 0x7f921c0ae830 2023-10-06T04:40:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.525+0000 7f92224c0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c16a760 con 0x7f921c069910 2023-10-06T04:40:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.525+0000 7f92224c0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c1673d0 con 0x7f921c0c5dd0 2023-10-06T04:40:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f9220cbd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921c0ae830 0x7f921c166e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f92214be700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f921c069910 0x7f921c146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f9220cbd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921c0ae830 0x7f921c166e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47296/0 (socket says 172.21.15.37:47296) 2023-10-06T04:40:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f92214be700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f921c069910 0x7f921c146f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:36286/0 (socket says 172.21.15.37:36286) 2023-10-06T04:40:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f9220cbd700 1 -- 172.21.15.37:0/1435741812 learned_addr learned my addr 172.21.15.37:0/1435741812 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f9221cbf700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f921c0c5dd0 0x7f921c0c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f9220cbd700 1 -- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f921c0c5dd0 msgr2=0x7f921c0c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f9220cbd700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f921c0c5dd0 0x7f921c0c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f9220cbd700 1 -- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f921c069910 msgr2=0x7f921c146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f9220cbd700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f921c069910 0x7f921c146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f9220cbd700 1 -- 172.21.15.37:0/1435741812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c009420 con 0x7f921c0ae830 2023-10-06T04:40:02.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f9220cbd700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921c0ae830 0x7f921c166e90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f921c0c9310 tx=0x7f920c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f92117fa700 1 -- 172.21.15.37:0/1435741812 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c000d10 con 0x7f921c0ae830 2023-10-06T04:40:02.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f92117fa700 1 -- 172.21.15.37:0/1435741812 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c011b10 con 0x7f921c0ae830 2023-10-06T04:40:02.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f92224c0700 1 -- 172.21.15.37:0/1435741812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c167660 con 0x7f921c0ae830 2023-10-06T04:40:02.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f92117fa700 1 -- 172.21.15.37:0/1435741812 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c025660 con 0x7f921c0ae830 2023-10-06T04:40:02.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f92224c0700 1 -- 172.21.15.37:0/1435741812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921c167c20 con 0x7f921c0ae830 2023-10-06T04:40:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f92224c0700 1 -- 172.21.15.37:0/1435741812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c16a8d0 con 0x7f921c0ae830 2023-10-06T04:40:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f92117fa700 1 -- 172.21.15.37:0/1435741812 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f920c025a50 con 0x7f921c0ae830 2023-10-06T04:40:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.529+0000 7f92117fa700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9200060620 0x7f9200062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.533+0000 7f92117fa700 1 -- 172.21.15.37:0/1435741812 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f920c07e3f0 con 0x7f921c0ae830 2023-10-06T04:40:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.533+0000 7f92214be700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9200060620 0x7f9200062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.533+0000 7f92214be700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9200060620 0x7f9200062ad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9218009db0 tx=0x7f92180091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.541+0000 7f92117fa700 1 -- 172.21.15.37:0/1435741812 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f920c04e530 con 0x7f921c0ae830 2023-10-06T04:40:02.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.705+0000 7f92224c0700 1 -- 172.21.15.37:0/1435741812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f921c0708a0 con 0x7f921c0ae830 2023-10-06T04:40:02.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.705+0000 7f92117fa700 1 -- 172.21.15.37:0/1435741812 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f920c051b50 con 0x7f921c0ae830 2023-10-06T04:40:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:40:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.709+0000 7f92224c0700 1 -- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9200060620 msgr2=0x7f9200062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.709+0000 7f92224c0700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9200060620 0x7f9200062ad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9218009db0 tx=0x7f92180091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.709+0000 7f92224c0700 1 -- 172.21.15.37:0/1435741812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921c0ae830 msgr2=0x7f921c166e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.709+0000 7f92224c0700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921c0ae830 0x7f921c166e90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f921c0c9310 tx=0x7f920c017000 comp rx=0 tx=0).stop 2023-10-06T04:40:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.709+0000 7f92224c0700 1 -- 172.21.15.37:0/1435741812 shutdown_connections 2023-10-06T04:40:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.709+0000 7f92224c0700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9200060620 0x7f9200062ad0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.709+0000 7f92224c0700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f921c0c5dd0 0x7f921c0c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.709+0000 7f92224c0700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921c0ae830 0x7f921c166e90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.709+0000 7f92224c0700 1 --2- 172.21.15.37:0/1435741812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f921c069910 0x7f921c146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.709+0000 7f92224c0700 1 -- 172.21.15.37:0/1435741812 >> 172.21.15.37:0/1435741812 conn(0x7f921c068760 msgr2=0x7f921c154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.709+0000 7f92224c0700 1 -- 172.21.15.37:0/1435741812 shutdown_connections 2023-10-06T04:40:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.709+0000 7f92224c0700 1 -- 172.21.15.37:0/1435741812 wait complete. 2023-10-06T04:40:02.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:02.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb0359e700 1 Processor -- start 2023-10-06T04:40:02.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb0359e700 1 -- start start 2023-10-06T04:40:02.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb0359e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffb0415d240 0x7ffb040aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb0359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb040cc0d0 0x7ffb0406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb0359e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0415e0e0 con 0x7ffb0406da20 2023-10-06T04:40:02.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb0359e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0406de60 con 0x7ffb0415d240 2023-10-06T04:40:02.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb0359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0415d7b0 con 0x7ffb040cc0d0 2023-10-06T04:40:02.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb01d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb040cc0d0 0x7ffb0406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb0259c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffb0415d240 0x7ffb040aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb01d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb040cc0d0 0x7ffb0406d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:33390/0 (socket says 172.21.15.37:33390) 2023-10-06T04:40:02.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb01d9b700 1 -- 172.21.15.37:0/2168886981 learned_addr learned my addr 172.21.15.37:0/2168886981 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:02.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb01d9b700 1 -- 172.21.15.37:0/2168886981 >> v2:172.21.15.83:3300/0 conn(0x7ffb0415d240 msgr2=0x7ffb040aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:02.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb01d9b700 1 --2- 172.21.15.37:0/2168886981 >> v2:172.21.15.83:3300/0 conn(0x7ffb0415d240 0x7ffb040aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb01d9b700 1 -- 172.21.15.37:0/2168886981 >> v1:172.21.15.83:6789/0 conn(0x7ffb0406da20 legacy=0x7ffb04160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb01d9b700 1 -- 172.21.15.37:0/2168886981 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0415da90 con 0x7ffb040cc0d0 2023-10-06T04:40:02.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb01d9b700 1 --2- 172.21.15.37:0/2168886981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb040cc0d0 0x7ffb0406d4e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0099b0 tx=0x7ffaec009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6e8686acc9fb8bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb0159a700 1 -- 172.21.15.37:0/2168886981 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec009ea0 con 0x7ffb040cc0d0 2023-10-06T04:40:02.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb0159a700 1 -- 172.21.15.37:0/2168886981 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec00b860 con 0x7ffb040cc0d0 2023-10-06T04:40:02.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.829+0000 7ffb0159a700 1 -- 172.21.15.37:0/2168886981 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec00bc00 con 0x7ffb040cc0d0 2023-10-06T04:40:02.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 -- 172.21.15.37:0/2168886981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb040cc0d0 msgr2=0x7ffb0406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 --2- 172.21.15.37:0/2168886981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb040cc0d0 0x7ffb0406d4e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0099b0 tx=0x7ffaec009250 comp rx=0 tx=0).stop 2023-10-06T04:40:02.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 -- 172.21.15.37:0/2168886981 shutdown_connections 2023-10-06T04:40:02.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 --2- 172.21.15.37:0/2168886981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb040cc0d0 0x7ffb0406d4e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 --2- 172.21.15.37:0/2168886981 >> v2:172.21.15.83:3300/0 conn(0x7ffb0415d240 0x7ffb040aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 -- 172.21.15.37:0/2168886981 >> 172.21.15.37:0/2168886981 conn(0x7ffb04068780 msgr2=0x7ffb040cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:02.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 -- 172.21.15.37:0/2168886981 shutdown_connections 2023-10-06T04:40:02.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 -- 172.21.15.37:0/2168886981 wait complete. 2023-10-06T04:40:02.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 Processor -- start 2023-10-06T04:40:02.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 -- start start 2023-10-06T04:40:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb0406da20 0x7ffb0416fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb040cc0d0 0x7ffb040c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0415d240 0x7ffb040c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040b0de0 con 0x7ffb040cc0d0 2023-10-06T04:40:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040b0b00 con 0x7ffb0406da20 2023-10-06T04:40:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040b01d0 con 0x7ffb0415d240 2023-10-06T04:40:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb01d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb040cc0d0 0x7ffb040c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb01d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb040cc0d0 0x7ffb040c5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47304/0 (socket says 172.21.15.37:47304) 2023-10-06T04:40:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb01d9b700 1 -- 172.21.15.37:0/3852329372 learned_addr learned my addr 172.21.15.37:0/3852329372 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb0259c700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb0406da20 0x7ffb0416fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb02d9d700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0415d240 0x7ffb040c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb01d9b700 1 -- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0415d240 msgr2=0x7ffb040c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb01d9b700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0415d240 0x7ffb040c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb01d9b700 1 -- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb0406da20 msgr2=0x7ffb0416fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb01d9b700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb0406da20 0x7ffb0416fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb01d9b700 1 -- 172.21.15.37:0/3852329372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec0094f0 con 0x7ffb040cc0d0 2023-10-06T04:40:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.833+0000 7ffb01d9b700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb040cc0d0 0x7ffb040c5210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffb0415d8f0 tx=0x7ffaec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.837+0000 7ffafa7fc700 1 -- 172.21.15.37:0/3852329372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec000d10 con 0x7ffb040cc0d0 2023-10-06T04:40:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.837+0000 7ffafa7fc700 1 -- 172.21.15.37:0/3852329372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec00bbe0 con 0x7ffb040cc0d0 2023-10-06T04:40:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.837+0000 7ffb0359e700 1 -- 172.21.15.37:0/3852329372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb040b04b0 con 0x7ffb040cc0d0 2023-10-06T04:40:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.837+0000 7ffafa7fc700 1 -- 172.21.15.37:0/3852329372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec011670 con 0x7ffb040cc0d0 2023-10-06T04:40:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.837+0000 7ffb0359e700 1 -- 172.21.15.37:0/3852329372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb04170140 con 0x7ffb040cc0d0 2023-10-06T04:40:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.837+0000 7ffb0359e700 1 -- 172.21.15.37:0/3852329372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb040708a0 con 0x7ffb040cc0d0 2023-10-06T04:40:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.837+0000 7ffafa7fc700 1 -- 172.21.15.37:0/3852329372 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffaec011a60 con 0x7ffb040cc0d0 2023-10-06T04:40:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.837+0000 7ffafa7fc700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffae4060550 0x7ffae4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.837+0000 7ffafa7fc700 1 -- 172.21.15.37:0/3852329372 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7ffaec07e430 con 0x7ffb040cc0d0 2023-10-06T04:40:02.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.837+0000 7ffb0259c700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffae4060550 0x7ffae4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.841+0000 7ffb0259c700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffae4060550 0x7ffae4062a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009d10 tx=0x7ffaf40091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:02.845+0000 7ffafa7fc700 1 -- 172.21.15.37:0/3852329372 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffaec04e570 con 0x7ffb040cc0d0 2023-10-06T04:40:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.045+0000 7ffb0359e700 1 -- 172.21.15.37:0/3852329372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb0415dd70 con 0x7ffb040cc0d0 2023-10-06T04:40:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffafa7fc700 1 -- 172.21.15.37:0/3852329372 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7ffaec051b90 con 0x7ffb040cc0d0 2023-10-06T04:40:03.053 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:03.053 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3463038764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3463038764},{"type":"v1","addr":"172.21.15.83:6835","nonce":3463038764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3802233690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3802233690},{"type":"v1","addr":"172.21.15.37:6833","nonce":3802233690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1262727325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1262727325},{"type":"v1","addr":"172.21.15.83:6837","nonce":1262727325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:10.126951+0000","modified":"2023-10-06T04:39:29.669009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1742476643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1742476643},{"type":"v1","addr":"172.21.15.37:6835","nonce":1742476643}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:40:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffb0359e700 1 -- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffae4060550 msgr2=0x7ffae4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffb0359e700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffae4060550 0x7ffae4062a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009d10 tx=0x7ffaf40091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffb0359e700 1 -- 172.21.15.37:0/3852329372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb040cc0d0 msgr2=0x7ffb040c5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffb0359e700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb040cc0d0 0x7ffb040c5210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffb0415d8f0 tx=0x7ffaec017000 comp rx=0 tx=0).stop 2023-10-06T04:40:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffb0359e700 1 -- 172.21.15.37:0/3852329372 shutdown_connections 2023-10-06T04:40:03.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffb0359e700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffae4060550 0x7ffae4062a00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffb0359e700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0415d240 0x7ffb040c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffb0359e700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb040cc0d0 0x7ffb040c5210 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffb0359e700 1 --2- 172.21.15.37:0/3852329372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb0406da20 0x7ffb0416fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffb0359e700 1 -- 172.21.15.37:0/3852329372 >> 172.21.15.37:0/3852329372 conn(0x7ffb04068780 msgr2=0x7ffb040c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:03.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffb0359e700 1 -- 172.21.15.37:0/3852329372 shutdown_connections 2023-10-06T04:40:03.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.049+0000 7ffb0359e700 1 -- 172.21.15.37:0/3852329372 wait complete. 2023-10-06T04:40:03.059 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:40:03.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.173+0000 7fc9e4839700 1 Processor -- start 2023-10-06T04:40:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.173+0000 7fc9e4839700 1 -- start start 2023-10-06T04:40:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.173+0000 7fc9e4839700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9e00aa8d0 0x7fc9e00c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.173+0000 7fc9e4839700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9e00cc1a0 0x7fc9e00c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.173+0000 7fc9e4839700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e00ca610 con 0x7fc9e00c77f0 2023-10-06T04:40:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.173+0000 7fc9e4839700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e00c9a00 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.173+0000 7fc9e4839700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00c9ce0 con 0x7fc9e00cc1a0 2023-10-06T04:40:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ded9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9e00aa8d0 0x7fc9e00c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9de59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9e00cc1a0 0x7fc9e00c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ded9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9e00aa8d0 0x7fc9e00c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47316/0 (socket says 172.21.15.37:47316) 2023-10-06T04:40:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9de59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9e00cc1a0 0x7fc9e00c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:33406/0 (socket says 172.21.15.37:33406) 2023-10-06T04:40:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ded9d700 1 -- 172.21.15.37:0/3027259595 learned_addr learned my addr 172.21.15.37:0/3027259595 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:03.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ddd9b700 1 -- 172.21.15.37:0/3027259595 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941247184 0 0) 0x7fc9e00ca610 con 0x7fc9e00c77f0 2023-10-06T04:40:03.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ddd9b700 1 -- 172.21.15.37:0/3027259595 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9cc003570 con 0x7fc9e00c77f0 2023-10-06T04:40:03.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ded9d700 1 -- 172.21.15.37:0/3027259595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9e00cc1a0 msgr2=0x7fc9e00c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:03.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ded9d700 1 --2- 172.21.15.37:0/3027259595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9e00cc1a0 0x7fc9e00c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ded9d700 1 -- 172.21.15.37:0/3027259595 >> v1:172.21.15.83:6789/0 conn(0x7fc9e00c77f0 legacy=0x7fc9e0159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ded9d700 1 -- 172.21.15.37:0/3027259595 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e00c9fc0 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9de59c700 1 --2- 172.21.15.37:0/3027259595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9e00cc1a0 0x7fc9e00c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:03.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ded9d700 1 --2- 172.21.15.37:0/3027259595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9e00aa8d0 0x7fc9e00c9370 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00099b0 tx=0x7fc9d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547495df1265ccb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ddd9b700 1 -- 172.21.15.37:0/3027259595 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000b680 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ddd9b700 1 -- 172.21.15.37:0/3027259595 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d000b7e0 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9ddd9b700 1 -- 172.21.15.37:0/3027259595 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000bb60 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9e4839700 1 -- 172.21.15.37:0/3027259595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9e00aa8d0 msgr2=0x7fc9e00c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9e4839700 1 --2- 172.21.15.37:0/3027259595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9e00aa8d0 0x7fc9e00c9370 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00099b0 tx=0x7fc9d0009250 comp rx=0 tx=0).stop 2023-10-06T04:40:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9e4839700 1 -- 172.21.15.37:0/3027259595 shutdown_connections 2023-10-06T04:40:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9e4839700 1 --2- 172.21.15.37:0/3027259595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9e00cc1a0 0x7fc9e00c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9e4839700 1 --2- 172.21.15.37:0/3027259595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9e00aa8d0 0x7fc9e00c9370 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9e4839700 1 -- 172.21.15.37:0/3027259595 >> 172.21.15.37:0/3027259595 conn(0x7fc9e0068780 msgr2=0x7fc9e00cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9e4839700 1 -- 172.21.15.37:0/3027259595 shutdown_connections 2023-10-06T04:40:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.177+0000 7fc9e4839700 1 -- 172.21.15.37:0/3027259595 wait complete. 2023-10-06T04:40:03.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9e4839700 1 Processor -- start 2023-10-06T04:40:03.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9e4839700 1 -- start start 2023-10-06T04:40:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9e4839700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9e00aa8d0 0x7fc9e00b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9e4839700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9e00c77f0 0x7fc9e0147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9e4839700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e00cc1a0 0x7fc9e006d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9e4839700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00af550 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9e4839700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00c33d0 con 0x7fc9e00cc1a0 2023-10-06T04:40:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9e4839700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00ae540 con 0x7fc9e00c77f0 2023-10-06T04:40:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9ded9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9e00aa8d0 0x7fc9e00b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9ded9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9e00aa8d0 0x7fc9e00b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47324/0 (socket says 172.21.15.37:47324) 2023-10-06T04:40:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9de59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9e00c77f0 0x7fc9e0147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9ded9d700 1 -- 172.21.15.37:0/197412972 learned_addr learned my addr 172.21.15.37:0/197412972 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9df59e700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e00cc1a0 0x7fc9e006d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9ded9d700 1 -- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9e00c77f0 msgr2=0x7fc9e0147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9ded9d700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9e00c77f0 0x7fc9e0147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9ded9d700 1 -- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e00cc1a0 msgr2=0x7fc9e006d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9ded9d700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e00cc1a0 0x7fc9e006d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9ded9d700 1 -- 172.21.15.37:0/197412972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c8009a20 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9ded9d700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9e00aa8d0 0x7fc9e00b0020 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0067c40 tx=0x7fc9d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9d6ffd700 1 -- 172.21.15.37:0/197412972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0002f90 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9d6ffd700 1 -- 172.21.15.37:0/197412972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d000b950 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9e4839700 1 -- 172.21.15.37:0/197412972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d00094f0 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9d6ffd700 1 -- 172.21.15.37:0/197412972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d001a660 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.181+0000 7fc9e4839700 1 -- 172.21.15.37:0/197412972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e00b0560 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.185+0000 7fc9e4839700 1 -- 172.21.15.37:0/197412972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e00708a0 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.185+0000 7fc9d6ffd700 1 -- 172.21.15.37:0/197412972 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc9d001aa50 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.185+0000 7fc9d6ffd700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc9c0060550 0x7fc9c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.185+0000 7fc9d6ffd700 1 -- 172.21.15.37:0/197412972 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fc9d007e850 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.185+0000 7fc9de59c700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc9c0060550 0x7fc9c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.185+0000 7fc9de59c700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc9c0060550 0x7fc9c0062a00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc9e006e3c0 tx=0x7fc9c800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.189+0000 7fc9d6ffd700 1 -- 172.21.15.37:0/197412972 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc9d004e9f0 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.353+0000 7fc9e4839700 1 -- 172.21.15.37:0/197412972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9e00c2290 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.353+0000 7fc9d6ffd700 1 -- 172.21.15.37:0/197412972 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18755 (secure 0 0 0) 0x7fc9d0051fd0 con 0x7fc9e00aa8d0 2023-10-06T04:40:03.360 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:03.360 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:52.800356+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:03.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.357+0000 7fc9e4839700 1 -- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc9c0060550 msgr2=0x7fc9c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.357+0000 7fc9e4839700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc9c0060550 0x7fc9c0062a00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc9e006e3c0 tx=0x7fc9c800b040 comp rx=0 tx=0).stop 2023-10-06T04:40:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.357+0000 7fc9e4839700 1 -- 172.21.15.37:0/197412972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9e00aa8d0 msgr2=0x7fc9e00b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.357+0000 7fc9e4839700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9e00aa8d0 0x7fc9e00b0020 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0067c40 tx=0x7fc9d0017000 comp rx=0 tx=0).stop 2023-10-06T04:40:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.357+0000 7fc9e4839700 1 -- 172.21.15.37:0/197412972 shutdown_connections 2023-10-06T04:40:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.357+0000 7fc9e4839700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc9c0060550 0x7fc9c0062a00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.357+0000 7fc9e4839700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e00cc1a0 0x7fc9e006d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.357+0000 7fc9e4839700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9e00c77f0 0x7fc9e0147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.357+0000 7fc9e4839700 1 --2- 172.21.15.37:0/197412972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9e00aa8d0 0x7fc9e00b0020 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.357+0000 7fc9e4839700 1 -- 172.21.15.37:0/197412972 >> 172.21.15.37:0/197412972 conn(0x7fc9e0068780 msgr2=0x7fc9e01590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.357+0000 7fc9e4839700 1 -- 172.21.15.37:0/197412972 shutdown_connections 2023-10-06T04:40:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.357+0000 7fc9e4839700 1 -- 172.21.15.37:0/197412972 wait complete. 2023-10-06T04:40:03.374 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:40:03.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:03.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.473+0000 7fadd22a2700 1 Processor -- start 2023-10-06T04:40:03.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.473+0000 7fadd22a2700 1 -- start start 2023-10-06T04:40:03.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd22a2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fadcc0aa8d0 0x7fadcc0c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd22a2700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadcc0ca610 con 0x7fadcc0cc1a0 2023-10-06T04:40:03.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd22a2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadcc0c9a00 con 0x7fadcc0c79c0 2023-10-06T04:40:03.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd22a2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadcc0c9ce0 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd0a9f700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fadcc0cc1a0 0x7fadcc0c72b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40482/0 (socket says 172.21.15.37:40482) 2023-10-06T04:40:03.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd0a9f700 1 -- 172.21.15.37:0/3682584094 learned_addr learned my addr 172.21.15.37:0/3682584094 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:03.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd12a0700 1 --2- 172.21.15.37:0/3682584094 >> v2:172.21.15.83:3300/0 conn(0x7fadcc0aa8d0 0x7fadcc0c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadc3fff700 1 -- 172.21.15.37:0/3682584094 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235837693 0 0) 0x7fadcc0ca610 con 0x7fadcc0cc1a0 2023-10-06T04:40:03.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadc3fff700 1 -- 172.21.15.37:0/3682584094 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb8003570 con 0x7fadcc0cc1a0 2023-10-06T04:40:03.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd12a0700 1 -- 172.21.15.37:0/3682584094 >> v1:172.21.15.83:6789/0 conn(0x7fadcc0c79c0 legacy=0x7fadcc0c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd12a0700 1 -- 172.21.15.37:0/3682584094 >> v1:172.21.15.37:6789/0 conn(0x7fadcc0cc1a0 legacy=0x7fadcc0c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd12a0700 1 -- 172.21.15.37:0/3682584094 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc0c9fc0 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd12a0700 1 --2- 172.21.15.37:0/3682584094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadcc0aa8d0 0x7fadcc0c9370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fadc80098e0 tx=0x7fadc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ef58310150abc46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadc3fff700 1 -- 172.21.15.37:0/3682584094 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800b640 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadc3fff700 1 -- 172.21.15.37:0/3682584094 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800b7a0 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadc3fff700 1 -- 172.21.15.37:0/3682584094 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800bb40 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd22a2700 1 -- 172.21.15.37:0/3682584094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadcc0aa8d0 msgr2=0x7fadcc0c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.477+0000 7fadd22a2700 1 --2- 172.21.15.37:0/3682584094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadcc0aa8d0 0x7fadcc0c9370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fadc80098e0 tx=0x7fadc80091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 -- 172.21.15.37:0/3682584094 shutdown_connections 2023-10-06T04:40:03.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 --2- 172.21.15.37:0/3682584094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadcc0aa8d0 0x7fadcc0c9370 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 -- 172.21.15.37:0/3682584094 >> 172.21.15.37:0/3682584094 conn(0x7fadcc068780 msgr2=0x7fadcc0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:03.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 -- 172.21.15.37:0/3682584094 shutdown_connections 2023-10-06T04:40:03.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 -- 172.21.15.37:0/3682584094 wait complete. 2023-10-06T04:40:03.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 Processor -- start 2023-10-06T04:40:03.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 -- start start 2023-10-06T04:40:03.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc0aa8d0 0x7fadcc15a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadcc0c79c0 0x7fadcc06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fadcc0cc1a0 0x7fadcc06da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc158fc0 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc1592a0 con 0x7fadcc0c79c0 2023-10-06T04:40:03.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd22a2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc159580 con 0x7fadcc0cc1a0 2023-10-06T04:40:03.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd12a0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc0aa8d0 0x7fadcc15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd12a0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc0aa8d0 0x7fadcc15a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47334/0 (socket says 172.21.15.37:47334) 2023-10-06T04:40:03.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.481+0000 7fadd12a0700 1 -- 172.21.15.37:0/1219636011 learned_addr learned my addr 172.21.15.37:0/1219636011 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:03.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadd0a9f700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadcc0c79c0 0x7fadcc06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadd1aa1700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fadcc0cc1a0 0x7fadcc06da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadd12a0700 1 -- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fadcc0cc1a0 msgr2=0x7fadcc06da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadd12a0700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fadcc0cc1a0 0x7fadcc06da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadd12a0700 1 -- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadcc0c79c0 msgr2=0x7fadcc06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadd12a0700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadcc0c79c0 0x7fadcc06d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadd12a0700 1 -- 172.21.15.37:0/1219636011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc8009420 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadd12a0700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc0aa8d0 0x7fadcc15a910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fadcc067c40 tx=0x7fadc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadc17fa700 1 -- 172.21.15.37:0/1219636011 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8000d10 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadc17fa700 1 -- 172.21.15.37:0/1219636011 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800bb20 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadc17fa700 1 -- 172.21.15.37:0/1219636011 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8011670 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadd22a2700 1 -- 172.21.15.37:0/1219636011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc159860 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadd22a2700 1 -- 172.21.15.37:0/1219636011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadcc15ae50 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.485+0000 7fadd22a2700 1 -- 172.21.15.37:0/1219636011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadcc0708a0 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.489+0000 7fadc17fa700 1 -- 172.21.15.37:0/1219636011 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fadc80119e0 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.489+0000 7fadc17fa700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fadb0060550 0x7fadb0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.489+0000 7fadc17fa700 1 -- 172.21.15.37:0/1219636011 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fadc807e270 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.489+0000 7fadd0a9f700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fadb0060550 0x7fadb0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.489+0000 7fadd0a9f700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fadb0060550 0x7fadb0062a00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fadcc15b520 tx=0x7fadbc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.493+0000 7fadc17fa700 1 -- 172.21.15.37:0/1219636011 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fadc804e330 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.689+0000 7fadd22a2700 1 -- 172.21.15.37:0/1219636011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadcc0c2290 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.689+0000 7fadc17fa700 1 -- 172.21.15.37:0/1219636011 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7fadc8051950 con 0x7fadcc0aa8d0 2023-10-06T04:40:03.696 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:03.696 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3463038764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3463038764},{"type":"v1","addr":"172.21.15.83:6835","nonce":3463038764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3802233690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3802233690},{"type":"v1","addr":"172.21.15.37:6833","nonce":3802233690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1262727325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1262727325},{"type":"v1","addr":"172.21.15.83:6837","nonce":1262727325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:10.126951+0000","modified":"2023-10-06T04:39:29.669009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1742476643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1742476643},{"type":"v1","addr":"172.21.15.37:6835","nonce":1742476643}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:40:03.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.693+0000 7fadd22a2700 1 -- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fadb0060550 msgr2=0x7fadb0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.693+0000 7fadd22a2700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fadb0060550 0x7fadb0062a00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fadcc15b520 tx=0x7fadbc009040 comp rx=0 tx=0).stop 2023-10-06T04:40:03.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.693+0000 7fadd22a2700 1 -- 172.21.15.37:0/1219636011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc0aa8d0 msgr2=0x7fadcc15a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.693+0000 7fadd22a2700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc0aa8d0 0x7fadcc15a910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fadcc067c40 tx=0x7fadc8017000 comp rx=0 tx=0).stop 2023-10-06T04:40:03.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.693+0000 7fadd22a2700 1 -- 172.21.15.37:0/1219636011 shutdown_connections 2023-10-06T04:40:03.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.693+0000 7fadd22a2700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fadb0060550 0x7fadb0062a00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.693+0000 7fadd22a2700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadcc0c79c0 0x7fadcc06d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.693+0000 7fadd22a2700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fadcc0cc1a0 0x7fadcc06da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.693+0000 7fadd22a2700 1 --2- 172.21.15.37:0/1219636011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc0aa8d0 0x7fadcc15a910 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.693+0000 7fadd22a2700 1 -- 172.21.15.37:0/1219636011 >> 172.21.15.37:0/1219636011 conn(0x7fadcc068780 msgr2=0x7fadcc154fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:03.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.693+0000 7fadd22a2700 1 -- 172.21.15.37:0/1219636011 shutdown_connections 2023-10-06T04:40:03.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.693+0000 7fadd22a2700 1 -- 172.21.15.37:0/1219636011 wait complete. 2023-10-06T04:40:03.700 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:40:03.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:03.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.813+0000 7fc6ca5c9700 1 Processor -- start 2023-10-06T04:40:03.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.813+0000 7fc6ca5c9700 1 -- start start 2023-10-06T04:40:03.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6ca5c9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6c4068400 0x7fc6c415d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6ca5c9700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40af7f0 con 0x7fc6c41587d0 2023-10-06T04:40:03.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6ca5c9700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40afad0 con 0x7fc6c4158ba0 2023-10-06T04:40:03.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6ca5c9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c415d6d0 con 0x7fc6c4068400 2023-10-06T04:40:03.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6c95c7700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc6c41587d0 0x7fc6c4067cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40496/0 (socket says 172.21.15.37:40496) 2023-10-06T04:40:03.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6c95c7700 1 -- 172.21.15.37:0/475231257 learned_addr learned my addr 172.21.15.37:0/475231257 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:03.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6c8dc6700 1 --2- 172.21.15.37:0/475231257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6c4068400 0x7fc6c415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6bbfff700 1 -- 172.21.15.37:0/475231257 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734628726 0 0) 0x7fc6c40af7f0 con 0x7fc6c41587d0 2023-10-06T04:40:03.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6bbfff700 1 -- 172.21.15.37:0/475231257 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6b0003570 con 0x7fc6c41587d0 2023-10-06T04:40:03.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6bbfff700 1 -- 172.21.15.37:0/475231257 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818070024 0 0) 0x7fc6c40afad0 con 0x7fc6c4158ba0 2023-10-06T04:40:03.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6c8dc6700 1 -- 172.21.15.37:0/475231257 >> v1:172.21.15.83:6789/0 conn(0x7fc6c4158ba0 legacy=0x7fc6c40ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6c8dc6700 1 -- 172.21.15.37:0/475231257 >> v1:172.21.15.37:6789/0 conn(0x7fc6c41587d0 legacy=0x7fc6c4067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6c8dc6700 1 -- 172.21.15.37:0/475231257 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40afdb0 con 0x7fc6c4068400 2023-10-06T04:40:03.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6c8dc6700 1 --2- 172.21.15.37:0/475231257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6c4068400 0x7fc6c415d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009910 tx=0x7fc6b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4714f73a46937446 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6bbfff700 1 -- 172.21.15.37:0/475231257 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0001470 con 0x7fc6c4068400 2023-10-06T04:40:03.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6bbfff700 1 -- 172.21.15.37:0/475231257 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b4011420 con 0x7fc6c4068400 2023-10-06T04:40:03.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6bbfff700 1 -- 172.21.15.37:0/475231257 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40117c0 con 0x7fc6c4068400 2023-10-06T04:40:03.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/475231257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6c4068400 msgr2=0x7fc6c415d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6ca5c9700 1 --2- 172.21.15.37:0/475231257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6c4068400 0x7fc6c415d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009910 tx=0x7fc6b40091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/475231257 shutdown_connections 2023-10-06T04:40:03.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6ca5c9700 1 --2- 172.21.15.37:0/475231257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6c4068400 0x7fc6c415d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/475231257 >> 172.21.15.37:0/475231257 conn(0x7fc6c40cc5f0 msgr2=0x7fc6c40cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:03.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/475231257 shutdown_connections 2023-10-06T04:40:03.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.817+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/475231257 wait complete. 2023-10-06T04:40:03.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.821+0000 7fc6ca5c9700 1 Processor -- start 2023-10-06T04:40:03.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.821+0000 7fc6ca5c9700 1 -- start start 2023-10-06T04:40:03.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.821+0000 7fc6ca5c9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6c4068400 0x7fc6c4147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.821+0000 7fc6ca5c9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6c41587d0 0x7fc6c40c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.821+0000 7fc6ca5c9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c4158ba0 0x7fc6c40ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.821+0000 7fc6ca5c9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4148530 con 0x7fc6c4158ba0 2023-10-06T04:40:03.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.821+0000 7fc6ca5c9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4158ff0 con 0x7fc6c41587d0 2023-10-06T04:40:03.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.821+0000 7fc6ca5c9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c41592d0 con 0x7fc6c4068400 2023-10-06T04:40:03.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.821+0000 7fc6c9dc8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c4158ba0 0x7fc6c40ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.821+0000 7fc6c95c7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6c4068400 0x7fc6c4147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6c95c7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6c4068400 0x7fc6c4147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:33446/0 (socket says 172.21.15.37:33446) 2023-10-06T04:40:03.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6c8dc6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6c41587d0 0x7fc6c40c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6c95c7700 1 -- 172.21.15.37:0/1039728117 learned_addr learned my addr 172.21.15.37:0/1039728117 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:03.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6c9dc8700 1 -- 172.21.15.37:0/1039728117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6c4068400 msgr2=0x7fc6c4147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6c9dc8700 1 --2- 172.21.15.37:0/1039728117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6c4068400 0x7fc6c4147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6c9dc8700 1 -- 172.21.15.37:0/1039728117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6c41587d0 msgr2=0x7fc6c40c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6c9dc8700 1 --2- 172.21.15.37:0/1039728117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6c41587d0 0x7fc6c40c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6c9dc8700 1 -- 172.21.15.37:0/1039728117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b4009420 con 0x7fc6c4158ba0 2023-10-06T04:40:03.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6c9dc8700 1 --2- 172.21.15.37:0/1039728117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c4158ba0 0x7fc6c40ca9f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc001560 tx=0x7fc6bc0016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6b97fa700 1 -- 172.21.15.37:0/1039728117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc012630 con 0x7fc6c4158ba0 2023-10-06T04:40:03.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6b97fa700 1 -- 172.21.15.37:0/1039728117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc012790 con 0x7fc6c4158ba0 2023-10-06T04:40:03.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/1039728117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c40c96d0 con 0x7fc6c4158ba0 2023-10-06T04:40:03.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6b97fa700 1 -- 172.21.15.37:0/1039728117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc012b50 con 0x7fc6c4158ba0 2023-10-06T04:40:03.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/1039728117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c40c9c90 con 0x7fc6c4158ba0 2023-10-06T04:40:03.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.825+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/1039728117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c4159440 con 0x7fc6c4158ba0 2023-10-06T04:40:03.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.829+0000 7fc6b97fa700 1 -- 172.21.15.37:0/1039728117 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc6bc003030 con 0x7fc6c4158ba0 2023-10-06T04:40:03.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.829+0000 7fc6b97fa700 1 --2- 172.21.15.37:0/1039728117 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc6a8060580 0x7fc6a8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.829+0000 7fc6b97fa700 1 -- 172.21.15.37:0/1039728117 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fc6bc07cb40 con 0x7fc6c4158ba0 2023-10-06T04:40:03.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.829+0000 7fc6c95c7700 1 --2- 172.21.15.37:0/1039728117 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc6a8060580 0x7fc6a8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.829+0000 7fc6c95c7700 1 --2- 172.21.15.37:0/1039728117 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc6a8060580 0x7fc6a8062a30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00011e0 tx=0x7fc6c0000bc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:03.837+0000 7fc6b97fa700 1 -- 172.21.15.37:0/1039728117 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc6bc04cca0 con 0x7fc6c4158ba0 2023-10-06T04:40:04.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.033+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/1039728117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6c40708a0 con 0x7fc6c4158ba0 2023-10-06T04:40:04.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.033+0000 7fc6b97fa700 1 -- 172.21.15.37:0/1039728117 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4593 (secure 0 0 0) 0x7fc6bc0502c0 con 0x7fc6c4158ba0 2023-10-06T04:40:04.040 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:04.040 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3463038764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3463038764},{"type":"v1","addr":"172.21.15.83:6835","nonce":3463038764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3802233690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3802233690},{"type":"v1","addr":"172.21.15.37:6833","nonce":3802233690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1262727325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1262727325},{"type":"v1","addr":"172.21.15.83:6837","nonce":1262727325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:10.126951+0000","modified":"2023-10-06T04:39:29.669009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1742476643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1742476643},{"type":"v1","addr":"172.21.15.37:6835","nonce":1742476643}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:40:04.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.037+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/1039728117 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc6a8060580 msgr2=0x7fc6a8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.037+0000 7fc6ca5c9700 1 --2- 172.21.15.37:0/1039728117 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc6a8060580 0x7fc6a8062a30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00011e0 tx=0x7fc6c0000bc0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.037+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/1039728117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c4158ba0 msgr2=0x7fc6c40ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.037+0000 7fc6ca5c9700 1 --2- 172.21.15.37:0/1039728117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c4158ba0 0x7fc6c40ca9f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc001560 tx=0x7fc6bc0016c0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.037+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/1039728117 shutdown_connections 2023-10-06T04:40:04.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.037+0000 7fc6ca5c9700 1 --2- 172.21.15.37:0/1039728117 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc6a8060580 0x7fc6a8062a30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.037+0000 7fc6ca5c9700 1 --2- 172.21.15.37:0/1039728117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6c41587d0 0x7fc6c40c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.037+0000 7fc6ca5c9700 1 --2- 172.21.15.37:0/1039728117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c4158ba0 0x7fc6c40ca9f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.037+0000 7fc6ca5c9700 1 --2- 172.21.15.37:0/1039728117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6c4068400 0x7fc6c4147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.037+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/1039728117 >> 172.21.15.37:0/1039728117 conn(0x7fc6c40cc5f0 msgr2=0x7fc6c40b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:04.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.037+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/1039728117 shutdown_connections 2023-10-06T04:40:04.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.037+0000 7fc6ca5c9700 1 -- 172.21.15.37:0/1039728117 wait complete. 2023-10-06T04:40:04.044 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:40:04.060 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d1d778700 1 Processor -- start 2023-10-06T04:40:04.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d1d778700 1 -- start start 2023-10-06T04:40:04.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d1d778700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7d180cbd50 0x7f7d180cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d1d778700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d1806e910 0x7f7d1815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d1d778700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1806dd70 con 0x7f7d180c9820 2023-10-06T04:40:04.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d1d778700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d180add50 con 0x7f7d180cbd50 2023-10-06T04:40:04.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d1d778700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180ae030 con 0x7f7d1806e910 2023-10-06T04:40:04.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d16ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7d180cbd50 0x7f7d180cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d177fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d1806e910 0x7f7d1815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d16ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7d180cbd50 0x7f7d180cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:36338/0 (socket says 172.21.15.37:36338) 2023-10-06T04:40:04.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d167fc700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f7d180c9820 0x7f7d1806e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:41006/0 (socket says 172.21.15.37:41006) 2023-10-06T04:40:04.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d16ffd700 1 -- 172.21.15.37:0/643620259 learned_addr learned my addr 172.21.15.37:0/643620259 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:04.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d16ffd700 1 -- 172.21.15.37:0/643620259 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d1806e910 msgr2=0x7f7d1815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:04.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d16ffd700 1 --2- 172.21.15.37:0/643620259 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d1806e910 0x7f7d1815cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d16ffd700 1 -- 172.21.15.37:0/643620259 >> v1:172.21.15.83:6789/0 conn(0x7f7d180c9820 legacy=0x7f7d1806e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d15ffb700 1 -- 172.21.15.37:0/643620259 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445340765 0 0) 0x7f7d1806dd70 con 0x7f7d180c9820 2023-10-06T04:40:04.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d16ffd700 1 -- 172.21.15.37:0/643620259 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d180ae310 con 0x7f7d180cbd50 2023-10-06T04:40:04.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d16ffd700 1 --2- 172.21.15.37:0/643620259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d180cbd50 0x7f7d180cc120 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7d080099b0 tx=0x7f7d08009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e1e1132d77fdb5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d15ffb700 1 -- 172.21.15.37:0/643620259 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08009ea0 con 0x7f7d180cbd50 2023-10-06T04:40:04.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d15ffb700 1 -- 172.21.15.37:0/643620259 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0800b860 con 0x7f7d180cbd50 2023-10-06T04:40:04.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.165+0000 7f7d15ffb700 1 -- 172.21.15.37:0/643620259 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800bc00 con 0x7f7d180cbd50 2023-10-06T04:40:04.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 -- 172.21.15.37:0/643620259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d180cbd50 msgr2=0x7f7d180cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 --2- 172.21.15.37:0/643620259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d180cbd50 0x7f7d180cc120 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7d080099b0 tx=0x7f7d08009250 comp rx=0 tx=0).stop 2023-10-06T04:40:04.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 -- 172.21.15.37:0/643620259 shutdown_connections 2023-10-06T04:40:04.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 --2- 172.21.15.37:0/643620259 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d1806e910 0x7f7d1815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 --2- 172.21.15.37:0/643620259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d180cbd50 0x7f7d180cc120 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 -- 172.21.15.37:0/643620259 >> 172.21.15.37:0/643620259 conn(0x7f7d180667b0 msgr2=0x7f7d18066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:04.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 -- 172.21.15.37:0/643620259 shutdown_connections 2023-10-06T04:40:04.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 -- 172.21.15.37:0/643620259 wait complete. 2023-10-06T04:40:04.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 Processor -- start 2023-10-06T04:40:04.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 -- start start 2023-10-06T04:40:04.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d1806e910 0x7f7d18159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d180c9820 0x7f7d1815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d180cbd50 0x7f7d1815ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1815a440 con 0x7f7d180c9820 2023-10-06T04:40:04.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1815a720 con 0x7f7d180cbd50 2023-10-06T04:40:04.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d1d778700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1815aa00 con 0x7f7d1806e910 2023-10-06T04:40:04.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d167fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d180c9820 0x7f7d1815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d167fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d180c9820 0x7f7d1815b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47352/0 (socket says 172.21.15.37:47352) 2023-10-06T04:40:04.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d177fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d180cbd50 0x7f7d1815ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d167fc700 1 -- 172.21.15.37:0/1372915936 learned_addr learned my addr 172.21.15.37:0/1372915936 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:04.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.169+0000 7f7d16ffd700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d1806e910 0x7f7d18159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7d167fc700 1 -- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d1806e910 msgr2=0x7f7d18159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7d167fc700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d1806e910 0x7f7d18159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7d167fc700 1 -- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d180cbd50 msgr2=0x7f7d1815ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7d167fc700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d180cbd50 0x7f7d1815ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7d167fc700 1 -- 172.21.15.37:0/1372915936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d080094f0 con 0x7f7d180c9820 2023-10-06T04:40:04.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7d167fc700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d180c9820 0x7f7d1815b4e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0011e0 tx=0x7f7d0c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7cfeffd700 1 -- 172.21.15.37:0/1372915936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c005a70 con 0x7f7d180c9820 2023-10-06T04:40:04.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7cfeffd700 1 -- 172.21.15.37:0/1372915936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c005bd0 con 0x7f7d180c9820 2023-10-06T04:40:04.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7cfeffd700 1 -- 172.21.15.37:0/1372915936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c0070d0 con 0x7f7d180c9820 2023-10-06T04:40:04.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7d1d778700 1 -- 172.21.15.37:0/1372915936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1815ace0 con 0x7f7d180c9820 2023-10-06T04:40:04.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7d1d778700 1 -- 172.21.15.37:0/1372915936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d18160490 con 0x7f7d180c9820 2023-10-06T04:40:04.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7d1d778700 1 -- 172.21.15.37:0/1372915936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d18070ee0 con 0x7f7d180c9820 2023-10-06T04:40:04.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.173+0000 7f7cfeffd700 1 -- 172.21.15.37:0/1372915936 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7d0c007480 con 0x7f7d180c9820 2023-10-06T04:40:04.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.177+0000 7f7cfeffd700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7d04060550 0x7f7d04062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.177+0000 7f7cfeffd700 1 -- 172.21.15.37:0/1372915936 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f7d0c07c170 con 0x7f7d180c9820 2023-10-06T04:40:04.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.177+0000 7f7d16ffd700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7d04060550 0x7f7d04062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.177+0000 7f7d16ffd700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7d04060550 0x7f7d04062a00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d080099b0 tx=0x7f7d08017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.181+0000 7f7cfeffd700 1 -- 172.21.15.37:0/1372915936 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7d0c04c2d0 con 0x7f7d180c9820 2023-10-06T04:40:04.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.345+0000 7f7d1d778700 1 -- 172.21.15.37:0/1372915936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d1806da00 con 0x7f7d180c9820 2023-10-06T04:40:04.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.345+0000 7f7cfeffd700 1 -- 172.21.15.37:0/1372915936 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18755 (secure 0 0 0) 0x7f7d0c04f8f0 con 0x7f7d180c9820 2023-10-06T04:40:04.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:04.352 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:39:52.800356+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:08.512565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:09.104711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:39:12.860905+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.349+0000 7f7d1d778700 1 -- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7d04060550 msgr2=0x7f7d04062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.349+0000 7f7d1d778700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7d04060550 0x7f7d04062a00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d080099b0 tx=0x7f7d08017000 comp rx=0 tx=0).stop 2023-10-06T04:40:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.349+0000 7f7d1d778700 1 -- 172.21.15.37:0/1372915936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d180c9820 msgr2=0x7f7d1815b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.349+0000 7f7d1d778700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d180c9820 0x7f7d1815b4e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0011e0 tx=0x7f7d0c007e10 comp rx=0 tx=0).stop 2023-10-06T04:40:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.349+0000 7f7d1d778700 1 -- 172.21.15.37:0/1372915936 shutdown_connections 2023-10-06T04:40:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.349+0000 7f7d1d778700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7d04060550 0x7f7d04062a00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.349+0000 7f7d1d778700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d180cbd50 0x7f7d1815ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.349+0000 7f7d1d778700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d180c9820 0x7f7d1815b4e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.349+0000 7f7d1d778700 1 --2- 172.21.15.37:0/1372915936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d1806e910 0x7f7d18159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.349+0000 7f7d1d778700 1 -- 172.21.15.37:0/1372915936 >> 172.21.15.37:0/1372915936 conn(0x7f7d180667b0 msgr2=0x7f7d180b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:04.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.349+0000 7f7d1d778700 1 -- 172.21.15.37:0/1372915936 shutdown_connections 2023-10-06T04:40:04.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.349+0000 7f7d1d778700 1 -- 172.21.15.37:0/1372915936 wait complete. 2023-10-06T04:40:04.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:40:04.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.469+0000 7fa676af1700 1 Processor -- start 2023-10-06T04:40:04.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.469+0000 7fa676af1700 1 -- start start 2023-10-06T04:40:04.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa676af1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa6701587d0 0x7fa67015d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa676af1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa670159040 con 0x7fa670068400 2023-10-06T04:40:04.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa676af1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6700af7f0 con 0x7fa670158ba0 2023-10-06T04:40:04.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa676af1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67015d6d0 con 0x7fa6701587d0 2023-10-06T04:40:04.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa6762f0700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa670068400 0x7fa6700ae510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40498/0 (socket says 172.21.15.37:40498) 2023-10-06T04:40:04.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa6762f0700 1 -- 172.21.15.37:0/3945051070 learned_addr learned my addr 172.21.15.37:0/3945051070 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:04.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa675aef700 1 --2- 172.21.15.37:0/3945051070 >> v2:172.21.15.83:3300/0 conn(0x7fa6701587d0 0x7fa67015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa674aed700 1 -- 172.21.15.37:0/3945051070 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021475905 0 0) 0x7fa670159040 con 0x7fa670068400 2023-10-06T04:40:04.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa674aed700 1 -- 172.21.15.37:0/3945051070 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa65c003570 con 0x7fa670068400 2023-10-06T04:40:04.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa674aed700 1 -- 172.21.15.37:0/3945051070 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105211581 0 0) 0x7fa6700af7f0 con 0x7fa670158ba0 2023-10-06T04:40:04.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa674aed700 1 -- 172.21.15.37:0/3945051070 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa670159040 con 0x7fa670158ba0 2023-10-06T04:40:04.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa675aef700 1 -- 172.21.15.37:0/3945051070 >> v1:172.21.15.83:6789/0 conn(0x7fa670158ba0 legacy=0x7fa670067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa675aef700 1 -- 172.21.15.37:0/3945051070 >> v1:172.21.15.37:6789/0 conn(0x7fa670068400 legacy=0x7fa6700ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa675aef700 1 -- 172.21.15.37:0/3945051070 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6700afad0 con 0x7fa6701587d0 2023-10-06T04:40:04.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa675aef700 1 --2- 172.21.15.37:0/3945051070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6701587d0 0x7fa67015d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa67015d810 tx=0x7fa66c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e93b8170de8b551 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa674aed700 1 -- 172.21.15.37:0/3945051070 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c011630 con 0x7fa6701587d0 2023-10-06T04:40:04.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa674aed700 1 -- 172.21.15.37:0/3945051070 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c011790 con 0x7fa6701587d0 2023-10-06T04:40:04.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.473+0000 7fa674aed700 1 -- 172.21.15.37:0/3945051070 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c011b50 con 0x7fa6701587d0 2023-10-06T04:40:04.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 -- 172.21.15.37:0/3945051070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6701587d0 msgr2=0x7fa67015d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 --2- 172.21.15.37:0/3945051070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6701587d0 0x7fa67015d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa67015d810 tx=0x7fa66c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 -- 172.21.15.37:0/3945051070 shutdown_connections 2023-10-06T04:40:04.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 --2- 172.21.15.37:0/3945051070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6701587d0 0x7fa67015d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 -- 172.21.15.37:0/3945051070 >> 172.21.15.37:0/3945051070 conn(0x7fa6700cc5f0 msgr2=0x7fa6700cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:04.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 -- 172.21.15.37:0/3945051070 shutdown_connections 2023-10-06T04:40:04.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 -- 172.21.15.37:0/3945051070 wait complete. 2023-10-06T04:40:04.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 Processor -- start 2023-10-06T04:40:04.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 -- start start 2023-10-06T04:40:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa670068400 0x7fa67014d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6701587d0 0x7fa6700c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa670158ba0 0x7fa6700ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67015b6d0 con 0x7fa6701587d0 2023-10-06T04:40:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67015aac0 con 0x7fa670158ba0 2023-10-06T04:40:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa676af1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67015ada0 con 0x7fa670068400 2023-10-06T04:40:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa6752ee700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6701587d0 0x7fa6700c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa6752ee700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6701587d0 0x7fa6700c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47360/0 (socket says 172.21.15.37:47360) 2023-10-06T04:40:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.477+0000 7fa6752ee700 1 -- 172.21.15.37:0/3722717507 learned_addr learned my addr 172.21.15.37:0/3722717507 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa675aef700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa670068400 0x7fa67014d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa6762f0700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa670158ba0 0x7fa6700ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa6752ee700 1 -- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa670068400 msgr2=0x7fa67014d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa6752ee700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa670068400 0x7fa67014d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa6752ee700 1 -- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa670158ba0 msgr2=0x7fa6700ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa6752ee700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa670158ba0 0x7fa6700ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa6752ee700 1 -- 172.21.15.37:0/3722717507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c009420 con 0x7fa6701587d0 2023-10-06T04:40:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa675aef700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa670068400 0x7fa67014d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa6762f0700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa670158ba0 0x7fa6700ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa6752ee700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6701587d0 0x7fa6700c45d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa66000c790 tx=0x7fa660007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa665ffb700 1 -- 172.21.15.37:0/3722717507 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660010510 con 0x7fa6701587d0 2023-10-06T04:40:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa676af1700 1 -- 172.21.15.37:0/3722717507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67015b080 con 0x7fa6701587d0 2023-10-06T04:40:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa676af1700 1 -- 172.21.15.37:0/3722717507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67014d7d0 con 0x7fa6701587d0 2023-10-06T04:40:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa665ffb700 1 -- 172.21.15.37:0/3722717507 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa660010670 con 0x7fa6701587d0 2023-10-06T04:40:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa665ffb700 1 -- 172.21.15.37:0/3722717507 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660010a10 con 0x7fa6701587d0 2023-10-06T04:40:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.481+0000 7fa676af1700 1 -- 172.21.15.37:0/3722717507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6500052b0 con 0x7fa6701587d0 2023-10-06T04:40:04.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.485+0000 7fa665ffb700 1 -- 172.21.15.37:0/3722717507 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa66001b400 con 0x7fa6701587d0 2023-10-06T04:40:04.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.485+0000 7fa665ffb700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa654060550 0x7fa654062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.485+0000 7fa665ffb700 1 -- 172.21.15.37:0/3722717507 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fa66007ca70 con 0x7fa6701587d0 2023-10-06T04:40:04.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.485+0000 7fa675aef700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa654060550 0x7fa654062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.485+0000 7fa675aef700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa654060550 0x7fa654062a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa67015d810 tx=0x7fa66c016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.493+0000 7fa665ffb700 1 -- 172.21.15.37:0/3722717507 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa66004cbd0 con 0x7fa6701587d0 2023-10-06T04:40:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.692+0000 7fa676af1700 1 -- 172.21.15.37:0/3722717507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa650005830 con 0x7fa6701587d0 2023-10-06T04:40:04.698 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T04:40:04.692+0000 7f2a85d34700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:40:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.700+0000 7fa665ffb700 1 -- 172.21.15.37:0/3722717507 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa6600501f0 con 0x7fa6701587d0 2023-10-06T04:40:04.709 INFO:tasks.ceph.mds.a.smithi037.stderr: -3468> 2023-10-06T04:39:11.745+0000 7f47a0927700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:40:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.704+0000 7fa676af1700 1 -- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa654060550 msgr2=0x7fa654062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.704+0000 7fa676af1700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa654060550 0x7fa654062a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa67015d810 tx=0x7fa66c016000 comp rx=0 tx=0).stop 2023-10-06T04:40:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.704+0000 7fa676af1700 1 -- 172.21.15.37:0/3722717507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6701587d0 msgr2=0x7fa6700c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.704+0000 7fa676af1700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6701587d0 0x7fa6700c45d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa66000c790 tx=0x7fa660007e10 comp rx=0 tx=0).stop 2023-10-06T04:40:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.704+0000 7fa676af1700 1 -- 172.21.15.37:0/3722717507 shutdown_connections 2023-10-06T04:40:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.704+0000 7fa676af1700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa654060550 0x7fa654062a00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.704+0000 7fa676af1700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa670158ba0 0x7fa6700ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.704+0000 7fa676af1700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6701587d0 0x7fa6700c45d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.704+0000 7fa676af1700 1 --2- 172.21.15.37:0/3722717507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa670068400 0x7fa67014d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.704+0000 7fa676af1700 1 -- 172.21.15.37:0/3722717507 >> 172.21.15.37:0/3722717507 conn(0x7fa6700cc5f0 msgr2=0x7fa670157050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.704+0000 7fa676af1700 1 -- 172.21.15.37:0/3722717507 shutdown_connections 2023-10-06T04:40:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.704+0000 7fa676af1700 1 -- 172.21.15.37:0/3722717507 wait complete. 2023-10-06T04:40:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:40:04.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:40:04.737 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T04:40:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.820+0000 7f13b7ea5700 1 Processor -- start 2023-10-06T04:40:04.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.820+0000 7f13b7ea5700 1 -- start start 2023-10-06T04:40:04.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.820+0000 7f13b7ea5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b0068270 0x7f13b00cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.820+0000 7f13b7ea5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f13b0068640 0x7f13b00cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.820+0000 7f13b7ea5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b015d150 con 0x7f13b0159360 2023-10-06T04:40:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.820+0000 7f13b7ea5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b015a330 con 0x7f13b0068640 2023-10-06T04:40:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.820+0000 7f13b7ea5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00c7260 con 0x7f13b0068270 2023-10-06T04:40:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.820+0000 7f13b5c41700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b0068270 0x7f13b00cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.820+0000 7f13b5440700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f13b0068640 0x7f13b00cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.820+0000 7f13b5c41700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b0068270 0x7f13b00cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:33488/0 (socket says 172.21.15.37:33488) 2023-10-06T04:40:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.820+0000 7f13b5c41700 1 -- 172.21.15.37:0/279936678 learned_addr learned my addr 172.21.15.37:0/279936678 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.820+0000 7f13b6442700 1 --1- 172.21.15.37:0/279936678 >> v1:172.21.15.83:6789/0 conn(0x7f13b0159360 0x7f13b0159800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:41030/0 (socket says 172.21.15.37:41030) 2023-10-06T04:40:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b5440700 1 -- 172.21.15.37:0/279936678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b0068270 msgr2=0x7f13b00cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b5440700 1 --2- 172.21.15.37:0/279936678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b0068270 0x7f13b00cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b5440700 1 -- 172.21.15.37:0/279936678 >> v1:172.21.15.83:6789/0 conn(0x7f13b0159360 legacy=0x7f13b0159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b5440700 1 -- 172.21.15.37:0/279936678 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b015a050 con 0x7f13b0068640 2023-10-06T04:40:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b5c41700 1 --2- 172.21.15.37:0/279936678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b0068270 0x7f13b00cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b5440700 1 --2- 172.21.15.37:0/279936678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b0068640 0x7f13b00cb190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f13a00098e0 tx=0x7f13a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba815aa61aca3421 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b4c3f700 1 -- 172.21.15.37:0/279936678 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000b6d0 con 0x7f13b0068640 2023-10-06T04:40:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b4c3f700 1 -- 172.21.15.37:0/279936678 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a000b830 con 0x7f13b0068640 2023-10-06T04:40:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b4c3f700 1 -- 172.21.15.37:0/279936678 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000bbd0 con 0x7f13b0068640 2023-10-06T04:40:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b7ea5700 1 -- 172.21.15.37:0/279936678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b0068640 msgr2=0x7f13b00cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b7ea5700 1 --2- 172.21.15.37:0/279936678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b0068640 0x7f13b00cb190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f13a00098e0 tx=0x7f13a00091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b7ea5700 1 -- 172.21.15.37:0/279936678 shutdown_connections 2023-10-06T04:40:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b7ea5700 1 --2- 172.21.15.37:0/279936678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b0068640 0x7f13b00cb190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b7ea5700 1 --2- 172.21.15.37:0/279936678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b0068270 0x7f13b00cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b7ea5700 1 -- 172.21.15.37:0/279936678 >> 172.21.15.37:0/279936678 conn(0x7f13b00698d0 msgr2=0x7f13b00cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b7ea5700 1 -- 172.21.15.37:0/279936678 shutdown_connections 2023-10-06T04:40:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.824+0000 7f13b7ea5700 1 -- 172.21.15.37:0/279936678 wait complete. 2023-10-06T04:40:04.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b7ea5700 1 Processor -- start 2023-10-06T04:40:04.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b7ea5700 1 -- start start 2023-10-06T04:40:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b7ea5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b0068270 0x7f13b0169310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b7ea5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b0068640 0x7f13b00c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b7ea5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b0159360 0x7f13b00c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b7ea5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00c80c0 con 0x7f13b0159360 2023-10-06T04:40:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b7ea5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00c76f0 con 0x7f13b0068640 2023-10-06T04:40:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b7ea5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b016a620 con 0x7f13b0068270 2023-10-06T04:40:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b6442700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b0159360 0x7f13b00c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b6442700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b0159360 0x7f13b00c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47368/0 (socket says 172.21.15.37:47368) 2023-10-06T04:40:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b6442700 1 -- 172.21.15.37:0/2091540348 learned_addr learned my addr 172.21.15.37:0/2091540348 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b5c41700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b0068270 0x7f13b0169310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b5440700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b0068640 0x7f13b00c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b6442700 1 -- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b0068270 msgr2=0x7f13b0169310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b6442700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b0068270 0x7f13b0169310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b6442700 1 -- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b0068640 msgr2=0x7f13b00c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b6442700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b0068640 0x7f13b00c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b6442700 1 -- 172.21.15.37:0/2091540348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac0094f0 con 0x7f13b0159360 2023-10-06T04:40:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b5440700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b0068640 0x7f13b00c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b6442700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b0159360 0x7f13b00c9cb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f13a800cca0 tx=0x7f13a8001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13a5ffb700 1 -- 172.21.15.37:0/2091540348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8005df0 con 0x7f13b0159360 2023-10-06T04:40:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13a5ffb700 1 -- 172.21.15.37:0/2091540348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a800a6a0 con 0x7f13b0159360 2023-10-06T04:40:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13a5ffb700 1 -- 172.21.15.37:0/2091540348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a800aa20 con 0x7f13b0159360 2023-10-06T04:40:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.828+0000 7f13b7ea5700 1 -- 172.21.15.37:0/2091540348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a0009420 con 0x7f13b0159360 2023-10-06T04:40:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.832+0000 7f13b7ea5700 1 -- 172.21.15.37:0/2091540348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b0169d50 con 0x7f13b0159360 2023-10-06T04:40:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.832+0000 7f13b7ea5700 1 -- 172.21.15.37:0/2091540348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b00c3870 con 0x7f13b0159360 2023-10-06T04:40:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.832+0000 7f13a5ffb700 1 -- 172.21.15.37:0/2091540348 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f13a80070f0 con 0x7f13b0159360 2023-10-06T04:40:04.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.832+0000 7f13a5ffb700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1394060550 0x7f1394062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.832+0000 7f13a5ffb700 1 -- 172.21.15.37:0/2091540348 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f13a807cca0 con 0x7f13b0159360 2023-10-06T04:40:04.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.832+0000 7f13b5c41700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1394060550 0x7f1394062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.836+0000 7f13b5c41700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1394060550 0x7f1394062a00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f13b00c2f90 tx=0x7f13ac009250 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:04.836+0000 7f13a5ffb700 1 -- 172.21.15.37:0/2091540348 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f13a804ce30 con 0x7f13b0159360 2023-10-06T04:40:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.036+0000 7f13b7ea5700 1 -- 172.21.15.37:0/2091540348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f13b0070ee0 con 0x7f13b0159360 2023-10-06T04:40:05.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.704+0000 7f13a5ffb700 1 -- 172.21.15.37:0/2091540348 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f13a8050450 con 0x7f13b0159360 2023-10-06T04:40:05.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.708+0000 7f13b7ea5700 1 -- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1394060550 msgr2=0x7f1394062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.708+0000 7f13b7ea5700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1394060550 0x7f1394062a00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f13b00c2f90 tx=0x7f13ac009250 comp rx=0 tx=0).stop 2023-10-06T04:40:05.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.708+0000 7f13b7ea5700 1 -- 172.21.15.37:0/2091540348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b0159360 msgr2=0x7f13b00c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.708+0000 7f13b7ea5700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b0159360 0x7f13b00c9cb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f13a800cca0 tx=0x7f13a8001a70 comp rx=0 tx=0).stop 2023-10-06T04:40:05.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.708+0000 7f13b7ea5700 1 -- 172.21.15.37:0/2091540348 shutdown_connections 2023-10-06T04:40:05.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.708+0000 7f13b7ea5700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1394060550 0x7f1394062a00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.708+0000 7f13b7ea5700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b0068640 0x7f13b00c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.708+0000 7f13b7ea5700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b0159360 0x7f13b00c9cb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.708+0000 7f13b7ea5700 1 --2- 172.21.15.37:0/2091540348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b0068270 0x7f13b0169310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.708+0000 7f13b7ea5700 1 -- 172.21.15.37:0/2091540348 >> 172.21.15.37:0/2091540348 conn(0x7f13b00698d0 msgr2=0x7f13b00cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.708+0000 7f13b7ea5700 1 -- 172.21.15.37:0/2091540348 shutdown_connections 2023-10-06T04:40:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.708+0000 7f13b7ea5700 1 -- 172.21.15.37:0/2091540348 wait complete. 2023-10-06T04:40:05.734 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:40:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.896+0000 7f69f9e5d700 1 Processor -- start 2023-10-06T04:40:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.896+0000 7f69f9e5d700 1 -- start start 2023-10-06T04:40:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.896+0000 7f69f9e5d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69f406e510 0x7f69f40cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.896+0000 7f69f9e5d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f69f40c82d0 0x7f69f40cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.896+0000 7f69f9e5d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f40c7e40 con 0x7f69f4155160 2023-10-06T04:40:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.896+0000 7f69f9e5d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f406f030 con 0x7f69f40c82d0 2023-10-06T04:40:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.896+0000 7f69f9e5d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40c7510 con 0x7f69f406e510 2023-10-06T04:40:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.896+0000 7f69f3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69f406e510 0x7f69f40cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.896+0000 7f69f8e5b700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f69f4155160 0x7f69f406de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:41034/0 (socket says 172.21.15.37:41034) 2023-10-06T04:40:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.896+0000 7f69f8e5b700 1 -- 172.21.15.37:0/53327084 learned_addr learned my addr 172.21.15.37:0/53327084 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.896+0000 7f69f965c700 1 --2- 172.21.15.37:0/53327084 >> v2:172.21.15.83:3300/0 conn(0x7f69f40c82d0 0x7f69f40cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.900+0000 7f69f965c700 1 -- 172.21.15.37:0/53327084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69f406e510 msgr2=0x7f69f40cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.900+0000 7f69f965c700 1 --2- 172.21.15.37:0/53327084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69f406e510 0x7f69f40cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.900+0000 7f69f965c700 1 -- 172.21.15.37:0/53327084 >> v1:172.21.15.83:6789/0 conn(0x7f69f4155160 legacy=0x7f69f406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.900+0000 7f69f965c700 1 -- 172.21.15.37:0/53327084 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f40c77f0 con 0x7f69f40c82d0 2023-10-06T04:40:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.900+0000 7f69f965c700 1 --2- 172.21.15.37:0/53327084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69f40c82d0 0x7f69f40cb0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009e60 tx=0x7f69ec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92764b6c5eccb4a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:05.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.904+0000 7f69f37fe700 1 -- 172.21.15.37:0/53327084 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec00e070 con 0x7f69f40c82d0 2023-10-06T04:40:05.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.908+0000 7f69f37fe700 1 -- 172.21.15.37:0/53327084 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec00bb60 con 0x7f69f40c82d0 2023-10-06T04:40:05.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.908+0000 7f69f37fe700 1 -- 172.21.15.37:0/53327084 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec012430 con 0x7f69f40c82d0 2023-10-06T04:40:05.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.908+0000 7f69f9e5d700 1 -- 172.21.15.37:0/53327084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69f40c82d0 msgr2=0x7f69f40cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.908+0000 7f69f9e5d700 1 --2- 172.21.15.37:0/53327084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69f40c82d0 0x7f69f40cb0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009e60 tx=0x7f69ec009780 comp rx=0 tx=0).stop 2023-10-06T04:40:05.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.908+0000 7f69f9e5d700 1 -- 172.21.15.37:0/53327084 shutdown_connections 2023-10-06T04:40:05.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.908+0000 7f69f9e5d700 1 --2- 172.21.15.37:0/53327084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69f40c82d0 0x7f69f40cb0a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.908+0000 7f69f9e5d700 1 --2- 172.21.15.37:0/53327084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69f406e510 0x7f69f40cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.908+0000 7f69f9e5d700 1 -- 172.21.15.37:0/53327084 >> 172.21.15.37:0/53327084 conn(0x7f69f40cc000 msgr2=0x7f69f40cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:05.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.908+0000 7f69f9e5d700 1 -- 172.21.15.37:0/53327084 shutdown_connections 2023-10-06T04:40:05.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.908+0000 7f69f9e5d700 1 -- 172.21.15.37:0/53327084 wait complete. 2023-10-06T04:40:05.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f9e5d700 1 Processor -- start 2023-10-06T04:40:05.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f9e5d700 1 -- start start 2023-10-06T04:40:05.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f9e5d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69f406e510 0x7f69f40c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f9e5d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40c82d0 0x7f69f414c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f9e5d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69f4155160 0x7f69f4152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f9e5d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40c5080 con 0x7f69f40c82d0 2023-10-06T04:40:05.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f9e5d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f414c930 con 0x7f69f406e510 2023-10-06T04:40:05.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f9e5d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f4166900 con 0x7f69f4155160 2023-10-06T04:40:05.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40c82d0 0x7f69f414c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40c82d0 0x7f69f414c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47376/0 (socket says 172.21.15.37:47376) 2023-10-06T04:40:05.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f3fff700 1 -- 172.21.15.37:0/2000356065 learned_addr learned my addr 172.21.15.37:0/2000356065 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:05.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f8e5b700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69f406e510 0x7f69f40c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.912+0000 7f69f965c700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69f4155160 0x7f69f4152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f3fff700 1 -- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69f4155160 msgr2=0x7f69f4152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f3fff700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69f4155160 0x7f69f4152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f3fff700 1 -- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69f406e510 msgr2=0x7f69f40c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f3fff700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69f406e510 0x7f69f40c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f3fff700 1 -- 172.21.15.37:0/2000356065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec009a20 con 0x7f69f40c82d0 2023-10-06T04:40:05.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f3fff700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40c82d0 0x7f69f414c3f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f69e000ece0 tx=0x7f69e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:05.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f0ff9700 1 -- 172.21.15.37:0/2000356065 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000c850 con 0x7f69f40c82d0 2023-10-06T04:40:05.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f0ff9700 1 -- 172.21.15.37:0/2000356065 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000c9b0 con 0x7f69f40c82d0 2023-10-06T04:40:05.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f9e5d700 1 -- 172.21.15.37:0/2000356065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f4152fa0 con 0x7f69f40c82d0 2023-10-06T04:40:05.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f0ff9700 1 -- 172.21.15.37:0/2000356065 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000cd50 con 0x7f69f40c82d0 2023-10-06T04:40:05.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f9e5d700 1 -- 172.21.15.37:0/2000356065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f41535d0 con 0x7f69f40c82d0 2023-10-06T04:40:05.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f9e5d700 1 -- 172.21.15.37:0/2000356065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f404be00 con 0x7f69f40c82d0 2023-10-06T04:40:05.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f0ff9700 1 -- 172.21.15.37:0/2000356065 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f69e0013680 con 0x7f69f40c82d0 2023-10-06T04:40:05.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.916+0000 7f69f0ff9700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f69d8060550 0x7f69d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.920+0000 7f69f0ff9700 1 -- 172.21.15.37:0/2000356065 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f69e007cf20 con 0x7f69f40c82d0 2023-10-06T04:40:05.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.920+0000 7f69f8e5b700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f69d8060550 0x7f69d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.920+0000 7f69f8e5b700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f69d8060550 0x7f69d8062a00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f69e8001950 tx=0x7f69e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:05.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:05.928+0000 7f69f0ff9700 1 -- 172.21.15.37:0/2000356065 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f69e004cf90 con 0x7f69f40c82d0 2023-10-06T04:40:06.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.088+0000 7f69f9e5d700 1 -- 172.21.15.37:0/2000356065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f69f406ebe0 con 0x7f69f40c82d0 2023-10-06T04:40:06.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.928+0000 7f69f0ff9700 1 -- 172.21.15.37:0/2000356065 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7f69e00505b0 con 0x7f69f40c82d0 2023-10-06T04:40:06.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.936+0000 7f69f9e5d700 1 -- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f69d8060550 msgr2=0x7f69d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:06.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.936+0000 7f69f9e5d700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f69d8060550 0x7f69d8062a00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f69e8001950 tx=0x7f69e8009040 comp rx=0 tx=0).stop 2023-10-06T04:40:06.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.936+0000 7f69f9e5d700 1 -- 172.21.15.37:0/2000356065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40c82d0 msgr2=0x7f69f414c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.936+0000 7f69f9e5d700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40c82d0 0x7f69f414c3f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f69e000ece0 tx=0x7f69e00091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.936+0000 7f69f9e5d700 1 -- 172.21.15.37:0/2000356065 shutdown_connections 2023-10-06T04:40:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.936+0000 7f69f9e5d700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f69d8060550 0x7f69d8062a00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.936+0000 7f69f9e5d700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69f4155160 0x7f69f4152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.936+0000 7f69f9e5d700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40c82d0 0x7f69f414c3f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.936+0000 7f69f9e5d700 1 --2- 172.21.15.37:0/2000356065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69f406e510 0x7f69f40c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.936+0000 7f69f9e5d700 1 -- 172.21.15.37:0/2000356065 >> 172.21.15.37:0/2000356065 conn(0x7f69f40cc000 msgr2=0x7f69f40cad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.936+0000 7f69f9e5d700 1 -- 172.21.15.37:0/2000356065 shutdown_connections 2023-10-06T04:40:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:06.936+0000 7f69f9e5d700 1 -- 172.21.15.37:0/2000356065 wait complete. 2023-10-06T04:40:06.943 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:40:06.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:40:07.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.060+0000 7fa91511d700 1 Processor -- start 2023-10-06T04:40:07.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa91511d700 1 -- start start 2023-10-06T04:40:07.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa91511d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9100ccc70 0x7fa9100af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa91511d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa9100afc80 0x7fa910158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa91511d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9100b0450 con 0x7fa910158bf0 2023-10-06T04:40:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa91511d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91015d290 con 0x7fa9100afc80 2023-10-06T04:40:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa91511d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91015d720 con 0x7fa9100ccc70 2023-10-06T04:40:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa910158bf0 0x7fa9100cc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40512/0 (socket says 172.21.15.37:40512) 2023-10-06T04:40:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90ffff700 1 -- 172.21.15.37:0/2649909935 learned_addr learned my addr 172.21.15.37:0/2649909935 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa91491c700 1 --2- 172.21.15.37:0/2649909935 >> v2:172.21.15.83:3300/0 conn(0x7fa9100afc80 0x7fa910158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90f7fe700 1 --2- 172.21.15.37:0/2649909935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9100ccc70 0x7fa9100af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90effd700 1 -- 172.21.15.37:0/2649909935 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930757412 0 0) 0x7fa8f8001110 con 0x7fa910158bf0 2023-10-06T04:40:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90effd700 1 -- 172.21.15.37:0/2649909935 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8fc003570 con 0x7fa910158bf0 2023-10-06T04:40:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90f7fe700 1 -- 172.21.15.37:0/2649909935 >> v2:172.21.15.83:3300/0 conn(0x7fa9100afc80 msgr2=0x7fa910158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90f7fe700 1 --2- 172.21.15.37:0/2649909935 >> v2:172.21.15.83:3300/0 conn(0x7fa9100afc80 0x7fa910158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90f7fe700 1 -- 172.21.15.37:0/2649909935 >> v1:172.21.15.37:6789/0 conn(0x7fa910158bf0 legacy=0x7fa9100cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90effd700 1 -- 172.21.15.37:0/2649909935 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 419875520 0 0) 0x7fa8fc003570 con 0x7fa910158bf0 2023-10-06T04:40:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90f7fe700 1 -- 172.21.15.37:0/2649909935 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91015c960 con 0x7fa9100ccc70 2023-10-06T04:40:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa91491c700 1 --2- 172.21.15.37:0/2649909935 >> v2:172.21.15.83:3300/0 conn(0x7fa9100afc80 0x7fa910158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90f7fe700 1 --2- 172.21.15.37:0/2649909935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9100ccc70 0x7fa9100af740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa9000098e0 tx=0x7fa9000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7f10aa704235324 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90effd700 1 -- 172.21.15.37:0/2649909935 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8001600 con 0x7fa9100ccc70 2023-10-06T04:40:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90effd700 1 -- 172.21.15.37:0/2649909935 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa900011420 con 0x7fa9100ccc70 2023-10-06T04:40:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.064+0000 7fa90effd700 1 -- 172.21.15.37:0/2649909935 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9000117a0 con 0x7fa9100ccc70 2023-10-06T04:40:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.068+0000 7fa91511d700 1 -- 172.21.15.37:0/2649909935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9100ccc70 msgr2=0x7fa9100af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.068+0000 7fa91511d700 1 --2- 172.21.15.37:0/2649909935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9100ccc70 0x7fa9100af740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa9000098e0 tx=0x7fa9000091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.068+0000 7fa91511d700 1 -- 172.21.15.37:0/2649909935 shutdown_connections 2023-10-06T04:40:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.068+0000 7fa91511d700 1 --2- 172.21.15.37:0/2649909935 >> v2:172.21.15.83:3300/0 conn(0x7fa9100afc80 0x7fa910158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.068+0000 7fa91511d700 1 --2- 172.21.15.37:0/2649909935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9100ccc70 0x7fa9100af740 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.068+0000 7fa91511d700 1 -- 172.21.15.37:0/2649909935 >> 172.21.15.37:0/2649909935 conn(0x7fa910067cf0 msgr2=0x7fa9100680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.068+0000 7fa91511d700 1 -- 172.21.15.37:0/2649909935 shutdown_connections 2023-10-06T04:40:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.068+0000 7fa91511d700 1 -- 172.21.15.37:0/2649909935 wait complete. 2023-10-06T04:40:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.068+0000 7fa91511d700 1 Processor -- start 2023-10-06T04:40:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.068+0000 7fa91511d700 1 -- start start 2023-10-06T04:40:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa91511d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9100afc80 0x7fa9101489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa91511d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9100ccc70 0x7fa91016ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa91511d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa910158bf0 0x7fa910168980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa91511d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa910149270 con 0x7fa9100afc80 2023-10-06T04:40:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa91511d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa910149550 con 0x7fa9100ccc70 2023-10-06T04:40:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa91511d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa910149830 con 0x7fa910158bf0 2023-10-06T04:40:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa90ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9100afc80 0x7fa9101489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa90ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9100afc80 0x7fa9101489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47378/0 (socket says 172.21.15.37:47378) 2023-10-06T04:40:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa90ffff700 1 -- 172.21.15.37:0/2482986506 learned_addr learned my addr 172.21.15.37:0/2482986506 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa90f7fe700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9100ccc70 0x7fa91016ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa91491c700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa910158bf0 0x7fa910168980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa90ffff700 1 -- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa910158bf0 msgr2=0x7fa910168980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa90ffff700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa910158bf0 0x7fa910168980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa90ffff700 1 -- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9100ccc70 msgr2=0x7fa91016ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa90ffff700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9100ccc70 0x7fa91016ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa90ffff700 1 -- 172.21.15.37:0/2482986506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa908009a20 con 0x7fa9100afc80 2023-10-06T04:40:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa90ffff700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9100afc80 0x7fa9101489e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800cb90 tx=0x7fa8f8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa907fff700 1 -- 172.21.15.37:0/2482986506 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8007e90 con 0x7fa9100afc80 2023-10-06T04:40:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa907fff700 1 -- 172.21.15.37:0/2482986506 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f8007360 con 0x7fa9100afc80 2023-10-06T04:40:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa91511d700 1 -- 172.21.15.37:0/2482986506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa900009420 con 0x7fa9100afc80 2023-10-06T04:40:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa907fff700 1 -- 172.21.15.37:0/2482986506 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8004830 con 0x7fa9100afc80 2023-10-06T04:40:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa91511d700 1 -- 172.21.15.37:0/2482986506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa910149df0 con 0x7fa9100afc80 2023-10-06T04:40:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.072+0000 7fa91511d700 1 -- 172.21.15.37:0/2482986506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9100b0be0 con 0x7fa9100afc80 2023-10-06T04:40:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.076+0000 7fa907fff700 1 -- 172.21.15.37:0/2482986506 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa8f8004c20 con 0x7fa9100afc80 2023-10-06T04:40:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.076+0000 7fa907fff700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa8f0060550 0x7fa8f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.076+0000 7fa907fff700 1 -- 172.21.15.37:0/2482986506 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6515+0+0 (secure 0 0 0) 0x7fa8f807c1c0 con 0x7fa9100afc80 2023-10-06T04:40:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.076+0000 7fa90f7fe700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa8f0060550 0x7fa8f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.076+0000 7fa90f7fe700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa8f0060550 0x7fa8f0062a00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa9100cd070 tx=0x7fa900016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.084+0000 7fa907fff700 1 -- 172.21.15.37:0/2482986506 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa9100b0be0 con 0x7fa9100afc80 2023-10-06T04:40:07.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.244+0000 7fa91511d700 1 -- 172.21.15.37:0/2482986506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa9100b0450 con 0x7fa9100afc80 2023-10-06T04:40:07.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.936+0000 7fa907fff700 1 -- 172.21.15.37:0/2482986506 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa9100b0450 con 0x7fa9100afc80 2023-10-06T04:40:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.948+0000 7fa91511d700 1 -- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa8f0060550 msgr2=0x7fa8f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.948+0000 7fa91511d700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa8f0060550 0x7fa8f0062a00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa9100cd070 tx=0x7fa900016000 comp rx=0 tx=0).stop 2023-10-06T04:40:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.948+0000 7fa91511d700 1 -- 172.21.15.37:0/2482986506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9100afc80 msgr2=0x7fa9101489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.948+0000 7fa91511d700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9100afc80 0x7fa9101489e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800cb90 tx=0x7fa8f8000ed0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.948+0000 7fa91511d700 1 -- 172.21.15.37:0/2482986506 shutdown_connections 2023-10-06T04:40:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.948+0000 7fa91511d700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa8f0060550 0x7fa8f0062a00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.948+0000 7fa91511d700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9100ccc70 0x7fa91016ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.948+0000 7fa91511d700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa910158bf0 0x7fa910168980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.948+0000 7fa91511d700 1 --2- 172.21.15.37:0/2482986506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9100afc80 0x7fa9101489e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.948+0000 7fa91511d700 1 -- 172.21.15.37:0/2482986506 >> 172.21.15.37:0/2482986506 conn(0x7fa910067cf0 msgr2=0x7fa9100b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.948+0000 7fa91511d700 1 -- 172.21.15.37:0/2482986506 shutdown_connections 2023-10-06T04:40:07.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:07.948+0000 7fa91511d700 1 -- 172.21.15.37:0/2482986506 wait complete. 2023-10-06T04:40:07.954 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-10-06T04:40:07.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-06T04:40:08.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.072+0000 7f3fe759e700 1 Processor -- start 2023-10-06T04:40:08.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.072+0000 7f3fe759e700 1 -- start start 2023-10-06T04:40:08.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe759e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3fe806f000 0x7f3fe8069030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe759e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3fe8069570 0x7f3fe8160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe759e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe80ceb20 con 0x7f3fe806ec30 2023-10-06T04:40:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe759e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe8069a10 con 0x7f3fe8069570 2023-10-06T04:40:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe759e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe80cee00 con 0x7f3fe806f000 2023-10-06T04:40:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe659c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3fe806ec30 0x7f3fe80aea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40524/0 (socket says 172.21.15.37:40524) 2023-10-06T04:40:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe659c700 1 -- 172.21.15.37:0/269549348 learned_addr learned my addr 172.21.15.37:0/269549348 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe6d9d700 1 --2- 172.21.15.37:0/269549348 >> v2:172.21.15.37:3300/0 conn(0x7f3fe8069570 0x7f3fe8160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe5d9b700 1 --2- 172.21.15.37:0/269549348 >> v2:172.21.15.83:3300/0 conn(0x7f3fe806f000 0x7f3fe8069030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe559a700 1 -- 172.21.15.37:0/269549348 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640063210 0 0) 0x7f3fe80ceb20 con 0x7f3fe806ec30 2023-10-06T04:40:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe559a700 1 -- 172.21.15.37:0/269549348 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fd0003570 con 0x7f3fe806ec30 2023-10-06T04:40:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe6d9d700 1 -- 172.21.15.37:0/269549348 >> v2:172.21.15.83:3300/0 conn(0x7f3fe806f000 msgr2=0x7f3fe8069030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:08.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe6d9d700 1 --2- 172.21.15.37:0/269549348 >> v2:172.21.15.83:3300/0 conn(0x7f3fe806f000 0x7f3fe8069030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe6d9d700 1 -- 172.21.15.37:0/269549348 >> v1:172.21.15.37:6789/0 conn(0x7f3fe806ec30 legacy=0x7f3fe80aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:08.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe6d9d700 1 -- 172.21.15.37:0/269549348 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe80cf0e0 con 0x7f3fe8069570 2023-10-06T04:40:08.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe6d9d700 1 --2- 172.21.15.37:0/269549348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe8069570 0x7f3fe8160cf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8088830 tx=0x7f3fe0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabb2664dec228a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:08.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe559a700 1 -- 172.21.15.37:0/269549348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000e070 con 0x7f3fe8069570 2023-10-06T04:40:08.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe559a700 1 -- 172.21.15.37:0/269549348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe000bab0 con 0x7f3fe8069570 2023-10-06T04:40:08.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe559a700 1 -- 172.21.15.37:0/269549348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000be70 con 0x7f3fe8069570 2023-10-06T04:40:08.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe759e700 1 -- 172.21.15.37:0/269549348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe8069570 msgr2=0x7f3fe8160cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:08.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.076+0000 7f3fe759e700 1 --2- 172.21.15.37:0/269549348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe8069570 0x7f3fe8160cf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8088830 tx=0x7f3fe0009780 comp rx=0 tx=0).stop 2023-10-06T04:40:08.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 -- 172.21.15.37:0/269549348 shutdown_connections 2023-10-06T04:40:08.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 --2- 172.21.15.37:0/269549348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe8069570 0x7f3fe8160cf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 --2- 172.21.15.37:0/269549348 >> v2:172.21.15.83:3300/0 conn(0x7f3fe806f000 0x7f3fe8069030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 -- 172.21.15.37:0/269549348 >> 172.21.15.37:0/269549348 conn(0x7f3fe80cfb70 msgr2=0x7f3fe80cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:08.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 -- 172.21.15.37:0/269549348 shutdown_connections 2023-10-06T04:40:08.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 -- 172.21.15.37:0/269549348 wait complete. 2023-10-06T04:40:08.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 Processor -- start 2023-10-06T04:40:08.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 -- start start 2023-10-06T04:40:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe8069570 0x7f3fe8160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fe806ec30 0x7f3fe80b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fe806f000 0x7f3fe8153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe80b5a30 con 0x7f3fe8069570 2023-10-06T04:40:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe80c8080 con 0x7f3fe806f000 2023-10-06T04:40:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe8161a50 con 0x7f3fe806ec30 2023-10-06T04:40:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe8069570 0x7f3fe8160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe8069570 0x7f3fe8160ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47404/0 (socket says 172.21.15.37:47404) 2023-10-06T04:40:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe659c700 1 -- 172.21.15.37:0/1355797905 learned_addr learned my addr 172.21.15.37:0/1355797905 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe6d9d700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fe806f000 0x7f3fe8153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe5d9b700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fe806ec30 0x7f3fe80b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe659c700 1 -- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fe806ec30 msgr2=0x7f3fe80b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe659c700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fe806ec30 0x7f3fe80b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe659c700 1 -- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fe806f000 msgr2=0x7f3fe8153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe659c700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fe806f000 0x7f3fe8153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe659c700 1 -- 172.21.15.37:0/1355797905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0009a20 con 0x7f3fe8069570 2023-10-06T04:40:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe5d9b700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fe806ec30 0x7f3fe80b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe659c700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe8069570 0x7f3fe8160ff0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c7f0 tx=0x7f3fd8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:08.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fd67fc700 1 -- 172.21.15.37:0/1355797905 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8005b30 con 0x7f3fe8069570 2023-10-06T04:40:08.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fd67fc700 1 -- 172.21.15.37:0/1355797905 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd8005cb0 con 0x7f3fe8069570 2023-10-06T04:40:08.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fd67fc700 1 -- 172.21.15.37:0/1355797905 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8007320 con 0x7f3fe8069570 2023-10-06T04:40:08.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 -- 172.21.15.37:0/1355797905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe80c7ac0 con 0x7f3fe8069570 2023-10-06T04:40:08.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.080+0000 7f3fe759e700 1 -- 172.21.15.37:0/1355797905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe8153a70 con 0x7f3fe8069570 2023-10-06T04:40:08.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.084+0000 7f3fd67fc700 1 -- 172.21.15.37:0/1355797905 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3fd801b3b0 con 0x7f3fe8069570 2023-10-06T04:40:08.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.084+0000 7f3fe759e700 1 -- 172.21.15.37:0/1355797905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe80c7920 con 0x7f3fe8069570 2023-10-06T04:40:08.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.084+0000 7f3fd67fc700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3fc8060550 0x7f3fc8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:08.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.084+0000 7f3fd67fc700 1 -- 172.21.15.37:0/1355797905 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6043+0+0 (secure 0 0 0) 0x7f3fd807bef0 con 0x7f3fe8069570 2023-10-06T04:40:08.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.084+0000 7f3fe5d9b700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3fc8060550 0x7f3fc8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:08.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.088+0000 7f3fe5d9b700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3fc8060550 0x7f3fc8062a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc006f00 tx=0x7f3fdc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:08.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.092+0000 7f3fd67fc700 1 -- 172.21.15.37:0/1355797905 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3fe80c7920 con 0x7f3fe8069570 2023-10-06T04:40:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.252+0000 7f3fe759e700 1 -- 172.21.15.37:0/1355797905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3fe8160d10 con 0x7f3fe8069570 2023-10-06T04:40:08.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.944+0000 7f3fd67fc700 1 -- 172.21.15.37:0/1355797905 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7f3fe8160d10 con 0x7f3fe8069570 2023-10-06T04:40:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.952+0000 7f3fe759e700 1 -- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3fc8060550 msgr2=0x7f3fc8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:08.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.952+0000 7f3fe759e700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3fc8060550 0x7f3fc8062a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc006f00 tx=0x7f3fdc008040 comp rx=0 tx=0).stop 2023-10-06T04:40:08.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.952+0000 7f3fe759e700 1 -- 172.21.15.37:0/1355797905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe8069570 msgr2=0x7f3fe8160ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:08.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.952+0000 7f3fe759e700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe8069570 0x7f3fe8160ff0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c7f0 tx=0x7f3fd8007e00 comp rx=0 tx=0).stop 2023-10-06T04:40:08.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.952+0000 7f3fe759e700 1 -- 172.21.15.37:0/1355797905 shutdown_connections 2023-10-06T04:40:08.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.952+0000 7f3fe759e700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3fc8060550 0x7f3fc8062a00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.952+0000 7f3fe759e700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fe806f000 0x7f3fe8153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.952+0000 7f3fe759e700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fe806ec30 0x7f3fe80b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.952+0000 7f3fe759e700 1 --2- 172.21.15.37:0/1355797905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe8069570 0x7f3fe8160ff0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.952+0000 7f3fe759e700 1 -- 172.21.15.37:0/1355797905 >> 172.21.15.37:0/1355797905 conn(0x7f3fe80cfb70 msgr2=0x7f3fe815f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.952+0000 7f3fe759e700 1 -- 172.21.15.37:0/1355797905 shutdown_connections 2023-10-06T04:40:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:08.952+0000 7f3fe759e700 1 -- 172.21.15.37:0/1355797905 wait complete. 2023-10-06T04:40:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' removed 2023-10-06T04:40:08.972 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:40:08.972 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T04:40:08.972 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:40:08.972 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:40:08.973 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:40:08.973 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T04:40:08.973 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:40:08.973 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:40:08.973 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:40:08.974 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T04:40:08.974 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:40:08.974 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:40:08.974 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:40:08.974 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T04:40:08.975 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:40:08.975 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:40:08.985 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:40:08.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:40:08.987 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:40:08.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:40:08.991 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:40:08.991 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:40:08.993 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:40:08.993 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:40:08.994 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:40:08.996 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:40:08.996 DEBUG:teuthology.parallel:result is None 2023-10-06T04:40:08.996 DEBUG:teuthology.parallel:result is None 2023-10-06T04:40:09.035 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:40:09.036 DEBUG:teuthology.parallel:result is None 2023-10-06T04:40:09.037 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:40:09.037 DEBUG:teuthology.parallel:result is None 2023-10-06T04:40:09.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T04:40:09.062 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T04:40:09.068 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T04:40:09.112 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T04:40:09.116 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T04:40:09.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 Processor -- start 2023-10-06T04:40:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 -- start start 2023-10-06T04:40:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8c0667b0 0x7ffa8c0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8c0acd30 con 0x7ffa8c0b1860 2023-10-06T04:40:09.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8c0b1ce0 con 0x7ffa8c15c240 2023-10-06T04:40:09.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0ac120 con 0x7ffa8c0667b0 2023-10-06T04:40:09.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8ad9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffa8c0b1860 0x7ffa8c0ad1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48398/0 (socket says 172.21.15.37:48398) 2023-10-06T04:40:09.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8ad9d700 1 -- 172.21.15.37:0/406260274 learned_addr learned my addr 172.21.15.37:0/406260274 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:09.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa89d9b700 1 --2- 172.21.15.37:0/406260274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8c0667b0 0x7ffa8c0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:09.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8959a700 1 -- 172.21.15.37:0/406260274 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296307157 0 0) 0x7ffa8c0acd30 con 0x7ffa8c0b1860 2023-10-06T04:40:09.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8959a700 1 -- 172.21.15.37:0/406260274 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa6c003570 con 0x7ffa8c0b1860 2023-10-06T04:40:09.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8959a700 1 -- 172.21.15.37:0/406260274 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183034924 0 0) 0x7ffa8c0b1ce0 con 0x7ffa8c15c240 2023-10-06T04:40:09.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8959a700 1 -- 172.21.15.37:0/406260274 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa8c0acd30 con 0x7ffa8c15c240 2023-10-06T04:40:09.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa89d9b700 1 -- 172.21.15.37:0/406260274 >> v1:172.21.15.83:6789/0 conn(0x7ffa8c15c240 legacy=0x7ffa8c0ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa89d9b700 1 -- 172.21.15.37:0/406260274 >> v1:172.21.15.37:6789/0 conn(0x7ffa8c0b1860 legacy=0x7ffa8c0ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa89d9b700 1 -- 172.21.15.37:0/406260274 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c0ac400 con 0x7ffa8c0667b0 2023-10-06T04:40:09.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa89d9b700 1 --2- 172.21.15.37:0/406260274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8c0667b0 0x7ffa8c0b1320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009e90 tx=0x7ffa7c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c0b47f56116d27a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:09.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8959a700 1 -- 172.21.15.37:0/406260274 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00e070 con 0x7ffa8c0667b0 2023-10-06T04:40:09.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8959a700 1 -- 172.21.15.37:0/406260274 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c00bb80 con 0x7ffa8c0667b0 2023-10-06T04:40:09.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8959a700 1 -- 172.21.15.37:0/406260274 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c012430 con 0x7ffa8c0667b0 2023-10-06T04:40:09.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 -- 172.21.15.37:0/406260274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8c0667b0 msgr2=0x7ffa8c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 --2- 172.21.15.37:0/406260274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8c0667b0 0x7ffa8c0b1320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009e90 tx=0x7ffa7c009780 comp rx=0 tx=0).stop 2023-10-06T04:40:09.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 -- 172.21.15.37:0/406260274 shutdown_connections 2023-10-06T04:40:09.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 --2- 172.21.15.37:0/406260274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8c0667b0 0x7ffa8c0b1320 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 -- 172.21.15.37:0/406260274 >> 172.21.15.37:0/406260274 conn(0x7ffa8c0ccb50 msgr2=0x7ffa8c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:09.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 -- 172.21.15.37:0/406260274 shutdown_connections 2023-10-06T04:40:09.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.140+0000 7ffa8b59e700 1 -- 172.21.15.37:0/406260274 wait complete. 2023-10-06T04:40:09.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa8b59e700 1 Processor -- start 2023-10-06T04:40:09.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa8b59e700 1 -- start start 2023-10-06T04:40:09.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa8b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa8c0667b0 0x7ffa8c1697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:09.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa8b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8c0b1860 0x7ffa8c0c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:09.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa8b59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa8c15c240 0x7ffa8c0c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:09.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa8b59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0c3730 con 0x7ffa8c0667b0 2023-10-06T04:40:09.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa8b59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0c2b20 con 0x7ffa8c15c240 2023-10-06T04:40:09.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa8b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0c2e00 con 0x7ffa8c0b1860 2023-10-06T04:40:09.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa8a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa8c0667b0 0x7ffa8c1697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:09.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa89d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8c0b1860 0x7ffa8c0c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:09.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa8a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa8c0667b0 0x7ffa8c1697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53316/0 (socket says 172.21.15.37:53316) 2023-10-06T04:40:09.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa8a59c700 1 -- 172.21.15.37:0/972350252 learned_addr learned my addr 172.21.15.37:0/972350252 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:09.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa8ad9d700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa8c15c240 0x7ffa8c0c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:09.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa89d9b700 1 -- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa8c15c240 msgr2=0x7ffa8c0c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa89d9b700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa8c15c240 0x7ffa8c0c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa89d9b700 1 -- 172.21.15.37:0/972350252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa8c0667b0 msgr2=0x7ffa8c1697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa89d9b700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa8c0667b0 0x7ffa8c1697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.144+0000 7ffa89d9b700 1 -- 172.21.15.37:0/972350252 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c009a20 con 0x7ffa8c0b1860 2023-10-06T04:40:09.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.148+0000 7ffa89d9b700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8c0b1860 0x7ffa8c0c6510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c016000 tx=0x7ffa7c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:09.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.148+0000 7ffa827fc700 1 -- 172.21.15.37:0/972350252 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c012a80 con 0x7ffa8c0b1860 2023-10-06T04:40:09.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.148+0000 7ffa827fc700 1 -- 172.21.15.37:0/972350252 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c012c00 con 0x7ffa8c0b1860 2023-10-06T04:40:09.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.148+0000 7ffa8b59e700 1 -- 172.21.15.37:0/972350252 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8c0c30e0 con 0x7ffa8c0b1860 2023-10-06T04:40:09.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.148+0000 7ffa827fc700 1 -- 172.21.15.37:0/972350252 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0263f0 con 0x7ffa8c0b1860 2023-10-06T04:40:09.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.148+0000 7ffa8b59e700 1 -- 172.21.15.37:0/972350252 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c16c110 con 0x7ffa8c0b1860 2023-10-06T04:40:09.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.148+0000 7ffa8b59e700 1 -- 172.21.15.37:0/972350252 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8c0c38a0 con 0x7ffa8c0b1860 2023-10-06T04:40:09.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.148+0000 7ffa827fc700 1 -- 172.21.15.37:0/972350252 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffa7c044920 con 0x7ffa8c0b1860 2023-10-06T04:40:09.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.148+0000 7ffa827fc700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffa70060580 0x7ffa70062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:09.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.152+0000 7ffa827fc700 1 -- 172.21.15.37:0/972350252 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5612+0+0 (secure 0 0 0) 0x7ffa7c07df70 con 0x7ffa8c0b1860 2023-10-06T04:40:09.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.152+0000 7ffa8a59c700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffa70060580 0x7ffa70062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:09.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.152+0000 7ffa8a59c700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffa70060580 0x7ffa70062a30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c15b3d0 tx=0x7ffa74007e10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.160+0000 7ffa827fc700 1 -- 172.21.15.37:0/972350252 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffa7c04e640 con 0x7ffa8c0b1860 2023-10-06T04:40:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.332+0000 7ffa8b59e700 1 -- 172.21.15.37:0/972350252 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ffa8c0708a0 con 0x7ffa8c0b1860 2023-10-06T04:40:09.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.972+0000 7ffa827fc700 1 -- 172.21.15.37:0/972350252 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffa7c051c60 con 0x7ffa8c0b1860 2023-10-06T04:40:09.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.976+0000 7ffa8b59e700 1 -- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffa70060580 msgr2=0x7ffa70062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.976+0000 7ffa8b59e700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffa70060580 0x7ffa70062a30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c15b3d0 tx=0x7ffa74007e10 comp rx=0 tx=0).stop 2023-10-06T04:40:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.976+0000 7ffa8b59e700 1 -- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8c0b1860 msgr2=0x7ffa8c0c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.976+0000 7ffa8b59e700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8c0b1860 0x7ffa8c0c6510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c016000 tx=0x7ffa7c019000 comp rx=0 tx=0).stop 2023-10-06T04:40:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.976+0000 7ffa8b59e700 1 -- 172.21.15.37:0/972350252 shutdown_connections 2023-10-06T04:40:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.976+0000 7ffa8b59e700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffa70060580 0x7ffa70062a30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.976+0000 7ffa8b59e700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa8c15c240 0x7ffa8c0c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.976+0000 7ffa8b59e700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8c0b1860 0x7ffa8c0c6510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.976+0000 7ffa8b59e700 1 --2- 172.21.15.37:0/972350252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa8c0667b0 0x7ffa8c1697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.976+0000 7ffa8b59e700 1 -- 172.21.15.37:0/972350252 >> 172.21.15.37:0/972350252 conn(0x7ffa8c0ccb50 msgr2=0x7ffa8c0aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.976+0000 7ffa8b59e700 1 -- 172.21.15.37:0/972350252 shutdown_connections 2023-10-06T04:40:09.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:09.976+0000 7ffa8b59e700 1 -- 172.21.15.37:0/972350252 wait complete. 2023-10-06T04:40:09.985 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-10-06T04:40:09.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T04:40:10.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 Processor -- start 2023-10-06T04:40:10.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 -- start start 2023-10-06T04:40:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dcc1587d0 0x7f4dcc15d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4dcc158ba0 0x7f4dcc067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dcc0af7f0 con 0x7f4dcc068230 2023-10-06T04:40:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dcc15d6d0 con 0x7f4dcc158ba0 2023-10-06T04:40:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc0686b0 con 0x7f4dcc1587d0 2023-10-06T04:40:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dcbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4dcc158ba0 0x7f4dcc067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dcbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4dcc158ba0 0x7f4dcc067cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53326/0 (socket says 172.21.15.37:53326) 2023-10-06T04:40:10.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dcbfff700 1 -- 172.21.15.37:0/958321669 learned_addr learned my addr 172.21.15.37:0/958321669 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:10.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd0963700 1 --2- 172.21.15.37:0/958321669 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dcc1587d0 0x7f4dcc15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dcbfff700 1 -- 172.21.15.37:0/958321669 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dcc1587d0 msgr2=0x7f4dcc15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:10.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dcbfff700 1 --2- 172.21.15.37:0/958321669 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dcc1587d0 0x7f4dcc15d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dcbfff700 1 -- 172.21.15.37:0/958321669 >> v1:172.21.15.83:6789/0 conn(0x7f4dcc068230 legacy=0x7f4dcc0ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dcbfff700 1 -- 172.21.15.37:0/958321669 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0afad0 con 0x7f4dcc158ba0 2023-10-06T04:40:10.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dcbfff700 1 --2- 172.21.15.37:0/958321669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dcc158ba0 0x7f4dcc067cf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4db80099b0 tx=0x7f4db8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4322eb3c47fec9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dcb7fe700 1 -- 172.21.15.37:0/958321669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8009ea0 con 0x7f4dcc158ba0 2023-10-06T04:40:10.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dcb7fe700 1 -- 172.21.15.37:0/958321669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db800b860 con 0x7f4dcc158ba0 2023-10-06T04:40:10.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dcb7fe700 1 -- 172.21.15.37:0/958321669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800bc00 con 0x7f4dcc158ba0 2023-10-06T04:40:10.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 -- 172.21.15.37:0/958321669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dcc158ba0 msgr2=0x7f4dcc067cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 --2- 172.21.15.37:0/958321669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dcc158ba0 0x7f4dcc067cf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4db80099b0 tx=0x7f4db8009250 comp rx=0 tx=0).stop 2023-10-06T04:40:10.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 -- 172.21.15.37:0/958321669 shutdown_connections 2023-10-06T04:40:10.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 --2- 172.21.15.37:0/958321669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dcc158ba0 0x7f4dcc067cf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 --2- 172.21.15.37:0/958321669 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dcc1587d0 0x7f4dcc15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.152+0000 7f4dd1965700 1 -- 172.21.15.37:0/958321669 >> 172.21.15.37:0/958321669 conn(0x7f4dcc0cc5f0 msgr2=0x7f4dcc0cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:10.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1965700 1 -- 172.21.15.37:0/958321669 shutdown_connections 2023-10-06T04:40:10.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1965700 1 -- 172.21.15.37:0/958321669 wait complete. 2023-10-06T04:40:10.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1965700 1 Processor -- start 2023-10-06T04:40:10.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1965700 1 -- start start 2023-10-06T04:40:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1965700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dcc068230 0x7f4dcc156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1965700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dcc1587d0 0x7f4dcc0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1965700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dcc158ba0 0x7f4dcc15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1965700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc15c0d0 con 0x7f4dcc158ba0 2023-10-06T04:40:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1965700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc15b4c0 con 0x7f4dcc068230 2023-10-06T04:40:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1965700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc15b7a0 con 0x7f4dcc1587d0 2023-10-06T04:40:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1164700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dcc158ba0 0x7f4dcc15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1164700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dcc158ba0 0x7f4dcc15c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53332/0 (socket says 172.21.15.37:53332) 2023-10-06T04:40:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd1164700 1 -- 172.21.15.37:0/2586452983 learned_addr learned my addr 172.21.15.37:0/2586452983 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dcbfff700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dcc1587d0 0x7f4dcc0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.156+0000 7f4dd0963700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dcc068230 0x7f4dcc156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dd1164700 1 -- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dcc1587d0 msgr2=0x7f4dcc0aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dd1164700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dcc1587d0 0x7f4dcc0aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dd1164700 1 -- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dcc068230 msgr2=0x7f4dcc156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dd1164700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dcc068230 0x7f4dcc156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dd1164700 1 -- 172.21.15.37:0/2586452983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db80094f0 con 0x7f4dcc158ba0 2023-10-06T04:40:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dd0963700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dcc068230 0x7f4dcc156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dd1164700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dcc158ba0 0x7f4dcc15c9c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c7f0 tx=0x7f4dc4001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dc8ff9700 1 -- 172.21.15.37:0/2586452983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4012630 con 0x7f4dcc158ba0 2023-10-06T04:40:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dc8ff9700 1 -- 172.21.15.37:0/2586452983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4012790 con 0x7f4dcc158ba0 2023-10-06T04:40:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dd1965700 1 -- 172.21.15.37:0/2586452983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dcc15ba80 con 0x7f4dcc158ba0 2023-10-06T04:40:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dc8ff9700 1 -- 172.21.15.37:0/2586452983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4012b50 con 0x7f4dcc158ba0 2023-10-06T04:40:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dd1965700 1 -- 172.21.15.37:0/2586452983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc0c9650 con 0x7f4dcc158ba0 2023-10-06T04:40:10.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dd1965700 1 -- 172.21.15.37:0/2586452983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dcc0708a0 con 0x7f4dcc158ba0 2023-10-06T04:40:10.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.160+0000 7f4dc8ff9700 1 -- 172.21.15.37:0/2586452983 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4dc4003030 con 0x7f4dcc158ba0 2023-10-06T04:40:10.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.164+0000 7f4dc8ff9700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4db0060580 0x7f4db0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.164+0000 7f4dc8ff9700 1 -- 172.21.15.37:0/2586452983 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4dc407c5d0 con 0x7f4dcc158ba0 2023-10-06T04:40:10.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.164+0000 7f4dd0963700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4db0060580 0x7f4db0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.164+0000 7f4dd0963700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4db0060580 0x7f4db0062a30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009d80 tx=0x7f4dc0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.172+0000 7f4dc8ff9700 1 -- 172.21.15.37:0/2586452983 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4dc404cc70 con 0x7f4dcc158ba0 2023-10-06T04:40:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.388+0000 7f4dd1965700 1 -- 172.21.15.37:0/2586452983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4dcc15c210 con 0x7f4dcc158ba0 2023-10-06T04:40:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.388+0000 7f4dc8ff9700 1 -- 172.21.15.37:0/2586452983 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4dcc15c210 con 0x7f4dcc158ba0 2023-10-06T04:40:10.394 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:10.394 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:40:10.394 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-10-06T04:40:10.394 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.394 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-10-06T04:40:10.395 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9lOJ5qARAAsrI6rKjWz9nRWFOt3Y+PqQ==", 2023-10-06T04:40:10.395 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.395 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:10.395 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:40:10.395 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:40:10.395 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.395 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.395 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.396 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-10-06T04:40:10.396 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9lfHbsCBAAtqsK3RVBoxm1lxiD6xvs2Q==", 2023-10-06T04:40:10.396 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.396 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:10.396 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:40:10.396 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:40:10.396 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.396 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.396 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.397 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.397 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-10-06T04:40:10.397 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9lUkX8BBAAnme43cfieXYJ9Su7RsbS4Q==", 2023-10-06T04:40:10.397 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.397 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:10.397 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:40:10.397 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:40:10.397 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.397 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.398 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.398 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-10-06T04:40:10.398 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9l58opDBAA35WNoMLpqmtJdWSSZXc64Q==", 2023-10-06T04:40:10.398 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.398 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:10.398 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:40:10.398 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:40:10.398 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.398 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.399 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.399 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-10-06T04:40:10.399 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA4jx9l/DyXOBAAzNFj0ooJ5/gyMftDwzeIlg==", 2023-10-06T04:40:10.399 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.399 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:10.399 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:10.399 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.399 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.400 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.400 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-10-06T04:40:10.400 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA8jx9lIzTRDhAA0Mk4SuNJdtaRS0kzMweOOQ==", 2023-10-06T04:40:10.400 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.400 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:10.400 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:10.400 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.400 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.400 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.401 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-10-06T04:40:10.401 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA/jx9lNqwfExAAGO+OBHAP8JCfGnY7jDuP1Q==", 2023-10-06T04:40:10.401 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.401 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:10.401 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:10.401 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.401 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.401 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.401 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.401 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-10-06T04:40:10.402 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBCjx9lGZqMGBAAKlgYTGI0/J4itMisLtuBtQ==", 2023-10-06T04:40:10.402 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.402 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:10.402 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:10.402 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.402 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.402 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.402 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.402 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-10-06T04:40:10.402 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBIjx9le+3tABAAUgbf+fMuquiP3PEQSPwN0g==", 2023-10-06T04:40:10.403 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.403 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:10.403 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:10.403 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.403 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.403 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.403 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.403 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-10-06T04:40:10.403 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBLjx9lo2yUFRAAGTmYOWUH6Z2oGz3iUfbnZQ==", 2023-10-06T04:40:10.403 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.404 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:10.404 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:10.404 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.404 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.404 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.404 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-10-06T04:40:10.405 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBOjx9lPNTIFxAAplImPCR+TZMSH032LvqX8Q==", 2023-10-06T04:40:10.405 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.405 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:10.405 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:10.405 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.405 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.405 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.405 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.405 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-10-06T04:40:10.406 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBRjx9lSP/+HxAAu8/0hIUn5ltVb2kRHQShag==", 2023-10-06T04:40:10.406 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.406 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:10.406 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:10.406 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.406 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.406 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.406 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-10-06T04:40:10.407 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9lEpkaDxAARPlbdi95Jplvg+MqEnvRtQ==", 2023-10-06T04:40:10.407 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.407 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:10.407 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T04:40:10.407 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T04:40:10.407 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T04:40:10.407 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.407 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.407 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-10-06T04:40:10.408 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9l7A4oFRAAHbqwpcFGrhOffbCbjsCImw==", 2023-10-06T04:40:10.408 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.408 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:10.408 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T04:40:10.408 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T04:40:10.408 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T04:40:10.408 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.408 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.408 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.408 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-10-06T04:40:10.409 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9lODj8ERAAtL4c9GBGm8/aWvdps6m9nQ==", 2023-10-06T04:40:10.409 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.409 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:10.409 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T04:40:10.409 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T04:40:10.409 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T04:40:10.409 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.410 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.410 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-10-06T04:40:10.410 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9lcZ10FxAAJg1NGICFz7QsIBKg/fPlHg==", 2023-10-06T04:40:10.410 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.410 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:10.410 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T04:40:10.410 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T04:40:10.411 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T04:40:10.411 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.411 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.411 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.411 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-10-06T04:40:10.411 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA1jx9lDoNZLRAAlxO5acBh/Y2TjiXwDEOmNQ==", 2023-10-06T04:40:10.411 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.411 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T04:40:10.411 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:40:10.411 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:40:10.412 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.412 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.412 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.412 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mds", 2023-10-06T04:40:10.412 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBWjx9lw+aSJxAAZkateARaYG0U8n2PdmL1zA==", 2023-10-06T04:40:10.412 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.412 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T04:40:10.412 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.412 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.413 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T04:40:10.413 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBWjx9lQfqSJxAAOi1lk2TnIv71iV9Iod20UA==", 2023-10-06T04:40:10.413 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.413 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T04:40:10.413 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.413 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.413 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.413 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-osd", 2023-10-06T04:40:10.413 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBWjx9lBwqTJxAA5KKI7SvBRLHV4OH33E+koA==", 2023-10-06T04:40:10.413 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.414 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T04:40:10.414 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.414 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.414 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.414 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T04:40:10.414 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBWjx9lFx2TJxAAQ3DKtaM7sEXHrKUWDUf6GA==", 2023-10-06T04:40:10.414 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.414 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T04:40:10.414 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.414 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.415 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.415 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T04:40:10.415 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBWjx9lXC2TJxAA0MYg7w+ce/FDcOpdHVb+Cw==", 2023-10-06T04:40:10.415 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.415 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T04:40:10.415 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.415 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.415 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T04:40:10.415 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBWjx9lXT2TJxAAugx1/IKVUS7XzTKZp39LoQ==", 2023-10-06T04:40:10.416 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.416 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T04:40:10.416 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.416 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.416 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-10-06T04:40:10.416 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA1jx9lX9oxOhAACDvgyzcGRrnVSVDAx+LzOw==", 2023-10-06T04:40:10.416 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.416 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T04:40:10.416 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T04:40:10.416 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.417 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:10.417 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:10.417 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-10-06T04:40:10.417 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA1jx9lDRlRNxAAXQyULCYNLpCmk2wGrYQdFA==", 2023-10-06T04:40:10.417 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:10.417 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T04:40:10.417 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T04:40:10.417 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:10.417 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.418 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:10.418 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-06T04:40:10.418 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:40:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.388+0000 7f4dd1965700 1 -- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4db0060580 msgr2=0x7f4db0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.388+0000 7f4dd1965700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4db0060580 0x7f4db0062a30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009d80 tx=0x7f4dc0008040 comp rx=0 tx=0).stop 2023-10-06T04:40:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.388+0000 7f4dd1965700 1 -- 172.21.15.37:0/2586452983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dcc158ba0 msgr2=0x7f4dcc15c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.388+0000 7f4dd1965700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dcc158ba0 0x7f4dcc15c9c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c7f0 tx=0x7f4dc4001630 comp rx=0 tx=0).stop 2023-10-06T04:40:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.392+0000 7f4dd1965700 1 -- 172.21.15.37:0/2586452983 shutdown_connections 2023-10-06T04:40:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.392+0000 7f4dd1965700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4db0060580 0x7f4db0062a30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.392+0000 7f4dd1965700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dcc158ba0 0x7f4dcc15c9c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.392+0000 7f4dd1965700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dcc1587d0 0x7f4dcc0aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.392+0000 7f4dd1965700 1 --2- 172.21.15.37:0/2586452983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dcc068230 0x7f4dcc156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.392+0000 7f4dd1965700 1 -- 172.21.15.37:0/2586452983 >> 172.21.15.37:0/2586452983 conn(0x7f4dcc0cc5f0 msgr2=0x7f4dcc0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.392+0000 7f4dd1965700 1 -- 172.21.15.37:0/2586452983 shutdown_connections 2023-10-06T04:40:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.392+0000 7f4dd1965700 1 -- 172.21.15.37:0/2586452983 wait complete. 2023-10-06T04:40:10.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T04:40:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b33fff700 1 Processor -- start 2023-10-06T04:40:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b33fff700 1 -- start start 2023-10-06T04:40:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b33fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3406a4a0 0x7f1b3406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b33fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b340ce0d0 0x7f1b34158a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b33fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b340ce8b0 con 0x7f1b3406d020 2023-10-06T04:40:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b33fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b34069860 con 0x7f1b340ce0d0 2023-10-06T04:40:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b33fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b34068f30 con 0x7f1b3406a4a0 2023-10-06T04:40:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b337fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b340ce0d0 0x7f1b34158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b337fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b340ce0d0 0x7f1b34158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53340/0 (socket says 172.21.15.37:53340) 2023-10-06T04:40:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b337fe700 1 -- 172.21.15.37:0/1512312401 learned_addr learned my addr 172.21.15.37:0/1512312401 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b327fc700 1 --2- 172.21.15.37:0/1512312401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3406a4a0 0x7f1b3406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b337fe700 1 -- 172.21.15.37:0/1512312401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3406a4a0 msgr2=0x7f1b3406d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b337fe700 1 --2- 172.21.15.37:0/1512312401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3406a4a0 0x7f1b3406d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b337fe700 1 -- 172.21.15.37:0/1512312401 >> v1:172.21.15.37:6789/0 conn(0x7f1b3406d020 legacy=0x7f1b34069cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.528+0000 7f1b337fe700 1 -- 172.21.15.37:0/1512312401 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b34069210 con 0x7f1b340ce0d0 2023-10-06T04:40:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b337fe700 1 --2- 172.21.15.37:0/1512312401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340ce0d0 0x7f1b34158a40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009f20 tx=0x7f1b2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde56e3e8bbf8f50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b31ffb700 1 -- 172.21.15.37:0/1512312401 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00e070 con 0x7f1b340ce0d0 2023-10-06T04:40:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b31ffb700 1 -- 172.21.15.37:0/1512312401 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c00b9d0 con 0x7f1b340ce0d0 2023-10-06T04:40:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b31ffb700 1 -- 172.21.15.37:0/1512312401 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0092e0 con 0x7f1b340ce0d0 2023-10-06T04:40:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 -- 172.21.15.37:0/1512312401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340ce0d0 msgr2=0x7f1b34158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 --2- 172.21.15.37:0/1512312401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340ce0d0 0x7f1b34158a40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009f20 tx=0x7f1b2c009840 comp rx=0 tx=0).stop 2023-10-06T04:40:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 -- 172.21.15.37:0/1512312401 shutdown_connections 2023-10-06T04:40:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 --2- 172.21.15.37:0/1512312401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340ce0d0 0x7f1b34158a40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 --2- 172.21.15.37:0/1512312401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3406a4a0 0x7f1b3406d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 -- 172.21.15.37:0/1512312401 >> 172.21.15.37:0/1512312401 conn(0x7f1b3406c2d0 msgr2=0x7f1b340cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 -- 172.21.15.37:0/1512312401 shutdown_connections 2023-10-06T04:40:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 -- 172.21.15.37:0/1512312401 wait complete. 2023-10-06T04:40:10.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 Processor -- start 2023-10-06T04:40:10.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 -- start start 2023-10-06T04:40:10.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b3406a4a0 0x7f1b34169240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3406d020 0x7f1b341515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340ce0d0 0x7f1b34155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b34156420 con 0x7f1b340ce0d0 2023-10-06T04:40:10.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340c4a70 con 0x7f1b3406a4a0 2023-10-06T04:40:10.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.532+0000 7f1b33fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340c4d50 con 0x7f1b3406d020 2023-10-06T04:40:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b337fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340ce0d0 0x7f1b34155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b337fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340ce0d0 0x7f1b34155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53348/0 (socket says 172.21.15.37:53348) 2023-10-06T04:40:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b337fe700 1 -- 172.21.15.37:0/513512056 learned_addr learned my addr 172.21.15.37:0/513512056 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b327fc700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3406d020 0x7f1b341515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b32ffd700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b3406a4a0 0x7f1b34169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b337fe700 1 -- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3406d020 msgr2=0x7f1b341515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b337fe700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3406d020 0x7f1b341515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b337fe700 1 -- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b3406a4a0 msgr2=0x7f1b34169240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b337fe700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b3406a4a0 0x7f1b34169240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b337fe700 1 -- 172.21.15.37:0/513512056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c009ae0 con 0x7f1b340ce0d0 2023-10-06T04:40:10.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b32ffd700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b3406a4a0 0x7f1b34169240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:10.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b337fe700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340ce0d0 0x7f1b34155a80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00b610 tx=0x7f1b2c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b1affd700 1 -- 172.21.15.37:0/513512056 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c008b80 con 0x7f1b340ce0d0 2023-10-06T04:40:10.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b33fff700 1 -- 172.21.15.37:0/513512056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b340c5030 con 0x7f1b340ce0d0 2023-10-06T04:40:10.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b1affd700 1 -- 172.21.15.37:0/513512056 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c008ce0 con 0x7f1b340ce0d0 2023-10-06T04:40:10.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b1affd700 1 -- 172.21.15.37:0/513512056 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c025690 con 0x7f1b340ce0d0 2023-10-06T04:40:10.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b33fff700 1 -- 172.21.15.37:0/513512056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b34169780 con 0x7f1b340ce0d0 2023-10-06T04:40:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b33fff700 1 -- 172.21.15.37:0/513512056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b340708a0 con 0x7f1b340ce0d0 2023-10-06T04:40:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.536+0000 7f1b1affd700 1 -- 172.21.15.37:0/513512056 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1b2c003040 con 0x7f1b340ce0d0 2023-10-06T04:40:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.540+0000 7f1b1affd700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1b20060550 0x7f1b20062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.540+0000 7f1b1affd700 1 -- 172.21.15.37:0/513512056 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1b2c07dd20 con 0x7f1b340ce0d0 2023-10-06T04:40:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.540+0000 7f1b32ffd700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1b20060550 0x7f1b20062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.540+0000 7f1b32ffd700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1b20060550 0x7f1b20062a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b28007fd0 tx=0x7f1b28009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.544+0000 7f1b1affd700 1 -- 172.21.15.37:0/513512056 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1b2c04e3c0 con 0x7f1b340ce0d0 2023-10-06T04:40:10.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.768+0000 7f1b33fff700 1 -- 172.21.15.37:0/513512056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f1b340694f0 con 0x7f1b340ce0d0 2023-10-06T04:40:10.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.772+0000 7f1b1affd700 1 -- 172.21.15.37:0/513512056 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1b2c0519e0 con 0x7f1b340ce0d0 2023-10-06T04:40:10.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.776+0000 7f1b33fff700 1 -- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1b20060550 msgr2=0x7f1b20062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.776+0000 7f1b33fff700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1b20060550 0x7f1b20062a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b28007fd0 tx=0x7f1b28009040 comp rx=0 tx=0).stop 2023-10-06T04:40:10.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.776+0000 7f1b33fff700 1 -- 172.21.15.37:0/513512056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340ce0d0 msgr2=0x7f1b34155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.776+0000 7f1b33fff700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340ce0d0 0x7f1b34155a80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00b610 tx=0x7f1b2c018000 comp rx=0 tx=0).stop 2023-10-06T04:40:10.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.776+0000 7f1b33fff700 1 -- 172.21.15.37:0/513512056 shutdown_connections 2023-10-06T04:40:10.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.776+0000 7f1b33fff700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1b20060550 0x7f1b20062a00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.776+0000 7f1b33fff700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340ce0d0 0x7f1b34155a80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.776+0000 7f1b33fff700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3406d020 0x7f1b341515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.776+0000 7f1b33fff700 1 --2- 172.21.15.37:0/513512056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b3406a4a0 0x7f1b34169240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.776+0000 7f1b33fff700 1 -- 172.21.15.37:0/513512056 >> 172.21.15.37:0/513512056 conn(0x7f1b3406c2d0 msgr2=0x7f1b340c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:10.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.776+0000 7f1b33fff700 1 -- 172.21.15.37:0/513512056 shutdown_connections 2023-10-06T04:40:10.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.776+0000 7f1b33fff700 1 -- 172.21.15.37:0/513512056 wait complete. 2023-10-06T04:40:10.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T04:40:10.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.892+0000 7f2a92288700 1 Processor -- start 2023-10-06T04:40:10.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.892+0000 7f2a92288700 1 -- start start 2023-10-06T04:40:10.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a92288700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a8c0affd0 0x7f2a8c0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a92288700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2a8c1570e0 0x7f2a8c06ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a92288700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8c0ad600 con 0x7f2a8c157550 2023-10-06T04:40:10.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a92288700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8c0c2b40 con 0x7f2a8c0affd0 2023-10-06T04:40:10.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a92288700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8c157ab0 con 0x7f2a8c1570e0 2023-10-06T04:40:10.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a91286700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a8c0affd0 0x7f2a8c0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a91a87700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2a8c157550 0x7f2a8c15a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48428/0 (socket says 172.21.15.37:48428) 2023-10-06T04:40:10.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a91a87700 1 -- 172.21.15.37:0/204488995 learned_addr learned my addr 172.21.15.37:0/204488995 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:10.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a90a85700 1 --2- 172.21.15.37:0/204488995 >> v2:172.21.15.83:3300/0 conn(0x7f2a8c1570e0 0x7f2a8c06ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a91286700 1 -- 172.21.15.37:0/204488995 >> v2:172.21.15.83:3300/0 conn(0x7f2a8c1570e0 msgr2=0x7f2a8c06ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:10.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a91286700 1 --2- 172.21.15.37:0/204488995 >> v2:172.21.15.83:3300/0 conn(0x7f2a8c1570e0 0x7f2a8c06ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a91286700 1 -- 172.21.15.37:0/204488995 >> v1:172.21.15.37:6789/0 conn(0x7f2a8c157550 legacy=0x7f2a8c15a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a91286700 1 -- 172.21.15.37:0/204488995 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c157d90 con 0x7f2a8c0affd0 2023-10-06T04:40:10.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a91286700 1 --2- 172.21.15.37:0/204488995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a8c0affd0 0x7f2a8c0c8ea0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c068d10 tx=0x7f2a880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818c7669533445c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a83fff700 1 -- 172.21.15.37:0/204488995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88011630 con 0x7f2a8c0affd0 2023-10-06T04:40:10.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a83fff700 1 -- 172.21.15.37:0/204488995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a88011790 con 0x7f2a8c0affd0 2023-10-06T04:40:10.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a83fff700 1 -- 172.21.15.37:0/204488995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88011b30 con 0x7f2a8c0affd0 2023-10-06T04:40:10.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a92288700 1 -- 172.21.15.37:0/204488995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a8c0affd0 msgr2=0x7f2a8c0c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.896+0000 7f2a92288700 1 --2- 172.21.15.37:0/204488995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a8c0affd0 0x7f2a8c0c8ea0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c068d10 tx=0x7f2a880091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 -- 172.21.15.37:0/204488995 shutdown_connections 2023-10-06T04:40:10.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 --2- 172.21.15.37:0/204488995 >> v2:172.21.15.83:3300/0 conn(0x7f2a8c1570e0 0x7f2a8c06ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 --2- 172.21.15.37:0/204488995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a8c0affd0 0x7f2a8c0c8ea0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 -- 172.21.15.37:0/204488995 >> 172.21.15.37:0/204488995 conn(0x7f2a8c06c330 msgr2=0x7f2a8c0cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:10.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 -- 172.21.15.37:0/204488995 shutdown_connections 2023-10-06T04:40:10.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 -- 172.21.15.37:0/204488995 wait complete. 2023-10-06T04:40:10.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 Processor -- start 2023-10-06T04:40:10.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 -- start start 2023-10-06T04:40:10.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a8c0affd0 0x7f2a8c14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a8c1570e0 0x7f2a8c06a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a8c157550 0x7f2a8c152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c06ac20 con 0x7f2a8c157550 2023-10-06T04:40:10.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c0cc9a0 con 0x7f2a8c1570e0 2023-10-06T04:40:10.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a92288700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c0ccc80 con 0x7f2a8c0affd0 2023-10-06T04:40:10.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.900+0000 7f2a91a87700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a8c157550 0x7f2a8c152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a90a85700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a8c1570e0 0x7f2a8c06a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a91a87700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a8c157550 0x7f2a8c152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53372/0 (socket says 172.21.15.37:53372) 2023-10-06T04:40:10.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a91286700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a8c0affd0 0x7f2a8c14ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a91a87700 1 -- 172.21.15.37:0/802813209 learned_addr learned my addr 172.21.15.37:0/802813209 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:10.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a91a87700 1 -- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a8c0affd0 msgr2=0x7f2a8c14ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a91a87700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a8c0affd0 0x7f2a8c14ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a91a87700 1 -- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a8c1570e0 msgr2=0x7f2a8c06a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a91a87700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a8c1570e0 0x7f2a8c06a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a91a87700 1 -- 172.21.15.37:0/802813209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a88009420 con 0x7f2a8c157550 2023-10-06T04:40:10.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a90a85700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a8c1570e0 0x7f2a8c06a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:10.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a91a87700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a8c157550 0x7f2a8c152790 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400cc40 tx=0x7f2a84001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a817fa700 1 -- 172.21.15.37:0/802813209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8400a8b0 con 0x7f2a8c157550 2023-10-06T04:40:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a817fa700 1 -- 172.21.15.37:0/802813209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8400aa10 con 0x7f2a8c157550 2023-10-06T04:40:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a92288700 1 -- 172.21.15.37:0/802813209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8c0ccf60 con 0x7f2a8c157550 2023-10-06T04:40:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a817fa700 1 -- 172.21.15.37:0/802813209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8400add0 con 0x7f2a8c157550 2023-10-06T04:40:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a92288700 1 -- 172.21.15.37:0/802813209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8c06a8e0 con 0x7f2a8c157550 2023-10-06T04:40:10.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.904+0000 7f2a92288700 1 -- 172.21.15.37:0/802813209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8c0708a0 con 0x7f2a8c157550 2023-10-06T04:40:10.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.908+0000 7f2a817fa700 1 -- 172.21.15.37:0/802813209 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2a84007300 con 0x7f2a8c157550 2023-10-06T04:40:10.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.908+0000 7f2a817fa700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2a70060550 0x7f2a70062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.908+0000 7f2a817fa700 1 -- 172.21.15.37:0/802813209 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2a8407c9b0 con 0x7f2a8c157550 2023-10-06T04:40:10.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.908+0000 7f2a91286700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2a70060550 0x7f2a70062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.908+0000 7f2a91286700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2a70060550 0x7f2a70062a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2a880093f0 tx=0x7f2a88017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:10.912+0000 7f2a817fa700 1 -- 172.21.15.37:0/802813209 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2a8404d0d0 con 0x7f2a8c157550 2023-10-06T04:40:11.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.140+0000 7f2a92288700 1 -- 172.21.15.37:0/802813209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f2a8c0ad0d0 con 0x7f2a8c157550 2023-10-06T04:40:11.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a817fa700 1 -- 172.21.15.37:0/802813209 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2a840506f0 con 0x7f2a8c157550 2023-10-06T04:40:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a92288700 1 -- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2a70060550 msgr2=0x7f2a70062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a92288700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2a70060550 0x7f2a70062a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2a880093f0 tx=0x7f2a88017000 comp rx=0 tx=0).stop 2023-10-06T04:40:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a92288700 1 -- 172.21.15.37:0/802813209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a8c157550 msgr2=0x7f2a8c152790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a92288700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a8c157550 0x7f2a8c152790 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400cc40 tx=0x7f2a84001a50 comp rx=0 tx=0).stop 2023-10-06T04:40:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a92288700 1 -- 172.21.15.37:0/802813209 shutdown_connections 2023-10-06T04:40:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a92288700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2a70060550 0x7f2a70062a00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a92288700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a8c1570e0 0x7f2a8c06a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a92288700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a8c157550 0x7f2a8c152790 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a92288700 1 --2- 172.21.15.37:0/802813209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a8c0affd0 0x7f2a8c14ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a92288700 1 -- 172.21.15.37:0/802813209 >> 172.21.15.37:0/802813209 conn(0x7f2a8c06c330 msgr2=0x7f2a8c0aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a92288700 1 -- 172.21.15.37:0/802813209 shutdown_connections 2023-10-06T04:40:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.148+0000 7f2a92288700 1 -- 172.21.15.37:0/802813209 wait complete. 2023-10-06T04:40:11.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T04:40:11.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.272+0000 7fc382fdd700 1 Processor -- start 2023-10-06T04:40:11.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc382fdd700 1 -- start start 2023-10-06T04:40:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc382fdd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc37c0aba80 0x7fc37c0c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc382fdd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc37c0c9b30 0x7fc37c1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc382fdd700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c15a1b0 con 0x7fc37c0c8ae0 2023-10-06T04:40:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc382fdd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c159880 con 0x7fc37c0aba80 2023-10-06T04:40:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc382fdd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c159b60 con 0x7fc37c0c9b30 2023-10-06T04:40:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc37bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc37c0c8ae0 0x7fc37c0c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48436/0 (socket says 172.21.15.37:48436) 2023-10-06T04:40:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc37bfff700 1 -- 172.21.15.37:0/669670230 learned_addr learned my addr 172.21.15.37:0/669670230 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc380d79700 1 --2- 172.21.15.37:0/669670230 >> v2:172.21.15.83:3300/0 conn(0x7fc37c0aba80 0x7fc37c0c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc38157a700 1 --2- 172.21.15.37:0/669670230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc37c0c9b30 0x7fc37c1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc37b7fe700 1 -- 172.21.15.37:0/669670230 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114050771 0 0) 0x7fc37c15a1b0 con 0x7fc37c0c8ae0 2023-10-06T04:40:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc37b7fe700 1 -- 172.21.15.37:0/669670230 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc36c003570 con 0x7fc37c0c8ae0 2023-10-06T04:40:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc380d79700 1 -- 172.21.15.37:0/669670230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc37c0c9b30 msgr2=0x7fc37c1560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc37b7fe700 1 -- 172.21.15.37:0/669670230 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2325859066 0 0) 0x7fc36c003570 con 0x7fc37c0c8ae0 2023-10-06T04:40:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc380d79700 1 --2- 172.21.15.37:0/669670230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc37c0c9b30 0x7fc37c1560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc380d79700 1 -- 172.21.15.37:0/669670230 >> v1:172.21.15.37:6789/0 conn(0x7fc37c0c8ae0 legacy=0x7fc37c0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc380d79700 1 -- 172.21.15.37:0/669670230 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c159e40 con 0x7fc37c0aba80 2023-10-06T04:40:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc38157a700 1 --2- 172.21.15.37:0/669670230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc37c0c9b30 0x7fc37c1560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc380d79700 1 --2- 172.21.15.37:0/669670230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc37c0aba80 0x7fc37c0c85a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc3700098e0 tx=0x7fc3700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6502a0e80b1aeaeb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc37b7fe700 1 -- 172.21.15.37:0/669670230 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368001470 con 0x7fc37c0aba80 2023-10-06T04:40:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc37b7fe700 1 -- 172.21.15.37:0/669670230 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc370011420 con 0x7fc37c0aba80 2023-10-06T04:40:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.276+0000 7fc37b7fe700 1 -- 172.21.15.37:0/669670230 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3700117a0 con 0x7fc37c0aba80 2023-10-06T04:40:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 -- 172.21.15.37:0/669670230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc37c0aba80 msgr2=0x7fc37c0c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 --2- 172.21.15.37:0/669670230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc37c0aba80 0x7fc37c0c85a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc3700098e0 tx=0x7fc3700091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 -- 172.21.15.37:0/669670230 shutdown_connections 2023-10-06T04:40:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 --2- 172.21.15.37:0/669670230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc37c0c9b30 0x7fc37c1560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 --2- 172.21.15.37:0/669670230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc37c0aba80 0x7fc37c0c85a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 -- 172.21.15.37:0/669670230 >> 172.21.15.37:0/669670230 conn(0x7fc37c068e00 msgr2=0x7fc37c069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 -- 172.21.15.37:0/669670230 shutdown_connections 2023-10-06T04:40:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 -- 172.21.15.37:0/669670230 wait complete. 2023-10-06T04:40:11.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 Processor -- start 2023-10-06T04:40:11.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 -- start start 2023-10-06T04:40:11.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc37c0aba80 0x7fc37c0aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc37c0c8ae0 0x7fc37c0a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c0c9b30 0x7fc37c1694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0adc00 con 0x7fc37c0c9b30 2023-10-06T04:40:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0ac610 con 0x7fc37c0aba80 2023-10-06T04:40:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.280+0000 7fc382fdd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0ad2d0 con 0x7fc37c0c8ae0 2023-10-06T04:40:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc38157a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c0c9b30 0x7fc37c1694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc38157a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c0c9b30 0x7fc37c1694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53386/0 (socket says 172.21.15.37:53386) 2023-10-06T04:40:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc38157a700 1 -- 172.21.15.37:0/3759032215 learned_addr learned my addr 172.21.15.37:0/3759032215 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc380d79700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc37c0aba80 0x7fc37c0aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc37bfff700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc37c0c8ae0 0x7fc37c0a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc38157a700 1 -- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc37c0c8ae0 msgr2=0x7fc37c0a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc38157a700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc37c0c8ae0 0x7fc37c0a9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc38157a700 1 -- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc37c0aba80 msgr2=0x7fc37c0aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc38157a700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc37c0aba80 0x7fc37c0aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc38157a700 1 -- 172.21.15.37:0/3759032215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374009a20 con 0x7fc37c0c9b30 2023-10-06T04:40:11.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc38157a700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c0c9b30 0x7fc37c1694a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc374009f20 tx=0x7fc37400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc378ff9700 1 -- 172.21.15.37:0/3759032215 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400cb70 con 0x7fc37c0c9b30 2023-10-06T04:40:11.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc378ff9700 1 -- 172.21.15.37:0/3759032215 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37400f040 con 0x7fc37c0c9b30 2023-10-06T04:40:11.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc382fdd700 1 -- 172.21.15.37:0/3759032215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc370009420 con 0x7fc37c0c9b30 2023-10-06T04:40:11.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc378ff9700 1 -- 172.21.15.37:0/3759032215 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374014480 con 0x7fc37c0c9b30 2023-10-06T04:40:11.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc382fdd700 1 -- 172.21.15.37:0/3759032215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c0ad890 con 0x7fc37c0c9b30 2023-10-06T04:40:11.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc382fdd700 1 -- 172.21.15.37:0/3759032215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c0addb0 con 0x7fc37c0c9b30 2023-10-06T04:40:11.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.284+0000 7fc378ff9700 1 -- 172.21.15.37:0/3759032215 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc374003020 con 0x7fc37c0c9b30 2023-10-06T04:40:11.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.288+0000 7fc378ff9700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc360060550 0x7fc360062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.288+0000 7fc378ff9700 1 -- 172.21.15.37:0/3759032215 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc37407cf40 con 0x7fc37c0c9b30 2023-10-06T04:40:11.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.288+0000 7fc380d79700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc360060550 0x7fc360062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.288+0000 7fc380d79700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc360060550 0x7fc360062a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc3700091e0 tx=0x7fc370016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.292+0000 7fc378ff9700 1 -- 172.21.15.37:0/3759032215 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc37404d5e0 con 0x7fc37c0c9b30 2023-10-06T04:40:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.520+0000 7fc382fdd700 1 -- 172.21.15.37:0/3759032215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc37c070ee0 con 0x7fc37c0c9b30 2023-10-06T04:40:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.524+0000 7fc378ff9700 1 -- 172.21.15.37:0/3759032215 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc3740180a0 con 0x7fc37c0c9b30 2023-10-06T04:40:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.528+0000 7fc382fdd700 1 -- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc360060550 msgr2=0x7fc360062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.528+0000 7fc382fdd700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc360060550 0x7fc360062a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc3700091e0 tx=0x7fc370016000 comp rx=0 tx=0).stop 2023-10-06T04:40:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.528+0000 7fc382fdd700 1 -- 172.21.15.37:0/3759032215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c0c9b30 msgr2=0x7fc37c1694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.528+0000 7fc382fdd700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c0c9b30 0x7fc37c1694a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc374009f20 tx=0x7fc37400b040 comp rx=0 tx=0).stop 2023-10-06T04:40:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.528+0000 7fc382fdd700 1 -- 172.21.15.37:0/3759032215 shutdown_connections 2023-10-06T04:40:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.528+0000 7fc382fdd700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc360060550 0x7fc360062a00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.528+0000 7fc382fdd700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c0c9b30 0x7fc37c1694a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.528+0000 7fc382fdd700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc37c0c8ae0 0x7fc37c0a9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.528+0000 7fc382fdd700 1 --2- 172.21.15.37:0/3759032215 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc37c0aba80 0x7fc37c0aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.528+0000 7fc382fdd700 1 -- 172.21.15.37:0/3759032215 >> 172.21.15.37:0/3759032215 conn(0x7fc37c068e00 msgr2=0x7fc37c068690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.528+0000 7fc382fdd700 1 -- 172.21.15.37:0/3759032215 shutdown_connections 2023-10-06T04:40:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.528+0000 7fc382fdd700 1 -- 172.21.15.37:0/3759032215 wait complete. 2023-10-06T04:40:11.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T04:40:11.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d588fc700 1 Processor -- start 2023-10-06T04:40:11.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d588fc700 1 -- start start 2023-10-06T04:40:11.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d588fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d54066840 0x7f4d540b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d588fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4d540cb8b0 0x7f4d540ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d588fc700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d540cb110 con 0x7f4d540b1380 2023-10-06T04:40:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d588fc700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d540ca500 con 0x7f4d54066840 2023-10-06T04:40:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d588fc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d540ca7e0 con 0x7f4d540cb8b0 2023-10-06T04:40:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d52ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d54066840 0x7f4d540b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d52ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d54066840 0x7f4d540b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53390/0 (socket says 172.21.15.37:53390) 2023-10-06T04:40:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d52ffd700 1 -- 172.21.15.37:0/2370969415 learned_addr learned my addr 172.21.15.37:0/2370969415 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d53fff700 1 --2- 172.21.15.37:0/2370969415 >> v2:172.21.15.83:3300/0 conn(0x7f4d540cb8b0 0x7f4d540ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d52ffd700 1 -- 172.21.15.37:0/2370969415 >> v2:172.21.15.83:3300/0 conn(0x7f4d540cb8b0 msgr2=0x7f4d540ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d52ffd700 1 --2- 172.21.15.37:0/2370969415 >> v2:172.21.15.83:3300/0 conn(0x7f4d540cb8b0 0x7f4d540ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d52ffd700 1 -- 172.21.15.37:0/2370969415 >> v1:172.21.15.83:6789/0 conn(0x7f4d540b1380 legacy=0x7f4d540ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d52ffd700 1 -- 172.21.15.37:0/2370969415 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540caac0 con 0x7f4d54066840 2023-10-06T04:40:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d52ffd700 1 --2- 172.21.15.37:0/2370969415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d54066840 0x7f4d540b1750 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d540aeb90 tx=0x7f4d48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898005b1c1edd264 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d527fc700 1 -- 172.21.15.37:0/2370969415 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48009e70 con 0x7f4d54066840 2023-10-06T04:40:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d527fc700 1 -- 172.21.15.37:0/2370969415 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4800b8f0 con 0x7f4d54066840 2023-10-06T04:40:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.652+0000 7f4d527fc700 1 -- 172.21.15.37:0/2370969415 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800bc90 con 0x7f4d54066840 2023-10-06T04:40:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 -- 172.21.15.37:0/2370969415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d54066840 msgr2=0x7f4d540b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 --2- 172.21.15.37:0/2370969415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d54066840 0x7f4d540b1750 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d540aeb90 tx=0x7f4d48009250 comp rx=0 tx=0).stop 2023-10-06T04:40:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 -- 172.21.15.37:0/2370969415 shutdown_connections 2023-10-06T04:40:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 --2- 172.21.15.37:0/2370969415 >> v2:172.21.15.83:3300/0 conn(0x7f4d540cb8b0 0x7f4d540ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 --2- 172.21.15.37:0/2370969415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d54066840 0x7f4d540b1750 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 -- 172.21.15.37:0/2370969415 >> 172.21.15.37:0/2370969415 conn(0x7f4d540ccb50 msgr2=0x7f4d5406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 -- 172.21.15.37:0/2370969415 shutdown_connections 2023-10-06T04:40:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 -- 172.21.15.37:0/2370969415 wait complete. 2023-10-06T04:40:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 Processor -- start 2023-10-06T04:40:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 -- start start 2023-10-06T04:40:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d54066840 0x7f4d540a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d540b1380 0x7f4d541698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d540cb8b0 0x7f4d54169df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540a8240 con 0x7f4d540cb8b0 2023-10-06T04:40:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54154e70 con 0x7f4d540b1380 2023-10-06T04:40:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d588fc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540c8cc0 con 0x7f4d54066840 2023-10-06T04:40:11.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d53fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d540cb8b0 0x7f4d54169df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d53fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d540cb8b0 0x7f4d54169df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53402/0 (socket says 172.21.15.37:53402) 2023-10-06T04:40:11.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d53fff700 1 -- 172.21.15.37:0/2485003520 learned_addr learned my addr 172.21.15.37:0/2485003520 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:11.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d52ffd700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d540b1380 0x7f4d541698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.656+0000 7f4d537fe700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d54066840 0x7f4d540a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d53fff700 1 -- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d54066840 msgr2=0x7f4d540a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d53fff700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d54066840 0x7f4d540a9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d53fff700 1 -- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d540b1380 msgr2=0x7f4d541698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d53fff700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d540b1380 0x7f4d541698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d53fff700 1 -- 172.21.15.37:0/2485003520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d480094f0 con 0x7f4d540cb8b0 2023-10-06T04:40:11.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d53fff700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d540cb8b0 0x7f4d54169df0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009d70 tx=0x7f4d4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d3b7fe700 1 -- 172.21.15.37:0/2485003520 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c00caa0 con 0x7f4d540cb8b0 2023-10-06T04:40:11.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d3b7fe700 1 -- 172.21.15.37:0/2485003520 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c00f040 con 0x7f4d540cb8b0 2023-10-06T04:40:11.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d588fc700 1 -- 172.21.15.37:0/2485003520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d540a75c0 con 0x7f4d540cb8b0 2023-10-06T04:40:11.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d3b7fe700 1 -- 172.21.15.37:0/2485003520 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c00ce50 con 0x7f4d540cb8b0 2023-10-06T04:40:11.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d588fc700 1 -- 172.21.15.37:0/2485003520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d540a7b80 con 0x7f4d540cb8b0 2023-10-06T04:40:11.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d588fc700 1 -- 172.21.15.37:0/2485003520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d540a8380 con 0x7f4d540cb8b0 2023-10-06T04:40:11.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d3b7fe700 1 -- 172.21.15.37:0/2485003520 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4d4c014690 con 0x7f4d540cb8b0 2023-10-06T04:40:11.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d3b7fe700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d40060550 0x7f4d40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.660+0000 7f4d3b7fe700 1 -- 172.21.15.37:0/2485003520 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4d4c07d240 con 0x7f4d540cb8b0 2023-10-06T04:40:11.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.664+0000 7f4d537fe700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d40060550 0x7f4d40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.664+0000 7f4d537fe700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d40060550 0x7f4d40062a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d540cb830 tx=0x7f4d44009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.668+0000 7f4d3b7fe700 1 -- 172.21.15.37:0/2485003520 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4d540a8380 con 0x7f4d540cb8b0 2023-10-06T04:40:11.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.884+0000 7f4d588fc700 1 -- 172.21.15.37:0/2485003520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f4d540a8380 con 0x7f4d540cb8b0 2023-10-06T04:40:11.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.892+0000 7f4d3b7fe700 1 -- 172.21.15.37:0/2485003520 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4d540a8380 con 0x7f4d540cb8b0 2023-10-06T04:40:11.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.892+0000 7f4d588fc700 1 -- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d40060550 msgr2=0x7f4d40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.892+0000 7f4d588fc700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d40060550 0x7f4d40062a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d540cb830 tx=0x7f4d44009040 comp rx=0 tx=0).stop 2023-10-06T04:40:11.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.892+0000 7f4d588fc700 1 -- 172.21.15.37:0/2485003520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d540cb8b0 msgr2=0x7f4d54169df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.892+0000 7f4d588fc700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d540cb8b0 0x7f4d54169df0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009d70 tx=0x7f4d4c00b040 comp rx=0 tx=0).stop 2023-10-06T04:40:11.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.892+0000 7f4d588fc700 1 -- 172.21.15.37:0/2485003520 shutdown_connections 2023-10-06T04:40:11.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.892+0000 7f4d588fc700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4d40060550 0x7f4d40062a00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.892+0000 7f4d588fc700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d540b1380 0x7f4d541698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.892+0000 7f4d588fc700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d540cb8b0 0x7f4d54169df0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.892+0000 7f4d588fc700 1 --2- 172.21.15.37:0/2485003520 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d54066840 0x7f4d540a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.892+0000 7f4d588fc700 1 -- 172.21.15.37:0/2485003520 >> 172.21.15.37:0/2485003520 conn(0x7f4d540ccb50 msgr2=0x7f4d540ab920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:11.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.896+0000 7f4d588fc700 1 -- 172.21.15.37:0/2485003520 shutdown_connections 2023-10-06T04:40:11.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:11.896+0000 7f4d588fc700 1 -- 172.21.15.37:0/2485003520 wait complete. 2023-10-06T04:40:11.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T04:40:12.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f5112fc4700 1 Processor -- start 2023-10-06T04:40:12.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f5112fc4700 1 -- start start 2023-10-06T04:40:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f5112fc4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f510c06dbf0 0x7f510c0aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f5112fc4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0cc0d0 0x7f510c0c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f5112fc4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510c15e0e0 con 0x7f510c15d240 2023-10-06T04:40:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f5112fc4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c15d7b0 con 0x7f510c06dbf0 2023-10-06T04:40:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f5112fc4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c15da90 con 0x7f510c0cc0d0 2023-10-06T04:40:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f5111fc2700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f510c15d240 0x7f510c06d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48450/0 (socket says 172.21.15.37:48450) 2023-10-06T04:40:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f5111fc2700 1 -- 172.21.15.37:0/2472472088 learned_addr learned my addr 172.21.15.37:0/2472472088 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f51117c1700 1 --2- 172.21.15.37:0/2472472088 >> v2:172.21.15.83:3300/0 conn(0x7f510c06dbf0 0x7f510c0aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f51127c3700 1 --2- 172.21.15.37:0/2472472088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0cc0d0 0x7f510c0c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795686523 0 0) 0x7f510c15e0e0 con 0x7f510c15d240 2023-10-06T04:40:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50f4003570 con 0x7f510c15d240 2023-10-06T04:40:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.024+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2907308169 0 0) 0x7f50f4003570 con 0x7f510c15d240 2023-10-06T04:40:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0cc0d0 msgr2=0x7f510c0c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 --2- 172.21.15.37:0/2472472088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0cc0d0 0x7f510c0c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 >> v2:172.21.15.83:3300/0 conn(0x7f510c06dbf0 msgr2=0x7f510c0aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 --2- 172.21.15.37:0/2472472088 >> v2:172.21.15.83:3300/0 conn(0x7f510c06dbf0 0x7f510c0aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c15dd70 con 0x7f510c15d240 2023-10-06T04:40:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f51040017f0 con 0x7f510c15d240 2023-10-06T04:40:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 >> v1:172.21.15.37:6789/0 conn(0x7f510c15d240 legacy=0x7f510c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 --2- 172.21.15.37:0/2472472088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f4003a60 0x7f50f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 --2- 172.21.15.37:0/2472472088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50f4004810 0x7f50f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 --2- 172.21.15.37:0/2472472088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0cc0d0 0x7f50f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c15d7b0 con 0x7f50f4003a60 2023-10-06T04:40:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c15da90 con 0x7f50f4004810 2023-10-06T04:40:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f400bae0 con 0x7f510c0cc0d0 2023-10-06T04:40:12.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5111fc2700 1 --2- 172.21.15.37:0/2472472088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f4003a60 0x7f50f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f51117c1700 1 --2- 172.21.15.37:0/2472472088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50f4004810 0x7f50f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f51127c3700 1 --2- 172.21.15.37:0/2472472088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0cc0d0 0x7f50f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5111fc2700 1 -- 172.21.15.37:0/2472472088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0cc0d0 msgr2=0x7f50f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5111fc2700 1 --2- 172.21.15.37:0/2472472088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0cc0d0 0x7f50f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5111fc2700 1 -- 172.21.15.37:0/2472472088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50f4004810 msgr2=0x7f50f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5111fc2700 1 --2- 172.21.15.37:0/2472472088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50f4004810 0x7f50f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5111fc2700 1 -- 172.21.15.37:0/2472472088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4003570 con 0x7f50f4003a60 2023-10-06T04:40:12.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5111fc2700 1 --2- 172.21.15.37:0/2472472088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f4003a60 0x7f50f4003e70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f510400a970 tx=0x7f5104002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b08663edcdc7ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104012440 con 0x7f50f4003a60 2023-10-06T04:40:12.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51040125c0 con 0x7f50f4003a60 2023-10-06T04:40:12.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5110fc0700 1 -- 172.21.15.37:0/2472472088 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104012980 con 0x7f50f4003a60 2023-10-06T04:40:12.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5112fc4700 1 -- 172.21.15.37:0/2472472088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f4003a60 msgr2=0x7f50f4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5112fc4700 1 --2- 172.21.15.37:0/2472472088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f4003a60 0x7f50f4003e70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f510400a970 tx=0x7f5104002210 comp rx=0 tx=0).stop 2023-10-06T04:40:12.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f51127c3700 1 -- 172.21.15.37:0/2472472088 reap_dead start 2023-10-06T04:40:12.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5112fc4700 1 -- 172.21.15.37:0/2472472088 shutdown_connections 2023-10-06T04:40:12.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5112fc4700 1 -- 172.21.15.37:0/2472472088 >> 172.21.15.37:0/2472472088 conn(0x7f510c068780 msgr2=0x7f510c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5112fc4700 1 -- 172.21.15.37:0/2472472088 shutdown_connections 2023-10-06T04:40:12.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5112fc4700 1 -- 172.21.15.37:0/2472472088 wait complete. 2023-10-06T04:40:12.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5112fc4700 1 Processor -- start 2023-10-06T04:40:12.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.028+0000 7f5112fc4700 1 -- start start 2023-10-06T04:40:12.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5112fc4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50f4003a60 0x7f510c1495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5112fc4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0c2850 0x7f510c16ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5112fc4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c0c2cc0 0x7f510c16d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5112fc4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0c42d0 con 0x7f510c0c2cc0 2023-10-06T04:40:12.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5112fc4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c16d8d0 con 0x7f50f4003a60 2023-10-06T04:40:12.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5112fc4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0c3e40 con 0x7f510c0c2850 2023-10-06T04:40:12.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f51127c3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c0c2cc0 0x7f510c16d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f51127c3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c0c2cc0 0x7f510c16d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53420/0 (socket says 172.21.15.37:53420) 2023-10-06T04:40:12.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f51127c3700 1 -- 172.21.15.37:0/868980518 learned_addr learned my addr 172.21.15.37:0/868980518 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:12.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f51117c1700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0c2850 0x7f510c16ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5111fc2700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50f4003a60 0x7f510c1495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f51127c3700 1 -- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0c2850 msgr2=0x7f510c16ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f51127c3700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0c2850 0x7f510c16ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f51127c3700 1 -- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50f4003a60 msgr2=0x7f510c1495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f51127c3700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50f4003a60 0x7f510c1495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f51127c3700 1 -- 172.21.15.37:0/868980518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0c3230 con 0x7f510c0c2cc0 2023-10-06T04:40:12.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f51127c3700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c0c2cc0 0x7f510c16d390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f50fc006f00 tx=0x7f50fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5109ffb700 1 -- 172.21.15.37:0/868980518 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc013750 con 0x7f510c0c2cc0 2023-10-06T04:40:12.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5109ffb700 1 -- 172.21.15.37:0/868980518 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc0138b0 con 0x7f510c0c2cc0 2023-10-06T04:40:12.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5112fc4700 1 -- 172.21.15.37:0/868980518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510c0c3510 con 0x7f510c0c2cc0 2023-10-06T04:40:12.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5109ffb700 1 -- 172.21.15.37:0/868980518 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc013c50 con 0x7f510c0c2cc0 2023-10-06T04:40:12.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5112fc4700 1 -- 172.21.15.37:0/868980518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c0c3ad0 con 0x7f510c0c2cc0 2023-10-06T04:40:12.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5112fc4700 1 -- 172.21.15.37:0/868980518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510c0c3fd0 con 0x7f510c0c2cc0 2023-10-06T04:40:12.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.032+0000 7f5109ffb700 1 -- 172.21.15.37:0/868980518 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f50fc014440 con 0x7f510c0c2cc0 2023-10-06T04:40:12.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.036+0000 7f5109ffb700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f50f8060580 0x7f50f8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.036+0000 7f5109ffb700 1 -- 172.21.15.37:0/868980518 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f50fc07cc60 con 0x7f510c0c2cc0 2023-10-06T04:40:12.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.036+0000 7f5111fc2700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f50f8060580 0x7f50f8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.036+0000 7f5111fc2700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f50f8060580 0x7f50f8062a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f510400afd0 tx=0x7f5104015000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.040+0000 7f5109ffb700 1 -- 172.21.15.37:0/868980518 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f50fc04d2e0 con 0x7f510c0c2cc0 2023-10-06T04:40:12.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.260+0000 7f5112fc4700 1 -- 172.21.15.37:0/868980518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f510c0708a0 con 0x7f510c0c2cc0 2023-10-06T04:40:12.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5109ffb700 1 -- 172.21.15.37:0/868980518 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f50fc050900 con 0x7f510c0c2cc0 2023-10-06T04:40:12.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5112fc4700 1 -- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f50f8060580 msgr2=0x7f50f8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5112fc4700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f50f8060580 0x7f50f8062a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f510400afd0 tx=0x7f5104015000 comp rx=0 tx=0).stop 2023-10-06T04:40:12.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5112fc4700 1 -- 172.21.15.37:0/868980518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c0c2cc0 msgr2=0x7f510c16d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5112fc4700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c0c2cc0 0x7f510c16d390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f50fc006f00 tx=0x7f50fc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5112fc4700 1 -- 172.21.15.37:0/868980518 shutdown_connections 2023-10-06T04:40:12.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5112fc4700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f50f8060580 0x7f50f8062a30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5112fc4700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f510c0c2cc0 0x7f510c16d390 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5112fc4700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f510c0c2850 0x7f510c16ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5112fc4700 1 --2- 172.21.15.37:0/868980518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50f4003a60 0x7f510c1495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5112fc4700 1 -- 172.21.15.37:0/868980518 >> 172.21.15.37:0/868980518 conn(0x7f510c068780 msgr2=0x7f510c15c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5112fc4700 1 -- 172.21.15.37:0/868980518 shutdown_connections 2023-10-06T04:40:12.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.272+0000 7f5112fc4700 1 -- 172.21.15.37:0/868980518 wait complete. 2023-10-06T04:40:12.294 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T04:40:12.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.400+0000 7fcfd5cd7700 1 Processor -- start 2023-10-06T04:40:12.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.400+0000 7fcfd5cd7700 1 -- start start 2023-10-06T04:40:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.400+0000 7fcfd5cd7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcfd00c6960 0x7fcfd006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.400+0000 7fcfd5cd7700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd00c79e0 con 0x7fcfd0155110 2023-10-06T04:40:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.400+0000 7fcfd5cd7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd00c1610 con 0x7fcfd01554e0 2023-10-06T04:40:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.400+0000 7fcfd5cd7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00c2450 con 0x7fcfd00c6960 2023-10-06T04:40:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.400+0000 7fcfc7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcfd00c6960 0x7fcfd006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfd4cd5700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcfd0155110 0x7fcfd00c0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48460/0 (socket says 172.21.15.37:48460) 2023-10-06T04:40:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfc7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcfd00c6960 0x7fcfd006d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53430/0 (socket says 172.21.15.37:53430) 2023-10-06T04:40:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfd4cd5700 1 -- 172.21.15.37:0/1507486953 learned_addr learned my addr 172.21.15.37:0/1507486953 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfc7fff700 1 -- 172.21.15.37:0/1507486953 >> v1:172.21.15.83:6789/0 conn(0x7fcfd01554e0 legacy=0x7fcfd00c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfc7fff700 1 -- 172.21.15.37:0/1507486953 >> v1:172.21.15.37:6789/0 conn(0x7fcfd0155110 legacy=0x7fcfd00c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfc77fe700 1 -- 172.21.15.37:0/1507486953 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905431506 0 0) 0x7fcfd00c1610 con 0x7fcfd01554e0 2023-10-06T04:40:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfc7fff700 1 -- 172.21.15.37:0/1507486953 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd00c6dd0 con 0x7fcfd00c6960 2023-10-06T04:40:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfc7fff700 1 --2- 172.21.15.37:0/1507486953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd00c6960 0x7fcfd006d4e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000aa90 tx=0x7fcfc000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733b5e9cb0952d2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfc77fe700 1 -- 172.21.15.37:0/1507486953 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc000c940 con 0x7fcfd00c6960 2023-10-06T04:40:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfc77fe700 1 -- 172.21.15.37:0/1507486953 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc000caa0 con 0x7fcfd00c6960 2023-10-06T04:40:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfc77fe700 1 -- 172.21.15.37:0/1507486953 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc000ce60 con 0x7fcfd00c6960 2023-10-06T04:40:12.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/1507486953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd00c6960 msgr2=0x7fcfd006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfd5cd7700 1 --2- 172.21.15.37:0/1507486953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd00c6960 0x7fcfd006d4e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000aa90 tx=0x7fcfc000a330 comp rx=0 tx=0).stop 2023-10-06T04:40:12.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/1507486953 shutdown_connections 2023-10-06T04:40:12.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfd5cd7700 1 --2- 172.21.15.37:0/1507486953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd00c6960 0x7fcfd006d4e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/1507486953 >> 172.21.15.37:0/1507486953 conn(0x7fcfd0068780 msgr2=0x7fcfd00cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/1507486953 shutdown_connections 2023-10-06T04:40:12.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.404+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/1507486953 wait complete. 2023-10-06T04:40:12.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.408+0000 7fcfd5cd7700 1 Processor -- start 2023-10-06T04:40:12.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.408+0000 7fcfd5cd7700 1 -- start start 2023-10-06T04:40:12.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.408+0000 7fcfd5cd7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfd00c6960 0x7fcfd0164530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.408+0000 7fcfd5cd7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd0155110 0x7fcfd0167310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.408+0000 7fcfd5cd7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfd01554e0 0x7fcfd01660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.408+0000 7fcfd5cd7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0158e90 con 0x7fcfd0155110 2023-10-06T04:40:12.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.408+0000 7fcfd5cd7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0168bd0 con 0x7fcfd00c6960 2023-10-06T04:40:12.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.408+0000 7fcfd5cd7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0164a70 con 0x7fcfd01554e0 2023-10-06T04:40:12.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.408+0000 7fcfc7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd0155110 0x7fcfd0167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.408+0000 7fcfc7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd0155110 0x7fcfd0167310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53444/0 (socket says 172.21.15.37:53444) 2023-10-06T04:40:12.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.408+0000 7fcfc7fff700 1 -- 172.21.15.37:0/676807968 learned_addr learned my addr 172.21.15.37:0/676807968 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:12.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfd54d6700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfd01554e0 0x7fcfd01660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfd4cd5700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfd00c6960 0x7fcfd0164530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfc7fff700 1 -- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfd01554e0 msgr2=0x7fcfd01660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfc7fff700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfd01554e0 0x7fcfd01660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfc7fff700 1 -- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfd00c6960 msgr2=0x7fcfd0164530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfc7fff700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfd00c6960 0x7fcfd0164530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfc7fff700 1 -- 172.21.15.37:0/676807968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc000a5d0 con 0x7fcfd0155110 2023-10-06T04:40:12.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfc7fff700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd0155110 0x7fcfd0167310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000c4d0 tx=0x7fcfc0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfc4ff9700 1 -- 172.21.15.37:0/676807968 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0018c70 con 0x7fcfd0155110 2023-10-06T04:40:12.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfc4ff9700 1 -- 172.21.15.37:0/676807968 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc0018df0 con 0x7fcfd0155110 2023-10-06T04:40:12.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/676807968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd0167850 con 0x7fcfd0155110 2023-10-06T04:40:12.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfc4ff9700 1 -- 172.21.15.37:0/676807968 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0022670 con 0x7fcfd0155110 2023-10-06T04:40:12.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/676807968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd0168070 con 0x7fcfd0155110 2023-10-06T04:40:12.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/676807968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd0168d80 con 0x7fcfd0155110 2023-10-06T04:40:12.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.412+0000 7fcfc4ff9700 1 -- 172.21.15.37:0/676807968 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcfc0020070 con 0x7fcfd0155110 2023-10-06T04:40:12.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.416+0000 7fcfc4ff9700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fcfbc060550 0x7fcfbc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.416+0000 7fcfc4ff9700 1 -- 172.21.15.37:0/676807968 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fcfc007d7f0 con 0x7fcfd0155110 2023-10-06T04:40:12.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.416+0000 7fcfd4cd5700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fcfbc060550 0x7fcfbc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.416+0000 7fcfd4cd5700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fcfbc060550 0x7fcfbc062a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0154030 tx=0x7fcfcc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.420+0000 7fcfc4ff9700 1 -- 172.21.15.37:0/676807968 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcfd0168d80 con 0x7fcfd0155110 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.644+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/676807968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fcfd0168d80 con 0x7fcfd0155110 2023-10-06T04:40:12.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.652+0000 7fcfc4ff9700 1 -- 172.21.15.37:0/676807968 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcfd0168d80 con 0x7fcfd0155110 2023-10-06T04:40:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.656+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fcfbc060550 msgr2=0x7fcfbc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.656+0000 7fcfd5cd7700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fcfbc060550 0x7fcfbc062a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0154030 tx=0x7fcfcc009040 comp rx=0 tx=0).stop 2023-10-06T04:40:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.656+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/676807968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd0155110 msgr2=0x7fcfd0167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.656+0000 7fcfd5cd7700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd0155110 0x7fcfd0167310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000c4d0 tx=0x7fcfc0019000 comp rx=0 tx=0).stop 2023-10-06T04:40:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.656+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/676807968 shutdown_connections 2023-10-06T04:40:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.656+0000 7fcfd5cd7700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fcfbc060550 0x7fcfbc062a00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.656+0000 7fcfd5cd7700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfd01554e0 0x7fcfd01660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.656+0000 7fcfd5cd7700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd0155110 0x7fcfd0167310 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.656+0000 7fcfd5cd7700 1 --2- 172.21.15.37:0/676807968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfd00c6960 0x7fcfd0164530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.656+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/676807968 >> 172.21.15.37:0/676807968 conn(0x7fcfd0068780 msgr2=0x7fcfd00c11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.656+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/676807968 shutdown_connections 2023-10-06T04:40:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.656+0000 7fcfd5cd7700 1 -- 172.21.15.37:0/676807968 wait complete. 2023-10-06T04:40:12.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.772+0000 7f1ebb208700 1 Processor -- start 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.772+0000 7f1ebb208700 1 -- start start 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1ebb208700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1eb40aded0 0x7f1eb4160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1ebb208700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb415a390 con 0x7f1eb40cc120 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1ebb208700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb41597c0 con 0x7f1eb40cbd50 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1ebb208700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb4159a60 con 0x7f1eb40aded0 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1eb3fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1eb40cc120 0x7f1eb415cb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48474/0 (socket says 172.21.15.37:48474) 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1eb3fff700 1 -- 172.21.15.37:0/3546398910 learned_addr learned my addr 172.21.15.37:0/3546398910 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1eb97a5700 1 --2- 172.21.15.37:0/3546398910 >> v2:172.21.15.83:3300/0 conn(0x7f1eb40aded0 0x7f1eb4160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1eb37fe700 1 -- 172.21.15.37:0/3546398910 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503217717 0 0) 0x7f1eb415a390 con 0x7f1eb40cc120 2023-10-06T04:40:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1eb37fe700 1 -- 172.21.15.37:0/3546398910 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea0003570 con 0x7f1eb40cc120 2023-10-06T04:40:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1eb97a5700 1 -- 172.21.15.37:0/3546398910 >> v1:172.21.15.83:6789/0 conn(0x7f1eb40cbd50 legacy=0x7f1eb40ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1eb97a5700 1 -- 172.21.15.37:0/3546398910 >> v1:172.21.15.37:6789/0 conn(0x7f1eb40cc120 legacy=0x7f1eb415cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1eb97a5700 1 -- 172.21.15.37:0/3546398910 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb4159d40 con 0x7f1eb40aded0 2023-10-06T04:40:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1eb97a5700 1 --2- 172.21.15.37:0/3546398910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb40aded0 0x7f1eb4160270 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009e90 tx=0x7f1eac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22560b7ef4c1b495 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1eb37fe700 1 -- 172.21.15.37:0/3546398910 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac00e070 con 0x7f1eb40aded0 2023-10-06T04:40:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1eb37fe700 1 -- 172.21.15.37:0/3546398910 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac00bc40 con 0x7f1eb40aded0 2023-10-06T04:40:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1eb37fe700 1 -- 172.21.15.37:0/3546398910 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac012430 con 0x7f1eb40aded0 2023-10-06T04:40:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1ebb208700 1 -- 172.21.15.37:0/3546398910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb40aded0 msgr2=0x7f1eb4160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1ebb208700 1 --2- 172.21.15.37:0/3546398910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb40aded0 0x7f1eb4160270 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009e90 tx=0x7f1eac009780 comp rx=0 tx=0).stop 2023-10-06T04:40:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1ebb208700 1 -- 172.21.15.37:0/3546398910 shutdown_connections 2023-10-06T04:40:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1ebb208700 1 --2- 172.21.15.37:0/3546398910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb40aded0 0x7f1eb4160270 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1ebb208700 1 -- 172.21.15.37:0/3546398910 >> 172.21.15.37:0/3546398910 conn(0x7f1eb40667b0 msgr2=0x7f1eb4066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1ebb208700 1 -- 172.21.15.37:0/3546398910 shutdown_connections 2023-10-06T04:40:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.776+0000 7f1ebb208700 1 -- 172.21.15.37:0/3546398910 wait complete. 2023-10-06T04:40:12.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1ebb208700 1 Processor -- start 2023-10-06T04:40:12.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1ebb208700 1 -- start start 2023-10-06T04:40:12.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1ebb208700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb40aded0 0x7f1eb4140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1ebb208700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb40cbd50 0x7f1eb40b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1ebb208700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1eb40cc120 0x7f1eb4148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1ebb208700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4140a50 con 0x7f1eb40cbd50 2023-10-06T04:40:12.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1ebb208700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb414ffe0 con 0x7f1eb40aded0 2023-10-06T04:40:12.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1ebb208700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb41502c0 con 0x7f1eb40cc120 2023-10-06T04:40:12.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb40cbd50 0x7f1eb40b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb8fa4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb40aded0 0x7f1eb4140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb40cbd50 0x7f1eb40b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53458/0 (socket says 172.21.15.37:53458) 2023-10-06T04:40:12.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb3fff700 1 -- 172.21.15.37:0/1478724635 learned_addr learned my addr 172.21.15.37:0/1478724635 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:12.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb97a5700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1eb40cc120 0x7f1eb4148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb8fa4700 1 -- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1eb40cc120 msgr2=0x7f1eb4148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb8fa4700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1eb40cc120 0x7f1eb4148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb8fa4700 1 -- 172.21.15.37:0/1478724635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb40cbd50 msgr2=0x7f1eb40b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb8fa4700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb40cbd50 0x7f1eb40b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb8fa4700 1 -- 172.21.15.37:0/1478724635 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac009a20 con 0x7f1eb40aded0 2023-10-06T04:40:12.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb3fff700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb40cbd50 0x7f1eb40b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:12.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb8fa4700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb40aded0 0x7f1eb4140510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400c590 tx=0x7f1ea4007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb0ff9700 1 -- 172.21.15.37:0/1478724635 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4011590 con 0x7f1eb40aded0 2023-10-06T04:40:12.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1eb0ff9700 1 -- 172.21.15.37:0/1478724635 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea4011710 con 0x7f1eb40aded0 2023-10-06T04:40:12.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.780+0000 7f1ebb208700 1 -- 172.21.15.37:0/1478724635 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb41505a0 con 0x7f1eb40aded0 2023-10-06T04:40:12.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.784+0000 7f1eb0ff9700 1 -- 172.21.15.37:0/1478724635 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4011ad0 con 0x7f1eb40aded0 2023-10-06T04:40:12.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.784+0000 7f1ebb208700 1 -- 172.21.15.37:0/1478724635 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb4150b60 con 0x7f1eb40aded0 2023-10-06T04:40:12.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.784+0000 7f1ebb208700 1 -- 172.21.15.37:0/1478724635 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb4070ee0 con 0x7f1eb40aded0 2023-10-06T04:40:12.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.784+0000 7f1eb0ff9700 1 -- 172.21.15.37:0/1478724635 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1ea401b3b0 con 0x7f1eb40aded0 2023-10-06T04:40:12.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.784+0000 7f1eb0ff9700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e94060580 0x7f1e94062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.784+0000 7f1eb0ff9700 1 -- 172.21.15.37:0/1478724635 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1ea407ba40 con 0x7f1eb40aded0 2023-10-06T04:40:12.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.784+0000 7f1eb3fff700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e94060580 0x7f1e94062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.788+0000 7f1eb3fff700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e94060580 0x7f1e94062a30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1eb41621d0 tx=0x7f1e9c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.796+0000 7f1eb0ff9700 1 -- 172.21.15.37:0/1478724635 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1ea407de60 con 0x7f1eb40aded0 2023-10-06T04:40:12.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:40:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.960+0000 7f1ebb208700 1 -- 172.21.15.37:0/1478724635 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1eb406e4a0 con 0x7f1eb40aded0 2023-10-06T04:40:12.967 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:40:12.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.960+0000 7f1eb0ff9700 1 -- 172.21.15.37:0/1478724635 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13807 (secure 0 0 0) 0x7f1ea404c0e0 con 0x7f1eb40aded0 2023-10-06T04:40:12.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:12.969 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:40:09.983349+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:12.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.964+0000 7f1ebb208700 1 -- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e94060580 msgr2=0x7f1e94062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.964+0000 7f1ebb208700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e94060580 0x7f1e94062a30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1eb41621d0 tx=0x7f1e9c009040 comp rx=0 tx=0).stop 2023-10-06T04:40:12.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.964+0000 7f1ebb208700 1 -- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb40aded0 msgr2=0x7f1eb4140510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.964+0000 7f1ebb208700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb40aded0 0x7f1eb4140510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400c590 tx=0x7f1ea4007ec0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.964+0000 7f1ebb208700 1 -- 172.21.15.37:0/1478724635 shutdown_connections 2023-10-06T04:40:12.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.964+0000 7f1ebb208700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e94060580 0x7f1e94062a30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.964+0000 7f1ebb208700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1eb40cc120 0x7f1eb4148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.964+0000 7f1ebb208700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb40cbd50 0x7f1eb40b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.964+0000 7f1ebb208700 1 --2- 172.21.15.37:0/1478724635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb40aded0 0x7f1eb4140510 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.964+0000 7f1ebb208700 1 -- 172.21.15.37:0/1478724635 >> 172.21.15.37:0/1478724635 conn(0x7f1eb40667b0 msgr2=0x7f1eb41525c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.964+0000 7f1ebb208700 1 -- 172.21.15.37:0/1478724635 shutdown_connections 2023-10-06T04:40:12.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:12.964+0000 7f1ebb208700 1 -- 172.21.15.37:0/1478724635 wait complete. 2023-10-06T04:40:12.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T04:40:12.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:40:13.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.092+0000 7fb3bb59e700 1 Processor -- start 2023-10-06T04:40:13.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.092+0000 7fb3bb59e700 1 -- start start 2023-10-06T04:40:13.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.092+0000 7fb3bb59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3bc150130 0x7fb3bc0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.092+0000 7fb3bb59e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3bc0c9360 con 0x7fb3bc155ed0 2023-10-06T04:40:13.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.092+0000 7fb3bb59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3bc156440 con 0x7fb3bc0cac40 2023-10-06T04:40:13.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.092+0000 7fb3bb59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc156720 con 0x7fb3bc150130 2023-10-06T04:40:13.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.092+0000 7fb3bad9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb3bc155ed0 0x7fb3bc0ad540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48484/0 (socket says 172.21.15.37:48484) 2023-10-06T04:40:13.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.092+0000 7fb3bad9d700 1 -- 172.21.15.37:0/3967118250 learned_addr learned my addr 172.21.15.37:0/3967118250 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:13.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b3fff700 1 --2- 172.21.15.37:0/3967118250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3bc150130 0x7fb3bc0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b9d9b700 1 -- 172.21.15.37:0/3967118250 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998830765 0 0) 0x7fb3bc0c9360 con 0x7fb3bc155ed0 2023-10-06T04:40:13.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b9d9b700 1 -- 172.21.15.37:0/3967118250 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3a8003570 con 0x7fb3bc155ed0 2023-10-06T04:40:13.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b9d9b700 1 -- 172.21.15.37:0/3967118250 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388897401 0 0) 0x7fb3bc156440 con 0x7fb3bc0cac40 2023-10-06T04:40:13.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b9d9b700 1 -- 172.21.15.37:0/3967118250 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3bc0c9360 con 0x7fb3bc0cac40 2023-10-06T04:40:13.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b3fff700 1 -- 172.21.15.37:0/3967118250 >> v1:172.21.15.83:6789/0 conn(0x7fb3bc0cac40 legacy=0x7fb3bc14fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b3fff700 1 -- 172.21.15.37:0/3967118250 >> v1:172.21.15.37:6789/0 conn(0x7fb3bc155ed0 legacy=0x7fb3bc0ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b3fff700 1 -- 172.21.15.37:0/3967118250 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc156a00 con 0x7fb3bc150130 2023-10-06T04:40:13.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b9d9b700 1 -- 172.21.15.37:0/3967118250 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2298554067 0 0) 0x7fb3a8003570 con 0x7fb3bc155ed0 2023-10-06T04:40:13.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b3fff700 1 --2- 172.21.15.37:0/3967118250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3bc150130 0x7fb3bc0cb010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009910 tx=0x7fb3a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c54af68ee3d98b8d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:13.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b9d9b700 1 -- 172.21.15.37:0/3967118250 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4011630 con 0x7fb3bc150130 2023-10-06T04:40:13.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b9d9b700 1 -- 172.21.15.37:0/3967118250 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a4011790 con 0x7fb3bc150130 2023-10-06T04:40:13.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3b9d9b700 1 -- 172.21.15.37:0/3967118250 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4011b30 con 0x7fb3bc150130 2023-10-06T04:40:13.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3bb59e700 1 -- 172.21.15.37:0/3967118250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3bc150130 msgr2=0x7fb3bc0cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3bb59e700 1 --2- 172.21.15.37:0/3967118250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3bc150130 0x7fb3bc0cb010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009910 tx=0x7fb3a40091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3bb59e700 1 -- 172.21.15.37:0/3967118250 shutdown_connections 2023-10-06T04:40:13.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3bb59e700 1 --2- 172.21.15.37:0/3967118250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3bc150130 0x7fb3bc0cb010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3bb59e700 1 -- 172.21.15.37:0/3967118250 >> 172.21.15.37:0/3967118250 conn(0x7fb3bc068760 msgr2=0x7fb3bc0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:13.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3bb59e700 1 -- 172.21.15.37:0/3967118250 shutdown_connections 2023-10-06T04:40:13.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.096+0000 7fb3bb59e700 1 -- 172.21.15.37:0/3967118250 wait complete. 2023-10-06T04:40:13.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3bb59e700 1 Processor -- start 2023-10-06T04:40:13.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3bb59e700 1 -- start start 2023-10-06T04:40:13.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3bb59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc0cac40 0x7fb3bc13b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3bb59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3bc150130 0x7fb3bc157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3bb59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3bc155ed0 0x7fb3bc1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3bb59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc0c28e0 con 0x7fb3bc0cac40 2023-10-06T04:40:13.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3bb59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc1587f0 con 0x7fb3bc150130 2023-10-06T04:40:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3bb59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc158ad0 con 0x7fb3bc155ed0 2023-10-06T04:40:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3ba59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc0cac40 0x7fb3bc13b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3ba59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc0cac40 0x7fb3bc13b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53468/0 (socket says 172.21.15.37:53468) 2023-10-06T04:40:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3ba59c700 1 -- 172.21.15.37:0/370176568 learned_addr learned my addr 172.21.15.37:0/370176568 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3b3fff700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3bc150130 0x7fb3bc157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3bad9d700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3bc155ed0 0x7fb3bc1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3ba59c700 1 -- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3bc155ed0 msgr2=0x7fb3bc1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3ba59c700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3bc155ed0 0x7fb3bc1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3ba59c700 1 -- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3bc150130 msgr2=0x7fb3bc157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3ba59c700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3bc150130 0x7fb3bc157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3ba59c700 1 -- 172.21.15.37:0/370176568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a4009420 con 0x7fb3bc0cac40 2023-10-06T04:40:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3bad9d700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3bc155ed0 0x7fb3bc1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3ba59c700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc0cac40 0x7fb3bc13b9e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00c790 tx=0x7fb3ac007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3b27fc700 1 -- 172.21.15.37:0/370176568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac010510 con 0x7fb3bc0cac40 2023-10-06T04:40:13.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3b27fc700 1 -- 172.21.15.37:0/370176568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac010670 con 0x7fb3bc0cac40 2023-10-06T04:40:13.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3bb59e700 1 -- 172.21.15.37:0/370176568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc0c2b50 con 0x7fb3bc0cac40 2023-10-06T04:40:13.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3b27fc700 1 -- 172.21.15.37:0/370176568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac010a30 con 0x7fb3bc0cac40 2023-10-06T04:40:13.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.100+0000 7fb3bb59e700 1 -- 172.21.15.37:0/370176568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc158430 con 0x7fb3bc0cac40 2023-10-06T04:40:13.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.104+0000 7fb3bb59e700 1 -- 172.21.15.37:0/370176568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3bc0c2d90 con 0x7fb3bc0cac40 2023-10-06T04:40:13.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.104+0000 7fb3b27fc700 1 -- 172.21.15.37:0/370176568 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb3ac01b3b0 con 0x7fb3bc0cac40 2023-10-06T04:40:13.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.104+0000 7fb3b27fc700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb39c060550 0x7fb39c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.104+0000 7fb3b27fc700 1 -- 172.21.15.37:0/370176568 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fb3ac07bfb0 con 0x7fb3bc0cac40 2023-10-06T04:40:13.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.104+0000 7fb3b3fff700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb39c060550 0x7fb39c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.108+0000 7fb3b3fff700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb39c060550 0x7fb39c062a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009860 tx=0x7fb3a4017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.116+0000 7fb3b27fc700 1 -- 172.21.15.37:0/370176568 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb3bc0c2d90 con 0x7fb3bc0cac40 2023-10-06T04:40:13.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.276+0000 7fb3bb59e700 1 -- 172.21.15.37:0/370176568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3bc0c2d90 con 0x7fb3bc0cac40 2023-10-06T04:40:13.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.276+0000 7fb3b27fc700 1 -- 172.21.15.37:0/370176568 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3bc0c2d90 con 0x7fb3bc0cac40 2023-10-06T04:40:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:40:13.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.280+0000 7fb3bb59e700 1 -- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb39c060550 msgr2=0x7fb39c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.280+0000 7fb3bb59e700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb39c060550 0x7fb39c062a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009860 tx=0x7fb3a4017000 comp rx=0 tx=0).stop 2023-10-06T04:40:13.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.280+0000 7fb3bb59e700 1 -- 172.21.15.37:0/370176568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc0cac40 msgr2=0x7fb3bc13b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.280+0000 7fb3bb59e700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc0cac40 0x7fb3bc13b9e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00c790 tx=0x7fb3ac007e10 comp rx=0 tx=0).stop 2023-10-06T04:40:13.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.280+0000 7fb3bb59e700 1 -- 172.21.15.37:0/370176568 shutdown_connections 2023-10-06T04:40:13.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.280+0000 7fb3bb59e700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb39c060550 0x7fb39c062a00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.280+0000 7fb3bb59e700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3bc150130 0x7fb3bc157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.280+0000 7fb3bb59e700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3bc155ed0 0x7fb3bc1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.280+0000 7fb3bb59e700 1 --2- 172.21.15.37:0/370176568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc0cac40 0x7fb3bc13b9e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.280+0000 7fb3bb59e700 1 -- 172.21.15.37:0/370176568 >> 172.21.15.37:0/370176568 conn(0x7fb3bc068760 msgr2=0x7fb3bc0696e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.280+0000 7fb3bb59e700 1 -- 172.21.15.37:0/370176568 shutdown_connections 2023-10-06T04:40:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.280+0000 7fb3bb59e700 1 -- 172.21.15.37:0/370176568 wait complete. 2023-10-06T04:40:13.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:40:13.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.400+0000 7f78c2359700 1 Processor -- start 2023-10-06T04:40:13.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.400+0000 7f78c2359700 1 -- start start 2023-10-06T04:40:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c2359700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f78bc069b40 0x7f78bc0b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c2359700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78bc1537d0 0x7f78bc0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c2359700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc0b5a60 con 0x7f78bc153400 2023-10-06T04:40:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c2359700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc0b4c60 con 0x7f78bc069b40 2023-10-06T04:40:13.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c2359700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc15a680 con 0x7f78bc1537d0 2023-10-06T04:40:13.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c08f6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78bc1537d0 0x7f78bc0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78bb7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f78bc069b40 0x7f78bc0b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c08f6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78bc1537d0 0x7f78bc0b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:50106/0 (socket says 172.21.15.37:50106) 2023-10-06T04:40:13.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c08f6700 1 -- 172.21.15.37:0/918736314 learned_addr learned my addr 172.21.15.37:0/918736314 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:13.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c08f6700 1 -- 172.21.15.37:0/918736314 >> v2:172.21.15.83:3300/0 conn(0x7f78bc069b40 msgr2=0x7f78bc0b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:13.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c08f6700 1 --2- 172.21.15.37:0/918736314 >> v2:172.21.15.83:3300/0 conn(0x7f78bc069b40 0x7f78bc0b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c08f6700 1 -- 172.21.15.37:0/918736314 >> v1:172.21.15.83:6789/0 conn(0x7f78bc153400 legacy=0x7f78bc069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c08f6700 1 -- 172.21.15.37:0/918736314 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc159950 con 0x7f78bc1537d0 2023-10-06T04:40:13.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78bb7fe700 1 --2- 172.21.15.37:0/918736314 >> v2:172.21.15.83:3300/0 conn(0x7f78bc069b40 0x7f78bc0b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:13.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c08f6700 1 --2- 172.21.15.37:0/918736314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78bc1537d0 0x7f78bc0b4720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009f20 tx=0x7f78b4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd757de783673ea8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:13.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78baffd700 1 -- 172.21.15.37:0/918736314 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b400e070 con 0x7f78bc1537d0 2023-10-06T04:40:13.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78baffd700 1 -- 172.21.15.37:0/918736314 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b400b9d0 con 0x7f78bc1537d0 2023-10-06T04:40:13.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78baffd700 1 -- 172.21.15.37:0/918736314 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b40092e0 con 0x7f78bc1537d0 2023-10-06T04:40:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c2359700 1 -- 172.21.15.37:0/918736314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78bc1537d0 msgr2=0x7f78bc0b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.404+0000 7f78c2359700 1 --2- 172.21.15.37:0/918736314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78bc1537d0 0x7f78bc0b4720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009f20 tx=0x7f78b4009840 comp rx=0 tx=0).stop 2023-10-06T04:40:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 -- 172.21.15.37:0/918736314 shutdown_connections 2023-10-06T04:40:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 --2- 172.21.15.37:0/918736314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78bc1537d0 0x7f78bc0b4720 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 --2- 172.21.15.37:0/918736314 >> v2:172.21.15.83:3300/0 conn(0x7f78bc069b40 0x7f78bc0b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 -- 172.21.15.37:0/918736314 >> 172.21.15.37:0/918736314 conn(0x7f78bc067cf0 msgr2=0x7f78bc0680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 -- 172.21.15.37:0/918736314 shutdown_connections 2023-10-06T04:40:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 -- 172.21.15.37:0/918736314 wait complete. 2023-10-06T04:40:13.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 Processor -- start 2023-10-06T04:40:13.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 -- start start 2023-10-06T04:40:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78bc069b40 0x7f78bc14ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78bc153400 0x7f78bc15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78bc1537d0 0x7f78bc15e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc14cc10 con 0x7f78bc069b40 2023-10-06T04:40:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc14d3e0 con 0x7f78bc153400 2023-10-06T04:40:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78c2359700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc169200 con 0x7f78bc1537d0 2023-10-06T04:40:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.408+0000 7f78bbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78bc069b40 0x7f78bc14ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78bbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78bc069b40 0x7f78bc14ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53470/0 (socket says 172.21.15.37:53470) 2023-10-06T04:40:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78bbfff700 1 -- 172.21.15.37:0/1566327393 learned_addr learned my addr 172.21.15.37:0/1566327393 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78c08f6700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78bc1537d0 0x7f78bc15e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78bb7fe700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78bc153400 0x7f78bc15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78bbfff700 1 -- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78bc1537d0 msgr2=0x7f78bc15e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78bbfff700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78bc1537d0 0x7f78bc15e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78bbfff700 1 -- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78bc153400 msgr2=0x7f78bc15e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78bbfff700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78bc153400 0x7f78bc15e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78bbfff700 1 -- 172.21.15.37:0/1566327393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac009420 con 0x7f78bc069b40 2023-10-06T04:40:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78bbfff700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78bc069b40 0x7f78bc14ba00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f78b000c590 tx=0x7f78b000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78a3fff700 1 -- 172.21.15.37:0/1566327393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0011590 con 0x7f78bc069b40 2023-10-06T04:40:13.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78a3fff700 1 -- 172.21.15.37:0/1566327393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b0011710 con 0x7f78bc069b40 2023-10-06T04:40:13.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78c2359700 1 -- 172.21.15.37:0/1566327393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b4009ae0 con 0x7f78bc069b40 2023-10-06T04:40:13.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78a3fff700 1 -- 172.21.15.37:0/1566327393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0011ad0 con 0x7f78bc069b40 2023-10-06T04:40:13.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78c2359700 1 -- 172.21.15.37:0/1566327393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc14ce20 con 0x7f78bc069b40 2023-10-06T04:40:13.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.412+0000 7f78c2359700 1 -- 172.21.15.37:0/1566327393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc070ee0 con 0x7f78bc069b40 2023-10-06T04:40:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.416+0000 7f78a3fff700 1 -- 172.21.15.37:0/1566327393 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f78b001b3b0 con 0x7f78bc069b40 2023-10-06T04:40:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.416+0000 7f78a3fff700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f78a8060550 0x7f78a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.416+0000 7f78a3fff700 1 -- 172.21.15.37:0/1566327393 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f78b007bb50 con 0x7f78bc069b40 2023-10-06T04:40:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.416+0000 7f78bb7fe700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f78a8060550 0x7f78a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.416+0000 7f78bb7fe700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f78a8060550 0x7f78a8062a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f78bc16c730 tx=0x7f78ac0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.424+0000 7f78a3fff700 1 -- 172.21.15.37:0/1566327393 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f78b004c150 con 0x7f78bc069b40 2023-10-06T04:40:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.584+0000 7f78c2359700 1 -- 172.21.15.37:0/1566327393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f78bc068870 con 0x7f78bc069b40 2023-10-06T04:40:13.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.584+0000 7f78a3fff700 1 -- 172.21.15.37:0/1566327393 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f78b0017020 con 0x7f78bc069b40 2023-10-06T04:40:13.592 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:40:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.588+0000 7f78c2359700 1 -- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f78a8060550 msgr2=0x7f78a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.588+0000 7f78c2359700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f78a8060550 0x7f78a8062a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f78bc16c730 tx=0x7f78ac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.588+0000 7f78c2359700 1 -- 172.21.15.37:0/1566327393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78bc069b40 msgr2=0x7f78bc14ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.588+0000 7f78c2359700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78bc069b40 0x7f78bc14ba00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f78b000c590 tx=0x7f78b000c8a0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.588+0000 7f78c2359700 1 -- 172.21.15.37:0/1566327393 shutdown_connections 2023-10-06T04:40:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.588+0000 7f78c2359700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f78a8060550 0x7f78a8062a00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.588+0000 7f78c2359700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78bc153400 0x7f78bc15e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.588+0000 7f78c2359700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78bc1537d0 0x7f78bc15e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.588+0000 7f78c2359700 1 --2- 172.21.15.37:0/1566327393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78bc069b40 0x7f78bc14ba00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.588+0000 7f78c2359700 1 -- 172.21.15.37:0/1566327393 >> 172.21.15.37:0/1566327393 conn(0x7f78bc067cf0 msgr2=0x7f78bc0b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.588+0000 7f78c2359700 1 -- 172.21.15.37:0/1566327393 shutdown_connections 2023-10-06T04:40:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.588+0000 7f78c2359700 1 -- 172.21.15.37:0/1566327393 wait complete. 2023-10-06T04:40:13.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:40:13.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c7fff700 1 Processor -- start 2023-10-06T04:40:13.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c7fff700 1 -- start start 2023-10-06T04:40:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c7fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c806d020 0x7f57c806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c7fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c80ce8b0 con 0x7f57c806a4a0 2023-10-06T04:40:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c7fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c8069860 con 0x7f57c80ce0d0 2023-10-06T04:40:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c7fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c8068f30 con 0x7f57c806d020 2023-10-06T04:40:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c67fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f57c806a4a0 0x7f57c8069cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48486/0 (socket says 172.21.15.37:48486) 2023-10-06T04:40:13.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c67fc700 1 -- 172.21.15.37:0/17981504 learned_addr learned my addr 172.21.15.37:0/17981504 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:13.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c6ffd700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c806d020 0x7f57c806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438444166 0 0) 0x7f57c80ce8b0 con 0x7f57c806a4a0 2023-10-06T04:40:13.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57b4003570 con 0x7f57c806a4a0 2023-10-06T04:40:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729915835 0 0) 0x7f57c8069860 con 0x7f57c80ce0d0 2023-10-06T04:40:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c80ce8b0 con 0x7f57c80ce0d0 2023-10-06T04:40:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 713094630 0 0) 0x7f57b4003570 con 0x7f57c806a4a0 2023-10-06T04:40:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c806d020 msgr2=0x7f57c806d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c806d020 0x7f57c806d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 >> v1:172.21.15.83:6789/0 conn(0x7f57c80ce0d0 legacy=0x7f57c8158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c8069210 con 0x7f57c806a4a0 2023-10-06T04:40:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f57b0001470 con 0x7f57c806a4a0 2023-10-06T04:40:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 >> v1:172.21.15.37:6789/0 conn(0x7f57c806a4a0 legacy=0x7f57c8069cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c806d020 0x7f57b4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b40041d0 0x7f57b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b4004d50 0x7f57b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c8068f30 con 0x7f57b4004d50 2023-10-06T04:40:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b400bbf0 con 0x7f57b40041d0 2023-10-06T04:40:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b400bdb0 con 0x7f57c806d020 2023-10-06T04:40:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c77fe700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b4004d50 0x7f57b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c6ffd700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c806d020 0x7f57b4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c67fc700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b40041d0 0x7f57b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c77fe700 1 -- 172.21.15.37:0/17981504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c806d020 msgr2=0x7f57b4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c77fe700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c806d020 0x7f57b4003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c77fe700 1 -- 172.21.15.37:0/17981504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b40041d0 msgr2=0x7f57b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c77fe700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b40041d0 0x7f57b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c77fe700 1 -- 172.21.15.37:0/17981504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4003570 con 0x7f57b4004d50 2023-10-06T04:40:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.708+0000 7f57c67fc700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b40041d0 0x7f57b4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c77fe700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b4004d50 0x7f57b40051c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f57c0002120 tx=0x7f57c00017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3414b671a7598a07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0001ab0 con 0x7f57b4004d50 2023-10-06T04:40:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c000c980 con 0x7f57b4004d50 2023-10-06T04:40:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c5ffb700 1 -- 172.21.15.37:0/17981504 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c000cd20 con 0x7f57b4004d50 2023-10-06T04:40:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 -- 172.21.15.37:0/17981504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b4004d50 msgr2=0x7f57b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 --2- 172.21.15.37:0/17981504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b4004d50 0x7f57b40051c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f57c0002120 tx=0x7f57c00017a0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c77fe700 1 -- 172.21.15.37:0/17981504 reap_dead start 2023-10-06T04:40:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 -- 172.21.15.37:0/17981504 shutdown_connections 2023-10-06T04:40:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 -- 172.21.15.37:0/17981504 >> 172.21.15.37:0/17981504 conn(0x7f57c806c2d0 msgr2=0x7f57c80cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 -- 172.21.15.37:0/17981504 shutdown_connections 2023-10-06T04:40:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 -- 172.21.15.37:0/17981504 wait complete. 2023-10-06T04:40:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 Processor -- start 2023-10-06T04:40:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 -- start start 2023-10-06T04:40:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57c80af930 0x7f57c80afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c816a560 0x7f57c816aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c814fb60 0x7f57c814d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c816afe0 con 0x7f57c816a560 2023-10-06T04:40:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c8150530 con 0x7f57c80af930 2023-10-06T04:40:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c7fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80b1530 con 0x7f57c814fb60 2023-10-06T04:40:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c816a560 0x7f57c816aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c816a560 0x7f57c816aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53480/0 (socket says 172.21.15.37:53480) 2023-10-06T04:40:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c67fc700 1 -- 172.21.15.37:0/1039796746 learned_addr learned my addr 172.21.15.37:0/1039796746 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c77fe700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c814fb60 0x7f57c814d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.712+0000 7f57c6ffd700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57c80af930 0x7f57c80afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57c67fc700 1 -- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c814fb60 msgr2=0x7f57c814d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57c67fc700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c814fb60 0x7f57c814d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57c67fc700 1 -- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57c80af930 msgr2=0x7f57c80afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57c67fc700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57c80af930 0x7f57c80afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57c67fc700 1 -- 172.21.15.37:0/1039796746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c80b1810 con 0x7f57c816a560 2023-10-06T04:40:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57c67fc700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c816a560 0x7f57c816aaa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f57b0000ff0 tx=0x7f57b0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57beffd700 1 -- 172.21.15.37:0/1039796746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0010490 con 0x7f57c816a560 2023-10-06T04:40:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57beffd700 1 -- 172.21.15.37:0/1039796746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b0010040 con 0x7f57c816a560 2023-10-06T04:40:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57beffd700 1 -- 172.21.15.37:0/1039796746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0010820 con 0x7f57c816a560 2023-10-06T04:40:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57c7fff700 1 -- 172.21.15.37:0/1039796746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c80b1af0 con 0x7f57c816a560 2023-10-06T04:40:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57c7fff700 1 -- 172.21.15.37:0/1039796746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c814ffd0 con 0x7f57c816a560 2023-10-06T04:40:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57c7fff700 1 -- 172.21.15.37:0/1039796746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c80b1ff0 con 0x7f57c816a560 2023-10-06T04:40:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57beffd700 1 -- 172.21.15.37:0/1039796746 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f57b0010bd0 con 0x7f57c816a560 2023-10-06T04:40:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57beffd700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f57a8060580 0x7f57a8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.716+0000 7f57beffd700 1 -- 172.21.15.37:0/1039796746 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f57b007b5e0 con 0x7f57c816a560 2023-10-06T04:40:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.720+0000 7f57c6ffd700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f57a8060580 0x7f57a8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.720+0000 7f57c6ffd700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f57a8060580 0x7f57a8062a30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f57c80c5270 tx=0x7f57b80091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:13.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.724+0000 7f57beffd700 1 -- 172.21.15.37:0/1039796746 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f57b004abe0 con 0x7f57c816a560 2023-10-06T04:40:13.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57c7fff700 1 -- 172.21.15.37:0/1039796746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f57c80708a0 con 0x7f57c816a560 2023-10-06T04:40:13.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57beffd700 1 -- 172.21.15.37:0/1039796746 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) v1 ==== 84+0+126 (secure 0 0 0) 0x7f57b0019090 con 0x7f57c816a560 2023-10-06T04:40:13.898 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:13.898 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-10-06T04:40:13.898 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:13.898 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-10-06T04:40:13.899 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-10-06T04:40:13.899 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:13.899 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:13.899 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-10-06T04:40:13.899 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-10-06T04:40:13.899 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:13.900 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-10-06T04:40:13.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57c7fff700 1 -- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f57a8060580 msgr2=0x7f57a8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57c7fff700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f57a8060580 0x7f57a8062a30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f57c80c5270 tx=0x7f57b80091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57c7fff700 1 -- 172.21.15.37:0/1039796746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c816a560 msgr2=0x7f57c816aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57c7fff700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c816a560 0x7f57c816aaa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f57b0000ff0 tx=0x7f57b0001120 comp rx=0 tx=0).stop 2023-10-06T04:40:13.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57c7fff700 1 -- 172.21.15.37:0/1039796746 shutdown_connections 2023-10-06T04:40:13.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57c7fff700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f57a8060580 0x7f57a8062a30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57c7fff700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57c814fb60 0x7f57c814d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57c7fff700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c816a560 0x7f57c816aaa0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57c7fff700 1 --2- 172.21.15.37:0/1039796746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57c80af930 0x7f57c80afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57c7fff700 1 -- 172.21.15.37:0/1039796746 >> 172.21.15.37:0/1039796746 conn(0x7f57c806c2d0 msgr2=0x7f57c80c9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.892+0000 7f57c7fff700 1 -- 172.21.15.37:0/1039796746 shutdown_connections 2023-10-06T04:40:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:13.896+0000 7f57c7fff700 1 -- 172.21.15.37:0/1039796746 wait complete. 2023-10-06T04:40:13.912 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:40:13.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:40:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.020+0000 7f88d655c700 1 Processor -- start 2023-10-06T04:40:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.020+0000 7f88d655c700 1 -- start start 2023-10-06T04:40:14.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.020+0000 7f88d655c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88d00af000 0x7f88d00cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:14.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.020+0000 7f88d655c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d00ce950 con 0x7f88d00aec30 2023-10-06T04:40:14.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d655c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d00ce060 con 0x7f88d00cad00 2023-10-06T04:40:14.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d655c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00ce300 con 0x7f88d00af000 2023-10-06T04:40:14.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88cffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f88d00aec30 0x7f88d00af750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48490/0 (socket says 172.21.15.37:48490) 2023-10-06T04:40:14.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88cffff700 1 -- 172.21.15.37:0/789611036 learned_addr learned my addr 172.21.15.37:0/789611036 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d4af9700 1 --2- 172.21.15.37:0/789611036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88d00af000 0x7f88d00cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88ceffd700 1 -- 172.21.15.37:0/789611036 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498461995 0 0) 0x7f88d00ce950 con 0x7f88d00aec30 2023-10-06T04:40:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88ceffd700 1 -- 172.21.15.37:0/789611036 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88bc003570 con 0x7f88d00aec30 2023-10-06T04:40:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88ceffd700 1 -- 172.21.15.37:0/789611036 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700816823 0 0) 0x7f88d00ce060 con 0x7f88d00cad00 2023-10-06T04:40:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88ceffd700 1 -- 172.21.15.37:0/789611036 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88d00ce950 con 0x7f88d00cad00 2023-10-06T04:40:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d4af9700 1 -- 172.21.15.37:0/789611036 >> v1:172.21.15.83:6789/0 conn(0x7f88d00cad00 legacy=0x7f88d015d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d4af9700 1 -- 172.21.15.37:0/789611036 >> v1:172.21.15.37:6789/0 conn(0x7f88d00aec30 legacy=0x7f88d00af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d4af9700 1 -- 172.21.15.37:0/789611036 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d00ce5e0 con 0x7f88d00af000 2023-10-06T04:40:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d4af9700 1 --2- 172.21.15.37:0/789611036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88d00af000 0x7f88d00cc6e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009e90 tx=0x7f88c8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a8639499a1f3351 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88ceffd700 1 -- 172.21.15.37:0/789611036 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c800e070 con 0x7f88d00af000 2023-10-06T04:40:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88ceffd700 1 -- 172.21.15.37:0/789611036 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c800bc10 con 0x7f88d00af000 2023-10-06T04:40:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88ceffd700 1 -- 172.21.15.37:0/789611036 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8012430 con 0x7f88d00af000 2023-10-06T04:40:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d655c700 1 -- 172.21.15.37:0/789611036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88d00af000 msgr2=0x7f88d00cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d655c700 1 --2- 172.21.15.37:0/789611036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88d00af000 0x7f88d00cc6e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009e90 tx=0x7f88c8009780 comp rx=0 tx=0).stop 2023-10-06T04:40:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d655c700 1 -- 172.21.15.37:0/789611036 shutdown_connections 2023-10-06T04:40:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d655c700 1 --2- 172.21.15.37:0/789611036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88d00af000 0x7f88d00cc6e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d655c700 1 -- 172.21.15.37:0/789611036 >> 172.21.15.37:0/789611036 conn(0x7f88d0067cf0 msgr2=0x7f88d00680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d655c700 1 -- 172.21.15.37:0/789611036 shutdown_connections 2023-10-06T04:40:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.024+0000 7f88d655c700 1 -- 172.21.15.37:0/789611036 wait complete. 2023-10-06T04:40:14.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88d655c700 1 Processor -- start 2023-10-06T04:40:14.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88d655c700 1 -- start start 2023-10-06T04:40:14.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88d655c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00aec30 0x7f88d0154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:14.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88d655c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88d00af000 0x7f88d00c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:14.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88d655c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d00cad00 0x7f88d0147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:14.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88d655c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0147d50 con 0x7f88d00aec30 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88d655c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0158610 con 0x7f88d00cad00 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88d655c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0157a00 con 0x7f88d00af000 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88cffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00aec30 0x7f88d0154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88cffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00aec30 0x7f88d0154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53492/0 (socket says 172.21.15.37:53492) 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88cffff700 1 -- 172.21.15.37:0/3380735622 learned_addr learned my addr 172.21.15.37:0/3380735622 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88cf7fe700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88d00af000 0x7f88d00c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88d4af9700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d00cad00 0x7f88d0147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88cffff700 1 -- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88d00af000 msgr2=0x7f88d00c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88cffff700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88d00af000 0x7f88d00c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88cffff700 1 -- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d00cad00 msgr2=0x7f88d0147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88cffff700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d00cad00 0x7f88d0147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88cffff700 1 -- 172.21.15.37:0/3380735622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c8009a20 con 0x7f88d00aec30 2023-10-06T04:40:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88cf7fe700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88d00af000 0x7f88d00c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:14.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.028+0000 7f88cffff700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00aec30 0x7f88d0154730 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f88b800c790 tx=0x7f88b8007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:14.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.032+0000 7f88c7fff700 1 -- 172.21.15.37:0/3380735622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8005b30 con 0x7f88d00aec30 2023-10-06T04:40:14.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.032+0000 7f88c7fff700 1 -- 172.21.15.37:0/3380735622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8005cd0 con 0x7f88d00aec30 2023-10-06T04:40:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.032+0000 7f88d655c700 1 -- 172.21.15.37:0/3380735622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d0157ce0 con 0x7f88d00aec30 2023-10-06T04:40:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.032+0000 7f88c7fff700 1 -- 172.21.15.37:0/3380735622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8007320 con 0x7f88d00aec30 2023-10-06T04:40:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.032+0000 7f88d655c700 1 -- 172.21.15.37:0/3380735622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d01582a0 con 0x7f88d00aec30 2023-10-06T04:40:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.032+0000 7f88d655c700 1 -- 172.21.15.37:0/3380735622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d004be00 con 0x7f88d00aec30 2023-10-06T04:40:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.032+0000 7f88c7fff700 1 -- 172.21.15.37:0/3380735622 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f88b8012400 con 0x7f88d00aec30 2023-10-06T04:40:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.032+0000 7f88c7fff700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f88b0060550 0x7f88b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.032+0000 7f88c7fff700 1 -- 172.21.15.37:0/3380735622 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f88b807ba10 con 0x7f88d00aec30 2023-10-06T04:40:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.032+0000 7f88cf7fe700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f88b0060550 0x7f88b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.036+0000 7f88cf7fe700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f88b0060550 0x7f88b0062a00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f88d00c7680 tx=0x7f88c0007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.040+0000 7f88c7fff700 1 -- 172.21.15.37:0/3380735622 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f88b8049be0 con 0x7f88d00aec30 2023-10-06T04:40:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:14.204+0000 7f88d655c700 1 -- 172.21.15.37:0/3380735622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f88d00af430 con 0x7f88d00aec30 2023-10-06T04:40:15.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.016+0000 7f88c7fff700 1 -- 172.21.15.37:0/3380735622 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f88b80170b0 con 0x7f88d00aec30 2023-10-06T04:40:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.020+0000 7f88d655c700 1 -- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f88b0060550 msgr2=0x7f88b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.020+0000 7f88d655c700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f88b0060550 0x7f88b0062a00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f88d00c7680 tx=0x7f88c0007d50 comp rx=0 tx=0).stop 2023-10-06T04:40:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.020+0000 7f88d655c700 1 -- 172.21.15.37:0/3380735622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00aec30 msgr2=0x7f88d0154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.020+0000 7f88d655c700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00aec30 0x7f88d0154730 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f88b800c790 tx=0x7f88b8007e80 comp rx=0 tx=0).stop 2023-10-06T04:40:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.020+0000 7f88d655c700 1 -- 172.21.15.37:0/3380735622 shutdown_connections 2023-10-06T04:40:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.020+0000 7f88d655c700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f88b0060550 0x7f88b0062a00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.020+0000 7f88d655c700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d00cad00 0x7f88d0147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.020+0000 7f88d655c700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88d00af000 0x7f88d00c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.020+0000 7f88d655c700 1 --2- 172.21.15.37:0/3380735622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00aec30 0x7f88d0154730 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.020+0000 7f88d655c700 1 -- 172.21.15.37:0/3380735622 >> 172.21.15.37:0/3380735622 conn(0x7f88d0067cf0 msgr2=0x7f88d00c4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:15.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.024+0000 7f88d655c700 1 -- 172.21.15.37:0/3380735622 shutdown_connections 2023-10-06T04:40:15.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.024+0000 7f88d655c700 1 -- 172.21.15.37:0/3380735622 wait complete. 2023-10-06T04:40:15.030 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-10-06T04:40:15.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:40:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.152+0000 7f6d94b74700 1 Processor -- start 2023-10-06T04:40:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.152+0000 7f6d94b74700 1 -- start start 2023-10-06T04:40:15.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d94b74700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6d900c9bd0 0x7f6d90158c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:15.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d94b74700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9006a620 con 0x7f6d900c6c30 2023-10-06T04:40:15.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d94b74700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9006f100 con 0x7f6d90159170 2023-10-06T04:40:15.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d94b74700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d900aedc0 con 0x7f6d900c9bd0 2023-10-06T04:40:15.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6d900c6c30 0x7f6d900c7000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48496/0 (socket says 172.21.15.37:48496) 2023-10-06T04:40:15.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8f7fe700 1 -- 172.21.15.37:0/515368774 learned_addr learned my addr 172.21.15.37:0/515368774 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:15.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8effd700 1 --2- 172.21.15.37:0/515368774 >> v2:172.21.15.83:3300/0 conn(0x7f6d900c9bd0 0x7f6d90158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:15.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143827135 0 0) 0x7f6d9006a620 con 0x7f6d900c6c30 2023-10-06T04:40:15.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d78003570 con 0x7f6d900c6c30 2023-10-06T04:40:15.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473639945 0 0) 0x7f6d9006f100 con 0x7f6d90159170 2023-10-06T04:40:15.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d9006a620 con 0x7f6d90159170 2023-10-06T04:40:15.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2117254427 0 0) 0x7f6d78003570 con 0x7f6d900c6c30 2023-10-06T04:40:15.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 >> v2:172.21.15.83:3300/0 conn(0x7f6d900c9bd0 msgr2=0x7f6d90158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:15.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 --2- 172.21.15.37:0/515368774 >> v2:172.21.15.83:3300/0 conn(0x7f6d900c9bd0 0x7f6d90158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 >> v1:172.21.15.83:6789/0 conn(0x7f6d90159170 legacy=0x7f6d9006aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:15.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d900c7ae0 con 0x7f6d900c6c30 2023-10-06T04:40:15.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f6d84001470 con 0x7f6d900c6c30 2023-10-06T04:40:15.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 >> v1:172.21.15.37:6789/0 conn(0x7f6d900c6c30 legacy=0x7f6d900c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:15.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d78003bf0 0x7f6d78003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:15.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 0x7f6d78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:15.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d780051c0 0x7f6d7800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:15.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900aedc0 con 0x7f6d78004810 2023-10-06T04:40:15.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7800c160 con 0x7f6d780051c0 2023-10-06T04:40:15.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7800c320 con 0x7f6d78003bf0 2023-10-06T04:40:15.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8effd700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 0x7f6d78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:15.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8f7fe700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d78003bf0 0x7f6d78003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:15.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8ffff700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d780051c0 0x7f6d7800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:15.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8effd700 1 -- 172.21.15.37:0/515368774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d78003bf0 msgr2=0x7f6d78003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:15.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8effd700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d78003bf0 0x7f6d78003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8effd700 1 -- 172.21.15.37:0/515368774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d780051c0 msgr2=0x7f6d7800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:15.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8effd700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d780051c0 0x7f6d7800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8effd700 1 -- 172.21.15.37:0/515368774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78003570 con 0x7f6d78004810 2023-10-06T04:40:15.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8f7fe700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d78003bf0 0x7f6d78003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:15.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8ffff700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d780051c0 0x7f6d7800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:15.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8ffff700 1 -- 172.21.15.37:0/515368774 reap_dead start 2023-10-06T04:40:15.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8effd700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 0x7f6d78004c80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6d800094d0 tx=0x7f6d8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735acb2bce37fd4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:15.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000ea90 con 0x7f6d78004810 2023-10-06T04:40:15.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000f040 con 0x7f6d78004810 2023-10-06T04:40:15.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d8e7fc700 1 -- 172.21.15.37:0/515368774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000ee40 con 0x7f6d78004810 2023-10-06T04:40:15.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d94b74700 1 -- 172.21.15.37:0/515368774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 msgr2=0x7f6d78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:15.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.156+0000 7f6d94b74700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 0x7f6d78004c80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6d800094d0 tx=0x7f6d8000b040 comp rx=0 tx=0).stop 2023-10-06T04:40:15.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.160+0000 7f6d94b74700 1 -- 172.21.15.37:0/515368774 shutdown_connections 2023-10-06T04:40:15.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.160+0000 7f6d94b74700 1 --2- 172.21.15.37:0/515368774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 0x7f6d78004c80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.160+0000 7f6d94b74700 1 -- 172.21.15.37:0/515368774 >> 172.21.15.37:0/515368774 conn(0x7f6d900cc000 msgr2=0x7f6d900cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:15.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.160+0000 7f6d94b74700 1 -- 172.21.15.37:0/515368774 shutdown_connections 2023-10-06T04:40:15.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.160+0000 7f6d94b74700 1 -- 172.21.15.37:0/515368774 wait complete. 2023-10-06T04:40:15.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.160+0000 7f6d94b74700 1 Processor -- start 2023-10-06T04:40:15.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.160+0000 7f6d94b74700 1 -- start start 2023-10-06T04:40:15.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d94b74700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 0x7f6d900b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:15.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d94b74700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d901539a0 0x7f6d9015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:15.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d94b74700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d900c0fc0 0x7f6d900c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:15.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d94b74700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9016a040 con 0x7f6d78004810 2023-10-06T04:40:15.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d94b74700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900c1950 con 0x7f6d900c0fc0 2023-10-06T04:40:15.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d94b74700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d901693c0 con 0x7f6d901539a0 2023-10-06T04:40:15.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d8f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 0x7f6d900b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:15.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d8f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 0x7f6d900b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53522/0 (socket says 172.21.15.37:53522) 2023-10-06T04:40:15.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d8f7fe700 1 -- 172.21.15.37:0/1561395340 learned_addr learned my addr 172.21.15.37:0/1561395340 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:15.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d8ffff700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d900c0fc0 0x7f6d900c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:15.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d8effd700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d901539a0 0x7f6d9015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:15.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d8f7fe700 1 -- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d901539a0 msgr2=0x7f6d9015f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:15.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d8f7fe700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d901539a0 0x7f6d9015f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d8f7fe700 1 -- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d900c0fc0 msgr2=0x7f6d900c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:15.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d8f7fe700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d900c0fc0 0x7f6d900c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d8f7fe700 1 -- 172.21.15.37:0/1561395340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d901696a0 con 0x7f6d78004810 2023-10-06T04:40:15.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d8f7fe700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 0x7f6d900b18c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400db80 tx=0x7f6d84009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:15.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d777fe700 1 -- 172.21.15.37:0/1561395340 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84007150 con 0x7f6d78004810 2023-10-06T04:40:15.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d777fe700 1 -- 172.21.15.37:0/1561395340 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d840072b0 con 0x7f6d78004810 2023-10-06T04:40:15.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d94b74700 1 -- 172.21.15.37:0/1561395340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d90169980 con 0x7f6d78004810 2023-10-06T04:40:15.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d777fe700 1 -- 172.21.15.37:0/1561395340 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84007650 con 0x7f6d78004810 2023-10-06T04:40:15.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.164+0000 7f6d94b74700 1 -- 172.21.15.37:0/1561395340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d900b1e00 con 0x7f6d78004810 2023-10-06T04:40:15.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.168+0000 7f6d94b74700 1 -- 172.21.15.37:0/1561395340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9004be00 con 0x7f6d78004810 2023-10-06T04:40:15.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.168+0000 7f6d777fe700 1 -- 172.21.15.37:0/1561395340 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6d84004a40 con 0x7f6d78004810 2023-10-06T04:40:15.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.168+0000 7f6d777fe700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6d7c060550 0x7f6d7c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:15.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.168+0000 7f6d777fe700 1 -- 172.21.15.37:0/1561395340 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f6d8407c2f0 con 0x7f6d78004810 2023-10-06T04:40:15.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.168+0000 7f6d8effd700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6d7c060550 0x7f6d7c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:15.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.168+0000 7f6d8effd700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6d7c060550 0x7f6d7c062a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000afd0 tx=0x7f6d8001a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.176+0000 7f6d777fe700 1 -- 172.21.15.37:0/1561395340 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6d8404bbe0 con 0x7f6d78004810 2023-10-06T04:40:15.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:15.340+0000 7f6d94b74700 1 -- 172.21.15.37:0/1561395340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6d900c0da0 con 0x7f6d78004810 2023-10-06T04:40:16.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.028+0000 7f6d777fe700 1 -- 172.21.15.37:0/1561395340 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v40) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6d8404c8b0 con 0x7f6d78004810 2023-10-06T04:40:16.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.040+0000 7f6d94b74700 1 -- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6d7c060550 msgr2=0x7f6d7c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.040+0000 7f6d94b74700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6d7c060550 0x7f6d7c062a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000afd0 tx=0x7f6d8001a000 comp rx=0 tx=0).stop 2023-10-06T04:40:16.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.044+0000 7f6d94b74700 1 -- 172.21.15.37:0/1561395340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 msgr2=0x7f6d900b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.044+0000 7f6d94b74700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 0x7f6d900b18c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400db80 tx=0x7f6d84009040 comp rx=0 tx=0).stop 2023-10-06T04:40:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.044+0000 7f6d94b74700 1 -- 172.21.15.37:0/1561395340 shutdown_connections 2023-10-06T04:40:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.044+0000 7f6d94b74700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6d7c060550 0x7f6d7c062a00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.044+0000 7f6d94b74700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d900c0fc0 0x7f6d900c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.044+0000 7f6d94b74700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d901539a0 0x7f6d9015f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.044+0000 7f6d94b74700 1 --2- 172.21.15.37:0/1561395340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d78004810 0x7f6d900b18c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.044+0000 7f6d94b74700 1 -- 172.21.15.37:0/1561395340 >> 172.21.15.37:0/1561395340 conn(0x7f6d900cc000 msgr2=0x7f6d901580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.044+0000 7f6d94b74700 1 -- 172.21.15.37:0/1561395340 shutdown_connections 2023-10-06T04:40:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.044+0000 7f6d94b74700 1 -- 172.21.15.37:0/1561395340 wait complete. 2023-10-06T04:40:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-10-06T04:40:16.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:40:16.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.168+0000 7f4c221c8700 1 Processor -- start 2023-10-06T04:40:16.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.168+0000 7f4c221c8700 1 -- start start 2023-10-06T04:40:16.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4c1c156800 0x7f4c1c0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4c1c0b36b0 0x7f4c1c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c1c156bd0 0x7f4c1c06d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0cd490 con 0x7f4c1c0b36b0 2023-10-06T04:40:16.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0cc880 con 0x7f4c1c156800 2023-10-06T04:40:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0ccb60 con 0x7f4c1c156bd0 2023-10-06T04:40:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c209c5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4c1c0b36b0 0x7f4c1c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c209c5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4c1c0b36b0 0x7f4c1c06cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53524/0 (socket says 172.21.15.37:53524) 2023-10-06T04:40:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c209c5700 1 -- 172.21.15.37:0/2636161727 learned_addr learned my addr 172.21.15.37:0/2636161727 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c211c6700 1 --2- 172.21.15.37:0/2636161727 >> v2:172.21.15.83:3300/0 conn(0x7f4c1c156800 0x7f4c1c0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c219c7700 1 --2- 172.21.15.37:0/2636161727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c1c156bd0 0x7f4c1c06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c209c5700 1 -- 172.21.15.37:0/2636161727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c1c156bd0 msgr2=0x7f4c1c06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:16.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c209c5700 1 --2- 172.21.15.37:0/2636161727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c1c156bd0 0x7f4c1c06d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c209c5700 1 -- 172.21.15.37:0/2636161727 >> v2:172.21.15.83:3300/0 conn(0x7f4c1c156800 msgr2=0x7f4c1c0b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c209c5700 1 --2- 172.21.15.37:0/2636161727 >> v2:172.21.15.83:3300/0 conn(0x7f4c1c156800 0x7f4c1c0b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c209c5700 1 -- 172.21.15.37:0/2636161727 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0cce40 con 0x7f4c1c0b36b0 2023-10-06T04:40:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c211c6700 1 --2- 172.21.15.37:0/2636161727 >> v2:172.21.15.83:3300/0 conn(0x7f4c1c156800 0x7f4c1c0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c219c7700 1 --2- 172.21.15.37:0/2636161727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c1c156bd0 0x7f4c1c06d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c209c5700 1 --2- 172.21.15.37:0/2636161727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c1c0b36b0 0x7f4c1c06cdd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c068af0 tx=0x7f4c10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9875aa5e4a9d85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c0ffff700 1 -- 172.21.15.37:0/2636161727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000b640 con 0x7f4c1c0b36b0 2023-10-06T04:40:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c0ffff700 1 -- 172.21.15.37:0/2636161727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1000b7a0 con 0x7f4c1c0b36b0 2023-10-06T04:40:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c0ffff700 1 -- 172.21.15.37:0/2636161727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000bb60 con 0x7f4c1c0b36b0 2023-10-06T04:40:16.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 -- 172.21.15.37:0/2636161727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c1c0b36b0 msgr2=0x7f4c1c06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 --2- 172.21.15.37:0/2636161727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c1c0b36b0 0x7f4c1c06cdd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c068af0 tx=0x7f4c10009250 comp rx=0 tx=0).stop 2023-10-06T04:40:16.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 -- 172.21.15.37:0/2636161727 shutdown_connections 2023-10-06T04:40:16.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 --2- 172.21.15.37:0/2636161727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c1c156bd0 0x7f4c1c06d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 --2- 172.21.15.37:0/2636161727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c1c0b36b0 0x7f4c1c06cdd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 --2- 172.21.15.37:0/2636161727 >> v2:172.21.15.83:3300/0 conn(0x7f4c1c156800 0x7f4c1c0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 -- 172.21.15.37:0/2636161727 >> 172.21.15.37:0/2636161727 conn(0x7f4c1c0ce400 msgr2=0x7f4c1c0af390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:16.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 -- 172.21.15.37:0/2636161727 shutdown_connections 2023-10-06T04:40:16.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.172+0000 7f4c221c8700 1 -- 172.21.15.37:0/2636161727 wait complete. 2023-10-06T04:40:16.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c221c8700 1 Processor -- start 2023-10-06T04:40:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c221c8700 1 -- start start 2023-10-06T04:40:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c221c8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c1c156800 0x7f4c1c168dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c221c8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c1c156bd0 0x7f4c1c16bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c221c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c1c158440 0x7f4c1c1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c221c8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c169300 con 0x7f4c1c158440 2023-10-06T04:40:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c221c8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c069cf0 con 0x7f4c1c156bd0 2023-10-06T04:40:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c221c8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c16c160 con 0x7f4c1c156800 2023-10-06T04:40:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c219c7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c1c158440 0x7f4c1c1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c209c5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c1c156bd0 0x7f4c1c16bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c219c7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c1c158440 0x7f4c1c1570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53530/0 (socket says 172.21.15.37:53530) 2023-10-06T04:40:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c219c7700 1 -- 172.21.15.37:0/4291456319 learned_addr learned my addr 172.21.15.37:0/4291456319 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c211c6700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c1c156800 0x7f4c1c168dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c219c7700 1 -- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c1c156800 msgr2=0x7f4c1c168dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c219c7700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c1c156800 0x7f4c1c168dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c219c7700 1 -- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c1c156bd0 msgr2=0x7f4c1c16bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c219c7700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c1c156bd0 0x7f4c1c16bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c219c7700 1 -- 172.21.15.37:0/4291456319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c18009420 con 0x7f4c1c158440 2023-10-06T04:40:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c209c5700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c1c156bd0 0x7f4c1c16bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c219c7700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c1c158440 0x7f4c1c1570a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009f20 tx=0x7f4c1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c0d7fa700 1 -- 172.21.15.37:0/4291456319 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1400cb70 con 0x7f4c1c158440 2023-10-06T04:40:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c0d7fa700 1 -- 172.21.15.37:0/4291456319 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1400f040 con 0x7f4c1c158440 2023-10-06T04:40:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c221c8700 1 -- 172.21.15.37:0/4291456319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c14009a20 con 0x7f4c1c158440 2023-10-06T04:40:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c0d7fa700 1 -- 172.21.15.37:0/4291456319 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c14014480 con 0x7f4c1c158440 2023-10-06T04:40:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.176+0000 7f4c221c8700 1 -- 172.21.15.37:0/4291456319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c100094f0 con 0x7f4c1c158440 2023-10-06T04:40:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.180+0000 7f4c221c8700 1 -- 172.21.15.37:0/4291456319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c069e80 con 0x7f4c1c158440 2023-10-06T04:40:16.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.180+0000 7f4c0d7fa700 1 -- 172.21.15.37:0/4291456319 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4c14003020 con 0x7f4c1c158440 2023-10-06T04:40:16.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.180+0000 7f4c0d7fa700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4c00060550 0x7f4c00062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.180+0000 7f4c0d7fa700 1 -- 172.21.15.37:0/4291456319 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f4c1407d300 con 0x7f4c1c158440 2023-10-06T04:40:16.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.180+0000 7f4c211c6700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4c00060550 0x7f4c00062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.184+0000 7f4c211c6700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4c00060550 0x7f4c00062a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009eb0 tx=0x7f4c180091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:16.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.192+0000 7f4c0d7fa700 1 -- 172.21.15.37:0/4291456319 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4c1404d610 con 0x7f4c1c158440 2023-10-06T04:40:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:16.388+0000 7f4c221c8700 1 -- 172.21.15.37:0/4291456319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4c1c069140 con 0x7f4c1c158440 2023-10-06T04:40:17.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.028+0000 7f4c0d7fa700 1 -- 172.21.15.37:0/4291456319 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4c14050c30 con 0x7f4c1c158440 2023-10-06T04:40:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.032+0000 7f4c221c8700 1 -- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4c00060550 msgr2=0x7f4c00062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.032+0000 7f4c221c8700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4c00060550 0x7f4c00062a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009eb0 tx=0x7f4c180091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.032+0000 7f4c221c8700 1 -- 172.21.15.37:0/4291456319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c1c158440 msgr2=0x7f4c1c1570a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.032+0000 7f4c221c8700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c1c158440 0x7f4c1c1570a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009f20 tx=0x7f4c1400b040 comp rx=0 tx=0).stop 2023-10-06T04:40:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.032+0000 7f4c221c8700 1 -- 172.21.15.37:0/4291456319 shutdown_connections 2023-10-06T04:40:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.032+0000 7f4c221c8700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4c00060550 0x7f4c00062a00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.032+0000 7f4c221c8700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c1c156bd0 0x7f4c1c16bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.032+0000 7f4c221c8700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c1c158440 0x7f4c1c1570a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.032+0000 7f4c221c8700 1 --2- 172.21.15.37:0/4291456319 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c1c156800 0x7f4c1c168dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.032+0000 7f4c221c8700 1 -- 172.21.15.37:0/4291456319 >> 172.21.15.37:0/4291456319 conn(0x7f4c1c0ce400 msgr2=0x7f4c1c151e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:17.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.032+0000 7f4c221c8700 1 -- 172.21.15.37:0/4291456319 shutdown_connections 2023-10-06T04:40:17.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.032+0000 7f4c221c8700 1 -- 172.21.15.37:0/4291456319 wait complete. 2023-10-06T04:40:17.043 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T04:40:17.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:17.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.152+0000 7f8e32058700 1 Processor -- start 2023-10-06T04:40:17.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.152+0000 7f8e32058700 1 -- start start 2023-10-06T04:40:17.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8e2c0c8cb0 0x7f8e2c0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8e2c0c9960 0x7f8e2c1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2c15a1b0 con 0x7f8e2c0aba80 2023-10-06T04:40:17.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c0c9e00 con 0x7f8e2c0c8cb0 2023-10-06T04:40:17.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c159880 con 0x7f8e2c0c9960 2023-10-06T04:40:17.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e22ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8e2c0c8cb0 0x7f8e2c0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e2b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8e2c0aba80 0x7f8e2c0c85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48508/0 (socket says 172.21.15.37:48508) 2023-10-06T04:40:17.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e22ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8e2c0c8cb0 0x7f8e2c0c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53544/0 (socket says 172.21.15.37:53544) 2023-10-06T04:40:17.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e2b7fe700 1 -- 172.21.15.37:0/2933786420 learned_addr learned my addr 172.21.15.37:0/2933786420 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:17.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e2bfff700 1 --2- 172.21.15.37:0/2933786420 >> v2:172.21.15.83:3300/0 conn(0x7f8e2c0c9960 0x7f8e2c1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e22ffd700 1 -- 172.21.15.37:0/2933786420 >> v2:172.21.15.83:3300/0 conn(0x7f8e2c0c9960 msgr2=0x7f8e2c1560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:17.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e22ffd700 1 --2- 172.21.15.37:0/2933786420 >> v2:172.21.15.83:3300/0 conn(0x7f8e2c0c9960 0x7f8e2c1560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e22ffd700 1 -- 172.21.15.37:0/2933786420 >> v1:172.21.15.37:6789/0 conn(0x7f8e2c0aba80 legacy=0x7f8e2c0c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e2affd700 1 -- 172.21.15.37:0/2933786420 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680823084 0 0) 0x7f8e2c15a1b0 con 0x7f8e2c0aba80 2023-10-06T04:40:17.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e22ffd700 1 -- 172.21.15.37:0/2933786420 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c159b60 con 0x7f8e2c0c8cb0 2023-10-06T04:40:17.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e22ffd700 1 --2- 172.21.15.37:0/2933786420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2c0c8cb0 0x7f8e2c0c9420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400bbc0 tx=0x7f8e1400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a037e12aea9985 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e2affd700 1 -- 172.21.15.37:0/2933786420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1400daa0 con 0x7f8e2c0c8cb0 2023-10-06T04:40:17.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e2affd700 1 -- 172.21.15.37:0/2933786420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1400dc00 con 0x7f8e2c0c8cb0 2023-10-06T04:40:17.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e2affd700 1 -- 172.21.15.37:0/2933786420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14019480 con 0x7f8e2c0c8cb0 2023-10-06T04:40:17.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 -- 172.21.15.37:0/2933786420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2c0c8cb0 msgr2=0x7f8e2c0c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 --2- 172.21.15.37:0/2933786420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2c0c8cb0 0x7f8e2c0c9420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400bbc0 tx=0x7f8e1400b430 comp rx=0 tx=0).stop 2023-10-06T04:40:17.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 -- 172.21.15.37:0/2933786420 shutdown_connections 2023-10-06T04:40:17.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 --2- 172.21.15.37:0/2933786420 >> v2:172.21.15.83:3300/0 conn(0x7f8e2c0c9960 0x7f8e2c1560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 --2- 172.21.15.37:0/2933786420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2c0c8cb0 0x7f8e2c0c9420 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 -- 172.21.15.37:0/2933786420 >> 172.21.15.37:0/2933786420 conn(0x7f8e2c068e00 msgr2=0x7f8e2c069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:17.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 -- 172.21.15.37:0/2933786420 shutdown_connections 2023-10-06T04:40:17.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.156+0000 7f8e32058700 1 -- 172.21.15.37:0/2933786420 wait complete. 2023-10-06T04:40:17.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e32058700 1 Processor -- start 2023-10-06T04:40:17.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e32058700 1 -- start start 2023-10-06T04:40:17.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e32058700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2c0aba80 0x7f8e2c0ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e32058700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e2c0c8cb0 0x7f8e2c0aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e32058700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e2c0c9960 0x7f8e2c0ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e32058700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0b1e40 con 0x7f8e2c0aba80 2023-10-06T04:40:17.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e32058700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0b1230 con 0x7f8e2c0c9960 2023-10-06T04:40:17.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e32058700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0b1510 con 0x7f8e2c0c8cb0 2023-10-06T04:40:17.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e2b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2c0aba80 0x7f8e2c0ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e2b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2c0aba80 0x7f8e2c0ae710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53546/0 (socket says 172.21.15.37:53546) 2023-10-06T04:40:17.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e2b7fe700 1 -- 172.21.15.37:0/3391864212 learned_addr learned my addr 172.21.15.37:0/3391864212 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:17.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e2bfff700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e2c0c9960 0x7f8e2c0ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e22ffd700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e2c0c8cb0 0x7f8e2c0aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e2b7fe700 1 -- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e2c0c8cb0 msgr2=0x7f8e2c0aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.160+0000 7f8e2b7fe700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e2c0c8cb0 0x7f8e2c0aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.164+0000 7f8e2b7fe700 1 -- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e2c0c9960 msgr2=0x7f8e2c0ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.164+0000 7f8e2b7fe700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e2c0c9960 0x7f8e2c0ad950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.164+0000 7f8e2b7fe700 1 -- 172.21.15.37:0/3391864212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1400b6d0 con 0x7f8e2c0aba80 2023-10-06T04:40:17.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.164+0000 7f8e2b7fe700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2c0aba80 0x7f8e2c0ae710 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00c7e0 tx=0x7f8e1c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.164+0000 7f8e23fff700 1 -- 172.21.15.37:0/3391864212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c005b30 con 0x7f8e2c0aba80 2023-10-06T04:40:17.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.164+0000 7f8e23fff700 1 -- 172.21.15.37:0/3391864212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c005c90 con 0x7f8e2c0aba80 2023-10-06T04:40:17.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.164+0000 7f8e32058700 1 -- 172.21.15.37:0/3391864212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c0b17f0 con 0x7f8e2c0aba80 2023-10-06T04:40:17.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.164+0000 7f8e23fff700 1 -- 172.21.15.37:0/3391864212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c007300 con 0x7f8e2c0aba80 2023-10-06T04:40:17.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.164+0000 7f8e32058700 1 -- 172.21.15.37:0/3391864212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c0ac570 con 0x7f8e2c0aba80 2023-10-06T04:40:17.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.164+0000 7f8e32058700 1 -- 172.21.15.37:0/3391864212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c070ee0 con 0x7f8e2c0aba80 2023-10-06T04:40:17.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.164+0000 7f8e23fff700 1 -- 172.21.15.37:0/3391864212 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8e1c01b3b0 con 0x7f8e2c0aba80 2023-10-06T04:40:17.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.164+0000 7f8e23fff700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8e0c060580 0x7f8e0c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.168+0000 7f8e23fff700 1 -- 172.21.15.37:0/3391864212 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8e1c07bee0 con 0x7f8e2c0aba80 2023-10-06T04:40:17.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.168+0000 7f8e22ffd700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8e0c060580 0x7f8e0c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.168+0000 7f8e22ffd700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8e0c060580 0x7f8e0c062a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400bbc0 tx=0x7f8e1401b000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.176+0000 7f8e23fff700 1 -- 172.21.15.37:0/3391864212 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8e1c04c230 con 0x7f8e2c0aba80 2023-10-06T04:40:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.328+0000 7f8e32058700 1 -- 172.21.15.37:0/3391864212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e2c159e40 con 0x7f8e2c0aba80 2023-10-06T04:40:17.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e23fff700 1 -- 172.21.15.37:0/3391864212 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f8e1c001d60 con 0x7f8e2c0aba80 2023-10-06T04:40:17.338 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:17.338 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:40:16.392378+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:14.249153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:15.385254+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e32058700 1 -- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8e0c060580 msgr2=0x7f8e0c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e32058700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8e0c060580 0x7f8e0c062a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400bbc0 tx=0x7f8e1401b000 comp rx=0 tx=0).stop 2023-10-06T04:40:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e32058700 1 -- 172.21.15.37:0/3391864212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2c0aba80 msgr2=0x7f8e2c0ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e32058700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2c0aba80 0x7f8e2c0ae710 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00c7e0 tx=0x7f8e1c007df0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e32058700 1 -- 172.21.15.37:0/3391864212 shutdown_connections 2023-10-06T04:40:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e32058700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8e0c060580 0x7f8e0c062a30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e32058700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e2c0c9960 0x7f8e2c0ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e32058700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e2c0c8cb0 0x7f8e2c0aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e32058700 1 --2- 172.21.15.37:0/3391864212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2c0aba80 0x7f8e2c0ae710 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e32058700 1 -- 172.21.15.37:0/3391864212 >> 172.21.15.37:0/3391864212 conn(0x7f8e2c068e00 msgr2=0x7f8e2c068690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e32058700 1 -- 172.21.15.37:0/3391864212 shutdown_connections 2023-10-06T04:40:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.332+0000 7f8e32058700 1 -- 172.21.15.37:0/3391864212 wait complete. 2023-10-06T04:40:17.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f61809bc700 1 Processor -- start 2023-10-06T04:40:17.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f61809bc700 1 -- start start 2023-10-06T04:40:17.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f61809bc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f617c066840 0x7f617c0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f61809bc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f617c0cb8b0 0x7f617c0ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f61809bc700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617c0cb110 con 0x7f617c0b1380 2023-10-06T04:40:17.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f61809bc700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617c0ca500 con 0x7f617c0cb8b0 2023-10-06T04:40:17.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f61809bc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0ca7e0 con 0x7f617c066840 2023-10-06T04:40:17.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f617bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f617c0cb8b0 0x7f617c0ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f617b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f617c0b1380 0x7f617c0ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48522/0 (socket says 172.21.15.37:48522) 2023-10-06T04:40:17.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f617b7fe700 1 -- 172.21.15.37:0/376409390 learned_addr learned my addr 172.21.15.37:0/376409390 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:17.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f617affd700 1 --2- 172.21.15.37:0/376409390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f617c066840 0x7f617c0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f617a7fc700 1 -- 172.21.15.37:0/376409390 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708124340 0 0) 0x7f617c0cb110 con 0x7f617c0b1380 2023-10-06T04:40:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f617a7fc700 1 -- 172.21.15.37:0/376409390 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6168003570 con 0x7f617c0b1380 2023-10-06T04:40:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f617bfff700 1 -- 172.21.15.37:0/376409390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f617c066840 msgr2=0x7f617c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f617bfff700 1 --2- 172.21.15.37:0/376409390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f617c066840 0x7f617c0b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f617bfff700 1 -- 172.21.15.37:0/376409390 >> v1:172.21.15.37:6789/0 conn(0x7f617c0b1380 legacy=0x7f617c0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.452+0000 7f617bfff700 1 -- 172.21.15.37:0/376409390 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c0caac0 con 0x7f617c0cb8b0 2023-10-06T04:40:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.456+0000 7f617bfff700 1 --2- 172.21.15.37:0/376409390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617c0cb8b0 0x7f617c0ad580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f61740098e0 tx=0x7f61740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7c2c02e66d41b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.456+0000 7f617a7fc700 1 -- 172.21.15.37:0/376409390 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174011630 con 0x7f617c0cb8b0 2023-10-06T04:40:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.456+0000 7f617a7fc700 1 -- 172.21.15.37:0/376409390 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6174011790 con 0x7f617c0cb8b0 2023-10-06T04:40:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.456+0000 7f617a7fc700 1 -- 172.21.15.37:0/376409390 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174011b30 con 0x7f617c0cb8b0 2023-10-06T04:40:17.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.456+0000 7f61809bc700 1 -- 172.21.15.37:0/376409390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617c0cb8b0 msgr2=0x7f617c0ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.456+0000 7f61809bc700 1 --2- 172.21.15.37:0/376409390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617c0cb8b0 0x7f617c0ad580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f61740098e0 tx=0x7f61740091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.456+0000 7f61809bc700 1 -- 172.21.15.37:0/376409390 shutdown_connections 2023-10-06T04:40:17.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.456+0000 7f61809bc700 1 --2- 172.21.15.37:0/376409390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617c0cb8b0 0x7f617c0ad580 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.456+0000 7f61809bc700 1 --2- 172.21.15.37:0/376409390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f617c066840 0x7f617c0b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.456+0000 7f61809bc700 1 -- 172.21.15.37:0/376409390 >> 172.21.15.37:0/376409390 conn(0x7f617c0ccb50 msgr2=0x7f617c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:17.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.456+0000 7f61809bc700 1 -- 172.21.15.37:0/376409390 shutdown_connections 2023-10-06T04:40:17.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.456+0000 7f61809bc700 1 -- 172.21.15.37:0/376409390 wait complete. 2023-10-06T04:40:17.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61809bc700 1 Processor -- start 2023-10-06T04:40:17.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61809bc700 1 -- start start 2023-10-06T04:40:17.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61809bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617c066840 0x7f617c154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61809bc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f617c0b1380 0x7f617c15cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61809bc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f617c0cb8b0 0x7f617c0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61809bc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0b0370 con 0x7f617c066840 2023-10-06T04:40:17.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61809bc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c1553c0 con 0x7f617c0b1380 2023-10-06T04:40:17.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61809bc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0afb60 con 0x7f617c0cb8b0 2023-10-06T04:40:17.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f617b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617c066840 0x7f617c154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f617b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617c066840 0x7f617c154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53562/0 (socket says 172.21.15.37:53562) 2023-10-06T04:40:17.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f617b7fe700 1 -- 172.21.15.37:0/3929275333 learned_addr learned my addr 172.21.15.37:0/3929275333 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:17.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f617affd700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f617c0b1380 0x7f617c15cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f617bfff700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f617c0cb8b0 0x7f617c0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f617b7fe700 1 -- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f617c0cb8b0 msgr2=0x7f617c0c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f617b7fe700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f617c0cb8b0 0x7f617c0c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f617b7fe700 1 -- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f617c0b1380 msgr2=0x7f617c15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f617b7fe700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f617c0b1380 0x7f617c15cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f617b7fe700 1 -- 172.21.15.37:0/3929275333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6174009420 con 0x7f617c066840 2023-10-06T04:40:17.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f617b7fe700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617c066840 0x7f617c154e80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f616c00cd60 tx=0x7f616c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61737fe700 1 -- 172.21.15.37:0/3929275333 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c00aa20 con 0x7f617c066840 2023-10-06T04:40:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61737fe700 1 -- 172.21.15.37:0/3929275333 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c00aba0 con 0x7f617c066840 2023-10-06T04:40:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61809bc700 1 -- 172.21.15.37:0/3929275333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c15cae0 con 0x7f617c066840 2023-10-06T04:40:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61737fe700 1 -- 172.21.15.37:0/3929275333 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c0070f0 con 0x7f617c066840 2023-10-06T04:40:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.460+0000 7f61809bc700 1 -- 172.21.15.37:0/3929275333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c0afdb0 con 0x7f617c066840 2023-10-06T04:40:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.464+0000 7f61809bc700 1 -- 172.21.15.37:0/3929275333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c0708a0 con 0x7f617c066840 2023-10-06T04:40:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.464+0000 7f61737fe700 1 -- 172.21.15.37:0/3929275333 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f616c007520 con 0x7f617c066840 2023-10-06T04:40:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.464+0000 7f61737fe700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f615c060580 0x7f615c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.464+0000 7f61737fe700 1 -- 172.21.15.37:0/3929275333 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f616c07ce10 con 0x7f617c066840 2023-10-06T04:40:17.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.464+0000 7f617affd700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f615c060580 0x7f615c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.468+0000 7f617affd700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f615c060580 0x7f615c062a30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f617c159b00 tx=0x7f61640091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.472+0000 7f61737fe700 1 -- 172.21.15.37:0/3929275333 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f616c04d160 con 0x7f617c066840 2023-10-06T04:40:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.640+0000 7f61809bc700 1 -- 172.21.15.37:0/3929275333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f617c0cada0 con 0x7f617c066840 2023-10-06T04:40:17.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.640+0000 7f61737fe700 1 -- 172.21.15.37:0/3929275333 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f616c050780 con 0x7f617c066840 2023-10-06T04:40:17.646 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:17.647 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:40:16.392378+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:14.249153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:15.385254+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.644+0000 7f61809bc700 1 -- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f615c060580 msgr2=0x7f615c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.644+0000 7f61809bc700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f615c060580 0x7f615c062a30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f617c159b00 tx=0x7f61640091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.644+0000 7f61809bc700 1 -- 172.21.15.37:0/3929275333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617c066840 msgr2=0x7f617c154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.644+0000 7f61809bc700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617c066840 0x7f617c154e80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f616c00cd60 tx=0x7f616c001b10 comp rx=0 tx=0).stop 2023-10-06T04:40:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.644+0000 7f61809bc700 1 -- 172.21.15.37:0/3929275333 shutdown_connections 2023-10-06T04:40:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.644+0000 7f61809bc700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f615c060580 0x7f615c062a30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.644+0000 7f61809bc700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f617c0b1380 0x7f617c15cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.644+0000 7f61809bc700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f617c0cb8b0 0x7f617c0c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.644+0000 7f61809bc700 1 --2- 172.21.15.37:0/3929275333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617c066840 0x7f617c154e80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.644+0000 7f61809bc700 1 -- 172.21.15.37:0/3929275333 >> 172.21.15.37:0/3929275333 conn(0x7f617c0ccb50 msgr2=0x7f617c06ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:17.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.644+0000 7f61809bc700 1 -- 172.21.15.37:0/3929275333 shutdown_connections 2023-10-06T04:40:17.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.644+0000 7f61809bc700 1 -- 172.21.15.37:0/3929275333 wait complete. 2023-10-06T04:40:17.662 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:40:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.768+0000 7f5e2bfff700 1 Processor -- start 2023-10-06T04:40:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.768+0000 7f5e2bfff700 1 -- start start 2023-10-06T04:40:17.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2bfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5e2c06e560 0x7f5e2c0c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2bfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2c0c66c0 con 0x7f5e2c159bd0 2023-10-06T04:40:17.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2bfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2c0c6910 con 0x7f5e2c06e190 2023-10-06T04:40:17.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2bfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2c0c6bf0 con 0x7f5e2c06e560 2023-10-06T04:40:17.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2a7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5e2c159bd0 0x7f5e2c0ac6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48532/0 (socket says 172.21.15.37:48532) 2023-10-06T04:40:17.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2a7fc700 1 -- 172.21.15.37:0/2951970304 learned_addr learned my addr 172.21.15.37:0/2951970304 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:17.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2b7fe700 1 --2- 172.21.15.37:0/2951970304 >> v2:172.21.15.83:3300/0 conn(0x7f5e2c06e560 0x7f5e2c0c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e29ffb700 1 -- 172.21.15.37:0/2951970304 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222625667 0 0) 0x7f5e2c0c66c0 con 0x7f5e2c159bd0 2023-10-06T04:40:17.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e29ffb700 1 -- 172.21.15.37:0/2951970304 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e14003490 con 0x7f5e2c159bd0 2023-10-06T04:40:17.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e29ffb700 1 -- 172.21.15.37:0/2951970304 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088542076 0 0) 0x7f5e2c0c6910 con 0x7f5e2c06e190 2023-10-06T04:40:17.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e29ffb700 1 -- 172.21.15.37:0/2951970304 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e2c0c66c0 con 0x7f5e2c06e190 2023-10-06T04:40:17.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2b7fe700 1 -- 172.21.15.37:0/2951970304 >> v1:172.21.15.83:6789/0 conn(0x7f5e2c06e190 legacy=0x7f5e2c06ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2b7fe700 1 -- 172.21.15.37:0/2951970304 >> v1:172.21.15.37:6789/0 conn(0x7f5e2c159bd0 legacy=0x7f5e2c0ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2b7fe700 1 -- 172.21.15.37:0/2951970304 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c0c6ed0 con 0x7f5e2c06e560 2023-10-06T04:40:17.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2b7fe700 1 --2- 172.21.15.37:0/2951970304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e2c06e560 0x7f5e2c0c76d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e240098e0 tx=0x7f5e240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=944557a0d7e51b2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e29ffb700 1 -- 172.21.15.37:0/2951970304 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24011630 con 0x7f5e2c06e560 2023-10-06T04:40:17.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e29ffb700 1 -- 172.21.15.37:0/2951970304 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e24011790 con 0x7f5e2c06e560 2023-10-06T04:40:17.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e29ffb700 1 -- 172.21.15.37:0/2951970304 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24011b10 con 0x7f5e2c06e560 2023-10-06T04:40:17.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2951970304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e2c06e560 msgr2=0x7f5e2c0c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2bfff700 1 --2- 172.21.15.37:0/2951970304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e2c06e560 0x7f5e2c0c76d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e240098e0 tx=0x7f5e240091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2951970304 shutdown_connections 2023-10-06T04:40:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2bfff700 1 --2- 172.21.15.37:0/2951970304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e2c06e560 0x7f5e2c0c76d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2951970304 >> 172.21.15.37:0/2951970304 conn(0x7f5e2c0c9570 msgr2=0x7f5e2c067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2951970304 shutdown_connections 2023-10-06T04:40:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.772+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2951970304 wait complete. 2023-10-06T04:40:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2bfff700 1 Processor -- start 2023-10-06T04:40:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2bfff700 1 -- start start 2023-10-06T04:40:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e2c06e190 0x7f5e2c14b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e2c06e560 0x7f5e2c152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e2c159bd0 0x7f5e2c0c2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2bfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0c4c50 con 0x7f5e2c06e560 2023-10-06T04:40:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2bfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0c0860 con 0x7f5e2c06e190 2023-10-06T04:40:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2bfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0c0b40 con 0x7f5e2c159bd0 2023-10-06T04:40:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e2c06e560 0x7f5e2c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e2c06e560 0x7f5e2c152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53566/0 (socket says 172.21.15.37:53566) 2023-10-06T04:40:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2a7fc700 1 -- 172.21.15.37:0/2856175493 learned_addr learned my addr 172.21.15.37:0/2856175493 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2affd700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e2c06e190 0x7f5e2c14b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2b7fe700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e2c159bd0 0x7f5e2c0c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2a7fc700 1 -- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e2c159bd0 msgr2=0x7f5e2c0c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2a7fc700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e2c159bd0 0x7f5e2c0c2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2a7fc700 1 -- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e2c06e190 msgr2=0x7f5e2c14b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2a7fc700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e2c06e190 0x7f5e2c14b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2a7fc700 1 -- 172.21.15.37:0/2856175493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e24009420 con 0x7f5e2c06e560 2023-10-06T04:40:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2b7fe700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e2c159bd0 0x7f5e2c0c2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2a7fc700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e2c06e560 0x7f5e2c152800 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000c790 tx=0x7f5e20007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e12ffd700 1 -- 172.21.15.37:0/2856175493 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20005b30 con 0x7f5e2c06e560 2023-10-06T04:40:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e12ffd700 1 -- 172.21.15.37:0/2856175493 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e20005c90 con 0x7f5e2c06e560 2023-10-06T04:40:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2856175493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2c0c0e20 con 0x7f5e2c06e560 2023-10-06T04:40:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e12ffd700 1 -- 172.21.15.37:0/2856175493 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20007340 con 0x7f5e2c06e560 2023-10-06T04:40:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.776+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2856175493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2c0c2650 con 0x7f5e2c06e560 2023-10-06T04:40:17.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.780+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2856175493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2c0c4740 con 0x7f5e2c06e560 2023-10-06T04:40:17.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.780+0000 7f5e12ffd700 1 -- 172.21.15.37:0/2856175493 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5e20025430 con 0x7f5e2c06e560 2023-10-06T04:40:17.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.780+0000 7f5e12ffd700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e18060580 0x7f5e18062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.780+0000 7f5e12ffd700 1 -- 172.21.15.37:0/2856175493 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5e2007ce60 con 0x7f5e2c06e560 2023-10-06T04:40:17.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.780+0000 7f5e2affd700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e18060580 0x7f5e18062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.784+0000 7f5e2affd700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e18060580 0x7f5e18062a30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c000f80 tx=0x7f5e1c002680 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.788+0000 7f5e12ffd700 1 -- 172.21.15.37:0/2856175493 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5e2004d2d0 con 0x7f5e2c06e560 2023-10-06T04:40:17.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:17.992+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2856175493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5e2c0c4740 con 0x7f5e2c06e560 2023-10-06T04:40:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.048+0000 7f5e12ffd700 1 -- 172.21.15.37:0/2856175493 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5e2c0c4740 con 0x7f5e2c06e560 2023-10-06T04:40:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.052+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e18060580 msgr2=0x7f5e18062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.052+0000 7f5e2bfff700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e18060580 0x7f5e18062a30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c000f80 tx=0x7f5e1c002680 comp rx=0 tx=0).stop 2023-10-06T04:40:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.052+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2856175493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e2c06e560 msgr2=0x7f5e2c152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.052+0000 7f5e2bfff700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e2c06e560 0x7f5e2c152800 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000c790 tx=0x7f5e20007e80 comp rx=0 tx=0).stop 2023-10-06T04:40:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.052+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2856175493 shutdown_connections 2023-10-06T04:40:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.052+0000 7f5e2bfff700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e18060580 0x7f5e18062a30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.052+0000 7f5e2bfff700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e2c159bd0 0x7f5e2c0c2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.052+0000 7f5e2bfff700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e2c06e560 0x7f5e2c152800 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.052+0000 7f5e2bfff700 1 --2- 172.21.15.37:0/2856175493 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e2c06e190 0x7f5e2c14b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.052+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2856175493 >> 172.21.15.37:0/2856175493 conn(0x7f5e2c0c9570 msgr2=0x7f5e2c158660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.052+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2856175493 shutdown_connections 2023-10-06T04:40:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.052+0000 7f5e2bfff700 1 -- 172.21.15.37:0/2856175493 wait complete. 2023-10-06T04:40:18.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:40:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.184+0000 7f7c1759e700 1 Processor -- start 2023-10-06T04:40:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.184+0000 7f7c1759e700 1 -- start start 2023-10-06T04:40:18.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7c18156800 0x7f7c180b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c18156bd0 0x7f7c1806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c180cc6d0 con 0x7f7c1806d310 2023-10-06T04:40:18.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1806d790 con 0x7f7c18156bd0 2023-10-06T04:40:18.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c180cc930 con 0x7f7c18156800 2023-10-06T04:40:18.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c15d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c18156bd0 0x7f7c1806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c16d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7c1806d310 0x7f7c1815a650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48538/0 (socket says 172.21.15.37:48538) 2023-10-06T04:40:18.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c16d9d700 1 -- 172.21.15.37:0/3498273804 learned_addr learned my addr 172.21.15.37:0/3498273804 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:18.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1659c700 1 --2- 172.21.15.37:0/3498273804 >> v2:172.21.15.83:3300/0 conn(0x7f7c18156800 0x7f7c180b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1559a700 1 -- 172.21.15.37:0/3498273804 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3213296522 0 0) 0x7f7c180cc6d0 con 0x7f7c1806d310 2023-10-06T04:40:18.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1559a700 1 -- 172.21.15.37:0/3498273804 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c04003570 con 0x7f7c1806d310 2023-10-06T04:40:18.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c15d9b700 1 -- 172.21.15.37:0/3498273804 >> v2:172.21.15.83:3300/0 conn(0x7f7c18156800 msgr2=0x7f7c180b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:18.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c15d9b700 1 --2- 172.21.15.37:0/3498273804 >> v2:172.21.15.83:3300/0 conn(0x7f7c18156800 0x7f7c180b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c15d9b700 1 -- 172.21.15.37:0/3498273804 >> v1:172.21.15.37:6789/0 conn(0x7f7c1806d310 legacy=0x7f7c1815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c15d9b700 1 -- 172.21.15.37:0/3498273804 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c180ccc10 con 0x7f7c18156bd0 2023-10-06T04:40:18.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c15d9b700 1 --2- 172.21.15.37:0/3498273804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c18156bd0 0x7f7c1806cdd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7c180cead0 tx=0x7f7c080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2f484e21ae8590 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:18.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1559a700 1 -- 172.21.15.37:0/3498273804 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08011630 con 0x7f7c18156bd0 2023-10-06T04:40:18.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1559a700 1 -- 172.21.15.37:0/3498273804 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c080117b0 con 0x7f7c18156bd0 2023-10-06T04:40:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1559a700 1 -- 172.21.15.37:0/3498273804 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08011b70 con 0x7f7c18156bd0 2023-10-06T04:40:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 -- 172.21.15.37:0/3498273804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c18156bd0 msgr2=0x7f7c1806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 --2- 172.21.15.37:0/3498273804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c18156bd0 0x7f7c1806cdd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7c180cead0 tx=0x7f7c080091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 -- 172.21.15.37:0/3498273804 shutdown_connections 2023-10-06T04:40:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 --2- 172.21.15.37:0/3498273804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c18156bd0 0x7f7c1806cdd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 --2- 172.21.15.37:0/3498273804 >> v2:172.21.15.83:3300/0 conn(0x7f7c18156800 0x7f7c180b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 -- 172.21.15.37:0/3498273804 >> 172.21.15.37:0/3498273804 conn(0x7f7c180ce460 msgr2=0x7f7c180af390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 -- 172.21.15.37:0/3498273804 shutdown_connections 2023-10-06T04:40:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.188+0000 7f7c1759e700 1 -- 172.21.15.37:0/3498273804 wait complete. 2023-10-06T04:40:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c1759e700 1 Processor -- start 2023-10-06T04:40:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c1759e700 1 -- start start 2023-10-06T04:40:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c1759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c1806d310 0x7f7c181545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c1759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c18156800 0x7f7c180c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c1759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c18156bd0 0x7f7c1814e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c1759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c181553c0 con 0x7f7c18156800 2023-10-06T04:40:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c1759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c18158a60 con 0x7f7c1806d310 2023-10-06T04:40:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c1759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c18154e00 con 0x7f7c18156bd0 2023-10-06T04:40:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c15d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c18156800 0x7f7c180c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c1659c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c1806d310 0x7f7c181545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c15d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c18156800 0x7f7c180c2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53584/0 (socket says 172.21.15.37:53584) 2023-10-06T04:40:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c15d9b700 1 -- 172.21.15.37:0/995970036 learned_addr learned my addr 172.21.15.37:0/995970036 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c16d9d700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c18156bd0 0x7f7c1814e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c15d9b700 1 -- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c18156bd0 msgr2=0x7f7c1814e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c15d9b700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c18156bd0 0x7f7c1814e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c15d9b700 1 -- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c1806d310 msgr2=0x7f7c181545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c15d9b700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c1806d310 0x7f7c181545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c15d9b700 1 -- 172.21.15.37:0/995970036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08009420 con 0x7f7c18156800 2023-10-06T04:40:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c15d9b700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c18156800 0x7f7c180c2990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7c180cc860 tx=0x7f7c08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c0e7fc700 1 -- 172.21.15.37:0/995970036 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0801f070 con 0x7f7c18156800 2023-10-06T04:40:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c0e7fc700 1 -- 172.21.15.37:0/995970036 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08011920 con 0x7f7c18156800 2023-10-06T04:40:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c1759e700 1 -- 172.21.15.37:0/995970036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c181550e0 con 0x7f7c18156800 2023-10-06T04:40:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c0e7fc700 1 -- 172.21.15.37:0/995970036 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08023410 con 0x7f7c18156800 2023-10-06T04:40:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.192+0000 7f7c1759e700 1 -- 172.21.15.37:0/995970036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c18154b10 con 0x7f7c18156800 2023-10-06T04:40:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.196+0000 7f7c0e7fc700 1 -- 172.21.15.37:0/995970036 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7c0802c3b0 con 0x7f7c18156800 2023-10-06T04:40:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.196+0000 7f7c1759e700 1 -- 172.21.15.37:0/995970036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c180708a0 con 0x7f7c18156800 2023-10-06T04:40:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.196+0000 7f7c0e7fc700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7bf8060550 0x7f7bf8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.196+0000 7f7c0e7fc700 1 -- 172.21.15.37:0/995970036 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7c0807dbf0 con 0x7f7c18156800 2023-10-06T04:40:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.196+0000 7f7c1659c700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7bf8060550 0x7f7bf8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.196+0000 7f7c1659c700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7bf8060550 0x7f7bf8062a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009db0 tx=0x7f7c000091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:18.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.204+0000 7f7c0e7fc700 1 -- 172.21.15.37:0/995970036 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7c0804df40 con 0x7f7c18156800 2023-10-06T04:40:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:18.396+0000 7f7c1759e700 1 -- 172.21.15.37:0/995970036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7c18158ba0 con 0x7f7c18156800 2023-10-06T04:40:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.056+0000 7f7c0e7fc700 1 -- 172.21.15.37:0/995970036 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7c08051560 con 0x7f7c18156800 2023-10-06T04:40:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.064+0000 7f7c1759e700 1 -- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7bf8060550 msgr2=0x7f7bf8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.064+0000 7f7c1759e700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7bf8060550 0x7f7bf8062a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009db0 tx=0x7f7c000091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.064+0000 7f7c1759e700 1 -- 172.21.15.37:0/995970036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c18156800 msgr2=0x7f7c180c2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.064+0000 7f7c1759e700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c18156800 0x7f7c180c2990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7c180cc860 tx=0x7f7c08017000 comp rx=0 tx=0).stop 2023-10-06T04:40:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.064+0000 7f7c1759e700 1 -- 172.21.15.37:0/995970036 shutdown_connections 2023-10-06T04:40:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.064+0000 7f7c1759e700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7bf8060550 0x7f7bf8062a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.064+0000 7f7c1759e700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c18156bd0 0x7f7c1814e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.064+0000 7f7c1759e700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c18156800 0x7f7c180c2990 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.064+0000 7f7c1759e700 1 --2- 172.21.15.37:0/995970036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c1806d310 0x7f7c181545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.064+0000 7f7c1759e700 1 -- 172.21.15.37:0/995970036 >> 172.21.15.37:0/995970036 conn(0x7f7c180ce460 msgr2=0x7f7c180b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.064+0000 7f7c1759e700 1 -- 172.21.15.37:0/995970036 shutdown_connections 2023-10-06T04:40:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.064+0000 7f7c1759e700 1 -- 172.21.15.37:0/995970036 wait complete. 2023-10-06T04:40:19.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.192+0000 7f37187f9700 1 Processor -- start 2023-10-06T04:40:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.192+0000 7f37187f9700 1 -- start start 2023-10-06T04:40:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f37187f9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f371015d2e0 0x7f37101535b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f37187f9700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3710153af0 con 0x7f37101531e0 2023-10-06T04:40:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f37187f9700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371015b1e0 con 0x7f37100cc870 2023-10-06T04:40:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f37187f9700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37100cd3c0 con 0x7f371015d2e0 2023-10-06T04:40:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f3716595700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f37101531e0 0x7f371015cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40792/0 (socket says 172.21.15.37:40792) 2023-10-06T04:40:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f3716595700 1 -- 172.21.15.37:0/1182275275 learned_addr learned my addr 172.21.15.37:0/1182275275 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f3715d94700 1 --2- 172.21.15.37:0/1182275275 >> v2:172.21.15.83:3300/0 conn(0x7f371015d2e0 0x7f37101535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f3715593700 1 -- 172.21.15.37:0/1182275275 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156535007 0 0) 0x7f3710153af0 con 0x7f37101531e0 2023-10-06T04:40:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f3715593700 1 -- 172.21.15.37:0/1182275275 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36fc003570 con 0x7f37101531e0 2023-10-06T04:40:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f3715d94700 1 -- 172.21.15.37:0/1182275275 >> v1:172.21.15.83:6789/0 conn(0x7f37100cc870 legacy=0x7f37100cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f3715d94700 1 -- 172.21.15.37:0/1182275275 >> v1:172.21.15.37:6789/0 conn(0x7f37101531e0 legacy=0x7f371015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f3715d94700 1 -- 172.21.15.37:0/1182275275 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37100cd5e0 con 0x7f371015d2e0 2023-10-06T04:40:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f3715d94700 1 --2- 172.21.15.37:0/1182275275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f371015d2e0 0x7f37101535b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f37000098e0 tx=0x7f37000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0dbcb5d389cb632 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f3715593700 1 -- 172.21.15.37:0/1182275275 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370000b640 con 0x7f371015d2e0 2023-10-06T04:40:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f3715593700 1 -- 172.21.15.37:0/1182275275 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370000b7a0 con 0x7f371015d2e0 2023-10-06T04:40:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.196+0000 7f3715593700 1 -- 172.21.15.37:0/1182275275 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370000bb20 con 0x7f371015d2e0 2023-10-06T04:40:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 -- 172.21.15.37:0/1182275275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f371015d2e0 msgr2=0x7f37101535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 --2- 172.21.15.37:0/1182275275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f371015d2e0 0x7f37101535b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f37000098e0 tx=0x7f37000091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 -- 172.21.15.37:0/1182275275 shutdown_connections 2023-10-06T04:40:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 --2- 172.21.15.37:0/1182275275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f371015d2e0 0x7f37101535b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 -- 172.21.15.37:0/1182275275 >> 172.21.15.37:0/1182275275 conn(0x7f3710087ab0 msgr2=0x7f3710067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 -- 172.21.15.37:0/1182275275 shutdown_connections 2023-10-06T04:40:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 -- 172.21.15.37:0/1182275275 wait complete. 2023-10-06T04:40:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 Processor -- start 2023-10-06T04:40:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 -- start start 2023-10-06T04:40:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37101531e0 0x7f371014f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f371015d2e0 0x7f3710169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37100b0ac0 0x7f37100c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3710151e30 con 0x7f37100b0ac0 2023-10-06T04:40:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371016a440 con 0x7f37101531e0 2023-10-06T04:40:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.200+0000 7f37187f9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37101522c0 con 0x7f371015d2e0 2023-10-06T04:40:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f3716d96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37100b0ac0 0x7f37100c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f3716595700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37101531e0 0x7f371014f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f3716d96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37100b0ac0 0x7f37100c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60950/0 (socket says 172.21.15.37:60950) 2023-10-06T04:40:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f3716d96700 1 -- 172.21.15.37:0/1145775500 learned_addr learned my addr 172.21.15.37:0/1145775500 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f3715d94700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f371015d2e0 0x7f3710169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f3716d96700 1 -- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f371015d2e0 msgr2=0x7f3710169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f3716d96700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f371015d2e0 0x7f3710169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f3716d96700 1 -- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37101531e0 msgr2=0x7f371014f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f3716d96700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37101531e0 0x7f371014f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f3716d96700 1 -- 172.21.15.37:0/1145775500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3700009420 con 0x7f37100b0ac0 2023-10-06T04:40:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f3716595700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37101531e0 0x7f371014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f3716d96700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37100b0ac0 0x7f37100c8f10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f370800c820 tx=0x7f3708001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f37067fc700 1 -- 172.21.15.37:0/1145775500 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708012630 con 0x7f37100b0ac0 2023-10-06T04:40:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f37067fc700 1 -- 172.21.15.37:0/1145775500 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3708012790 con 0x7f37100b0ac0 2023-10-06T04:40:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f37067fc700 1 -- 172.21.15.37:0/1145775500 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708012b50 con 0x7f37100b0ac0 2023-10-06T04:40:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f37187f9700 1 -- 172.21.15.37:0/1145775500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3710151220 con 0x7f37100b0ac0 2023-10-06T04:40:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f37187f9700 1 -- 172.21.15.37:0/1145775500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37101517e0 con 0x7f37100b0ac0 2023-10-06T04:40:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.204+0000 7f37187f9700 1 -- 172.21.15.37:0/1145775500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3710151fe0 con 0x7f37100b0ac0 2023-10-06T04:40:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.208+0000 7f37067fc700 1 -- 172.21.15.37:0/1145775500 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3708003030 con 0x7f37100b0ac0 2023-10-06T04:40:19.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.208+0000 7f37067fc700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f36f4060550 0x7f36f4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.208+0000 7f37067fc700 1 -- 172.21.15.37:0/1145775500 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f370807c900 con 0x7f37100b0ac0 2023-10-06T04:40:19.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.208+0000 7f3716595700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f36f4060550 0x7f36f4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.208+0000 7f3716595700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f36f4060550 0x7f36f4062a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f370c007fd0 tx=0x7f370c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.216+0000 7f37067fc700 1 -- 172.21.15.37:0/1145775500 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3710151fe0 con 0x7f37100b0ac0 2023-10-06T04:40:19.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.416+0000 7f37187f9700 1 -- 172.21.15.37:0/1145775500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3710151fe0 con 0x7f37100b0ac0 2023-10-06T04:40:19.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.416+0000 7f37067fc700 1 -- 172.21.15.37:0/1145775500 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f3710151fe0 con 0x7f37100b0ac0 2023-10-06T04:40:19.421 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:19.422 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/968432746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":968432746},{"type":"v1","addr":"172.21.15.37:6833","nonce":968432746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2573831912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2573831912},{"type":"v1","addr":"172.21.15.37:6835","nonce":2573831912}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3283827040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3283827040},{"type":"v1","addr":"172.21.15.83:6835","nonce":3283827040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:16.392787+0000","modified":"2023-10-06T04:40:19.047129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5161},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5161":{"gid":5161,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1183217493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1183217493},{"type":"v1","addr":"172.21.15.83:6837","nonce":1183217493}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.416+0000 7f37187f9700 1 -- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f36f4060550 msgr2=0x7f36f4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.416+0000 7f37187f9700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f36f4060550 0x7f36f4062a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f370c007fd0 tx=0x7f370c009040 comp rx=0 tx=0).stop 2023-10-06T04:40:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.416+0000 7f37187f9700 1 -- 172.21.15.37:0/1145775500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37100b0ac0 msgr2=0x7f37100c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.416+0000 7f37187f9700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37100b0ac0 0x7f37100c8f10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f370800c820 tx=0x7f3708001630 comp rx=0 tx=0).stop 2023-10-06T04:40:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.416+0000 7f37187f9700 1 -- 172.21.15.37:0/1145775500 shutdown_connections 2023-10-06T04:40:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.416+0000 7f37187f9700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f36f4060550 0x7f36f4062a00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.416+0000 7f37187f9700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37100b0ac0 0x7f37100c8f10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.416+0000 7f37187f9700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f371015d2e0 0x7f3710169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.416+0000 7f37187f9700 1 --2- 172.21.15.37:0/1145775500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37101531e0 0x7f371014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.416+0000 7f37187f9700 1 -- 172.21.15.37:0/1145775500 >> 172.21.15.37:0/1145775500 conn(0x7f37100cc870 msgr2=0x7f37100b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.420+0000 7f37187f9700 1 -- 172.21.15.37:0/1145775500 shutdown_connections 2023-10-06T04:40:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.420+0000 7f37187f9700 1 -- 172.21.15.37:0/1145775500 wait complete. 2023-10-06T04:40:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 15 2023-10-06T04:40:19.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:19.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff83359e700 1 Processor -- start 2023-10-06T04:40:19.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff83359e700 1 -- start start 2023-10-06T04:40:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff83359e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff8341587d0 0x7ff83415d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff83359e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff834068400 0x7ff8340ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff83359e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff834159040 con 0x7ff834158ba0 2023-10-06T04:40:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff83359e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83415d6d0 con 0x7ff834068400 2023-10-06T04:40:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff83359e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8340af7f0 con 0x7ff8341587d0 2023-10-06T04:40:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff832d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff834068400 0x7ff8340ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff832d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff834068400 0x7ff8340ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60960/0 (socket says 172.21.15.37:60960) 2023-10-06T04:40:19.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff832d9d700 1 -- 172.21.15.37:0/1806103347 learned_addr learned my addr 172.21.15.37:0/1806103347 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:19.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff83259c700 1 --2- 172.21.15.37:0/1806103347 >> v2:172.21.15.83:3300/0 conn(0x7ff8341587d0 0x7ff83415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff832d9d700 1 -- 172.21.15.37:0/1806103347 >> v2:172.21.15.83:3300/0 conn(0x7ff8341587d0 msgr2=0x7ff83415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:19.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff832d9d700 1 --2- 172.21.15.37:0/1806103347 >> v2:172.21.15.83:3300/0 conn(0x7ff8341587d0 0x7ff83415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff832d9d700 1 -- 172.21.15.37:0/1806103347 >> v1:172.21.15.83:6789/0 conn(0x7ff834158ba0 legacy=0x7ff834067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff83159a700 1 -- 172.21.15.37:0/1806103347 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915049646 0 0) 0x7ff834159040 con 0x7ff834158ba0 2023-10-06T04:40:19.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff832d9d700 1 -- 172.21.15.37:0/1806103347 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8340afad0 con 0x7ff834068400 2023-10-06T04:40:19.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff832d9d700 1 --2- 172.21.15.37:0/1806103347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff834068400 0x7ff8340ae510 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff8340cd560 tx=0x7ff82c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1708abe6193952 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff83159a700 1 -- 172.21.15.37:0/1806103347 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00e070 con 0x7ff834068400 2023-10-06T04:40:19.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff83159a700 1 -- 172.21.15.37:0/1806103347 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c00ba20 con 0x7ff834068400 2023-10-06T04:40:19.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.536+0000 7ff83159a700 1 -- 172.21.15.37:0/1806103347 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0092e0 con 0x7ff834068400 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 -- 172.21.15.37:0/1806103347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff834068400 msgr2=0x7ff8340ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 --2- 172.21.15.37:0/1806103347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff834068400 0x7ff8340ae510 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff8340cd560 tx=0x7ff82c009840 comp rx=0 tx=0).stop 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 -- 172.21.15.37:0/1806103347 shutdown_connections 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 --2- 172.21.15.37:0/1806103347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff834068400 0x7ff8340ae510 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 --2- 172.21.15.37:0/1806103347 >> v2:172.21.15.83:3300/0 conn(0x7ff8341587d0 0x7ff83415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 -- 172.21.15.37:0/1806103347 >> 172.21.15.37:0/1806103347 conn(0x7ff8340cc5f0 msgr2=0x7ff8340cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 -- 172.21.15.37:0/1806103347 shutdown_connections 2023-10-06T04:40:19.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 -- 172.21.15.37:0/1806103347 wait complete. 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 Processor -- start 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 -- start start 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff834068400 0x7ff8340d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8341587d0 0x7ff83416bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff834158ba0 0x7ff8340c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c6380 con 0x7ff8341587d0 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff834156760 con 0x7ff834158ba0 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff834152de0 con 0x7ff834068400 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff831d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8341587d0 0x7ff83416bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff831d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8341587d0 0x7ff83416bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60968/0 (socket says 172.21.15.37:60968) 2023-10-06T04:40:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff831d9b700 1 -- 172.21.15.37:0/296837313 learned_addr learned my addr 172.21.15.37:0/296837313 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff832d9d700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff834158ba0 0x7ff8340c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff83259c700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff834068400 0x7ff8340d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff832d9d700 1 -- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff834068400 msgr2=0x7ff8340d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff832d9d700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff834068400 0x7ff8340d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff832d9d700 1 -- 172.21.15.37:0/296837313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8341587d0 msgr2=0x7ff83416bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff832d9d700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8341587d0 0x7ff83416bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff832d9d700 1 -- 172.21.15.37:0/296837313 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c009ae0 con 0x7ff834158ba0 2023-10-06T04:40:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.540+0000 7ff832d9d700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff834158ba0 0x7ff8340c53f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff82c015000 tx=0x7ff82c018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.544+0000 7ff8227fc700 1 -- 172.21.15.37:0/296837313 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c008a80 con 0x7ff834158ba0 2023-10-06T04:40:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.544+0000 7ff8227fc700 1 -- 172.21.15.37:0/296837313 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c008c00 con 0x7ff834158ba0 2023-10-06T04:40:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.544+0000 7ff83359e700 1 -- 172.21.15.37:0/296837313 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8341530c0 con 0x7ff834158ba0 2023-10-06T04:40:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.544+0000 7ff8227fc700 1 -- 172.21.15.37:0/296837313 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c025460 con 0x7ff834158ba0 2023-10-06T04:40:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.544+0000 7ff83359e700 1 -- 172.21.15.37:0/296837313 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83416c100 con 0x7ff834158ba0 2023-10-06T04:40:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.544+0000 7ff83359e700 1 -- 172.21.15.37:0/296837313 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8340af5b0 con 0x7ff834158ba0 2023-10-06T04:40:19.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.544+0000 7ff8227fc700 1 -- 172.21.15.37:0/296837313 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff82c003040 con 0x7ff834158ba0 2023-10-06T04:40:19.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.544+0000 7ff8227fc700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8140605d0 0x7ff814062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.544+0000 7ff8227fc700 1 -- 172.21.15.37:0/296837313 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff82c07e650 con 0x7ff834158ba0 2023-10-06T04:40:19.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.544+0000 7ff83259c700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8140605d0 0x7ff814062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.548+0000 7ff83259c700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8140605d0 0x7ff814062a80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff828009db0 tx=0x7ff8280091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.552+0000 7ff8227fc700 1 -- 172.21.15.37:0/296837313 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff82c04e9c0 con 0x7ff834158ba0 2023-10-06T04:40:19.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.720+0000 7ff83359e700 1 -- 172.21.15.37:0/296837313 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8340af5b0 con 0x7ff834158ba0 2023-10-06T04:40:19.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.720+0000 7ff8227fc700 1 -- 172.21.15.37:0/296837313 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17023 (secure 0 0 0) 0x7ff8340af5b0 con 0x7ff834158ba0 2023-10-06T04:40:19.728 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:19.728 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":42,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:40:17.650875+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:14.249153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:15.385254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.724+0000 7ff83359e700 1 -- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8140605d0 msgr2=0x7ff814062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.724+0000 7ff83359e700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8140605d0 0x7ff814062a80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff828009db0 tx=0x7ff8280091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.724+0000 7ff83359e700 1 -- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff834158ba0 msgr2=0x7ff8340c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.724+0000 7ff83359e700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff834158ba0 0x7ff8340c53f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff82c015000 tx=0x7ff82c018000 comp rx=0 tx=0).stop 2023-10-06T04:40:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.724+0000 7ff83359e700 1 -- 172.21.15.37:0/296837313 shutdown_connections 2023-10-06T04:40:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.724+0000 7ff83359e700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8140605d0 0x7ff814062a80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.724+0000 7ff83359e700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff834158ba0 0x7ff8340c53f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.724+0000 7ff83359e700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8341587d0 0x7ff83416bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.724+0000 7ff83359e700 1 --2- 172.21.15.37:0/296837313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff834068400 0x7ff8340d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.724+0000 7ff83359e700 1 -- 172.21.15.37:0/296837313 >> 172.21.15.37:0/296837313 conn(0x7ff8340cc5f0 msgr2=0x7ff8340ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.724+0000 7ff83359e700 1 -- 172.21.15.37:0/296837313 shutdown_connections 2023-10-06T04:40:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.724+0000 7ff83359e700 1 -- 172.21.15.37:0/296837313 wait complete. 2023-10-06T04:40:19.746 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:40:19.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f743eb54700 1 Processor -- start 2023-10-06T04:40:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f743eb54700 1 -- start start 2023-10-06T04:40:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f743eb54700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74380cbd50 0x7f74380cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f743eb54700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f74380ad750 0x7f74380adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f743eb54700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74380c8b60 con 0x7f74381555c0 2023-10-06T04:40:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f743eb54700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74380ae0e0 con 0x7f74380ad750 2023-10-06T04:40:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f743eb54700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743815a6e0 con 0x7f74380cbd50 2023-10-06T04:40:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f7437fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f74380ad750 0x7f74380adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f7437fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f74380ad750 0x7f74380adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60976/0 (socket says 172.21.15.37:60976) 2023-10-06T04:40:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f7437fff700 1 -- 172.21.15.37:0/677473083 learned_addr learned my addr 172.21.15.37:0/677473083 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f743c8f0700 1 --2- 172.21.15.37:0/677473083 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74380cbd50 0x7f74380cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f7437fff700 1 -- 172.21.15.37:0/677473083 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74380cbd50 msgr2=0x7f74380cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f7437fff700 1 --2- 172.21.15.37:0/677473083 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74380cbd50 0x7f74380cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f7437fff700 1 -- 172.21.15.37:0/677473083 >> v1:172.21.15.83:6789/0 conn(0x7f74381555c0 legacy=0x7f7438155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f7437fff700 1 -- 172.21.15.37:0/677473083 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380ae2c0 con 0x7f74380ad750 2023-10-06T04:40:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f7437fff700 1 --2- 172.21.15.37:0/677473083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74380ad750 0x7f74380adba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f74240099b0 tx=0x7f7424009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eceb4b58e3b7afe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.848+0000 7f74377fe700 1 -- 172.21.15.37:0/677473083 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400b860 con 0x7f74380ad750 2023-10-06T04:40:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.852+0000 7f74377fe700 1 -- 172.21.15.37:0/677473083 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742400b9c0 con 0x7f74380ad750 2023-10-06T04:40:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.852+0000 7f74377fe700 1 -- 172.21.15.37:0/677473083 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400bd60 con 0x7f74380ad750 2023-10-06T04:40:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.852+0000 7f743eb54700 1 -- 172.21.15.37:0/677473083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74380ad750 msgr2=0x7f74380adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.852+0000 7f743eb54700 1 --2- 172.21.15.37:0/677473083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74380ad750 0x7f74380adba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f74240099b0 tx=0x7f7424009250 comp rx=0 tx=0).stop 2023-10-06T04:40:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.852+0000 7f743eb54700 1 -- 172.21.15.37:0/677473083 shutdown_connections 2023-10-06T04:40:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.852+0000 7f743eb54700 1 --2- 172.21.15.37:0/677473083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74380ad750 0x7f74380adba0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.852+0000 7f743eb54700 1 --2- 172.21.15.37:0/677473083 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74380cbd50 0x7f74380cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.852+0000 7f743eb54700 1 -- 172.21.15.37:0/677473083 >> 172.21.15.37:0/677473083 conn(0x7f74380667b0 msgr2=0x7f7438066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.852+0000 7f743eb54700 1 -- 172.21.15.37:0/677473083 shutdown_connections 2023-10-06T04:40:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.852+0000 7f743eb54700 1 -- 172.21.15.37:0/677473083 wait complete. 2023-10-06T04:40:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.852+0000 7f743eb54700 1 Processor -- start 2023-10-06T04:40:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.852+0000 7f743eb54700 1 -- start start 2023-10-06T04:40:19.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743eb54700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74380ad750 0x7f74380c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743eb54700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74380cbd50 0x7f74381548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743eb54700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74381555c0 0x7f7438067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743eb54700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74380c2650 con 0x7f74380ad750 2023-10-06T04:40:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743eb54700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74380c21c0 con 0x7f74380cbd50 2023-10-06T04:40:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743eb54700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7438154df0 con 0x7f74381555c0 2023-10-06T04:40:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743c8f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74380ad750 0x7f74380c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743c8f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74380ad750 0x7f74380c0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60980/0 (socket says 172.21.15.37:60980) 2023-10-06T04:40:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743c8f0700 1 -- 172.21.15.37:0/3013074542 learned_addr learned my addr 172.21.15.37:0/3013074542 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f7437fff700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74380cbd50 0x7f74381548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743d0f1700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74381555c0 0x7f7438067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743c8f0700 1 -- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74381555c0 msgr2=0x7f7438067f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743c8f0700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74381555c0 0x7f7438067f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743c8f0700 1 -- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74380cbd50 msgr2=0x7f74381548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743c8f0700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74380cbd50 0x7f74381548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743c8f0700 1 -- 172.21.15.37:0/3013074542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74240094f0 con 0x7f74380ad750 2023-10-06T04:40:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743c8f0700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74380ad750 0x7f74380c0fa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f742c00d890 tx=0x7f742c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f7434ff9700 1 -- 172.21.15.37:0/3013074542 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c0125f0 con 0x7f74380ad750 2023-10-06T04:40:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f7434ff9700 1 -- 172.21.15.37:0/3013074542 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c012750 con 0x7f74380ad750 2023-10-06T04:40:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743eb54700 1 -- 172.21.15.37:0/3013074542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74380c15b0 con 0x7f74380ad750 2023-10-06T04:40:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f7434ff9700 1 -- 172.21.15.37:0/3013074542 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c012af0 con 0x7f74380ad750 2023-10-06T04:40:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743eb54700 1 -- 172.21.15.37:0/3013074542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74380c1b70 con 0x7f74380ad750 2023-10-06T04:40:19.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.856+0000 7f743eb54700 1 -- 172.21.15.37:0/3013074542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7438070ee0 con 0x7f74380ad750 2023-10-06T04:40:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.860+0000 7f7434ff9700 1 -- 172.21.15.37:0/3013074542 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f742c01e460 con 0x7f74380ad750 2023-10-06T04:40:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.860+0000 7f7434ff9700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f741c060580 0x7f741c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.860+0000 7f7434ff9700 1 -- 172.21.15.37:0/3013074542 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f742c07d060 con 0x7f74380ad750 2023-10-06T04:40:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.860+0000 7f7437fff700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f741c060580 0x7f741c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.860+0000 7f7437fff700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f741c060580 0x7f741c062a30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f74240099b0 tx=0x7f7424017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:19.868+0000 7f7434ff9700 1 -- 172.21.15.37:0/3013074542 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f742c0acbe0 con 0x7f74380ad750 2023-10-06T04:40:20.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.032+0000 7f743eb54700 1 -- 172.21.15.37:0/3013074542 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74380c2300 con 0x7f741c060580 2023-10-06T04:40:20.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.052+0000 7f7434ff9700 1 -- 172.21.15.37:0/3013074542 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309312 (secure 0 0 0) 0x7f742400bb30 con 0x7f741c060580 2023-10-06T04:40:20.063 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.060+0000 7f743eb54700 1 -- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f741c060580 msgr2=0x7f741c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.060+0000 7f743eb54700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f741c060580 0x7f741c062a30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f74240099b0 tx=0x7f7424017000 comp rx=0 tx=0).stop 2023-10-06T04:40:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.060+0000 7f743eb54700 1 -- 172.21.15.37:0/3013074542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74380ad750 msgr2=0x7f74380c0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.060+0000 7f743eb54700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74380ad750 0x7f74380c0fa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f742c00d890 tx=0x7f742c008040 comp rx=0 tx=0).stop 2023-10-06T04:40:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.060+0000 7f743eb54700 1 -- 172.21.15.37:0/3013074542 shutdown_connections 2023-10-06T04:40:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.060+0000 7f743eb54700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f741c060580 0x7f741c062a30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.060+0000 7f743eb54700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74380cbd50 0x7f74381548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.060+0000 7f743eb54700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74381555c0 0x7f7438067f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.060+0000 7f743eb54700 1 --2- 172.21.15.37:0/3013074542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74380ad750 0x7f74380c0fa0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.060+0000 7f743eb54700 1 -- 172.21.15.37:0/3013074542 >> 172.21.15.37:0/3013074542 conn(0x7f74380667b0 msgr2=0x7f74380ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.060+0000 7f743eb54700 1 -- 172.21.15.37:0/3013074542 shutdown_connections 2023-10-06T04:40:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.060+0000 7f743eb54700 1 -- 172.21.15.37:0/3013074542 wait complete. 2023-10-06T04:40:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:40:20.084 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-10-06T04:40:19.053656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387176,"kb_used_data":4776,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752587544,"statfs":{"total":773094113280,"available":770649645056,"internally_reserved":0,"allocated":4890624,"data_stored":2812836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039405"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.673739+0000","last_change":"2023-10-06T04:40:16.673739+0000","last_active":"2023-10-06T04:40:16.673739+0000","last_peered":"2023-10-06T04:40:16.673739+0000","last_clean":"2023-10-06T04:40:16.673739+0000","last_became_active":"2023-10-06T04:40:16.673410+0000","last_became_peered":"2023-10-06T04:40:16.673410+0000","last_unstale":"2023-10-06T04:40:16.673739+0000","last_undegraded":"2023-10-06T04:40:16.673739+0000","last_fullsized":"2023-10-06T04:40:16.673739+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:23:12.147820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.689245+0000","last_change":"2023-10-06T04:40:16.689245+0000","last_active":"2023-10-06T04:40:16.689245+0000","last_peered":"2023-10-06T04:40:16.689245+0000","last_clean":"2023-10-06T04:40:16.689245+0000","last_became_active":"2023-10-06T04:40:16.688880+0000","last_became_peered":"2023-10-06T04:40:16.688880+0000","last_unstale":"2023-10-06T04:40:16.689245+0000","last_undegraded":"2023-10-06T04:40:16.689245+0000","last_fullsized":"2023-10-06T04:40:16.689245+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:39.402305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.671464+0000","last_change":"2023-10-06T04:40:16.671464+0000","last_active":"2023-10-06T04:40:16.671464+0000","last_peered":"2023-10-06T04:40:16.671464+0000","last_clean":"2023-10-06T04:40:16.671464+0000","last_became_active":"2023-10-06T04:40:16.671139+0000","last_became_peered":"2023-10-06T04:40:16.671139+0000","last_unstale":"2023-10-06T04:40:16.671464+0000","last_undegraded":"2023-10-06T04:40:16.671464+0000","last_fullsized":"2023-10-06T04:40:16.671464+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:43.111255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.685344+0000","last_change":"2023-10-06T04:40:16.685344+0000","last_active":"2023-10-06T04:40:16.685344+0000","last_peered":"2023-10-06T04:40:16.685344+0000","last_clean":"2023-10-06T04:40:16.685344+0000","last_became_active":"2023-10-06T04:40:16.684907+0000","last_became_peered":"2023-10-06T04:40:16.684907+0000","last_unstale":"2023-10-06T04:40:16.685344+0000","last_undegraded":"2023-10-06T04:40:16.685344+0000","last_fullsized":"2023-10-06T04:40:16.685344+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:45.306880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.686814+0000","last_change":"2023-10-06T04:40:16.686814+0000","last_active":"2023-10-06T04:40:16.686814+0000","last_peered":"2023-10-06T04:40:16.686814+0000","last_clean":"2023-10-06T04:40:16.686814+0000","last_became_active":"2023-10-06T04:40:16.686487+0000","last_became_peered":"2023-10-06T04:40:16.686487+0000","last_unstale":"2023-10-06T04:40:16.686814+0000","last_undegraded":"2023-10-06T04:40:16.686814+0000","last_fullsized":"2023-10-06T04:40:16.686814+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:19.502785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681801+0000","last_change":"2023-10-06T04:40:16.675203+0000","last_active":"2023-10-06T04:40:16.681801+0000","last_peered":"2023-10-06T04:40:16.681801+0000","last_clean":"2023-10-06T04:40:16.681801+0000","last_became_active":"2023-10-06T04:40:16.674905+0000","last_became_peered":"2023-10-06T04:40:16.674905+0000","last_unstale":"2023-10-06T04:40:16.681801+0000","last_undegraded":"2023-10-06T04:40:16.681801+0000","last_fullsized":"2023-10-06T04:40:16.681801+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:08.816116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.676358+0000","last_change":"2023-10-06T04:40:16.676358+0000","last_active":"2023-10-06T04:40:16.676358+0000","last_peered":"2023-10-06T04:40:16.676358+0000","last_clean":"2023-10-06T04:40:16.676358+0000","last_became_active":"2023-10-06T04:40:16.676062+0000","last_became_peered":"2023-10-06T04:40:16.676062+0000","last_unstale":"2023-10-06T04:40:16.676358+0000","last_undegraded":"2023-10-06T04:40:16.676358+0000","last_fullsized":"2023-10-06T04:40:16.676358+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:27.011953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.685837+0000","last_change":"2023-10-06T04:40:16.685837+0000","last_active":"2023-10-06T04:40:16.685837+0000","last_peered":"2023-10-06T04:40:16.685837+0000","last_clean":"2023-10-06T04:40:16.685837+0000","last_became_active":"2023-10-06T04:40:16.682908+0000","last_became_peered":"2023-10-06T04:40:16.682908+0000","last_unstale":"2023-10-06T04:40:16.685837+0000","last_undegraded":"2023-10-06T04:40:16.685837+0000","last_fullsized":"2023-10-06T04:40:16.685837+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:21.163939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.682432+0000","last_change":"2023-10-06T04:40:16.682432+0000","last_active":"2023-10-06T04:40:16.682432+0000","last_peered":"2023-10-06T04:40:16.682432+0000","last_clean":"2023-10-06T04:40:16.682432+0000","last_became_active":"2023-10-06T04:40:16.679957+0000","last_became_peered":"2023-10-06T04:40:16.679957+0000","last_unstale":"2023-10-06T04:40:16.682432+0000","last_undegraded":"2023-10-06T04:40:16.682432+0000","last_fullsized":"2023-10-06T04:40:16.682432+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:43.111255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.688072+0000","last_change":"2023-10-06T04:40:16.688072+0000","last_active":"2023-10-06T04:40:16.688072+0000","last_peered":"2023-10-06T04:40:16.688072+0000","last_clean":"2023-10-06T04:40:16.688072+0000","last_became_active":"2023-10-06T04:40:16.687698+0000","last_became_peered":"2023-10-06T04:40:16.687698+0000","last_unstale":"2023-10-06T04:40:16.688072+0000","last_undegraded":"2023-10-06T04:40:16.688072+0000","last_fullsized":"2023-10-06T04:40:16.688072+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:01.381508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.679700+0000","last_change":"2023-10-06T04:40:16.679700+0000","last_active":"2023-10-06T04:40:16.679700+0000","last_peered":"2023-10-06T04:40:16.679700+0000","last_clean":"2023-10-06T04:40:16.679700+0000","last_became_active":"2023-10-06T04:40:16.679368+0000","last_became_peered":"2023-10-06T04:40:16.679368+0000","last_unstale":"2023-10-06T04:40:16.679700+0000","last_undegraded":"2023-10-06T04:40:16.679700+0000","last_fullsized":"2023-10-06T04:40:16.679700+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:40.982645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.675819+0000","last_change":"2023-10-06T04:40:16.675819+0000","last_active":"2023-10-06T04:40:16.675819+0000","last_peered":"2023-10-06T04:40:16.675819+0000","last_clean":"2023-10-06T04:40:16.675819+0000","last_became_active":"2023-10-06T04:40:16.672933+0000","last_became_peered":"2023-10-06T04:40:16.672933+0000","last_unstale":"2023-10-06T04:40:16.675819+0000","last_undegraded":"2023-10-06T04:40:16.675819+0000","last_fullsized":"2023-10-06T04:40:16.675819+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:22.941848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.673518+0000","last_change":"2023-10-06T04:40:16.673518+0000","last_active":"2023-10-06T04:40:16.673518+0000","last_peered":"2023-10-06T04:40:16.673518+0000","last_clean":"2023-10-06T04:40:16.673518+0000","last_became_active":"2023-10-06T04:40:16.673111+0000","last_became_peered":"2023-10-06T04:40:16.673111+0000","last_unstale":"2023-10-06T04:40:16.673518+0000","last_undegraded":"2023-10-06T04:40:16.673518+0000","last_fullsized":"2023-10-06T04:40:16.673518+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:15.990571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.685567+0000","last_change":"2023-10-06T04:40:16.685567+0000","last_active":"2023-10-06T04:40:16.685567+0000","last_peered":"2023-10-06T04:40:16.685567+0000","last_clean":"2023-10-06T04:40:16.685567+0000","last_became_active":"2023-10-06T04:40:16.684711+0000","last_became_peered":"2023-10-06T04:40:16.684711+0000","last_unstale":"2023-10-06T04:40:16.685567+0000","last_undegraded":"2023-10-06T04:40:16.685567+0000","last_fullsized":"2023-10-06T04:40:16.685567+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:21.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.674633+0000","last_change":"2023-10-06T04:40:16.665946+0000","last_active":"2023-10-06T04:40:16.674633+0000","last_peered":"2023-10-06T04:40:16.674633+0000","last_clean":"2023-10-06T04:40:16.674633+0000","last_became_active":"2023-10-06T04:40:16.665606+0000","last_became_peered":"2023-10-06T04:40:16.665606+0000","last_unstale":"2023-10-06T04:40:16.674633+0000","last_undegraded":"2023-10-06T04:40:16.674633+0000","last_fullsized":"2023-10-06T04:40:16.674633+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:40.982645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.689976+0000","last_change":"2023-10-06T04:40:16.689976+0000","last_active":"2023-10-06T04:40:16.689976+0000","last_peered":"2023-10-06T04:40:16.689976+0000","last_clean":"2023-10-06T04:40:16.689976+0000","last_became_active":"2023-10-06T04:40:16.689708+0000","last_became_peered":"2023-10-06T04:40:16.689708+0000","last_unstale":"2023-10-06T04:40:16.689976+0000","last_undegraded":"2023-10-06T04:40:16.689976+0000","last_fullsized":"2023-10-06T04:40:16.689976+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:25.061931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681272+0000","last_change":"2023-10-06T04:40:16.681272+0000","last_active":"2023-10-06T04:40:16.681272+0000","last_peered":"2023-10-06T04:40:16.681272+0000","last_clean":"2023-10-06T04:40:16.681272+0000","last_became_active":"2023-10-06T04:40:16.680957+0000","last_became_peered":"2023-10-06T04:40:16.680957+0000","last_unstale":"2023-10-06T04:40:16.681272+0000","last_undegraded":"2023-10-06T04:40:16.681272+0000","last_fullsized":"2023-10-06T04:40:16.681272+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:27.638087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.685314+0000","last_change":"2023-10-06T04:40:16.685314+0000","last_active":"2023-10-06T04:40:16.685314+0000","last_peered":"2023-10-06T04:40:16.685314+0000","last_clean":"2023-10-06T04:40:16.685314+0000","last_became_active":"2023-10-06T04:40:16.684991+0000","last_became_peered":"2023-10-06T04:40:16.684991+0000","last_unstale":"2023-10-06T04:40:16.685314+0000","last_undegraded":"2023-10-06T04:40:16.685314+0000","last_fullsized":"2023-10-06T04:40:16.685314+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:03.602422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.684778+0000","last_change":"2023-10-06T04:40:16.684778+0000","last_active":"2023-10-06T04:40:16.684778+0000","last_peered":"2023-10-06T04:40:16.684778+0000","last_clean":"2023-10-06T04:40:16.684778+0000","last_became_active":"2023-10-06T04:40:16.684444+0000","last_became_peered":"2023-10-06T04:40:16.684444+0000","last_unstale":"2023-10-06T04:40:16.684778+0000","last_undegraded":"2023-10-06T04:40:16.684778+0000","last_fullsized":"2023-10-06T04:40:16.684778+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:01.110437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.686542+0000","last_change":"2023-10-06T04:40:16.686542+0000","last_active":"2023-10-06T04:40:16.686542+0000","last_peered":"2023-10-06T04:40:16.686542+0000","last_clean":"2023-10-06T04:40:16.686542+0000","last_became_active":"2023-10-06T04:40:16.686176+0000","last_became_peered":"2023-10-06T04:40:16.686176+0000","last_unstale":"2023-10-06T04:40:16.686542+0000","last_undegraded":"2023-10-06T04:40:16.686542+0000","last_fullsized":"2023-10-06T04:40:16.686542+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:59:00.564452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681873+0000","last_change":"2023-10-06T04:40:16.675659+0000","last_active":"2023-10-06T04:40:16.681873+0000","last_peered":"2023-10-06T04:40:16.681873+0000","last_clean":"2023-10-06T04:40:16.681873+0000","last_became_active":"2023-10-06T04:40:16.675357+0000","last_became_peered":"2023-10-06T04:40:16.675357+0000","last_unstale":"2023-10-06T04:40:16.681873+0000","last_undegraded":"2023-10-06T04:40:16.681873+0000","last_fullsized":"2023-10-06T04:40:16.681873+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:14.158434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.684945+0000","last_change":"2023-10-06T04:40:16.684945+0000","last_active":"2023-10-06T04:40:16.684945+0000","last_peered":"2023-10-06T04:40:16.684945+0000","last_clean":"2023-10-06T04:40:16.684945+0000","last_became_active":"2023-10-06T04:40:16.683610+0000","last_became_peered":"2023-10-06T04:40:16.683610+0000","last_unstale":"2023-10-06T04:40:16.684945+0000","last_undegraded":"2023-10-06T04:40:16.684945+0000","last_fullsized":"2023-10-06T04:40:16.684945+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:43.967016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.678502+0000","last_change":"2023-10-06T04:40:16.678502+0000","last_active":"2023-10-06T04:40:16.678502+0000","last_peered":"2023-10-06T04:40:16.678502+0000","last_clean":"2023-10-06T04:40:16.678502+0000","last_became_active":"2023-10-06T04:40:16.677196+0000","last_became_peered":"2023-10-06T04:40:16.677196+0000","last_unstale":"2023-10-06T04:40:16.678502+0000","last_undegraded":"2023-10-06T04:40:16.678502+0000","last_fullsized":"2023-10-06T04:40:16.678502+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:16.229803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.678407+0000","last_change":"2023-10-06T04:40:16.678407+0000","last_active":"2023-10-06T04:40:16.678407+0000","last_peered":"2023-10-06T04:40:16.678407+0000","last_clean":"2023-10-06T04:40:16.678407+0000","last_became_active":"2023-10-06T04:40:16.678095+0000","last_became_peered":"2023-10-06T04:40:16.678095+0000","last_unstale":"2023-10-06T04:40:16.678407+0000","last_undegraded":"2023-10-06T04:40:16.678407+0000","last_fullsized":"2023-10-06T04:40:16.678407+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:25.935569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681806+0000","last_change":"2023-10-06T04:40:16.681806+0000","last_active":"2023-10-06T04:40:16.681806+0000","last_peered":"2023-10-06T04:40:16.681806+0000","last_clean":"2023-10-06T04:40:16.681806+0000","last_became_active":"2023-10-06T04:40:16.681460+0000","last_became_peered":"2023-10-06T04:40:16.681460+0000","last_unstale":"2023-10-06T04:40:16.681806+0000","last_undegraded":"2023-10-06T04:40:16.681806+0000","last_fullsized":"2023-10-06T04:40:16.681806+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:19.423049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.676880+0000","last_change":"2023-10-06T04:40:16.676880+0000","last_active":"2023-10-06T04:40:16.676880+0000","last_peered":"2023-10-06T04:40:16.676880+0000","last_clean":"2023-10-06T04:40:16.676880+0000","last_became_active":"2023-10-06T04:40:16.676565+0000","last_became_peered":"2023-10-06T04:40:16.676565+0000","last_unstale":"2023-10-06T04:40:16.676880+0000","last_undegraded":"2023-10-06T04:40:16.676880+0000","last_fullsized":"2023-10-06T04:40:16.676880+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:10.156881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.673947+0000","last_change":"2023-10-06T04:40:16.673947+0000","last_active":"2023-10-06T04:40:16.673947+0000","last_peered":"2023-10-06T04:40:16.673947+0000","last_clean":"2023-10-06T04:40:16.673947+0000","last_became_active":"2023-10-06T04:40:16.673619+0000","last_became_peered":"2023-10-06T04:40:16.673619+0000","last_unstale":"2023-10-06T04:40:16.673947+0000","last_undegraded":"2023-10-06T04:40:16.673947+0000","last_fullsized":"2023-10-06T04:40:16.673947+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:08.816116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.680291+0000","last_change":"2023-10-06T04:40:16.680291+0000","last_active":"2023-10-06T04:40:16.680291+0000","last_peered":"2023-10-06T04:40:16.680291+0000","last_clean":"2023-10-06T04:40:16.680291+0000","last_became_active":"2023-10-06T04:40:16.680033+0000","last_became_peered":"2023-10-06T04:40:16.680033+0000","last_unstale":"2023-10-06T04:40:16.680291+0000","last_undegraded":"2023-10-06T04:40:16.680291+0000","last_fullsized":"2023-10-06T04:40:16.680291+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:58.185477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681417+0000","last_change":"2023-10-06T04:40:16.681417+0000","last_active":"2023-10-06T04:40:16.681417+0000","last_peered":"2023-10-06T04:40:16.681417+0000","last_clean":"2023-10-06T04:40:16.681417+0000","last_became_active":"2023-10-06T04:40:16.681113+0000","last_became_peered":"2023-10-06T04:40:16.681113+0000","last_unstale":"2023-10-06T04:40:16.681417+0000","last_undegraded":"2023-10-06T04:40:16.681417+0000","last_fullsized":"2023-10-06T04:40:16.681417+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:03.616182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.675804+0000","last_change":"2023-10-06T04:40:16.675804+0000","last_active":"2023-10-06T04:40:16.675804+0000","last_peered":"2023-10-06T04:40:16.675804+0000","last_clean":"2023-10-06T04:40:16.675804+0000","last_became_active":"2023-10-06T04:40:16.675454+0000","last_became_peered":"2023-10-06T04:40:16.675454+0000","last_unstale":"2023-10-06T04:40:16.675804+0000","last_undegraded":"2023-10-06T04:40:16.675804+0000","last_fullsized":"2023-10-06T04:40:16.675804+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:01.381508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.678690+0000","last_change":"2023-10-06T04:40:16.673336+0000","last_active":"2023-10-06T04:40:16.678690+0000","last_peered":"2023-10-06T04:40:16.678690+0000","last_clean":"2023-10-06T04:40:16.678690+0000","last_became_active":"2023-10-06T04:40:16.672537+0000","last_became_peered":"2023-10-06T04:40:16.672537+0000","last_unstale":"2023-10-06T04:40:16.678690+0000","last_undegraded":"2023-10-06T04:40:16.678690+0000","last_fullsized":"2023-10-06T04:40:16.678690+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:01.381508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.670291+0000","last_change":"2023-10-06T04:40:16.670291+0000","last_active":"2023-10-06T04:40:16.670291+0000","last_peered":"2023-10-06T04:40:16.670291+0000","last_clean":"2023-10-06T04:40:16.670291+0000","last_became_active":"2023-10-06T04:40:16.669139+0000","last_became_peered":"2023-10-06T04:40:16.669139+0000","last_unstale":"2023-10-06T04:40:16.670291+0000","last_undegraded":"2023-10-06T04:40:16.670291+0000","last_fullsized":"2023-10-06T04:40:16.670291+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:56.151507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.676149+0000","last_change":"2023-10-06T04:40:16.676149+0000","last_active":"2023-10-06T04:40:16.676149+0000","last_peered":"2023-10-06T04:40:16.676149+0000","last_clean":"2023-10-06T04:40:16.676149+0000","last_became_active":"2023-10-06T04:40:16.675790+0000","last_became_peered":"2023-10-06T04:40:16.675790+0000","last_unstale":"2023-10-06T04:40:16.676149+0000","last_undegraded":"2023-10-06T04:40:16.676149+0000","last_fullsized":"2023-10-06T04:40:16.676149+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:56.151507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.049491+0000","last_change":"2023-10-06T04:40:16.052768+0000","last_active":"2023-10-06T04:40:17.049491+0000","last_peered":"2023-10-06T04:40:17.049491+0000","last_clean":"2023-10-06T04:40:17.049491+0000","last_became_active":"2023-10-06T04:40:16.052473+0000","last_became_peered":"2023-10-06T04:40:16.052473+0000","last_unstale":"2023-10-06T04:40:17.049491+0000","last_undegraded":"2023-10-06T04:40:17.049491+0000","last_fullsized":"2023-10-06T04:40:17.049491+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:50.962886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.677485+0000","last_change":"2023-10-06T04:40:16.677485+0000","last_active":"2023-10-06T04:40:16.677485+0000","last_peered":"2023-10-06T04:40:16.677485+0000","last_clean":"2023-10-06T04:40:16.677485+0000","last_became_active":"2023-10-06T04:40:16.677178+0000","last_became_peered":"2023-10-06T04:40:16.677178+0000","last_unstale":"2023-10-06T04:40:16.677485+0000","last_undegraded":"2023-10-06T04:40:16.677485+0000","last_fullsized":"2023-10-06T04:40:16.677485+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:37.854095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.661605+0000","last_change":"2023-10-06T04:40:16.043615+0000","last_active":"2023-10-06T04:40:16.661605+0000","last_peered":"2023-10-06T04:40:16.661605+0000","last_clean":"2023-10-06T04:40:16.661605+0000","last_became_active":"2023-10-06T04:40:16.043343+0000","last_became_peered":"2023-10-06T04:40:16.043343+0000","last_unstale":"2023-10-06T04:40:16.661605+0000","last_undegraded":"2023-10-06T04:40:16.661605+0000","last_fullsized":"2023-10-06T04:40:16.661605+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:37.682647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.679781+0000","last_change":"2023-10-06T04:40:16.679781+0000","last_active":"2023-10-06T04:40:16.679781+0000","last_peered":"2023-10-06T04:40:16.679781+0000","last_clean":"2023-10-06T04:40:16.679781+0000","last_became_active":"2023-10-06T04:40:16.679453+0000","last_became_peered":"2023-10-06T04:40:16.679453+0000","last_unstale":"2023-10-06T04:40:16.679781+0000","last_undegraded":"2023-10-06T04:40:16.679781+0000","last_fullsized":"2023-10-06T04:40:16.679781+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:00.730220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.042643+0000","last_change":"2023-10-06T04:40:16.048295+0000","last_active":"2023-10-06T04:40:17.042643+0000","last_peered":"2023-10-06T04:40:17.042643+0000","last_clean":"2023-10-06T04:40:17.042643+0000","last_became_active":"2023-10-06T04:40:16.047972+0000","last_became_peered":"2023-10-06T04:40:16.047972+0000","last_unstale":"2023-10-06T04:40:17.042643+0000","last_undegraded":"2023-10-06T04:40:17.042643+0000","last_fullsized":"2023-10-06T04:40:17.042643+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:26.093296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.676860+0000","last_change":"2023-10-06T04:40:16.676860+0000","last_active":"2023-10-06T04:40:16.676860+0000","last_peered":"2023-10-06T04:40:16.676860+0000","last_clean":"2023-10-06T04:40:16.676860+0000","last_became_active":"2023-10-06T04:40:16.676571+0000","last_became_peered":"2023-10-06T04:40:16.676571+0000","last_unstale":"2023-10-06T04:40:16.676860+0000","last_undegraded":"2023-10-06T04:40:16.676860+0000","last_fullsized":"2023-10-06T04:40:16.676860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:10.156881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.044200+0000","last_change":"2023-10-06T04:40:16.052519+0000","last_active":"2023-10-06T04:40:17.044200+0000","last_peered":"2023-10-06T04:40:17.044200+0000","last_clean":"2023-10-06T04:40:17.044200+0000","last_became_active":"2023-10-06T04:40:16.052291+0000","last_became_peered":"2023-10-06T04:40:16.052291+0000","last_unstale":"2023-10-06T04:40:17.044200+0000","last_undegraded":"2023-10-06T04:40:17.044200+0000","last_fullsized":"2023-10-06T04:40:17.044200+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:39.386753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.674712+0000","last_change":"2023-10-06T04:40:16.674712+0000","last_active":"2023-10-06T04:40:16.674712+0000","last_peered":"2023-10-06T04:40:16.674712+0000","last_clean":"2023-10-06T04:40:16.674712+0000","last_became_active":"2023-10-06T04:40:16.674361+0000","last_became_peered":"2023-10-06T04:40:16.674361+0000","last_unstale":"2023-10-06T04:40:16.674712+0000","last_undegraded":"2023-10-06T04:40:16.674712+0000","last_fullsized":"2023-10-06T04:40:16.674712+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:10.097264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.048104+0000","last_change":"2023-10-06T04:40:16.049077+0000","last_active":"2023-10-06T04:40:17.048104+0000","last_peered":"2023-10-06T04:40:17.048104+0000","last_clean":"2023-10-06T04:40:17.048104+0000","last_became_active":"2023-10-06T04:40:16.048191+0000","last_became_peered":"2023-10-06T04:40:16.048191+0000","last_unstale":"2023-10-06T04:40:17.048104+0000","last_undegraded":"2023-10-06T04:40:17.048104+0000","last_fullsized":"2023-10-06T04:40:17.048104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:23:11.133646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.685655+0000","last_change":"2023-10-06T04:40:16.685655+0000","last_active":"2023-10-06T04:40:16.685655+0000","last_peered":"2023-10-06T04:40:16.685655+0000","last_clean":"2023-10-06T04:40:16.685655+0000","last_became_active":"2023-10-06T04:40:16.685276+0000","last_became_peered":"2023-10-06T04:40:16.685276+0000","last_unstale":"2023-10-06T04:40:16.685655+0000","last_undegraded":"2023-10-06T04:40:16.685655+0000","last_fullsized":"2023-10-06T04:40:16.685655+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:17.964341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.661045+0000","last_change":"2023-10-06T04:40:16.043553+0000","last_active":"2023-10-06T04:40:16.661045+0000","last_peered":"2023-10-06T04:40:16.661045+0000","last_clean":"2023-10-06T04:40:16.661045+0000","last_became_active":"2023-10-06T04:40:16.043187+0000","last_became_peered":"2023-10-06T04:40:16.043187+0000","last_unstale":"2023-10-06T04:40:16.661045+0000","last_undegraded":"2023-10-06T04:40:16.661045+0000","last_fullsized":"2023-10-06T04:40:16.661045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:44.896559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.679927+0000","last_change":"2023-10-06T04:40:16.679927+0000","last_active":"2023-10-06T04:40:16.679927+0000","last_peered":"2023-10-06T04:40:16.679927+0000","last_clean":"2023-10-06T04:40:16.679927+0000","last_became_active":"2023-10-06T04:40:16.679435+0000","last_became_peered":"2023-10-06T04:40:16.679435+0000","last_unstale":"2023-10-06T04:40:16.679927+0000","last_undegraded":"2023-10-06T04:40:16.679927+0000","last_fullsized":"2023-10-06T04:40:16.679927+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:12.411273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.052193+0000","last_change":"2023-10-06T04:40:16.048844+0000","last_active":"2023-10-06T04:40:16.052193+0000","last_peered":"2023-10-06T04:40:16.052193+0000","last_clean":"2023-10-06T04:40:16.052193+0000","last_became_active":"2023-10-06T04:40:16.048570+0000","last_became_peered":"2023-10-06T04:40:16.048570+0000","last_unstale":"2023-10-06T04:40:16.052193+0000","last_undegraded":"2023-10-06T04:40:16.052193+0000","last_fullsized":"2023-10-06T04:40:16.052193+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:09.142707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.680564+0000","last_change":"2023-10-06T04:40:16.680564+0000","last_active":"2023-10-06T04:40:16.680564+0000","last_peered":"2023-10-06T04:40:16.680564+0000","last_clean":"2023-10-06T04:40:16.680564+0000","last_became_active":"2023-10-06T04:40:16.678370+0000","last_became_peered":"2023-10-06T04:40:16.678370+0000","last_unstale":"2023-10-06T04:40:16.680564+0000","last_undegraded":"2023-10-06T04:40:16.680564+0000","last_fullsized":"2023-10-06T04:40:16.680564+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:06.702825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.056882+0000","last_change":"2023-10-06T04:40:16.053867+0000","last_active":"2023-10-06T04:40:16.056882+0000","last_peered":"2023-10-06T04:40:16.056882+0000","last_clean":"2023-10-06T04:40:16.056882+0000","last_became_active":"2023-10-06T04:40:16.053286+0000","last_became_peered":"2023-10-06T04:40:16.053286+0000","last_unstale":"2023-10-06T04:40:16.056882+0000","last_undegraded":"2023-10-06T04:40:16.056882+0000","last_fullsized":"2023-10-06T04:40:16.056882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:40.703411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.689003+0000","last_change":"2023-10-06T04:40:16.689003+0000","last_active":"2023-10-06T04:40:16.689003+0000","last_peered":"2023-10-06T04:40:16.689003+0000","last_clean":"2023-10-06T04:40:16.689003+0000","last_became_active":"2023-10-06T04:40:16.688716+0000","last_became_peered":"2023-10-06T04:40:16.688716+0000","last_unstale":"2023-10-06T04:40:16.689003+0000","last_undegraded":"2023-10-06T04:40:16.689003+0000","last_fullsized":"2023-10-06T04:40:16.689003+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:04.927330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.049698+0000","last_change":"2023-10-06T04:40:16.044716+0000","last_active":"2023-10-06T04:40:16.049698+0000","last_peered":"2023-10-06T04:40:16.049698+0000","last_clean":"2023-10-06T04:40:16.049698+0000","last_became_active":"2023-10-06T04:40:16.044413+0000","last_became_peered":"2023-10-06T04:40:16.044413+0000","last_unstale":"2023-10-06T04:40:16.049698+0000","last_undegraded":"2023-10-06T04:40:16.049698+0000","last_fullsized":"2023-10-06T04:40:16.049698+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:25.997779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681185+0000","last_change":"2023-10-06T04:40:16.681185+0000","last_active":"2023-10-06T04:40:16.681185+0000","last_peered":"2023-10-06T04:40:16.681185+0000","last_clean":"2023-10-06T04:40:16.681185+0000","last_became_active":"2023-10-06T04:40:16.680897+0000","last_became_peered":"2023-10-06T04:40:16.680897+0000","last_unstale":"2023-10-06T04:40:16.681185+0000","last_undegraded":"2023-10-06T04:40:16.681185+0000","last_fullsized":"2023-10-06T04:40:16.681185+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:59.929528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.056880+0000","last_change":"2023-10-06T04:40:16.053205+0000","last_active":"2023-10-06T04:40:16.056880+0000","last_peered":"2023-10-06T04:40:16.056880+0000","last_clean":"2023-10-06T04:40:16.056880+0000","last_became_active":"2023-10-06T04:40:16.052922+0000","last_became_peered":"2023-10-06T04:40:16.052922+0000","last_unstale":"2023-10-06T04:40:16.056880+0000","last_undegraded":"2023-10-06T04:40:16.056880+0000","last_fullsized":"2023-10-06T04:40:16.056880+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:36.945866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.674857+0000","last_change":"2023-10-06T04:40:16.668371+0000","last_active":"2023-10-06T04:40:16.674857+0000","last_peered":"2023-10-06T04:40:16.674857+0000","last_clean":"2023-10-06T04:40:16.674857+0000","last_became_active":"2023-10-06T04:40:16.667259+0000","last_became_peered":"2023-10-06T04:40:16.667259+0000","last_unstale":"2023-10-06T04:40:16.674857+0000","last_undegraded":"2023-10-06T04:40:16.674857+0000","last_fullsized":"2023-10-06T04:40:16.674857+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:43.967016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.049116+0000","last_change":"2023-10-06T04:40:16.053478+0000","last_active":"2023-10-06T04:40:17.049116+0000","last_peered":"2023-10-06T04:40:17.049116+0000","last_clean":"2023-10-06T04:40:17.049116+0000","last_became_active":"2023-10-06T04:40:16.053191+0000","last_became_peered":"2023-10-06T04:40:16.053191+0000","last_unstale":"2023-10-06T04:40:17.049116+0000","last_undegraded":"2023-10-06T04:40:17.049116+0000","last_fullsized":"2023-10-06T04:40:17.049116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:50.962886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.679767+0000","last_change":"2023-10-06T04:40:16.679767+0000","last_active":"2023-10-06T04:40:16.679767+0000","last_peered":"2023-10-06T04:40:16.679767+0000","last_clean":"2023-10-06T04:40:16.679767+0000","last_became_active":"2023-10-06T04:40:16.679391+0000","last_became_peered":"2023-10-06T04:40:16.679391+0000","last_unstale":"2023-10-06T04:40:16.679767+0000","last_undegraded":"2023-10-06T04:40:16.679767+0000","last_fullsized":"2023-10-06T04:40:16.679767+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:42.238565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.048781+0000","last_change":"2023-10-06T04:40:16.040464+0000","last_active":"2023-10-06T04:40:17.048781+0000","last_peered":"2023-10-06T04:40:17.048781+0000","last_clean":"2023-10-06T04:40:17.048781+0000","last_became_active":"2023-10-06T04:40:16.040114+0000","last_became_peered":"2023-10-06T04:40:16.040114+0000","last_unstale":"2023-10-06T04:40:17.048781+0000","last_undegraded":"2023-10-06T04:40:17.048781+0000","last_fullsized":"2023-10-06T04:40:17.048781+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:24.921396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.689244+0000","last_change":"2023-10-06T04:40:16.689244+0000","last_active":"2023-10-06T04:40:16.689244+0000","last_peered":"2023-10-06T04:40:16.689244+0000","last_clean":"2023-10-06T04:40:16.689244+0000","last_became_active":"2023-10-06T04:40:16.688826+0000","last_became_peered":"2023-10-06T04:40:16.688826+0000","last_unstale":"2023-10-06T04:40:16.689244+0000","last_undegraded":"2023-10-06T04:40:16.689244+0000","last_fullsized":"2023-10-06T04:40:16.689244+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:27.107470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.048207+0000","last_change":"2023-10-06T04:40:16.053453+0000","last_active":"2023-10-06T04:40:17.048207+0000","last_peered":"2023-10-06T04:40:17.048207+0000","last_clean":"2023-10-06T04:40:17.048207+0000","last_became_active":"2023-10-06T04:40:16.053148+0000","last_became_peered":"2023-10-06T04:40:16.053148+0000","last_unstale":"2023-10-06T04:40:17.048207+0000","last_undegraded":"2023-10-06T04:40:17.048207+0000","last_fullsized":"2023-10-06T04:40:17.048207+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:15.129153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.682605+0000","last_change":"2023-10-06T04:40:16.682605+0000","last_active":"2023-10-06T04:40:16.682605+0000","last_peered":"2023-10-06T04:40:16.682605+0000","last_clean":"2023-10-06T04:40:16.682605+0000","last_became_active":"2023-10-06T04:40:16.682115+0000","last_became_peered":"2023-10-06T04:40:16.682115+0000","last_unstale":"2023-10-06T04:40:16.682605+0000","last_undegraded":"2023-10-06T04:40:16.682605+0000","last_fullsized":"2023-10-06T04:40:16.682605+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:36.993305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.060296+0000","last_change":"2023-10-06T04:40:16.058180+0000","last_active":"2023-10-06T04:40:16.060296+0000","last_peered":"2023-10-06T04:40:16.060296+0000","last_clean":"2023-10-06T04:40:16.060296+0000","last_became_active":"2023-10-06T04:40:16.057907+0000","last_became_peered":"2023-10-06T04:40:16.057907+0000","last_unstale":"2023-10-06T04:40:16.060296+0000","last_undegraded":"2023-10-06T04:40:16.060296+0000","last_fullsized":"2023-10-06T04:40:16.060296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:20.985389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.674575+0000","last_change":"2023-10-06T04:40:16.667724+0000","last_active":"2023-10-06T04:40:16.674575+0000","last_peered":"2023-10-06T04:40:16.674575+0000","last_clean":"2023-10-06T04:40:16.674575+0000","last_became_active":"2023-10-06T04:40:16.667406+0000","last_became_peered":"2023-10-06T04:40:16.667406+0000","last_unstale":"2023-10-06T04:40:16.674575+0000","last_undegraded":"2023-10-06T04:40:16.674575+0000","last_fullsized":"2023-10-06T04:40:16.674575+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:36.993305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.659172+0000","last_change":"2023-10-06T04:40:16.054523+0000","last_active":"2023-10-06T04:40:16.659172+0000","last_peered":"2023-10-06T04:40:16.659172+0000","last_clean":"2023-10-06T04:40:16.659172+0000","last_became_active":"2023-10-06T04:40:16.054210+0000","last_became_peered":"2023-10-06T04:40:16.054210+0000","last_unstale":"2023-10-06T04:40:16.659172+0000","last_undegraded":"2023-10-06T04:40:16.659172+0000","last_fullsized":"2023-10-06T04:40:16.659172+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:21.997654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.675774+0000","last_change":"2023-10-06T04:40:16.675774+0000","last_active":"2023-10-06T04:40:16.675774+0000","last_peered":"2023-10-06T04:40:16.675774+0000","last_clean":"2023-10-06T04:40:16.675774+0000","last_became_active":"2023-10-06T04:40:16.675428+0000","last_became_peered":"2023-10-06T04:40:16.675428+0000","last_unstale":"2023-10-06T04:40:16.675774+0000","last_undegraded":"2023-10-06T04:40:16.675774+0000","last_fullsized":"2023-10-06T04:40:16.675774+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:43:36.182092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.049559+0000","last_change":"2023-10-06T04:40:16.053550+0000","last_active":"2023-10-06T04:40:17.049559+0000","last_peered":"2023-10-06T04:40:17.049559+0000","last_clean":"2023-10-06T04:40:17.049559+0000","last_became_active":"2023-10-06T04:40:16.052973+0000","last_became_peered":"2023-10-06T04:40:16.052973+0000","last_unstale":"2023-10-06T04:40:17.049559+0000","last_undegraded":"2023-10-06T04:40:17.049559+0000","last_fullsized":"2023-10-06T04:40:17.049559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:21:52.682763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.680774+0000","last_change":"2023-10-06T04:40:16.680774+0000","last_active":"2023-10-06T04:40:16.680774+0000","last_peered":"2023-10-06T04:40:16.680774+0000","last_clean":"2023-10-06T04:40:16.680774+0000","last_became_active":"2023-10-06T04:40:16.680398+0000","last_became_peered":"2023-10-06T04:40:16.680398+0000","last_unstale":"2023-10-06T04:40:16.680774+0000","last_undegraded":"2023-10-06T04:40:16.680774+0000","last_fullsized":"2023-10-06T04:40:16.680774+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:21.280757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.660580+0000","last_change":"2023-10-06T04:40:16.047111+0000","last_active":"2023-10-06T04:40:16.660580+0000","last_peered":"2023-10-06T04:40:16.660580+0000","last_clean":"2023-10-06T04:40:16.660580+0000","last_became_active":"2023-10-06T04:40:16.046773+0000","last_became_peered":"2023-10-06T04:40:16.046773+0000","last_unstale":"2023-10-06T04:40:16.660580+0000","last_undegraded":"2023-10-06T04:40:16.660580+0000","last_fullsized":"2023-10-06T04:40:16.660580+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:28.825170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.680165+0000","last_change":"2023-10-06T04:40:16.680165+0000","last_active":"2023-10-06T04:40:16.680165+0000","last_peered":"2023-10-06T04:40:16.680165+0000","last_clean":"2023-10-06T04:40:16.680165+0000","last_became_active":"2023-10-06T04:40:16.679857+0000","last_became_peered":"2023-10-06T04:40:16.679857+0000","last_unstale":"2023-10-06T04:40:16.680165+0000","last_undegraded":"2023-10-06T04:40:16.680165+0000","last_fullsized":"2023-10-06T04:40:16.680165+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:27.011953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.042619+0000","last_change":"2023-10-06T04:40:16.050308+0000","last_active":"2023-10-06T04:40:17.042619+0000","last_peered":"2023-10-06T04:40:17.042619+0000","last_clean":"2023-10-06T04:40:17.042619+0000","last_became_active":"2023-10-06T04:40:16.049812+0000","last_became_peered":"2023-10-06T04:40:16.049812+0000","last_unstale":"2023-10-06T04:40:17.042619+0000","last_undegraded":"2023-10-06T04:40:17.042619+0000","last_fullsized":"2023-10-06T04:40:17.042619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:43:35.167918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.680698+0000","last_change":"2023-10-06T04:40:16.680698+0000","last_active":"2023-10-06T04:40:16.680698+0000","last_peered":"2023-10-06T04:40:16.680698+0000","last_clean":"2023-10-06T04:40:16.680698+0000","last_became_active":"2023-10-06T04:40:16.678469+0000","last_became_peered":"2023-10-06T04:40:16.678469+0000","last_unstale":"2023-10-06T04:40:16.680698+0000","last_undegraded":"2023-10-06T04:40:16.680698+0000","last_fullsized":"2023-10-06T04:40:16.680698+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:01.138896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.670641+0000","last_change":"2023-10-06T04:40:16.049335+0000","last_active":"2023-10-06T04:40:16.670641+0000","last_peered":"2023-10-06T04:40:16.670641+0000","last_clean":"2023-10-06T04:40:16.670641+0000","last_became_active":"2023-10-06T04:40:16.049059+0000","last_became_peered":"2023-10-06T04:40:16.049059+0000","last_unstale":"2023-10-06T04:40:16.670641+0000","last_undegraded":"2023-10-06T04:40:16.670641+0000","last_fullsized":"2023-10-06T04:40:16.670641+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:19.674983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681333+0000","last_change":"2023-10-06T04:40:16.681333+0000","last_active":"2023-10-06T04:40:16.681333+0000","last_peered":"2023-10-06T04:40:16.681333+0000","last_clean":"2023-10-06T04:40:16.681333+0000","last_became_active":"2023-10-06T04:40:16.680981+0000","last_became_peered":"2023-10-06T04:40:16.680981+0000","last_unstale":"2023-10-06T04:40:16.681333+0000","last_undegraded":"2023-10-06T04:40:16.681333+0000","last_fullsized":"2023-10-06T04:40:16.681333+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:23.266546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.656744+0000","last_change":"2023-10-06T04:40:16.044225+0000","last_active":"2023-10-06T04:40:16.656744+0000","last_peered":"2023-10-06T04:40:16.656744+0000","last_clean":"2023-10-06T04:40:16.656744+0000","last_became_active":"2023-10-06T04:40:16.043882+0000","last_became_peered":"2023-10-06T04:40:16.043882+0000","last_unstale":"2023-10-06T04:40:16.656744+0000","last_undegraded":"2023-10-06T04:40:16.656744+0000","last_fullsized":"2023-10-06T04:40:16.656744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:53.489994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.678181+0000","last_change":"2023-10-06T04:40:16.673744+0000","last_active":"2023-10-06T04:40:16.678181+0000","last_peered":"2023-10-06T04:40:16.678181+0000","last_clean":"2023-10-06T04:40:16.678181+0000","last_became_active":"2023-10-06T04:40:16.673418+0000","last_became_peered":"2023-10-06T04:40:16.673418+0000","last_unstale":"2023-10-06T04:40:16.678181+0000","last_undegraded":"2023-10-06T04:40:16.678181+0000","last_fullsized":"2023-10-06T04:40:16.678181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:43.111255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.048241+0000","last_change":"2023-10-06T04:40:16.048800+0000","last_active":"2023-10-06T04:40:17.048241+0000","last_peered":"2023-10-06T04:40:17.048241+0000","last_clean":"2023-10-06T04:40:17.048241+0000","last_became_active":"2023-10-06T04:40:16.047827+0000","last_became_peered":"2023-10-06T04:40:16.047827+0000","last_unstale":"2023-10-06T04:40:17.048241+0000","last_undegraded":"2023-10-06T04:40:17.048241+0000","last_fullsized":"2023-10-06T04:40:17.048241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:33.899675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.673552+0000","last_change":"2023-10-06T04:40:16.673552+0000","last_active":"2023-10-06T04:40:16.673552+0000","last_peered":"2023-10-06T04:40:16.673552+0000","last_clean":"2023-10-06T04:40:16.673552+0000","last_became_active":"2023-10-06T04:40:16.673226+0000","last_became_peered":"2023-10-06T04:40:16.673226+0000","last_unstale":"2023-10-06T04:40:16.673552+0000","last_undegraded":"2023-10-06T04:40:16.673552+0000","last_fullsized":"2023-10-06T04:40:16.673552+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:21.280757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.055047+0000","last_change":"2023-10-06T04:40:16.051466+0000","last_active":"2023-10-06T04:40:16.055047+0000","last_peered":"2023-10-06T04:40:16.055047+0000","last_clean":"2023-10-06T04:40:16.055047+0000","last_became_active":"2023-10-06T04:40:16.051165+0000","last_became_peered":"2023-10-06T04:40:16.051165+0000","last_unstale":"2023-10-06T04:40:16.055047+0000","last_undegraded":"2023-10-06T04:40:16.055047+0000","last_fullsized":"2023-10-06T04:40:16.055047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:14.976397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.675931+0000","last_change":"2023-10-06T04:40:16.675931+0000","last_active":"2023-10-06T04:40:16.675931+0000","last_peered":"2023-10-06T04:40:16.675931+0000","last_clean":"2023-10-06T04:40:16.675931+0000","last_became_active":"2023-10-06T04:40:16.675591+0000","last_became_peered":"2023-10-06T04:40:16.675591+0000","last_unstale":"2023-10-06T04:40:16.675931+0000","last_undegraded":"2023-10-06T04:40:16.675931+0000","last_fullsized":"2023-10-06T04:40:16.675931+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:27:05.248898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.056779+0000","last_change":"2023-10-06T04:40:16.052554+0000","last_active":"2023-10-06T04:40:16.056779+0000","last_peered":"2023-10-06T04:40:16.056779+0000","last_clean":"2023-10-06T04:40:16.056779+0000","last_became_active":"2023-10-06T04:40:16.051637+0000","last_became_peered":"2023-10-06T04:40:16.051637+0000","last_unstale":"2023-10-06T04:40:16.056779+0000","last_undegraded":"2023-10-06T04:40:16.056779+0000","last_fullsized":"2023-10-06T04:40:16.056779+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:41.449616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.683670+0000","last_change":"2023-10-06T04:40:16.683670+0000","last_active":"2023-10-06T04:40:16.683670+0000","last_peered":"2023-10-06T04:40:16.683670+0000","last_clean":"2023-10-06T04:40:16.683670+0000","last_became_active":"2023-10-06T04:40:16.683318+0000","last_became_peered":"2023-10-06T04:40:16.683318+0000","last_unstale":"2023-10-06T04:40:16.683670+0000","last_undegraded":"2023-10-06T04:40:16.683670+0000","last_fullsized":"2023-10-06T04:40:16.683670+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:31:54.712833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.060277+0000","last_change":"2023-10-06T04:40:16.058126+0000","last_active":"2023-10-06T04:40:16.060277+0000","last_peered":"2023-10-06T04:40:16.060277+0000","last_clean":"2023-10-06T04:40:16.060277+0000","last_became_active":"2023-10-06T04:40:16.057851+0000","last_became_peered":"2023-10-06T04:40:16.057851+0000","last_unstale":"2023-10-06T04:40:16.060277+0000","last_undegraded":"2023-10-06T04:40:16.060277+0000","last_fullsized":"2023-10-06T04:40:16.060277+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.714286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.678161+0000","last_change":"2023-10-06T04:40:16.673682+0000","last_active":"2023-10-06T04:40:16.678161+0000","last_peered":"2023-10-06T04:40:16.678161+0000","last_clean":"2023-10-06T04:40:16.678161+0000","last_became_active":"2023-10-06T04:40:16.672907+0000","last_became_peered":"2023-10-06T04:40:16.672907+0000","last_unstale":"2023-10-06T04:40:16.678161+0000","last_undegraded":"2023-10-06T04:40:16.678161+0000","last_fullsized":"2023-10-06T04:40:16.678161+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:21.163939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.057436+0000","last_change":"2023-10-06T04:40:16.053621+0000","last_active":"2023-10-06T04:40:16.057436+0000","last_peered":"2023-10-06T04:40:16.057436+0000","last_clean":"2023-10-06T04:40:16.057436+0000","last_became_active":"2023-10-06T04:40:16.053344+0000","last_became_peered":"2023-10-06T04:40:16.053344+0000","last_unstale":"2023-10-06T04:40:16.057436+0000","last_undegraded":"2023-10-06T04:40:16.057436+0000","last_fullsized":"2023-10-06T04:40:16.057436+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:11.109744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.048954+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:40:16.048954+0000","last_peered":"2023-10-06T04:40:16.048954+0000","last_clean":"2023-10-06T04:40:16.048954+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:40:16.048954+0000","last_undegraded":"2023-10-06T04:40:16.048954+0000","last_fullsized":"2023-10-06T04:40:16.048954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.675227+0000","last_change":"2023-10-06T04:40:16.668783+0000","last_active":"2023-10-06T04:40:16.675227+0000","last_peered":"2023-10-06T04:40:16.675227+0000","last_clean":"2023-10-06T04:40:16.675227+0000","last_became_active":"2023-10-06T04:40:16.668480+0000","last_became_peered":"2023-10-06T04:40:16.668480+0000","last_unstale":"2023-10-06T04:40:16.675227+0000","last_undegraded":"2023-10-06T04:40:16.675227+0000","last_fullsized":"2023-10-06T04:40:16.675227+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:21.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.042724+0000","last_change":"2023-10-06T04:40:16.040907+0000","last_active":"2023-10-06T04:40:16.042724+0000","last_peered":"2023-10-06T04:40:16.042724+0000","last_clean":"2023-10-06T04:40:16.042724+0000","last_became_active":"2023-10-06T04:40:16.039830+0000","last_became_peered":"2023-10-06T04:40:16.039830+0000","last_unstale":"2023-10-06T04:40:16.042724+0000","last_undegraded":"2023-10-06T04:40:16.042724+0000","last_fullsized":"2023-10-06T04:40:16.042724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:58.915354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.038357+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:40:16.038357+0000","last_peered":"2023-10-06T04:40:16.038357+0000","last_clean":"2023-10-06T04:40:16.038357+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:40:16.038357+0000","last_undegraded":"2023-10-06T04:40:16.038357+0000","last_fullsized":"2023-10-06T04:40:16.038357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.677201+0000","last_change":"2023-10-06T04:40:16.677201+0000","last_active":"2023-10-06T04:40:16.677201+0000","last_peered":"2023-10-06T04:40:16.677201+0000","last_clean":"2023-10-06T04:40:16.677201+0000","last_became_active":"2023-10-06T04:40:16.676933+0000","last_became_peered":"2023-10-06T04:40:16.676933+0000","last_unstale":"2023-10-06T04:40:16.677201+0000","last_undegraded":"2023-10-06T04:40:16.677201+0000","last_fullsized":"2023-10-06T04:40:16.677201+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:54.276133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.059255+0000","last_change":"2023-10-06T04:40:16.052826+0000","last_active":"2023-10-06T04:40:16.059255+0000","last_peered":"2023-10-06T04:40:16.059255+0000","last_clean":"2023-10-06T04:40:16.059255+0000","last_became_active":"2023-10-06T04:40:16.052493+0000","last_became_peered":"2023-10-06T04:40:16.052493+0000","last_unstale":"2023-10-06T04:40:16.059255+0000","last_undegraded":"2023-10-06T04:40:16.059255+0000","last_fullsized":"2023-10-06T04:40:16.059255+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:44.322323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.047006+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:40:16.047006+0000","last_peered":"2023-10-06T04:40:16.047006+0000","last_clean":"2023-10-06T04:40:16.047006+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:40:16.047006+0000","last_undegraded":"2023-10-06T04:40:16.047006+0000","last_fullsized":"2023-10-06T04:40:16.047006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.668333+0000","last_change":"2023-10-06T04:40:16.668333+0000","last_active":"2023-10-06T04:40:16.668333+0000","last_peered":"2023-10-06T04:40:16.668333+0000","last_clean":"2023-10-06T04:40:16.668333+0000","last_became_active":"2023-10-06T04:40:16.667940+0000","last_became_peered":"2023-10-06T04:40:16.667940+0000","last_unstale":"2023-10-06T04:40:16.668333+0000","last_undegraded":"2023-10-06T04:40:16.668333+0000","last_fullsized":"2023-10-06T04:40:16.668333+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:21.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.056861+0000","last_change":"2023-10-06T04:40:16.052721+0000","last_active":"2023-10-06T04:40:16.056861+0000","last_peered":"2023-10-06T04:40:16.056861+0000","last_clean":"2023-10-06T04:40:16.056861+0000","last_became_active":"2023-10-06T04:40:16.052426+0000","last_became_peered":"2023-10-06T04:40:16.052426+0000","last_unstale":"2023-10-06T04:40:16.056861+0000","last_undegraded":"2023-10-06T04:40:16.056861+0000","last_fullsized":"2023-10-06T04:40:16.056861+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:39.386753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.037064+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:40:16.037064+0000","last_peered":"2023-10-06T04:40:16.037064+0000","last_clean":"2023-10-06T04:40:16.037064+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:40:16.037064+0000","last_undegraded":"2023-10-06T04:40:16.037064+0000","last_fullsized":"2023-10-06T04:40:16.037064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.684849+0000","last_change":"2023-10-06T04:40:16.684849+0000","last_active":"2023-10-06T04:40:16.684849+0000","last_peered":"2023-10-06T04:40:16.684849+0000","last_clean":"2023-10-06T04:40:16.684849+0000","last_became_active":"2023-10-06T04:40:16.684474+0000","last_became_peered":"2023-10-06T04:40:16.684474+0000","last_unstale":"2023-10-06T04:40:16.684849+0000","last_undegraded":"2023-10-06T04:40:16.684849+0000","last_fullsized":"2023-10-06T04:40:16.684849+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:45.336497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.656808+0000","last_change":"2023-10-06T04:40:16.042153+0000","last_active":"2023-10-06T04:40:16.656808+0000","last_peered":"2023-10-06T04:40:16.656808+0000","last_clean":"2023-10-06T04:40:16.656808+0000","last_became_active":"2023-10-06T04:40:16.041794+0000","last_became_peered":"2023-10-06T04:40:16.041794+0000","last_unstale":"2023-10-06T04:40:16.656808+0000","last_undegraded":"2023-10-06T04:40:16.656808+0000","last_fullsized":"2023-10-06T04:40:16.656808+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:35.346457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.042654+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:40:16.042654+0000","last_peered":"2023-10-06T04:40:16.042654+0000","last_clean":"2023-10-06T04:40:16.042654+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:40:16.042654+0000","last_undegraded":"2023-10-06T04:40:16.042654+0000","last_fullsized":"2023-10-06T04:40:16.042654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.680140+0000","last_change":"2023-10-06T04:40:16.680140+0000","last_active":"2023-10-06T04:40:16.680140+0000","last_peered":"2023-10-06T04:40:16.680140+0000","last_clean":"2023-10-06T04:40:16.680140+0000","last_became_active":"2023-10-06T04:40:16.679771+0000","last_became_peered":"2023-10-06T04:40:16.679771+0000","last_unstale":"2023-10-06T04:40:16.680140+0000","last_undegraded":"2023-10-06T04:40:16.680140+0000","last_fullsized":"2023-10-06T04:40:16.680140+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:43:36.182092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.057451+0000","last_change":"2023-10-06T04:40:16.053616+0000","last_active":"2023-10-06T04:40:16.057451+0000","last_peered":"2023-10-06T04:40:16.057451+0000","last_clean":"2023-10-06T04:40:16.057451+0000","last_became_active":"2023-10-06T04:40:16.053319+0000","last_became_peered":"2023-10-06T04:40:16.053319+0000","last_unstale":"2023-10-06T04:40:16.057451+0000","last_undegraded":"2023-10-06T04:40:16.057451+0000","last_fullsized":"2023-10-06T04:40:16.057451+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:40.703411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.030176+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:40:16.030176+0000","last_peered":"2023-10-06T04:40:16.030176+0000","last_clean":"2023-10-06T04:40:16.030176+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:40:16.030176+0000","last_undegraded":"2023-10-06T04:40:16.030176+0000","last_fullsized":"2023-10-06T04:40:16.030176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.675182+0000","last_change":"2023-10-06T04:40:16.675182+0000","last_active":"2023-10-06T04:40:16.675182+0000","last_peered":"2023-10-06T04:40:16.675182+0000","last_clean":"2023-10-06T04:40:16.675182+0000","last_became_active":"2023-10-06T04:40:16.674877+0000","last_became_peered":"2023-10-06T04:40:16.674877+0000","last_unstale":"2023-10-06T04:40:16.675182+0000","last_undegraded":"2023-10-06T04:40:16.675182+0000","last_fullsized":"2023-10-06T04:40:16.675182+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:38.696821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.056484+0000","last_change":"2023-10-06T04:40:16.049122+0000","last_active":"2023-10-06T04:40:16.056484+0000","last_peered":"2023-10-06T04:40:16.056484+0000","last_clean":"2023-10-06T04:40:16.056484+0000","last_became_active":"2023-10-06T04:40:16.048851+0000","last_became_peered":"2023-10-06T04:40:16.048851+0000","last_unstale":"2023-10-06T04:40:16.056484+0000","last_undegraded":"2023-10-06T04:40:16.056484+0000","last_fullsized":"2023-10-06T04:40:16.056484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:18.408875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.041259+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:40:16.041259+0000","last_peered":"2023-10-06T04:40:16.041259+0000","last_clean":"2023-10-06T04:40:16.041259+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:40:16.041259+0000","last_undegraded":"2023-10-06T04:40:16.041259+0000","last_fullsized":"2023-10-06T04:40:16.041259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.685097+0000","last_change":"2023-10-06T04:40:16.685097+0000","last_active":"2023-10-06T04:40:16.685097+0000","last_peered":"2023-10-06T04:40:16.685097+0000","last_clean":"2023-10-06T04:40:16.685097+0000","last_became_active":"2023-10-06T04:40:16.684763+0000","last_became_peered":"2023-10-06T04:40:16.684763+0000","last_unstale":"2023-10-06T04:40:16.685097+0000","last_undegraded":"2023-10-06T04:40:16.685097+0000","last_fullsized":"2023-10-06T04:40:16.685097+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:14.158434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.048263+0000","last_change":"2023-10-06T04:40:16.047920+0000","last_active":"2023-10-06T04:40:17.048263+0000","last_peered":"2023-10-06T04:40:17.048263+0000","last_clean":"2023-10-06T04:40:17.048263+0000","last_became_active":"2023-10-06T04:40:16.047615+0000","last_became_peered":"2023-10-06T04:40:16.047615+0000","last_unstale":"2023-10-06T04:40:17.048263+0000","last_undegraded":"2023-10-06T04:40:17.048263+0000","last_fullsized":"2023-10-06T04:40:17.048263+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:20.085622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.044032+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:40:16.044032+0000","last_peered":"2023-10-06T04:40:16.044032+0000","last_clean":"2023-10-06T04:40:16.044032+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:40:16.044032+0000","last_undegraded":"2023-10-06T04:40:16.044032+0000","last_fullsized":"2023-10-06T04:40:16.044032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.046443+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:40:16.046443+0000","last_peered":"2023-10-06T04:40:16.046443+0000","last_clean":"2023-10-06T04:40:16.046443+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:40:16.046443+0000","last_undegraded":"2023-10-06T04:40:16.046443+0000","last_fullsized":"2023-10-06T04:40:16.046443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":479232,"data_stored":208260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.77000000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":1.069},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.90200000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.48}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.0529999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.266}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.611}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302424,"kb_used_data":1040,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069416,"statfs":{"total":96636764160,"available":96327081984,"internally_reserved":0,"allocated":1064960,"data_stored":798052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.746},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78600000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.94999999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1579999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.05}]},{"osd":5,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.341},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.0840000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.214},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.262}]},{"osd":7,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.3109999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":1048576,"data_stored":790582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":3.347,"5min":3.347,"15min":3.347},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.0149999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.056}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.61799999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.1499999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.1099999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.93999999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.96999999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.123}]}]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":200214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.109}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":1.02},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.82599999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1879999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.052}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.78300000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.0800000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.143},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.214}]}]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":200214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.88300000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.131},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.026},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.628},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.97399999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.0509999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.097}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":200214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.079},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.95299999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.159}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.036}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.232},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.145}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.21}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.1899999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297744,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074096,"statfs":{"total":96636764160,"available":96331874304,"internally_reserved":0,"allocated":466944,"data_stored":207650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.77000000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.046},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.224}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.3149999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.01}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.365}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.1259999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297744,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074096,"statfs":{"total":96636764160,"available":96331874304,"internally_reserved":0,"allocated":466944,"data_stored":207650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.84499999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.0800000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.004},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.038}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.397},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.1459999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.236}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.2709999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:20.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.196+0000 7fa5f22dc700 1 Processor -- start 2023-10-06T04:40:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.196+0000 7fa5f22dc700 1 -- start start 2023-10-06T04:40:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.196+0000 7fa5f22dc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa5ec0cc0d0 0x7fa5ec0aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.196+0000 7fa5f22dc700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec15e0e0 con 0x7fa5ec06dbf0 2023-10-06T04:40:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.196+0000 7fa5f22dc700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec15d7b0 con 0x7fa5ec15d240 2023-10-06T04:40:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.196+0000 7fa5f22dc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec15da90 con 0x7fa5ec0cc0d0 2023-10-06T04:40:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f0ad9700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa5ec06dbf0 0x7fa5ec0c61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40804/0 (socket says 172.21.15.37:40804) 2023-10-06T04:40:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f0ad9700 1 -- 172.21.15.37:0/3027020599 learned_addr learned my addr 172.21.15.37:0/3027020599 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:20.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f1adb700 1 --2- 172.21.15.37:0/3027020599 >> v2:172.21.15.83:3300/0 conn(0x7fa5ec0cc0d0 0x7fa5ec0aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991040625 0 0) 0x7fa5ec15e0e0 con 0x7fa5ec06dbf0 2023-10-06T04:40:20.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d8003570 con 0x7fa5ec06dbf0 2023-10-06T04:40:20.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2208282673 0 0) 0x7fa5d8003570 con 0x7fa5ec06dbf0 2023-10-06T04:40:20.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 >> v2:172.21.15.83:3300/0 conn(0x7fa5ec0cc0d0 msgr2=0x7fa5ec0aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 --2- 172.21.15.37:0/3027020599 >> v2:172.21.15.83:3300/0 conn(0x7fa5ec0cc0d0 0x7fa5ec0aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 >> v1:172.21.15.83:6789/0 conn(0x7fa5ec15d240 legacy=0x7fa5ec06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec15dd70 con 0x7fa5ec06dbf0 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7fa5dc001470 con 0x7fa5ec06dbf0 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 >> v1:172.21.15.37:6789/0 conn(0x7fa5ec06dbf0 legacy=0x7fa5ec0c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 --2- 172.21.15.37:0/3027020599 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5d8003a60 0x7fa5d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 --2- 172.21.15.37:0/3027020599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 0x7fa5d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 --2- 172.21.15.37:0/3027020599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5d80051c0 0x7fa5d800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec15da90 con 0x7fa5d8004810 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d800c160 con 0x7fa5d80051c0 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d800c320 con 0x7fa5d8003a60 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f0ad9700 1 --2- 172.21.15.37:0/3027020599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 0x7fa5d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f1adb700 1 --2- 172.21.15.37:0/3027020599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5d80051c0 0x7fa5d800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f12da700 1 --2- 172.21.15.37:0/3027020599 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5d8003a60 0x7fa5d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f0ad9700 1 -- 172.21.15.37:0/3027020599 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5d8003a60 msgr2=0x7fa5d8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f0ad9700 1 --2- 172.21.15.37:0/3027020599 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5d8003a60 0x7fa5d8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f0ad9700 1 -- 172.21.15.37:0/3027020599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5d80051c0 msgr2=0x7fa5d800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f0ad9700 1 --2- 172.21.15.37:0/3027020599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5d80051c0 0x7fa5d800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f1adb700 1 -- 172.21.15.37:0/3027020599 reap_dead start 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f0ad9700 1 -- 172.21.15.37:0/3027020599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d8003570 con 0x7fa5d8004810 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f0ad9700 1 --2- 172.21.15.37:0/3027020599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 0x7fa5d8004c80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00c390 tx=0x7fa5dc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb2cb717fca415f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00cbe0 con 0x7fa5d8004810 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc00cd40 con 0x7fa5d8004810 2023-10-06T04:40:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5e3fff700 1 -- 172.21.15.37:0/3027020599 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc005b50 con 0x7fa5d8004810 2023-10-06T04:40:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f22dc700 1 -- 172.21.15.37:0/3027020599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 msgr2=0x7fa5d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f22dc700 1 --2- 172.21.15.37:0/3027020599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 0x7fa5d8004c80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00c390 tx=0x7fa5dc001e50 comp rx=0 tx=0).stop 2023-10-06T04:40:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f22dc700 1 -- 172.21.15.37:0/3027020599 shutdown_connections 2023-10-06T04:40:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f22dc700 1 --2- 172.21.15.37:0/3027020599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 0x7fa5d8004c80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f22dc700 1 -- 172.21.15.37:0/3027020599 >> 172.21.15.37:0/3027020599 conn(0x7fa5ec068780 msgr2=0x7fa5ec0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f22dc700 1 -- 172.21.15.37:0/3027020599 shutdown_connections 2023-10-06T04:40:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.200+0000 7fa5f22dc700 1 -- 172.21.15.37:0/3027020599 wait complete. 2023-10-06T04:40:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.204+0000 7fa5f22dc700 1 Processor -- start 2023-10-06T04:40:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.204+0000 7fa5f22dc700 1 -- start start 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.204+0000 7fa5f22dc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 0x7fa5ec0c3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.204+0000 7fa5f22dc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec0b0c50 0x7fa5ec16cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.204+0000 7fa5f22dc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5ec0a44b0 0x7fa5ec0a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.204+0000 7fa5f22dc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec14a530 con 0x7fa5d8004810 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.204+0000 7fa5f22dc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec0c4300 con 0x7fa5ec0b0c50 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.204+0000 7fa5f22dc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec0a4e40 con 0x7fa5ec0a44b0 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.204+0000 7fa5f12da700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 0x7fa5ec0c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.204+0000 7fa5f12da700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 0x7fa5ec0c3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60998/0 (socket says 172.21.15.37:60998) 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.204+0000 7fa5f12da700 1 -- 172.21.15.37:0/1474760633 learned_addr learned my addr 172.21.15.37:0/1474760633 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.204+0000 7fa5f0ad9700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec0b0c50 0x7fa5ec16cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5f1adb700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5ec0a44b0 0x7fa5ec0a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5f12da700 1 -- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5ec0a44b0 msgr2=0x7fa5ec0a4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5f12da700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5ec0a44b0 0x7fa5ec0a4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5f12da700 1 -- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec0b0c50 msgr2=0x7fa5ec16cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5f12da700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec0b0c50 0x7fa5ec16cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5f12da700 1 -- 172.21.15.37:0/1474760633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec0c36f0 con 0x7fa5d8004810 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5f12da700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 0x7fa5ec0c3030 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80029b0 tx=0x7fa5e8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5e17fa700 1 -- 172.21.15.37:0/1474760633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80033b0 con 0x7fa5d8004810 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5e17fa700 1 -- 172.21.15.37:0/1474760633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8002e40 con 0x7fa5d8004810 2023-10-06T04:40:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5f22dc700 1 -- 172.21.15.37:0/1474760633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec0c39d0 con 0x7fa5d8004810 2023-10-06T04:40:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5e17fa700 1 -- 172.21.15.37:0/1474760633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8006c80 con 0x7fa5d8004810 2023-10-06T04:40:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5f22dc700 1 -- 172.21.15.37:0/1474760633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec0c3f90 con 0x7fa5d8004810 2023-10-06T04:40:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5f22dc700 1 -- 172.21.15.37:0/1474760633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec063530 con 0x7fa5d8004810 2023-10-06T04:40:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5e17fa700 1 -- 172.21.15.37:0/1474760633 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa5e8007260 con 0x7fa5d8004810 2023-10-06T04:40:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5e17fa700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa5d0060580 0x7fa5d0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.208+0000 7fa5e17fa700 1 -- 172.21.15.37:0/1474760633 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa5e807c840 con 0x7fa5d8004810 2023-10-06T04:40:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.212+0000 7fa5f0ad9700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa5d0060580 0x7fa5d0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.212+0000 7fa5f0ad9700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa5d0060580 0x7fa5d0062a30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc001ed0 tx=0x7fa5dc015000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:20.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.216+0000 7fa5e17fa700 1 -- 172.21.15.37:0/1474760633 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa5ec063530 con 0x7fa5d8004810 2023-10-06T04:40:20.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.376+0000 7fa5f22dc700 1 -- 172.21.15.37:0/1474760633 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5ec0c4440 con 0x7fa5d0060580 2023-10-06T04:40:20.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.392+0000 7fa5e17fa700 1 -- 172.21.15.37:0/1474760633 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309312 (secure 0 0 0) 0x7fa5dc007b90 con 0x7fa5d0060580 2023-10-06T04:40:20.403 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:20.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.400+0000 7fa5f22dc700 1 -- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa5d0060580 msgr2=0x7fa5d0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.400+0000 7fa5f22dc700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa5d0060580 0x7fa5d0062a30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc001ed0 tx=0x7fa5dc015000 comp rx=0 tx=0).stop 2023-10-06T04:40:20.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.400+0000 7fa5f22dc700 1 -- 172.21.15.37:0/1474760633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 msgr2=0x7fa5ec0c3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.400+0000 7fa5f22dc700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 0x7fa5ec0c3030 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80029b0 tx=0x7fa5e8007d30 comp rx=0 tx=0).stop 2023-10-06T04:40:20.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.400+0000 7fa5f22dc700 1 -- 172.21.15.37:0/1474760633 shutdown_connections 2023-10-06T04:40:20.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.400+0000 7fa5f22dc700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa5d0060580 0x7fa5d0062a30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.400+0000 7fa5f22dc700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec0b0c50 0x7fa5ec16cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.400+0000 7fa5f22dc700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5ec0a44b0 0x7fa5ec0a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.400+0000 7fa5f22dc700 1 --2- 172.21.15.37:0/1474760633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5d8004810 0x7fa5ec0c3030 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.400+0000 7fa5f22dc700 1 -- 172.21.15.37:0/1474760633 >> 172.21.15.37:0/1474760633 conn(0x7fa5ec068780 msgr2=0x7fa5ec0c1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:20.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.400+0000 7fa5f22dc700 1 -- 172.21.15.37:0/1474760633 shutdown_connections 2023-10-06T04:40:20.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.400+0000 7fa5f22dc700 1 -- 172.21.15.37:0/1474760633 wait complete. 2023-10-06T04:40:20.407 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:40:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-10-06T04:40:19.053656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387176,"kb_used_data":4776,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752587544,"statfs":{"total":773094113280,"available":770649645056,"internally_reserved":0,"allocated":4890624,"data_stored":2812836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039405"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.673739+0000","last_change":"2023-10-06T04:40:16.673739+0000","last_active":"2023-10-06T04:40:16.673739+0000","last_peered":"2023-10-06T04:40:16.673739+0000","last_clean":"2023-10-06T04:40:16.673739+0000","last_became_active":"2023-10-06T04:40:16.673410+0000","last_became_peered":"2023-10-06T04:40:16.673410+0000","last_unstale":"2023-10-06T04:40:16.673739+0000","last_undegraded":"2023-10-06T04:40:16.673739+0000","last_fullsized":"2023-10-06T04:40:16.673739+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:23:12.147820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.689245+0000","last_change":"2023-10-06T04:40:16.689245+0000","last_active":"2023-10-06T04:40:16.689245+0000","last_peered":"2023-10-06T04:40:16.689245+0000","last_clean":"2023-10-06T04:40:16.689245+0000","last_became_active":"2023-10-06T04:40:16.688880+0000","last_became_peered":"2023-10-06T04:40:16.688880+0000","last_unstale":"2023-10-06T04:40:16.689245+0000","last_undegraded":"2023-10-06T04:40:16.689245+0000","last_fullsized":"2023-10-06T04:40:16.689245+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:39.402305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.671464+0000","last_change":"2023-10-06T04:40:16.671464+0000","last_active":"2023-10-06T04:40:16.671464+0000","last_peered":"2023-10-06T04:40:16.671464+0000","last_clean":"2023-10-06T04:40:16.671464+0000","last_became_active":"2023-10-06T04:40:16.671139+0000","last_became_peered":"2023-10-06T04:40:16.671139+0000","last_unstale":"2023-10-06T04:40:16.671464+0000","last_undegraded":"2023-10-06T04:40:16.671464+0000","last_fullsized":"2023-10-06T04:40:16.671464+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:43.111255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.685344+0000","last_change":"2023-10-06T04:40:16.685344+0000","last_active":"2023-10-06T04:40:16.685344+0000","last_peered":"2023-10-06T04:40:16.685344+0000","last_clean":"2023-10-06T04:40:16.685344+0000","last_became_active":"2023-10-06T04:40:16.684907+0000","last_became_peered":"2023-10-06T04:40:16.684907+0000","last_unstale":"2023-10-06T04:40:16.685344+0000","last_undegraded":"2023-10-06T04:40:16.685344+0000","last_fullsized":"2023-10-06T04:40:16.685344+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:45.306880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.686814+0000","last_change":"2023-10-06T04:40:16.686814+0000","last_active":"2023-10-06T04:40:16.686814+0000","last_peered":"2023-10-06T04:40:16.686814+0000","last_clean":"2023-10-06T04:40:16.686814+0000","last_became_active":"2023-10-06T04:40:16.686487+0000","last_became_peered":"2023-10-06T04:40:16.686487+0000","last_unstale":"2023-10-06T04:40:16.686814+0000","last_undegraded":"2023-10-06T04:40:16.686814+0000","last_fullsized":"2023-10-06T04:40:16.686814+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:19.502785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681801+0000","last_change":"2023-10-06T04:40:16.675203+0000","last_active":"2023-10-06T04:40:16.681801+0000","last_peered":"2023-10-06T04:40:16.681801+0000","last_clean":"2023-10-06T04:40:16.681801+0000","last_became_active":"2023-10-06T04:40:16.674905+0000","last_became_peered":"2023-10-06T04:40:16.674905+0000","last_unstale":"2023-10-06T04:40:16.681801+0000","last_undegraded":"2023-10-06T04:40:16.681801+0000","last_fullsized":"2023-10-06T04:40:16.681801+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:08.816116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.676358+0000","last_change":"2023-10-06T04:40:16.676358+0000","last_active":"2023-10-06T04:40:16.676358+0000","last_peered":"2023-10-06T04:40:16.676358+0000","last_clean":"2023-10-06T04:40:16.676358+0000","last_became_active":"2023-10-06T04:40:16.676062+0000","last_became_peered":"2023-10-06T04:40:16.676062+0000","last_unstale":"2023-10-06T04:40:16.676358+0000","last_undegraded":"2023-10-06T04:40:16.676358+0000","last_fullsized":"2023-10-06T04:40:16.676358+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:27.011953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.685837+0000","last_change":"2023-10-06T04:40:16.685837+0000","last_active":"2023-10-06T04:40:16.685837+0000","last_peered":"2023-10-06T04:40:16.685837+0000","last_clean":"2023-10-06T04:40:16.685837+0000","last_became_active":"2023-10-06T04:40:16.682908+0000","last_became_peered":"2023-10-06T04:40:16.682908+0000","last_unstale":"2023-10-06T04:40:16.685837+0000","last_undegraded":"2023-10-06T04:40:16.685837+0000","last_fullsized":"2023-10-06T04:40:16.685837+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:21.163939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.682432+0000","last_change":"2023-10-06T04:40:16.682432+0000","last_active":"2023-10-06T04:40:16.682432+0000","last_peered":"2023-10-06T04:40:16.682432+0000","last_clean":"2023-10-06T04:40:16.682432+0000","last_became_active":"2023-10-06T04:40:16.679957+0000","last_became_peered":"2023-10-06T04:40:16.679957+0000","last_unstale":"2023-10-06T04:40:16.682432+0000","last_undegraded":"2023-10-06T04:40:16.682432+0000","last_fullsized":"2023-10-06T04:40:16.682432+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:43.111255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.688072+0000","last_change":"2023-10-06T04:40:16.688072+0000","last_active":"2023-10-06T04:40:16.688072+0000","last_peered":"2023-10-06T04:40:16.688072+0000","last_clean":"2023-10-06T04:40:16.688072+0000","last_became_active":"2023-10-06T04:40:16.687698+0000","last_became_peered":"2023-10-06T04:40:16.687698+0000","last_unstale":"2023-10-06T04:40:16.688072+0000","last_undegraded":"2023-10-06T04:40:16.688072+0000","last_fullsized":"2023-10-06T04:40:16.688072+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:01.381508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.679700+0000","last_change":"2023-10-06T04:40:16.679700+0000","last_active":"2023-10-06T04:40:16.679700+0000","last_peered":"2023-10-06T04:40:16.679700+0000","last_clean":"2023-10-06T04:40:16.679700+0000","last_became_active":"2023-10-06T04:40:16.679368+0000","last_became_peered":"2023-10-06T04:40:16.679368+0000","last_unstale":"2023-10-06T04:40:16.679700+0000","last_undegraded":"2023-10-06T04:40:16.679700+0000","last_fullsized":"2023-10-06T04:40:16.679700+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:40.982645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.675819+0000","last_change":"2023-10-06T04:40:16.675819+0000","last_active":"2023-10-06T04:40:16.675819+0000","last_peered":"2023-10-06T04:40:16.675819+0000","last_clean":"2023-10-06T04:40:16.675819+0000","last_became_active":"2023-10-06T04:40:16.672933+0000","last_became_peered":"2023-10-06T04:40:16.672933+0000","last_unstale":"2023-10-06T04:40:16.675819+0000","last_undegraded":"2023-10-06T04:40:16.675819+0000","last_fullsized":"2023-10-06T04:40:16.675819+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:22.941848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.673518+0000","last_change":"2023-10-06T04:40:16.673518+0000","last_active":"2023-10-06T04:40:16.673518+0000","last_peered":"2023-10-06T04:40:16.673518+0000","last_clean":"2023-10-06T04:40:16.673518+0000","last_became_active":"2023-10-06T04:40:16.673111+0000","last_became_peered":"2023-10-06T04:40:16.673111+0000","last_unstale":"2023-10-06T04:40:16.673518+0000","last_undegraded":"2023-10-06T04:40:16.673518+0000","last_fullsized":"2023-10-06T04:40:16.673518+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:15.990571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.685567+0000","last_change":"2023-10-06T04:40:16.685567+0000","last_active":"2023-10-06T04:40:16.685567+0000","last_peered":"2023-10-06T04:40:16.685567+0000","last_clean":"2023-10-06T04:40:16.685567+0000","last_became_active":"2023-10-06T04:40:16.684711+0000","last_became_peered":"2023-10-06T04:40:16.684711+0000","last_unstale":"2023-10-06T04:40:16.685567+0000","last_undegraded":"2023-10-06T04:40:16.685567+0000","last_fullsized":"2023-10-06T04:40:16.685567+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:21.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.674633+0000","last_change":"2023-10-06T04:40:16.665946+0000","last_active":"2023-10-06T04:40:16.674633+0000","last_peered":"2023-10-06T04:40:16.674633+0000","last_clean":"2023-10-06T04:40:16.674633+0000","last_became_active":"2023-10-06T04:40:16.665606+0000","last_became_peered":"2023-10-06T04:40:16.665606+0000","last_unstale":"2023-10-06T04:40:16.674633+0000","last_undegraded":"2023-10-06T04:40:16.674633+0000","last_fullsized":"2023-10-06T04:40:16.674633+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:40.982645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.689976+0000","last_change":"2023-10-06T04:40:16.689976+0000","last_active":"2023-10-06T04:40:16.689976+0000","last_peered":"2023-10-06T04:40:16.689976+0000","last_clean":"2023-10-06T04:40:16.689976+0000","last_became_active":"2023-10-06T04:40:16.689708+0000","last_became_peered":"2023-10-06T04:40:16.689708+0000","last_unstale":"2023-10-06T04:40:16.689976+0000","last_undegraded":"2023-10-06T04:40:16.689976+0000","last_fullsized":"2023-10-06T04:40:16.689976+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:25.061931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681272+0000","last_change":"2023-10-06T04:40:16.681272+0000","last_active":"2023-10-06T04:40:16.681272+0000","last_peered":"2023-10-06T04:40:16.681272+0000","last_clean":"2023-10-06T04:40:16.681272+0000","last_became_active":"2023-10-06T04:40:16.680957+0000","last_became_peered":"2023-10-06T04:40:16.680957+0000","last_unstale":"2023-10-06T04:40:16.681272+0000","last_undegraded":"2023-10-06T04:40:16.681272+0000","last_fullsized":"2023-10-06T04:40:16.681272+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:27.638087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.685314+0000","last_change":"2023-10-06T04:40:16.685314+0000","last_active":"2023-10-06T04:40:16.685314+0000","last_peered":"2023-10-06T04:40:16.685314+0000","last_clean":"2023-10-06T04:40:16.685314+0000","last_became_active":"2023-10-06T04:40:16.684991+0000","last_became_peered":"2023-10-06T04:40:16.684991+0000","last_unstale":"2023-10-06T04:40:16.685314+0000","last_undegraded":"2023-10-06T04:40:16.685314+0000","last_fullsized":"2023-10-06T04:40:16.685314+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:03.602422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.684778+0000","last_change":"2023-10-06T04:40:16.684778+0000","last_active":"2023-10-06T04:40:16.684778+0000","last_peered":"2023-10-06T04:40:16.684778+0000","last_clean":"2023-10-06T04:40:16.684778+0000","last_became_active":"2023-10-06T04:40:16.684444+0000","last_became_peered":"2023-10-06T04:40:16.684444+0000","last_unstale":"2023-10-06T04:40:16.684778+0000","last_undegraded":"2023-10-06T04:40:16.684778+0000","last_fullsized":"2023-10-06T04:40:16.684778+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:01.110437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.686542+0000","last_change":"2023-10-06T04:40:16.686542+0000","last_active":"2023-10-06T04:40:16.686542+0000","last_peered":"2023-10-06T04:40:16.686542+0000","last_clean":"2023-10-06T04:40:16.686542+0000","last_became_active":"2023-10-06T04:40:16.686176+0000","last_became_peered":"2023-10-06T04:40:16.686176+0000","last_unstale":"2023-10-06T04:40:16.686542+0000","last_undegraded":"2023-10-06T04:40:16.686542+0000","last_fullsized":"2023-10-06T04:40:16.686542+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:59:00.564452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681873+0000","last_change":"2023-10-06T04:40:16.675659+0000","last_active":"2023-10-06T04:40:16.681873+0000","last_peered":"2023-10-06T04:40:16.681873+0000","last_clean":"2023-10-06T04:40:16.681873+0000","last_became_active":"2023-10-06T04:40:16.675357+0000","last_became_peered":"2023-10-06T04:40:16.675357+0000","last_unstale":"2023-10-06T04:40:16.681873+0000","last_undegraded":"2023-10-06T04:40:16.681873+0000","last_fullsized":"2023-10-06T04:40:16.681873+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:14.158434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.684945+0000","last_change":"2023-10-06T04:40:16.684945+0000","last_active":"2023-10-06T04:40:16.684945+0000","last_peered":"2023-10-06T04:40:16.684945+0000","last_clean":"2023-10-06T04:40:16.684945+0000","last_became_active":"2023-10-06T04:40:16.683610+0000","last_became_peered":"2023-10-06T04:40:16.683610+0000","last_unstale":"2023-10-06T04:40:16.684945+0000","last_undegraded":"2023-10-06T04:40:16.684945+0000","last_fullsized":"2023-10-06T04:40:16.684945+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:43.967016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.678502+0000","last_change":"2023-10-06T04:40:16.678502+0000","last_active":"2023-10-06T04:40:16.678502+0000","last_peered":"2023-10-06T04:40:16.678502+0000","last_clean":"2023-10-06T04:40:16.678502+0000","last_became_active":"2023-10-06T04:40:16.677196+0000","last_became_peered":"2023-10-06T04:40:16.677196+0000","last_unstale":"2023-10-06T04:40:16.678502+0000","last_undegraded":"2023-10-06T04:40:16.678502+0000","last_fullsized":"2023-10-06T04:40:16.678502+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:16.229803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.678407+0000","last_change":"2023-10-06T04:40:16.678407+0000","last_active":"2023-10-06T04:40:16.678407+0000","last_peered":"2023-10-06T04:40:16.678407+0000","last_clean":"2023-10-06T04:40:16.678407+0000","last_became_active":"2023-10-06T04:40:16.678095+0000","last_became_peered":"2023-10-06T04:40:16.678095+0000","last_unstale":"2023-10-06T04:40:16.678407+0000","last_undegraded":"2023-10-06T04:40:16.678407+0000","last_fullsized":"2023-10-06T04:40:16.678407+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:25.935569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681806+0000","last_change":"2023-10-06T04:40:16.681806+0000","last_active":"2023-10-06T04:40:16.681806+0000","last_peered":"2023-10-06T04:40:16.681806+0000","last_clean":"2023-10-06T04:40:16.681806+0000","last_became_active":"2023-10-06T04:40:16.681460+0000","last_became_peered":"2023-10-06T04:40:16.681460+0000","last_unstale":"2023-10-06T04:40:16.681806+0000","last_undegraded":"2023-10-06T04:40:16.681806+0000","last_fullsized":"2023-10-06T04:40:16.681806+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:19.423049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.676880+0000","last_change":"2023-10-06T04:40:16.676880+0000","last_active":"2023-10-06T04:40:16.676880+0000","last_peered":"2023-10-06T04:40:16.676880+0000","last_clean":"2023-10-06T04:40:16.676880+0000","last_became_active":"2023-10-06T04:40:16.676565+0000","last_became_peered":"2023-10-06T04:40:16.676565+0000","last_unstale":"2023-10-06T04:40:16.676880+0000","last_undegraded":"2023-10-06T04:40:16.676880+0000","last_fullsized":"2023-10-06T04:40:16.676880+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:10.156881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.673947+0000","last_change":"2023-10-06T04:40:16.673947+0000","last_active":"2023-10-06T04:40:16.673947+0000","last_peered":"2023-10-06T04:40:16.673947+0000","last_clean":"2023-10-06T04:40:16.673947+0000","last_became_active":"2023-10-06T04:40:16.673619+0000","last_became_peered":"2023-10-06T04:40:16.673619+0000","last_unstale":"2023-10-06T04:40:16.673947+0000","last_undegraded":"2023-10-06T04:40:16.673947+0000","last_fullsized":"2023-10-06T04:40:16.673947+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:08.816116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.680291+0000","last_change":"2023-10-06T04:40:16.680291+0000","last_active":"2023-10-06T04:40:16.680291+0000","last_peered":"2023-10-06T04:40:16.680291+0000","last_clean":"2023-10-06T04:40:16.680291+0000","last_became_active":"2023-10-06T04:40:16.680033+0000","last_became_peered":"2023-10-06T04:40:16.680033+0000","last_unstale":"2023-10-06T04:40:16.680291+0000","last_undegraded":"2023-10-06T04:40:16.680291+0000","last_fullsized":"2023-10-06T04:40:16.680291+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:58.185477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681417+0000","last_change":"2023-10-06T04:40:16.681417+0000","last_active":"2023-10-06T04:40:16.681417+0000","last_peered":"2023-10-06T04:40:16.681417+0000","last_clean":"2023-10-06T04:40:16.681417+0000","last_became_active":"2023-10-06T04:40:16.681113+0000","last_became_peered":"2023-10-06T04:40:16.681113+0000","last_unstale":"2023-10-06T04:40:16.681417+0000","last_undegraded":"2023-10-06T04:40:16.681417+0000","last_fullsized":"2023-10-06T04:40:16.681417+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:03.616182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.675804+0000","last_change":"2023-10-06T04:40:16.675804+0000","last_active":"2023-10-06T04:40:16.675804+0000","last_peered":"2023-10-06T04:40:16.675804+0000","last_clean":"2023-10-06T04:40:16.675804+0000","last_became_active":"2023-10-06T04:40:16.675454+0000","last_became_peered":"2023-10-06T04:40:16.675454+0000","last_unstale":"2023-10-06T04:40:16.675804+0000","last_undegraded":"2023-10-06T04:40:16.675804+0000","last_fullsized":"2023-10-06T04:40:16.675804+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:01.381508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.678690+0000","last_change":"2023-10-06T04:40:16.673336+0000","last_active":"2023-10-06T04:40:16.678690+0000","last_peered":"2023-10-06T04:40:16.678690+0000","last_clean":"2023-10-06T04:40:16.678690+0000","last_became_active":"2023-10-06T04:40:16.672537+0000","last_became_peered":"2023-10-06T04:40:16.672537+0000","last_unstale":"2023-10-06T04:40:16.678690+0000","last_undegraded":"2023-10-06T04:40:16.678690+0000","last_fullsized":"2023-10-06T04:40:16.678690+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:01.381508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.670291+0000","last_change":"2023-10-06T04:40:16.670291+0000","last_active":"2023-10-06T04:40:16.670291+0000","last_peered":"2023-10-06T04:40:16.670291+0000","last_clean":"2023-10-06T04:40:16.670291+0000","last_became_active":"2023-10-06T04:40:16.669139+0000","last_became_peered":"2023-10-06T04:40:16.669139+0000","last_unstale":"2023-10-06T04:40:16.670291+0000","last_undegraded":"2023-10-06T04:40:16.670291+0000","last_fullsized":"2023-10-06T04:40:16.670291+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:56.151507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.676149+0000","last_change":"2023-10-06T04:40:16.676149+0000","last_active":"2023-10-06T04:40:16.676149+0000","last_peered":"2023-10-06T04:40:16.676149+0000","last_clean":"2023-10-06T04:40:16.676149+0000","last_became_active":"2023-10-06T04:40:16.675790+0000","last_became_peered":"2023-10-06T04:40:16.675790+0000","last_unstale":"2023-10-06T04:40:16.676149+0000","last_undegraded":"2023-10-06T04:40:16.676149+0000","last_fullsized":"2023-10-06T04:40:16.676149+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:56.151507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.049491+0000","last_change":"2023-10-06T04:40:16.052768+0000","last_active":"2023-10-06T04:40:17.049491+0000","last_peered":"2023-10-06T04:40:17.049491+0000","last_clean":"2023-10-06T04:40:17.049491+0000","last_became_active":"2023-10-06T04:40:16.052473+0000","last_became_peered":"2023-10-06T04:40:16.052473+0000","last_unstale":"2023-10-06T04:40:17.049491+0000","last_undegraded":"2023-10-06T04:40:17.049491+0000","last_fullsized":"2023-10-06T04:40:17.049491+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:50.962886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.677485+0000","last_change":"2023-10-06T04:40:16.677485+0000","last_active":"2023-10-06T04:40:16.677485+0000","last_peered":"2023-10-06T04:40:16.677485+0000","last_clean":"2023-10-06T04:40:16.677485+0000","last_became_active":"2023-10-06T04:40:16.677178+0000","last_became_peered":"2023-10-06T04:40:16.677178+0000","last_unstale":"2023-10-06T04:40:16.677485+0000","last_undegraded":"2023-10-06T04:40:16.677485+0000","last_fullsized":"2023-10-06T04:40:16.677485+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:37.854095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.661605+0000","last_change":"2023-10-06T04:40:16.043615+0000","last_active":"2023-10-06T04:40:16.661605+0000","last_peered":"2023-10-06T04:40:16.661605+0000","last_clean":"2023-10-06T04:40:16.661605+0000","last_became_active":"2023-10-06T04:40:16.043343+0000","last_became_peered":"2023-10-06T04:40:16.043343+0000","last_unstale":"2023-10-06T04:40:16.661605+0000","last_undegraded":"2023-10-06T04:40:16.661605+0000","last_fullsized":"2023-10-06T04:40:16.661605+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:37.682647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.679781+0000","last_change":"2023-10-06T04:40:16.679781+0000","last_active":"2023-10-06T04:40:16.679781+0000","last_peered":"2023-10-06T04:40:16.679781+0000","last_clean":"2023-10-06T04:40:16.679781+0000","last_became_active":"2023-10-06T04:40:16.679453+0000","last_became_peered":"2023-10-06T04:40:16.679453+0000","last_unstale":"2023-10-06T04:40:16.679781+0000","last_undegraded":"2023-10-06T04:40:16.679781+0000","last_fullsized":"2023-10-06T04:40:16.679781+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:00.730220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.042643+0000","last_change":"2023-10-06T04:40:16.048295+0000","last_active":"2023-10-06T04:40:17.042643+0000","last_peered":"2023-10-06T04:40:17.042643+0000","last_clean":"2023-10-06T04:40:17.042643+0000","last_became_active":"2023-10-06T04:40:16.047972+0000","last_became_peered":"2023-10-06T04:40:16.047972+0000","last_unstale":"2023-10-06T04:40:17.042643+0000","last_undegraded":"2023-10-06T04:40:17.042643+0000","last_fullsized":"2023-10-06T04:40:17.042643+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:26.093296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.676860+0000","last_change":"2023-10-06T04:40:16.676860+0000","last_active":"2023-10-06T04:40:16.676860+0000","last_peered":"2023-10-06T04:40:16.676860+0000","last_clean":"2023-10-06T04:40:16.676860+0000","last_became_active":"2023-10-06T04:40:16.676571+0000","last_became_peered":"2023-10-06T04:40:16.676571+0000","last_unstale":"2023-10-06T04:40:16.676860+0000","last_undegraded":"2023-10-06T04:40:16.676860+0000","last_fullsized":"2023-10-06T04:40:16.676860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:10.156881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.044200+0000","last_change":"2023-10-06T04:40:16.052519+0000","last_active":"2023-10-06T04:40:17.044200+0000","last_peered":"2023-10-06T04:40:17.044200+0000","last_clean":"2023-10-06T04:40:17.044200+0000","last_became_active":"2023-10-06T04:40:16.052291+0000","last_became_peered":"2023-10-06T04:40:16.052291+0000","last_unstale":"2023-10-06T04:40:17.044200+0000","last_undegraded":"2023-10-06T04:40:17.044200+0000","last_fullsized":"2023-10-06T04:40:17.044200+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:39.386753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.674712+0000","last_change":"2023-10-06T04:40:16.674712+0000","last_active":"2023-10-06T04:40:16.674712+0000","last_peered":"2023-10-06T04:40:16.674712+0000","last_clean":"2023-10-06T04:40:16.674712+0000","last_became_active":"2023-10-06T04:40:16.674361+0000","last_became_peered":"2023-10-06T04:40:16.674361+0000","last_unstale":"2023-10-06T04:40:16.674712+0000","last_undegraded":"2023-10-06T04:40:16.674712+0000","last_fullsized":"2023-10-06T04:40:16.674712+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:10.097264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.048104+0000","last_change":"2023-10-06T04:40:16.049077+0000","last_active":"2023-10-06T04:40:17.048104+0000","last_peered":"2023-10-06T04:40:17.048104+0000","last_clean":"2023-10-06T04:40:17.048104+0000","last_became_active":"2023-10-06T04:40:16.048191+0000","last_became_peered":"2023-10-06T04:40:16.048191+0000","last_unstale":"2023-10-06T04:40:17.048104+0000","last_undegraded":"2023-10-06T04:40:17.048104+0000","last_fullsized":"2023-10-06T04:40:17.048104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:23:11.133646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.685655+0000","last_change":"2023-10-06T04:40:16.685655+0000","last_active":"2023-10-06T04:40:16.685655+0000","last_peered":"2023-10-06T04:40:16.685655+0000","last_clean":"2023-10-06T04:40:16.685655+0000","last_became_active":"2023-10-06T04:40:16.685276+0000","last_became_peered":"2023-10-06T04:40:16.685276+0000","last_unstale":"2023-10-06T04:40:16.685655+0000","last_undegraded":"2023-10-06T04:40:16.685655+0000","last_fullsized":"2023-10-06T04:40:16.685655+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:17.964341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.661045+0000","last_change":"2023-10-06T04:40:16.043553+0000","last_active":"2023-10-06T04:40:16.661045+0000","last_peered":"2023-10-06T04:40:16.661045+0000","last_clean":"2023-10-06T04:40:16.661045+0000","last_became_active":"2023-10-06T04:40:16.043187+0000","last_became_peered":"2023-10-06T04:40:16.043187+0000","last_unstale":"2023-10-06T04:40:16.661045+0000","last_undegraded":"2023-10-06T04:40:16.661045+0000","last_fullsized":"2023-10-06T04:40:16.661045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:44.896559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.679927+0000","last_change":"2023-10-06T04:40:16.679927+0000","last_active":"2023-10-06T04:40:16.679927+0000","last_peered":"2023-10-06T04:40:16.679927+0000","last_clean":"2023-10-06T04:40:16.679927+0000","last_became_active":"2023-10-06T04:40:16.679435+0000","last_became_peered":"2023-10-06T04:40:16.679435+0000","last_unstale":"2023-10-06T04:40:16.679927+0000","last_undegraded":"2023-10-06T04:40:16.679927+0000","last_fullsized":"2023-10-06T04:40:16.679927+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:12.411273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.052193+0000","last_change":"2023-10-06T04:40:16.048844+0000","last_active":"2023-10-06T04:40:16.052193+0000","last_peered":"2023-10-06T04:40:16.052193+0000","last_clean":"2023-10-06T04:40:16.052193+0000","last_became_active":"2023-10-06T04:40:16.048570+0000","last_became_peered":"2023-10-06T04:40:16.048570+0000","last_unstale":"2023-10-06T04:40:16.052193+0000","last_undegraded":"2023-10-06T04:40:16.052193+0000","last_fullsized":"2023-10-06T04:40:16.052193+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:09.142707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.680564+0000","last_change":"2023-10-06T04:40:16.680564+0000","last_active":"2023-10-06T04:40:16.680564+0000","last_peered":"2023-10-06T04:40:16.680564+0000","last_clean":"2023-10-06T04:40:16.680564+0000","last_became_active":"2023-10-06T04:40:16.678370+0000","last_became_peered":"2023-10-06T04:40:16.678370+0000","last_unstale":"2023-10-06T04:40:16.680564+0000","last_undegraded":"2023-10-06T04:40:16.680564+0000","last_fullsized":"2023-10-06T04:40:16.680564+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:06.702825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.056882+0000","last_change":"2023-10-06T04:40:16.053867+0000","last_active":"2023-10-06T04:40:16.056882+0000","last_peered":"2023-10-06T04:40:16.056882+0000","last_clean":"2023-10-06T04:40:16.056882+0000","last_became_active":"2023-10-06T04:40:16.053286+0000","last_became_peered":"2023-10-06T04:40:16.053286+0000","last_unstale":"2023-10-06T04:40:16.056882+0000","last_undegraded":"2023-10-06T04:40:16.056882+0000","last_fullsized":"2023-10-06T04:40:16.056882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:40.703411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.689003+0000","last_change":"2023-10-06T04:40:16.689003+0000","last_active":"2023-10-06T04:40:16.689003+0000","last_peered":"2023-10-06T04:40:16.689003+0000","last_clean":"2023-10-06T04:40:16.689003+0000","last_became_active":"2023-10-06T04:40:16.688716+0000","last_became_peered":"2023-10-06T04:40:16.688716+0000","last_unstale":"2023-10-06T04:40:16.689003+0000","last_undegraded":"2023-10-06T04:40:16.689003+0000","last_fullsized":"2023-10-06T04:40:16.689003+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:04.927330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.049698+0000","last_change":"2023-10-06T04:40:16.044716+0000","last_active":"2023-10-06T04:40:16.049698+0000","last_peered":"2023-10-06T04:40:16.049698+0000","last_clean":"2023-10-06T04:40:16.049698+0000","last_became_active":"2023-10-06T04:40:16.044413+0000","last_became_peered":"2023-10-06T04:40:16.044413+0000","last_unstale":"2023-10-06T04:40:16.049698+0000","last_undegraded":"2023-10-06T04:40:16.049698+0000","last_fullsized":"2023-10-06T04:40:16.049698+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:25.997779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681185+0000","last_change":"2023-10-06T04:40:16.681185+0000","last_active":"2023-10-06T04:40:16.681185+0000","last_peered":"2023-10-06T04:40:16.681185+0000","last_clean":"2023-10-06T04:40:16.681185+0000","last_became_active":"2023-10-06T04:40:16.680897+0000","last_became_peered":"2023-10-06T04:40:16.680897+0000","last_unstale":"2023-10-06T04:40:16.681185+0000","last_undegraded":"2023-10-06T04:40:16.681185+0000","last_fullsized":"2023-10-06T04:40:16.681185+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:59.929528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.056880+0000","last_change":"2023-10-06T04:40:16.053205+0000","last_active":"2023-10-06T04:40:16.056880+0000","last_peered":"2023-10-06T04:40:16.056880+0000","last_clean":"2023-10-06T04:40:16.056880+0000","last_became_active":"2023-10-06T04:40:16.052922+0000","last_became_peered":"2023-10-06T04:40:16.052922+0000","last_unstale":"2023-10-06T04:40:16.056880+0000","last_undegraded":"2023-10-06T04:40:16.056880+0000","last_fullsized":"2023-10-06T04:40:16.056880+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:36.945866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.674857+0000","last_change":"2023-10-06T04:40:16.668371+0000","last_active":"2023-10-06T04:40:16.674857+0000","last_peered":"2023-10-06T04:40:16.674857+0000","last_clean":"2023-10-06T04:40:16.674857+0000","last_became_active":"2023-10-06T04:40:16.667259+0000","last_became_peered":"2023-10-06T04:40:16.667259+0000","last_unstale":"2023-10-06T04:40:16.674857+0000","last_undegraded":"2023-10-06T04:40:16.674857+0000","last_fullsized":"2023-10-06T04:40:16.674857+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:43.967016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.049116+0000","last_change":"2023-10-06T04:40:16.053478+0000","last_active":"2023-10-06T04:40:17.049116+0000","last_peered":"2023-10-06T04:40:17.049116+0000","last_clean":"2023-10-06T04:40:17.049116+0000","last_became_active":"2023-10-06T04:40:16.053191+0000","last_became_peered":"2023-10-06T04:40:16.053191+0000","last_unstale":"2023-10-06T04:40:17.049116+0000","last_undegraded":"2023-10-06T04:40:17.049116+0000","last_fullsized":"2023-10-06T04:40:17.049116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:50.962886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.679767+0000","last_change":"2023-10-06T04:40:16.679767+0000","last_active":"2023-10-06T04:40:16.679767+0000","last_peered":"2023-10-06T04:40:16.679767+0000","last_clean":"2023-10-06T04:40:16.679767+0000","last_became_active":"2023-10-06T04:40:16.679391+0000","last_became_peered":"2023-10-06T04:40:16.679391+0000","last_unstale":"2023-10-06T04:40:16.679767+0000","last_undegraded":"2023-10-06T04:40:16.679767+0000","last_fullsized":"2023-10-06T04:40:16.679767+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:42.238565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.048781+0000","last_change":"2023-10-06T04:40:16.040464+0000","last_active":"2023-10-06T04:40:17.048781+0000","last_peered":"2023-10-06T04:40:17.048781+0000","last_clean":"2023-10-06T04:40:17.048781+0000","last_became_active":"2023-10-06T04:40:16.040114+0000","last_became_peered":"2023-10-06T04:40:16.040114+0000","last_unstale":"2023-10-06T04:40:17.048781+0000","last_undegraded":"2023-10-06T04:40:17.048781+0000","last_fullsized":"2023-10-06T04:40:17.048781+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:24.921396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.689244+0000","last_change":"2023-10-06T04:40:16.689244+0000","last_active":"2023-10-06T04:40:16.689244+0000","last_peered":"2023-10-06T04:40:16.689244+0000","last_clean":"2023-10-06T04:40:16.689244+0000","last_became_active":"2023-10-06T04:40:16.688826+0000","last_became_peered":"2023-10-06T04:40:16.688826+0000","last_unstale":"2023-10-06T04:40:16.689244+0000","last_undegraded":"2023-10-06T04:40:16.689244+0000","last_fullsized":"2023-10-06T04:40:16.689244+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:27.107470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.048207+0000","last_change":"2023-10-06T04:40:16.053453+0000","last_active":"2023-10-06T04:40:17.048207+0000","last_peered":"2023-10-06T04:40:17.048207+0000","last_clean":"2023-10-06T04:40:17.048207+0000","last_became_active":"2023-10-06T04:40:16.053148+0000","last_became_peered":"2023-10-06T04:40:16.053148+0000","last_unstale":"2023-10-06T04:40:17.048207+0000","last_undegraded":"2023-10-06T04:40:17.048207+0000","last_fullsized":"2023-10-06T04:40:17.048207+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:15.129153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.682605+0000","last_change":"2023-10-06T04:40:16.682605+0000","last_active":"2023-10-06T04:40:16.682605+0000","last_peered":"2023-10-06T04:40:16.682605+0000","last_clean":"2023-10-06T04:40:16.682605+0000","last_became_active":"2023-10-06T04:40:16.682115+0000","last_became_peered":"2023-10-06T04:40:16.682115+0000","last_unstale":"2023-10-06T04:40:16.682605+0000","last_undegraded":"2023-10-06T04:40:16.682605+0000","last_fullsized":"2023-10-06T04:40:16.682605+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:36.993305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.060296+0000","last_change":"2023-10-06T04:40:16.058180+0000","last_active":"2023-10-06T04:40:16.060296+0000","last_peered":"2023-10-06T04:40:16.060296+0000","last_clean":"2023-10-06T04:40:16.060296+0000","last_became_active":"2023-10-06T04:40:16.057907+0000","last_became_peered":"2023-10-06T04:40:16.057907+0000","last_unstale":"2023-10-06T04:40:16.060296+0000","last_undegraded":"2023-10-06T04:40:16.060296+0000","last_fullsized":"2023-10-06T04:40:16.060296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:20.985389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.674575+0000","last_change":"2023-10-06T04:40:16.667724+0000","last_active":"2023-10-06T04:40:16.674575+0000","last_peered":"2023-10-06T04:40:16.674575+0000","last_clean":"2023-10-06T04:40:16.674575+0000","last_became_active":"2023-10-06T04:40:16.667406+0000","last_became_peered":"2023-10-06T04:40:16.667406+0000","last_unstale":"2023-10-06T04:40:16.674575+0000","last_undegraded":"2023-10-06T04:40:16.674575+0000","last_fullsized":"2023-10-06T04:40:16.674575+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:36.993305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.659172+0000","last_change":"2023-10-06T04:40:16.054523+0000","last_active":"2023-10-06T04:40:16.659172+0000","last_peered":"2023-10-06T04:40:16.659172+0000","last_clean":"2023-10-06T04:40:16.659172+0000","last_became_active":"2023-10-06T04:40:16.054210+0000","last_became_peered":"2023-10-06T04:40:16.054210+0000","last_unstale":"2023-10-06T04:40:16.659172+0000","last_undegraded":"2023-10-06T04:40:16.659172+0000","last_fullsized":"2023-10-06T04:40:16.659172+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:21.997654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.675774+0000","last_change":"2023-10-06T04:40:16.675774+0000","last_active":"2023-10-06T04:40:16.675774+0000","last_peered":"2023-10-06T04:40:16.675774+0000","last_clean":"2023-10-06T04:40:16.675774+0000","last_became_active":"2023-10-06T04:40:16.675428+0000","last_became_peered":"2023-10-06T04:40:16.675428+0000","last_unstale":"2023-10-06T04:40:16.675774+0000","last_undegraded":"2023-10-06T04:40:16.675774+0000","last_fullsized":"2023-10-06T04:40:16.675774+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:43:36.182092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.049559+0000","last_change":"2023-10-06T04:40:16.053550+0000","last_active":"2023-10-06T04:40:17.049559+0000","last_peered":"2023-10-06T04:40:17.049559+0000","last_clean":"2023-10-06T04:40:17.049559+0000","last_became_active":"2023-10-06T04:40:16.052973+0000","last_became_peered":"2023-10-06T04:40:16.052973+0000","last_unstale":"2023-10-06T04:40:17.049559+0000","last_undegraded":"2023-10-06T04:40:17.049559+0000","last_fullsized":"2023-10-06T04:40:17.049559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:21:52.682763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.680774+0000","last_change":"2023-10-06T04:40:16.680774+0000","last_active":"2023-10-06T04:40:16.680774+0000","last_peered":"2023-10-06T04:40:16.680774+0000","last_clean":"2023-10-06T04:40:16.680774+0000","last_became_active":"2023-10-06T04:40:16.680398+0000","last_became_peered":"2023-10-06T04:40:16.680398+0000","last_unstale":"2023-10-06T04:40:16.680774+0000","last_undegraded":"2023-10-06T04:40:16.680774+0000","last_fullsized":"2023-10-06T04:40:16.680774+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:21.280757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.660580+0000","last_change":"2023-10-06T04:40:16.047111+0000","last_active":"2023-10-06T04:40:16.660580+0000","last_peered":"2023-10-06T04:40:16.660580+0000","last_clean":"2023-10-06T04:40:16.660580+0000","last_became_active":"2023-10-06T04:40:16.046773+0000","last_became_peered":"2023-10-06T04:40:16.046773+0000","last_unstale":"2023-10-06T04:40:16.660580+0000","last_undegraded":"2023-10-06T04:40:16.660580+0000","last_fullsized":"2023-10-06T04:40:16.660580+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:28.825170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.680165+0000","last_change":"2023-10-06T04:40:16.680165+0000","last_active":"2023-10-06T04:40:16.680165+0000","last_peered":"2023-10-06T04:40:16.680165+0000","last_clean":"2023-10-06T04:40:16.680165+0000","last_became_active":"2023-10-06T04:40:16.679857+0000","last_became_peered":"2023-10-06T04:40:16.679857+0000","last_unstale":"2023-10-06T04:40:16.680165+0000","last_undegraded":"2023-10-06T04:40:16.680165+0000","last_fullsized":"2023-10-06T04:40:16.680165+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:27.011953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.042619+0000","last_change":"2023-10-06T04:40:16.050308+0000","last_active":"2023-10-06T04:40:17.042619+0000","last_peered":"2023-10-06T04:40:17.042619+0000","last_clean":"2023-10-06T04:40:17.042619+0000","last_became_active":"2023-10-06T04:40:16.049812+0000","last_became_peered":"2023-10-06T04:40:16.049812+0000","last_unstale":"2023-10-06T04:40:17.042619+0000","last_undegraded":"2023-10-06T04:40:17.042619+0000","last_fullsized":"2023-10-06T04:40:17.042619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:43:35.167918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.680698+0000","last_change":"2023-10-06T04:40:16.680698+0000","last_active":"2023-10-06T04:40:16.680698+0000","last_peered":"2023-10-06T04:40:16.680698+0000","last_clean":"2023-10-06T04:40:16.680698+0000","last_became_active":"2023-10-06T04:40:16.678469+0000","last_became_peered":"2023-10-06T04:40:16.678469+0000","last_unstale":"2023-10-06T04:40:16.680698+0000","last_undegraded":"2023-10-06T04:40:16.680698+0000","last_fullsized":"2023-10-06T04:40:16.680698+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:01.138896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.670641+0000","last_change":"2023-10-06T04:40:16.049335+0000","last_active":"2023-10-06T04:40:16.670641+0000","last_peered":"2023-10-06T04:40:16.670641+0000","last_clean":"2023-10-06T04:40:16.670641+0000","last_became_active":"2023-10-06T04:40:16.049059+0000","last_became_peered":"2023-10-06T04:40:16.049059+0000","last_unstale":"2023-10-06T04:40:16.670641+0000","last_undegraded":"2023-10-06T04:40:16.670641+0000","last_fullsized":"2023-10-06T04:40:16.670641+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:19.674983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.681333+0000","last_change":"2023-10-06T04:40:16.681333+0000","last_active":"2023-10-06T04:40:16.681333+0000","last_peered":"2023-10-06T04:40:16.681333+0000","last_clean":"2023-10-06T04:40:16.681333+0000","last_became_active":"2023-10-06T04:40:16.680981+0000","last_became_peered":"2023-10-06T04:40:16.680981+0000","last_unstale":"2023-10-06T04:40:16.681333+0000","last_undegraded":"2023-10-06T04:40:16.681333+0000","last_fullsized":"2023-10-06T04:40:16.681333+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:23.266546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.656744+0000","last_change":"2023-10-06T04:40:16.044225+0000","last_active":"2023-10-06T04:40:16.656744+0000","last_peered":"2023-10-06T04:40:16.656744+0000","last_clean":"2023-10-06T04:40:16.656744+0000","last_became_active":"2023-10-06T04:40:16.043882+0000","last_became_peered":"2023-10-06T04:40:16.043882+0000","last_unstale":"2023-10-06T04:40:16.656744+0000","last_undegraded":"2023-10-06T04:40:16.656744+0000","last_fullsized":"2023-10-06T04:40:16.656744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:53.489994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.678181+0000","last_change":"2023-10-06T04:40:16.673744+0000","last_active":"2023-10-06T04:40:16.678181+0000","last_peered":"2023-10-06T04:40:16.678181+0000","last_clean":"2023-10-06T04:40:16.678181+0000","last_became_active":"2023-10-06T04:40:16.673418+0000","last_became_peered":"2023-10-06T04:40:16.673418+0000","last_unstale":"2023-10-06T04:40:16.678181+0000","last_undegraded":"2023-10-06T04:40:16.678181+0000","last_fullsized":"2023-10-06T04:40:16.678181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:43.111255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.048241+0000","last_change":"2023-10-06T04:40:16.048800+0000","last_active":"2023-10-06T04:40:17.048241+0000","last_peered":"2023-10-06T04:40:17.048241+0000","last_clean":"2023-10-06T04:40:17.048241+0000","last_became_active":"2023-10-06T04:40:16.047827+0000","last_became_peered":"2023-10-06T04:40:16.047827+0000","last_unstale":"2023-10-06T04:40:17.048241+0000","last_undegraded":"2023-10-06T04:40:17.048241+0000","last_fullsized":"2023-10-06T04:40:17.048241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:33.899675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.673552+0000","last_change":"2023-10-06T04:40:16.673552+0000","last_active":"2023-10-06T04:40:16.673552+0000","last_peered":"2023-10-06T04:40:16.673552+0000","last_clean":"2023-10-06T04:40:16.673552+0000","last_became_active":"2023-10-06T04:40:16.673226+0000","last_became_peered":"2023-10-06T04:40:16.673226+0000","last_unstale":"2023-10-06T04:40:16.673552+0000","last_undegraded":"2023-10-06T04:40:16.673552+0000","last_fullsized":"2023-10-06T04:40:16.673552+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:21.280757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.055047+0000","last_change":"2023-10-06T04:40:16.051466+0000","last_active":"2023-10-06T04:40:16.055047+0000","last_peered":"2023-10-06T04:40:16.055047+0000","last_clean":"2023-10-06T04:40:16.055047+0000","last_became_active":"2023-10-06T04:40:16.051165+0000","last_became_peered":"2023-10-06T04:40:16.051165+0000","last_unstale":"2023-10-06T04:40:16.055047+0000","last_undegraded":"2023-10-06T04:40:16.055047+0000","last_fullsized":"2023-10-06T04:40:16.055047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:14.976397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.675931+0000","last_change":"2023-10-06T04:40:16.675931+0000","last_active":"2023-10-06T04:40:16.675931+0000","last_peered":"2023-10-06T04:40:16.675931+0000","last_clean":"2023-10-06T04:40:16.675931+0000","last_became_active":"2023-10-06T04:40:16.675591+0000","last_became_peered":"2023-10-06T04:40:16.675591+0000","last_unstale":"2023-10-06T04:40:16.675931+0000","last_undegraded":"2023-10-06T04:40:16.675931+0000","last_fullsized":"2023-10-06T04:40:16.675931+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:27:05.248898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.056779+0000","last_change":"2023-10-06T04:40:16.052554+0000","last_active":"2023-10-06T04:40:16.056779+0000","last_peered":"2023-10-06T04:40:16.056779+0000","last_clean":"2023-10-06T04:40:16.056779+0000","last_became_active":"2023-10-06T04:40:16.051637+0000","last_became_peered":"2023-10-06T04:40:16.051637+0000","last_unstale":"2023-10-06T04:40:16.056779+0000","last_undegraded":"2023-10-06T04:40:16.056779+0000","last_fullsized":"2023-10-06T04:40:16.056779+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:41.449616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.683670+0000","last_change":"2023-10-06T04:40:16.683670+0000","last_active":"2023-10-06T04:40:16.683670+0000","last_peered":"2023-10-06T04:40:16.683670+0000","last_clean":"2023-10-06T04:40:16.683670+0000","last_became_active":"2023-10-06T04:40:16.683318+0000","last_became_peered":"2023-10-06T04:40:16.683318+0000","last_unstale":"2023-10-06T04:40:16.683670+0000","last_undegraded":"2023-10-06T04:40:16.683670+0000","last_fullsized":"2023-10-06T04:40:16.683670+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:31:54.712833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.060277+0000","last_change":"2023-10-06T04:40:16.058126+0000","last_active":"2023-10-06T04:40:16.060277+0000","last_peered":"2023-10-06T04:40:16.060277+0000","last_clean":"2023-10-06T04:40:16.060277+0000","last_became_active":"2023-10-06T04:40:16.057851+0000","last_became_peered":"2023-10-06T04:40:16.057851+0000","last_unstale":"2023-10-06T04:40:16.060277+0000","last_undegraded":"2023-10-06T04:40:16.060277+0000","last_fullsized":"2023-10-06T04:40:16.060277+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.714286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.678161+0000","last_change":"2023-10-06T04:40:16.673682+0000","last_active":"2023-10-06T04:40:16.678161+0000","last_peered":"2023-10-06T04:40:16.678161+0000","last_clean":"2023-10-06T04:40:16.678161+0000","last_became_active":"2023-10-06T04:40:16.672907+0000","last_became_peered":"2023-10-06T04:40:16.672907+0000","last_unstale":"2023-10-06T04:40:16.678161+0000","last_undegraded":"2023-10-06T04:40:16.678161+0000","last_fullsized":"2023-10-06T04:40:16.678161+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:21.163939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.057436+0000","last_change":"2023-10-06T04:40:16.053621+0000","last_active":"2023-10-06T04:40:16.057436+0000","last_peered":"2023-10-06T04:40:16.057436+0000","last_clean":"2023-10-06T04:40:16.057436+0000","last_became_active":"2023-10-06T04:40:16.053344+0000","last_became_peered":"2023-10-06T04:40:16.053344+0000","last_unstale":"2023-10-06T04:40:16.057436+0000","last_undegraded":"2023-10-06T04:40:16.057436+0000","last_fullsized":"2023-10-06T04:40:16.057436+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:11.109744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.048954+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:40:16.048954+0000","last_peered":"2023-10-06T04:40:16.048954+0000","last_clean":"2023-10-06T04:40:16.048954+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:40:16.048954+0000","last_undegraded":"2023-10-06T04:40:16.048954+0000","last_fullsized":"2023-10-06T04:40:16.048954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.675227+0000","last_change":"2023-10-06T04:40:16.668783+0000","last_active":"2023-10-06T04:40:16.675227+0000","last_peered":"2023-10-06T04:40:16.675227+0000","last_clean":"2023-10-06T04:40:16.675227+0000","last_became_active":"2023-10-06T04:40:16.668480+0000","last_became_peered":"2023-10-06T04:40:16.668480+0000","last_unstale":"2023-10-06T04:40:16.675227+0000","last_undegraded":"2023-10-06T04:40:16.675227+0000","last_fullsized":"2023-10-06T04:40:16.675227+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:21.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.042724+0000","last_change":"2023-10-06T04:40:16.040907+0000","last_active":"2023-10-06T04:40:16.042724+0000","last_peered":"2023-10-06T04:40:16.042724+0000","last_clean":"2023-10-06T04:40:16.042724+0000","last_became_active":"2023-10-06T04:40:16.039830+0000","last_became_peered":"2023-10-06T04:40:16.039830+0000","last_unstale":"2023-10-06T04:40:16.042724+0000","last_undegraded":"2023-10-06T04:40:16.042724+0000","last_fullsized":"2023-10-06T04:40:16.042724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:58.915354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.038357+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:40:16.038357+0000","last_peered":"2023-10-06T04:40:16.038357+0000","last_clean":"2023-10-06T04:40:16.038357+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:40:16.038357+0000","last_undegraded":"2023-10-06T04:40:16.038357+0000","last_fullsized":"2023-10-06T04:40:16.038357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.677201+0000","last_change":"2023-10-06T04:40:16.677201+0000","last_active":"2023-10-06T04:40:16.677201+0000","last_peered":"2023-10-06T04:40:16.677201+0000","last_clean":"2023-10-06T04:40:16.677201+0000","last_became_active":"2023-10-06T04:40:16.676933+0000","last_became_peered":"2023-10-06T04:40:16.676933+0000","last_unstale":"2023-10-06T04:40:16.677201+0000","last_undegraded":"2023-10-06T04:40:16.677201+0000","last_fullsized":"2023-10-06T04:40:16.677201+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:54.276133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.059255+0000","last_change":"2023-10-06T04:40:16.052826+0000","last_active":"2023-10-06T04:40:16.059255+0000","last_peered":"2023-10-06T04:40:16.059255+0000","last_clean":"2023-10-06T04:40:16.059255+0000","last_became_active":"2023-10-06T04:40:16.052493+0000","last_became_peered":"2023-10-06T04:40:16.052493+0000","last_unstale":"2023-10-06T04:40:16.059255+0000","last_undegraded":"2023-10-06T04:40:16.059255+0000","last_fullsized":"2023-10-06T04:40:16.059255+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:44.322323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.047006+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:40:16.047006+0000","last_peered":"2023-10-06T04:40:16.047006+0000","last_clean":"2023-10-06T04:40:16.047006+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:40:16.047006+0000","last_undegraded":"2023-10-06T04:40:16.047006+0000","last_fullsized":"2023-10-06T04:40:16.047006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.668333+0000","last_change":"2023-10-06T04:40:16.668333+0000","last_active":"2023-10-06T04:40:16.668333+0000","last_peered":"2023-10-06T04:40:16.668333+0000","last_clean":"2023-10-06T04:40:16.668333+0000","last_became_active":"2023-10-06T04:40:16.667940+0000","last_became_peered":"2023-10-06T04:40:16.667940+0000","last_unstale":"2023-10-06T04:40:16.668333+0000","last_undegraded":"2023-10-06T04:40:16.668333+0000","last_fullsized":"2023-10-06T04:40:16.668333+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:21.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.056861+0000","last_change":"2023-10-06T04:40:16.052721+0000","last_active":"2023-10-06T04:40:16.056861+0000","last_peered":"2023-10-06T04:40:16.056861+0000","last_clean":"2023-10-06T04:40:16.056861+0000","last_became_active":"2023-10-06T04:40:16.052426+0000","last_became_peered":"2023-10-06T04:40:16.052426+0000","last_unstale":"2023-10-06T04:40:16.056861+0000","last_undegraded":"2023-10-06T04:40:16.056861+0000","last_fullsized":"2023-10-06T04:40:16.056861+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:39.386753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.037064+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:40:16.037064+0000","last_peered":"2023-10-06T04:40:16.037064+0000","last_clean":"2023-10-06T04:40:16.037064+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:40:16.037064+0000","last_undegraded":"2023-10-06T04:40:16.037064+0000","last_fullsized":"2023-10-06T04:40:16.037064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.684849+0000","last_change":"2023-10-06T04:40:16.684849+0000","last_active":"2023-10-06T04:40:16.684849+0000","last_peered":"2023-10-06T04:40:16.684849+0000","last_clean":"2023-10-06T04:40:16.684849+0000","last_became_active":"2023-10-06T04:40:16.684474+0000","last_became_peered":"2023-10-06T04:40:16.684474+0000","last_unstale":"2023-10-06T04:40:16.684849+0000","last_undegraded":"2023-10-06T04:40:16.684849+0000","last_fullsized":"2023-10-06T04:40:16.684849+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:45.336497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.656808+0000","last_change":"2023-10-06T04:40:16.042153+0000","last_active":"2023-10-06T04:40:16.656808+0000","last_peered":"2023-10-06T04:40:16.656808+0000","last_clean":"2023-10-06T04:40:16.656808+0000","last_became_active":"2023-10-06T04:40:16.041794+0000","last_became_peered":"2023-10-06T04:40:16.041794+0000","last_unstale":"2023-10-06T04:40:16.656808+0000","last_undegraded":"2023-10-06T04:40:16.656808+0000","last_fullsized":"2023-10-06T04:40:16.656808+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:35.346457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.042654+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:40:16.042654+0000","last_peered":"2023-10-06T04:40:16.042654+0000","last_clean":"2023-10-06T04:40:16.042654+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:40:16.042654+0000","last_undegraded":"2023-10-06T04:40:16.042654+0000","last_fullsized":"2023-10-06T04:40:16.042654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.680140+0000","last_change":"2023-10-06T04:40:16.680140+0000","last_active":"2023-10-06T04:40:16.680140+0000","last_peered":"2023-10-06T04:40:16.680140+0000","last_clean":"2023-10-06T04:40:16.680140+0000","last_became_active":"2023-10-06T04:40:16.679771+0000","last_became_peered":"2023-10-06T04:40:16.679771+0000","last_unstale":"2023-10-06T04:40:16.680140+0000","last_undegraded":"2023-10-06T04:40:16.680140+0000","last_fullsized":"2023-10-06T04:40:16.680140+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:43:36.182092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.057451+0000","last_change":"2023-10-06T04:40:16.053616+0000","last_active":"2023-10-06T04:40:16.057451+0000","last_peered":"2023-10-06T04:40:16.057451+0000","last_clean":"2023-10-06T04:40:16.057451+0000","last_became_active":"2023-10-06T04:40:16.053319+0000","last_became_peered":"2023-10-06T04:40:16.053319+0000","last_unstale":"2023-10-06T04:40:16.057451+0000","last_undegraded":"2023-10-06T04:40:16.057451+0000","last_fullsized":"2023-10-06T04:40:16.057451+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:40.703411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.030176+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:40:16.030176+0000","last_peered":"2023-10-06T04:40:16.030176+0000","last_clean":"2023-10-06T04:40:16.030176+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:40:16.030176+0000","last_undegraded":"2023-10-06T04:40:16.030176+0000","last_fullsized":"2023-10-06T04:40:16.030176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.675182+0000","last_change":"2023-10-06T04:40:16.675182+0000","last_active":"2023-10-06T04:40:16.675182+0000","last_peered":"2023-10-06T04:40:16.675182+0000","last_clean":"2023-10-06T04:40:16.675182+0000","last_became_active":"2023-10-06T04:40:16.674877+0000","last_became_peered":"2023-10-06T04:40:16.674877+0000","last_unstale":"2023-10-06T04:40:16.675182+0000","last_undegraded":"2023-10-06T04:40:16.675182+0000","last_fullsized":"2023-10-06T04:40:16.675182+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:38.696821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.056484+0000","last_change":"2023-10-06T04:40:16.049122+0000","last_active":"2023-10-06T04:40:16.056484+0000","last_peered":"2023-10-06T04:40:16.056484+0000","last_clean":"2023-10-06T04:40:16.056484+0000","last_became_active":"2023-10-06T04:40:16.048851+0000","last_became_peered":"2023-10-06T04:40:16.048851+0000","last_unstale":"2023-10-06T04:40:16.056484+0000","last_undegraded":"2023-10-06T04:40:16.056484+0000","last_fullsized":"2023-10-06T04:40:16.056484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:18.408875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.041259+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:40:16.041259+0000","last_peered":"2023-10-06T04:40:16.041259+0000","last_clean":"2023-10-06T04:40:16.041259+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:40:16.041259+0000","last_undegraded":"2023-10-06T04:40:16.041259+0000","last_fullsized":"2023-10-06T04:40:16.041259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.685097+0000","last_change":"2023-10-06T04:40:16.685097+0000","last_active":"2023-10-06T04:40:16.685097+0000","last_peered":"2023-10-06T04:40:16.685097+0000","last_clean":"2023-10-06T04:40:16.685097+0000","last_became_active":"2023-10-06T04:40:16.684763+0000","last_became_peered":"2023-10-06T04:40:16.684763+0000","last_unstale":"2023-10-06T04:40:16.685097+0000","last_undegraded":"2023-10-06T04:40:16.685097+0000","last_fullsized":"2023-10-06T04:40:16.685097+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:16.012704+0000","last_clean_scrub_stamp":"2023-10-06T04:40:16.012704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:14.158434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:40:17.048263+0000","last_change":"2023-10-06T04:40:16.047920+0000","last_active":"2023-10-06T04:40:17.048263+0000","last_peered":"2023-10-06T04:40:17.048263+0000","last_clean":"2023-10-06T04:40:17.048263+0000","last_became_active":"2023-10-06T04:40:16.047615+0000","last_became_peered":"2023-10-06T04:40:16.047615+0000","last_unstale":"2023-10-06T04:40:17.048263+0000","last_undegraded":"2023-10-06T04:40:17.048263+0000","last_fullsized":"2023-10-06T04:40:17.048263+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:14.998530+0000","last_clean_scrub_stamp":"2023-10-06T04:40:14.998530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:20.085622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.044032+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:40:16.044032+0000","last_peered":"2023-10-06T04:40:16.044032+0000","last_clean":"2023-10-06T04:40:16.044032+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:40:16.044032+0000","last_undegraded":"2023-10-06T04:40:16.044032+0000","last_fullsized":"2023-10-06T04:40:16.044032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T04:40:16.046443+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:40:16.046443+0000","last_peered":"2023-10-06T04:40:16.046443+0000","last_clean":"2023-10-06T04:40:16.046443+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:40:16.046443+0000","last_undegraded":"2023-10-06T04:40:16.046443+0000","last_fullsized":"2023-10-06T04:40:16.046443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":479232,"data_stored":208260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.77000000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":1.069},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.90200000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.48}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.0529999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.266}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.611}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302424,"kb_used_data":1040,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069416,"statfs":{"total":96636764160,"available":96327081984,"internally_reserved":0,"allocated":1064960,"data_stored":798052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.746},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78600000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.94999999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1579999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.05}]},{"osd":5,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.341},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.0840000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.214},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.262}]},{"osd":7,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.3109999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":1048576,"data_stored":790582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":3.347,"5min":3.347,"15min":3.347},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.0149999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.056}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.61799999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.1499999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.1099999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.93999999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.96999999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.123}]}]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":200214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.109}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":1.02},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.82599999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1879999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.052}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.78300000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.0800000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.143},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.214}]}]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":200214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.88300000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.131},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.026},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.628},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.97399999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.0509999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.097}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":200214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.079},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.95299999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.159}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.036}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.232},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.145}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.21}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.1899999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297744,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074096,"statfs":{"total":96636764160,"available":96331874304,"internally_reserved":0,"allocated":466944,"data_stored":207650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.77000000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.046},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.224}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.3149999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.01}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.365}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.1259999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297744,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074096,"statfs":{"total":96636764160,"available":96331874304,"internally_reserved":0,"allocated":466944,"data_stored":207650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.84499999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.0800000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.004},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.038}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.397},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.1459999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.236}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.2709999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:20.576 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:40:20.577 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T04:40:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.704+0000 7fc96a3e3700 1 Processor -- start 2023-10-06T04:40:20.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.704+0000 7fc96a3e3700 1 -- start start 2023-10-06T04:40:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc964156bb0 0x7fc9640c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9640c9200 0x7fc96415a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9640cc170 con 0x7fc9640aac00 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9640acfc0 con 0x7fc9640c9200 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640c99b0 con 0x7fc964156bb0 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc9637fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9640c9200 0x7fc96415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc9637fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9640c9200 0x7fc96415a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32778/0 (socket says 172.21.15.37:32778) 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc9637fe700 1 -- 172.21.15.37:0/2258564294 learned_addr learned my addr 172.21.15.37:0/2258564294 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc963fff700 1 --2- 172.21.15.37:0/2258564294 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc964156bb0 0x7fc9640c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc9637fe700 1 -- 172.21.15.37:0/2258564294 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc964156bb0 msgr2=0x7fc9640c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc9637fe700 1 --2- 172.21.15.37:0/2258564294 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc964156bb0 0x7fc9640c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc9637fe700 1 -- 172.21.15.37:0/2258564294 >> v1:172.21.15.83:6789/0 conn(0x7fc9640aac00 legacy=0x7fc9640cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc9637fe700 1 -- 172.21.15.37:0/2258564294 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640cb840 con 0x7fc9640c9200 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc9637fe700 1 --2- 172.21.15.37:0/2258564294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9640c9200 0x7fc96415a870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc9580099b0 tx=0x7fc958009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a2de994cff5c5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc962ffd700 1 -- 172.21.15.37:0/2258564294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958009ea0 con 0x7fc9640c9200 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc962ffd700 1 -- 172.21.15.37:0/2258564294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95800b860 con 0x7fc9640c9200 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc962ffd700 1 -- 172.21.15.37:0/2258564294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800bc00 con 0x7fc9640c9200 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 -- 172.21.15.37:0/2258564294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9640c9200 msgr2=0x7fc96415a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 --2- 172.21.15.37:0/2258564294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9640c9200 0x7fc96415a870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc9580099b0 tx=0x7fc958009250 comp rx=0 tx=0).stop 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 -- 172.21.15.37:0/2258564294 shutdown_connections 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 --2- 172.21.15.37:0/2258564294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9640c9200 0x7fc96415a870 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 --2- 172.21.15.37:0/2258564294 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc964156bb0 0x7fc9640c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 -- 172.21.15.37:0/2258564294 >> 172.21.15.37:0/2258564294 conn(0x7fc9640870c0 msgr2=0x7fc964066f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 -- 172.21.15.37:0/2258564294 shutdown_connections 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.708+0000 7fc96a3e3700 1 -- 172.21.15.37:0/2258564294 wait complete. 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.712+0000 7fc96a3e3700 1 Processor -- start 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.712+0000 7fc96a3e3700 1 -- start start 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc96a3e3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9640aac00 0x7fc96415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc96a3e3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9640c9200 0x7fc9640ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc96a3e3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc964156bb0 0x7fc9640ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc96a3e3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc964167250 con 0x7fc964156bb0 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc96a3e3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9641537c0 con 0x7fc9640c9200 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc96a3e3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9641674d0 con 0x7fc9640aac00 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc963fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9640aac00 0x7fc96415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc968980700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc964156bb0 0x7fc9640ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc963fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9640aac00 0x7fc96415a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:49226/0 (socket says 172.21.15.37:49226) 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc963fff700 1 -- 172.21.15.37:0/1620081445 learned_addr learned my addr 172.21.15.37:0/1620081445 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc9637fe700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9640c9200 0x7fc9640ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc963fff700 1 -- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9640c9200 msgr2=0x7fc9640ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc963fff700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9640c9200 0x7fc9640ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc963fff700 1 -- 172.21.15.37:0/1620081445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc964156bb0 msgr2=0x7fc9640ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc963fff700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc964156bb0 0x7fc9640ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc963fff700 1 -- 172.21.15.37:0/1620081445 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580094f0 con 0x7fc9640aac00 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc963fff700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9640aac00 0x7fc96415a8a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc95400ea00 tx=0x7fc954009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc94bfff700 1 -- 172.21.15.37:0/1620081445 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95400c6a0 con 0x7fc9640aac00 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc94bfff700 1 -- 172.21.15.37:0/1620081445 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95400c800 con 0x7fc9640aac00 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc96a3e3700 1 -- 172.21.15.37:0/1620081445 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9640c6480 con 0x7fc9640aac00 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc94bfff700 1 -- 172.21.15.37:0/1620081445 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95400cb80 con 0x7fc9640aac00 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc96a3e3700 1 -- 172.21.15.37:0/1620081445 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9640c6a40 con 0x7fc9640aac00 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.716+0000 7fc96a3e3700 1 -- 172.21.15.37:0/1620081445 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc964070ee0 con 0x7fc9640aac00 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.720+0000 7fc94bfff700 1 -- 172.21.15.37:0/1620081445 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc954026480 con 0x7fc9640aac00 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.720+0000 7fc94bfff700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc9500605d0 0x7fc950062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.720+0000 7fc94bfff700 1 -- 172.21.15.37:0/1620081445 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc95407d470 con 0x7fc9640aac00 2023-10-06T04:40:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.720+0000 7fc9637fe700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc9500605d0 0x7fc950062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.720+0000 7fc9637fe700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc9500605d0 0x7fc950062a80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc9580099b0 tx=0x7fc958017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.728+0000 7fc94bfff700 1 -- 172.21.15.37:0/1620081445 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc95404d7a0 con 0x7fc9640aac00 2023-10-06T04:40:20.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.952+0000 7fc96a3e3700 1 -- 172.21.15.37:0/1620081445 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc9641557f0 con 0x7fc9640aac00 2023-10-06T04:40:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.960+0000 7fc94bfff700 1 -- 172.21.15.37:0/1620081445 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc954050dc0 con 0x7fc9640aac00 2023-10-06T04:40:20.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.964+0000 7fc96a3e3700 1 -- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc9500605d0 msgr2=0x7fc950062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.964+0000 7fc96a3e3700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc9500605d0 0x7fc950062a80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc9580099b0 tx=0x7fc958017000 comp rx=0 tx=0).stop 2023-10-06T04:40:20.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.964+0000 7fc96a3e3700 1 -- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9640aac00 msgr2=0x7fc96415a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.964+0000 7fc96a3e3700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9640aac00 0x7fc96415a8a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc95400ea00 tx=0x7fc954009120 comp rx=0 tx=0).stop 2023-10-06T04:40:20.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.964+0000 7fc96a3e3700 1 -- 172.21.15.37:0/1620081445 shutdown_connections 2023-10-06T04:40:20.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.964+0000 7fc96a3e3700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc9500605d0 0x7fc950062a80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.964+0000 7fc96a3e3700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9640c9200 0x7fc9640ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.964+0000 7fc96a3e3700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc964156bb0 0x7fc9640ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.964+0000 7fc96a3e3700 1 --2- 172.21.15.37:0/1620081445 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9640aac00 0x7fc96415a8a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.964+0000 7fc96a3e3700 1 -- 172.21.15.37:0/1620081445 >> 172.21.15.37:0/1620081445 conn(0x7fc9640870c0 msgr2=0x7fc96415b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:20.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.964+0000 7fc96a3e3700 1 -- 172.21.15.37:0/1620081445 shutdown_connections 2023-10-06T04:40:20.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:20.964+0000 7fc96a3e3700 1 -- 172.21.15.37:0/1620081445 wait complete. 2023-10-06T04:40:20.972 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-10-06T04:40:20.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:20.984 INFO:tasks.ceph.mds.b.smithi083.stderr:2023-10-06T04:40:20.981+0000 7f1a1fe09700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:40:21.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.080+0000 7fdeda86d700 1 Processor -- start 2023-10-06T04:40:21.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.080+0000 7fdeda86d700 1 -- start start 2023-10-06T04:40:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.080+0000 7fdeda86d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fded4156800 0x7fded40cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.080+0000 7fdeda86d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fded40c9680 0x7fded40cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.080+0000 7fdeda86d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded40c9aa0 con 0x7fded4156bd0 2023-10-06T04:40:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.080+0000 7fdeda86d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded415dac0 con 0x7fded4156800 2023-10-06T04:40:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.080+0000 7fdeda86d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded4159800 con 0x7fded40c9680 2023-10-06T04:40:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.080+0000 7fded3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fded4156800 0x7fded40cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.080+0000 7fded3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fded4156800 0x7fded40cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32800/0 (socket says 172.21.15.37:32800) 2023-10-06T04:40:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.080+0000 7fded3fff700 1 -- 172.21.15.37:0/3173320098 learned_addr learned my addr 172.21.15.37:0/3173320098 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.080+0000 7fded8e0a700 1 --2- 172.21.15.37:0/3173320098 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fded40c9680 0x7fded40cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.080+0000 7fded3fff700 1 -- 172.21.15.37:0/3173320098 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fded40c9680 msgr2=0x7fded40cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fded3fff700 1 --2- 172.21.15.37:0/3173320098 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fded40c9680 0x7fded40cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fded3fff700 1 -- 172.21.15.37:0/3173320098 >> v1:172.21.15.83:6789/0 conn(0x7fded4156bd0 legacy=0x7fded40c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fded3fff700 1 -- 172.21.15.37:0/3173320098 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4159ae0 con 0x7fded4156800 2023-10-06T04:40:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fded8e0a700 1 --2- 172.21.15.37:0/3173320098 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fded40c9680 0x7fded40cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:21.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fded3fff700 1 --2- 172.21.15.37:0/3173320098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fded4156800 0x7fded40cbb20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0099b0 tx=0x7fdecc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dddbc8459d0ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fded2ffd700 1 -- 172.21.15.37:0/3173320098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc00b860 con 0x7fded4156800 2023-10-06T04:40:21.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fded2ffd700 1 -- 172.21.15.37:0/3173320098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc00b9c0 con 0x7fded4156800 2023-10-06T04:40:21.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fded2ffd700 1 -- 172.21.15.37:0/3173320098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc00bd60 con 0x7fded4156800 2023-10-06T04:40:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fdeda86d700 1 -- 172.21.15.37:0/3173320098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fded4156800 msgr2=0x7fded40cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fdeda86d700 1 --2- 172.21.15.37:0/3173320098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fded4156800 0x7fded40cbb20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0099b0 tx=0x7fdecc009250 comp rx=0 tx=0).stop 2023-10-06T04:40:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fdeda86d700 1 -- 172.21.15.37:0/3173320098 shutdown_connections 2023-10-06T04:40:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fdeda86d700 1 --2- 172.21.15.37:0/3173320098 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fded40c9680 0x7fded40cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fdeda86d700 1 --2- 172.21.15.37:0/3173320098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fded4156800 0x7fded40cbb20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fdeda86d700 1 -- 172.21.15.37:0/3173320098 >> 172.21.15.37:0/3173320098 conn(0x7fded40667b0 msgr2=0x7fded4066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fdeda86d700 1 -- 172.21.15.37:0/3173320098 shutdown_connections 2023-10-06T04:40:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.084+0000 7fdeda86d700 1 -- 172.21.15.37:0/3173320098 wait complete. 2023-10-06T04:40:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fdeda86d700 1 Processor -- start 2023-10-06T04:40:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fdeda86d700 1 -- start start 2023-10-06T04:40:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fdeda86d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fded40c9680 0x7fded416a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fdeda86d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fded4156800 0x7fded4142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fdeda86d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fded4156bd0 0x7fded40c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fdeda86d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded40c7e40 con 0x7fded4156800 2023-10-06T04:40:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fdeda86d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded40c7b60 con 0x7fded40c9680 2023-10-06T04:40:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fdeda86d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded41695e0 con 0x7fded4156bd0 2023-10-06T04:40:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fded37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fded4156800 0x7fded4142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fded37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fded4156800 0x7fded4142260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32810/0 (socket says 172.21.15.37:32810) 2023-10-06T04:40:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fded37fe700 1 -- 172.21.15.37:0/1521066382 learned_addr learned my addr 172.21.15.37:0/1521066382 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fded8e0a700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fded4156bd0 0x7fded40c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.088+0000 7fded3fff700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fded40c9680 0x7fded416a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.092+0000 7fded37fe700 1 -- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fded4156bd0 msgr2=0x7fded40c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.092+0000 7fded37fe700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fded4156bd0 0x7fded40c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.092+0000 7fded37fe700 1 -- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fded40c9680 msgr2=0x7fded416a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.092+0000 7fded37fe700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fded40c9680 0x7fded416a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.092+0000 7fded37fe700 1 -- 172.21.15.37:0/1521066382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc0094f0 con 0x7fded4156800 2023-10-06T04:40:21.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.092+0000 7fded37fe700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fded4156800 0x7fded4142260 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdec400cb10 tx=0x7fdec40017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.092+0000 7fdecbfff700 1 -- 172.21.15.37:0/1521066382 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec400ce20 con 0x7fded4156800 2023-10-06T04:40:21.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.092+0000 7fdecbfff700 1 -- 172.21.15.37:0/1521066382 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec400a7e0 con 0x7fded4156800 2023-10-06T04:40:21.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.092+0000 7fdeda86d700 1 -- 172.21.15.37:0/1521066382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded41698c0 con 0x7fded4156800 2023-10-06T04:40:21.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.092+0000 7fdecbfff700 1 -- 172.21.15.37:0/1521066382 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec400aba0 con 0x7fded4156800 2023-10-06T04:40:21.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.092+0000 7fdeda86d700 1 -- 172.21.15.37:0/1521066382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded41427a0 con 0x7fded4156800 2023-10-06T04:40:21.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.092+0000 7fdeda86d700 1 -- 172.21.15.37:0/1521066382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded406e890 con 0x7fded4156800 2023-10-06T04:40:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.096+0000 7fdecbfff700 1 -- 172.21.15.37:0/1521066382 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdec4003030 con 0x7fded4156800 2023-10-06T04:40:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.096+0000 7fdecbfff700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdeb8060550 0x7fdeb8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.096+0000 7fdecbfff700 1 -- 172.21.15.37:0/1521066382 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdec407c950 con 0x7fded4156800 2023-10-06T04:40:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.096+0000 7fded3fff700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdeb8060550 0x7fdeb8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.096+0000 7fded3fff700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdeb8060550 0x7fdeb8062a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0099b0 tx=0x7fdecc017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.100+0000 7fdecbfff700 1 -- 172.21.15.37:0/1521066382 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fded406e890 con 0x7fded4156800 2023-10-06T04:40:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.296+0000 7fdeda86d700 1 -- 172.21.15.37:0/1521066382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fded40c9aa0 con 0x7fded4156800 2023-10-06T04:40:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.296+0000 7fdecbfff700 1 -- 172.21.15.37:0/1521066382 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fded40c9aa0 con 0x7fded4156800 2023-10-06T04:40:21.303 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:21.304 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/968432746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":968432746},{"type":"v1","addr":"172.21.15.37:6833","nonce":968432746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2573831912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2573831912},{"type":"v1","addr":"172.21.15.37:6835","nonce":2573831912}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3283827040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3283827040},{"type":"v1","addr":"172.21.15.83:6835","nonce":3283827040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:16.392787+0000","modified":"2023-10-06T04:40:19.047129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5161},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5161":{"gid":5161,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1183217493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1183217493},{"type":"v1","addr":"172.21.15.83:6837","nonce":1183217493}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.300+0000 7fdeda86d700 1 -- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdeb8060550 msgr2=0x7fdeb8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.300+0000 7fdeda86d700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdeb8060550 0x7fdeb8062a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0099b0 tx=0x7fdecc017000 comp rx=0 tx=0).stop 2023-10-06T04:40:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.300+0000 7fdeda86d700 1 -- 172.21.15.37:0/1521066382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fded4156800 msgr2=0x7fded4142260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.300+0000 7fdeda86d700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fded4156800 0x7fded4142260 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdec400cb10 tx=0x7fdec40017b0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.300+0000 7fdeda86d700 1 -- 172.21.15.37:0/1521066382 shutdown_connections 2023-10-06T04:40:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.300+0000 7fdeda86d700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fdeb8060550 0x7fdeb8062a00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.300+0000 7fdeda86d700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fded4156bd0 0x7fded40c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.300+0000 7fdeda86d700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fded4156800 0x7fded4142260 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.300+0000 7fdeda86d700 1 --2- 172.21.15.37:0/1521066382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fded40c9680 0x7fded416a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.300+0000 7fdeda86d700 1 -- 172.21.15.37:0/1521066382 >> 172.21.15.37:0/1521066382 conn(0x7fded40667b0 msgr2=0x7fded41514f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.300+0000 7fdeda86d700 1 -- 172.21.15.37:0/1521066382 shutdown_connections 2023-10-06T04:40:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.300+0000 7fdeda86d700 1 -- 172.21.15.37:0/1521066382 wait complete. 2023-10-06T04:40:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 15 2023-10-06T04:40:21.727 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:40:16.392787+0000', 'modified': '2023-10-06T04:40:19.047129+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5161}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5161': {'gid': 5161, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6837/1183217493', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6836', 'nonce': 1183217493}, {'type': 'v1', 'addr': '172.21.15.83:6837', 'nonce': 1183217493}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:40:21.727 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:40:21.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T04:40:21.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.844+0000 7f17088b0700 1 Processor -- start 2023-10-06T04:40:21.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.844+0000 7f17088b0700 1 -- start start 2023-10-06T04:40:21.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.844+0000 7f17088b0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f17040667b0 0x7f17040b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.844+0000 7f17088b0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17040b1860 0x7f17040ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.844+0000 7f17088b0700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17040acd30 con 0x7f170415c240 2023-10-06T04:40:21.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.844+0000 7f17088b0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17040b1ce0 con 0x7f17040b1860 2023-10-06T04:40:21.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.844+0000 7f17088b0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17040ac120 con 0x7f17040667b0 2023-10-06T04:40:21.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f1703fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17040b1860 0x7f17040ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f17037fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f170415c240 0x7f17040ab940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40818/0 (socket says 172.21.15.37:40818) 2023-10-06T04:40:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f17037fe700 1 -- 172.21.15.37:0/2196249499 learned_addr learned my addr 172.21.15.37:0/2196249499 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f16faffd700 1 --2- 172.21.15.37:0/2196249499 >> v2:172.21.15.83:3300/0 conn(0x7f17040667b0 0x7f17040b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f1703fff700 1 -- 172.21.15.37:0/2196249499 >> v2:172.21.15.83:3300/0 conn(0x7f17040667b0 msgr2=0x7f17040b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f1703fff700 1 --2- 172.21.15.37:0/2196249499 >> v2:172.21.15.83:3300/0 conn(0x7f17040667b0 0x7f17040b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f1703fff700 1 -- 172.21.15.37:0/2196249499 >> v1:172.21.15.37:6789/0 conn(0x7f170415c240 legacy=0x7f17040ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f1702ffd700 1 -- 172.21.15.37:0/2196249499 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004857095 0 0) 0x7f17040acd30 con 0x7f170415c240 2023-10-06T04:40:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f1703fff700 1 -- 172.21.15.37:0/2196249499 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17040ac400 con 0x7f17040b1860 2023-10-06T04:40:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f1703fff700 1 --2- 172.21.15.37:0/2196249499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17040b1860 0x7f17040ad1c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f170406cf20 tx=0x7f16fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cfd0ebd9fd9fe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f1702ffd700 1 -- 172.21.15.37:0/2196249499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc00e070 con 0x7f17040b1860 2023-10-06T04:40:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f1702ffd700 1 -- 172.21.15.37:0/2196249499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc00bb60 con 0x7f17040b1860 2023-10-06T04:40:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f1702ffd700 1 -- 172.21.15.37:0/2196249499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc012430 con 0x7f17040b1860 2023-10-06T04:40:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f17088b0700 1 -- 172.21.15.37:0/2196249499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17040b1860 msgr2=0x7f17040ad1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f17088b0700 1 --2- 172.21.15.37:0/2196249499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17040b1860 0x7f17040ad1c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f170406cf20 tx=0x7f16fc009780 comp rx=0 tx=0).stop 2023-10-06T04:40:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f17088b0700 1 -- 172.21.15.37:0/2196249499 shutdown_connections 2023-10-06T04:40:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f17088b0700 1 --2- 172.21.15.37:0/2196249499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17040b1860 0x7f17040ad1c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f17088b0700 1 --2- 172.21.15.37:0/2196249499 >> v2:172.21.15.83:3300/0 conn(0x7f17040667b0 0x7f17040b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f17088b0700 1 -- 172.21.15.37:0/2196249499 >> 172.21.15.37:0/2196249499 conn(0x7f17040ccb50 msgr2=0x7f170406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f17088b0700 1 -- 172.21.15.37:0/2196249499 shutdown_connections 2023-10-06T04:40:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.848+0000 7f17088b0700 1 -- 172.21.15.37:0/2196249499 wait complete. 2023-10-06T04:40:21.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f17088b0700 1 Processor -- start 2023-10-06T04:40:21.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f17088b0700 1 -- start start 2023-10-06T04:40:21.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f17088b0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17040667b0 0x7f1704169400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f17088b0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17040b1860 0x7f1704154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f17088b0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170415c240 0x7f1704099270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f17088b0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1704097fc0 con 0x7f17040b1860 2023-10-06T04:40:21.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f17088b0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1704098de0 con 0x7f170415c240 2023-10-06T04:40:21.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f17088b0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1704169940 con 0x7f17040667b0 2023-10-06T04:40:21.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f16faffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17040b1860 0x7f1704154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f16faffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17040b1860 0x7f1704154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32840/0 (socket says 172.21.15.37:32840) 2023-10-06T04:40:21.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f16faffd700 1 -- 172.21.15.37:0/2245751086 learned_addr learned my addr 172.21.15.37:0/2245751086 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:21.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f1703fff700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170415c240 0x7f1704099270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f17037fe700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17040667b0 0x7f1704169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f16faffd700 1 -- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17040667b0 msgr2=0x7f1704169400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f16faffd700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17040667b0 0x7f1704169400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f16faffd700 1 -- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170415c240 msgr2=0x7f1704099270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f16faffd700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170415c240 0x7f1704099270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.852+0000 7f16faffd700 1 -- 172.21.15.37:0/2245751086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc009a20 con 0x7f17040b1860 2023-10-06T04:40:21.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.856+0000 7f16faffd700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17040b1860 0x7f1704154a70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00ecb0 tx=0x7f16ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.856+0000 7f16fbfff700 1 -- 172.21.15.37:0/2245751086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00c850 con 0x7f17040b1860 2023-10-06T04:40:21.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.856+0000 7f16fbfff700 1 -- 172.21.15.37:0/2245751086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec00c9b0 con 0x7f17040b1860 2023-10-06T04:40:21.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.856+0000 7f16fbfff700 1 -- 172.21.15.37:0/2245751086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00cd50 con 0x7f17040b1860 2023-10-06T04:40:21.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.856+0000 7f17088b0700 1 -- 172.21.15.37:0/2245751086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1704154fb0 con 0x7f17040b1860 2023-10-06T04:40:21.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.856+0000 7f17088b0700 1 -- 172.21.15.37:0/2245751086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17040984b0 con 0x7f17040b1860 2023-10-06T04:40:21.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f16fbfff700 1 -- 172.21.15.37:0/2245751086 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f16ec013680 con 0x7f17040b1860 2023-10-06T04:40:21.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f16fbfff700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f16e4060580 0x7f16e4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f16fbfff700 1 -- 172.21.15.37:0/2245751086 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f16ec07cc20 con 0x7f17040b1860 2023-10-06T04:40:21.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f17037fe700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f16e4060580 0x7f16e4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f17037fe700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f16e4060580 0x7f16e4062a30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16f4007160 tx=0x7f16f4007f50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f170bdbb740 1 Processor -- start 2023-10-06T04:40:21.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f170bdbb740 1 -- start start 2023-10-06T04:40:21.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f170bdbb740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2bae0 0xea8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f170bdbb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2b710 0xea8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f170bdbb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xea90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f170bdbb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0xdd6f30 con 0xc2b710 2023-10-06T04:40:21.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f170bdbb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0xdd2ed0 con 0xc76790 2023-10-06T04:40:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f170bdbb740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0xd990b0 con 0xc2bae0 2023-10-06T04:40:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f16faffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2b710 0xea8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f17037fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2bae0 0xea8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f16faffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2b710 0xea8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32842/0 (socket says 172.21.15.37:32842) 2023-10-06T04:40:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.860+0000 7f16faffd700 1 -- 172.21.15.37:0/3419170840 learned_addr learned my addr 172.21.15.37:0/3419170840 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f1703fff700 1 --2- 172.21.15.37:0/3419170840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xea90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f17037fe700 1 -- 172.21.15.37:0/3419170840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 msgr2=0xea90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f17037fe700 1 --2- 172.21.15.37:0/3419170840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xea90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f17037fe700 1 -- 172.21.15.37:0/3419170840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2b710 msgr2=0xea8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f17037fe700 1 --2- 172.21.15.37:0/3419170840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2b710 0xea8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f17037fe700 1 -- 172.21.15.37:0/3419170840 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc779e0 con 0xc2bae0 2023-10-06T04:40:21.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f17037fe700 1 --2- 172.21.15.37:0/3419170840 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2bae0 0xea8630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16f4006a40 tx=0x7f16f4014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69535ade19999274 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f16f8ff9700 1 -- 172.21.15.37:0/3419170840 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f40063c0 con 0xc2bae0 2023-10-06T04:40:21.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f16f8ff9700 1 -- 172.21.15.37:0/3419170840 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f4006520 con 0xc2bae0 2023-10-06T04:40:21.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f16f8ff9700 1 -- 172.21.15.37:0/3419170840 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4001360 con 0xc2bae0 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f170bdbb740 1 -- 172.21.15.37:0/3419170840 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2bae0 msgr2=0xea8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3419170840 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2bae0 0xea8630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16f4006a40 tx=0x7f16f4014000 comp rx=0 tx=0).stop 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f170bdbb740 1 -- 172.21.15.37:0/3419170840 shutdown_connections 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3419170840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xea90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3419170840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2b710 0xea8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3419170840 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2bae0 0xea8630 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f170bdbb740 1 -- 172.21.15.37:0/3419170840 >> 172.21.15.37:0/3419170840 conn(0xc2beb0 msgr2=0xe65060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f170bdbb740 1 -- 172.21.15.37:0/3419170840 shutdown_connections 2023-10-06T04:40:21.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f170bdbb740 1 -- 172.21.15.37:0/3419170840 wait complete. 2023-10-06T04:40:21.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f170bdbb740 1 -- start start 2023-10-06T04:40:21.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.864+0000 7f170bdbb740 1 Processor -- start 2023-10-06T04:40:21.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f170bdbb740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2b710 0xeacc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f170bdbb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 0xead180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f170bdbb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xe62c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f170bdbb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0xd98d50 con 0xc2bae0 2023-10-06T04:40:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f170bdbb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0xd71970 con 0xc76790 2023-10-06T04:40:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f170bdbb740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0xd84550 con 0xc2b710 2023-10-06T04:40:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f170bdbb740 10 client.0 _ll_register_callbacks cb 0xd75b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:40:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16faffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 0xead180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f17037fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2b710 0xeacc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16faffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 0xead180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32846/0 (socket says 172.21.15.37:32846) 2023-10-06T04:40:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16faffd700 1 -- 172.21.15.37:0/3298485734 learned_addr learned my addr 172.21.15.37:0/3298485734 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f1703fff700 1 --2- 172.21.15.37:0/3298485734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xe62c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16faffd700 1 -- 172.21.15.37:0/3298485734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2b710 msgr2=0xeacc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16faffd700 1 --2- 172.21.15.37:0/3298485734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2b710 0xeacc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16faffd700 1 -- 172.21.15.37:0/3298485734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 msgr2=0xe62c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16faffd700 1 --2- 172.21.15.37:0/3298485734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xe62c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16faffd700 1 -- 172.21.15.37:0/3298485734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f4005a00 con 0xc2bae0 2023-10-06T04:40:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16faffd700 1 --2- 172.21.15.37:0/3298485734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 0xead180 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f16ec07aea0 tx=0x7f16ec015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16fa19c01f790ab8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:40:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16e1ffb700 1 -- 172.21.15.37:0/3298485734 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec053f20 con 0xc2bae0 2023-10-06T04:40:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16e1ffb700 1 -- 172.21.15.37:0/3298485734 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f16ec057c10 con 0xc2bae0 2023-10-06T04:40:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f170bdbb740 1 -- 172.21.15.37:0/3298485734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd71cc0 con 0xc2bae0 2023-10-06T04:40:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16e1ffb700 1 -- 172.21.15.37:0/3298485734 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16ec050120 con 0xc2bae0 2023-10-06T04:40:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f170bdbb740 10 client.5313 fetch_fsmap learned FSMap version 15 2023-10-06T04:40:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f170bdbb740 1 -- 172.21.15.37:0/3298485734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0xda1370 con 0xc2bae0 2023-10-06T04:40:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16e1ffb700 1 -- 172.21.15.37:0/3298485734 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd71cc0 con 0xc2bae0 2023-10-06T04:40:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.868+0000 7f16e1ffb700 1 -- 172.21.15.37:0/3298485734 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f16ec057780 con 0xc2bae0 2023-10-06T04:40:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 10 client.5313 fetch_fsmap finished waiting for FSMap version 15 2023-10-06T04:40:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 10 client.5313 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T04:40:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 20 client.5313 populate_metadata read hostname 'smithi037' 2023-10-06T04:40:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3298485734 >> [v2:172.21.15.83:6836/1183217493,v1:172.21.15.83:6837/1183217493] conn(0xe642c0 0xeb7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 4 client.5313 mds_command: new command op to 5161 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:40:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 -- 172.21.15.37:0/3298485734 --> [v2:172.21.15.83:6836/1183217493,v1:172.21.15.83:6837/1183217493] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd753e0 con 0xe642c0 2023-10-06T04:40:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f17037fe700 1 --2- 172.21.15.37:0/3298485734 >> [v2:172.21.15.83:6836/1183217493,v1:172.21.15.83:6837/1183217493] conn(0xe642c0 0xeb7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f17037fe700 1 --2- 172.21.15.37:0/3298485734 >> [v2:172.21.15.83:6836/1183217493,v1:172.21.15.83:6837/1183217493] conn(0xe642c0 0xeb7de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ad50c31a6d42e2a server_cookie=b42e659d536bbe0a in_seq=0 out_seq=0 2023-10-06T04:40:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f16e1ffb700 10 client.5313 ms_handle_connect on v2:172.21.15.83:6836/1183217493 2023-10-06T04:40:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f16e1ffb700 1 -- 172.21.15.37:0/3298485734 <== mds.0 v2:172.21.15.83:6836/1183217493 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0xd753e0 con 0xe642c0 2023-10-06T04:40:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f16e1ffb700 10 client.5313 handle_command_reply: tid=0 2023-10-06T04:40:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 client.5313 shutdown 2023-10-06T04:40:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 -- 172.21.15.37:0/3298485734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 msgr2=0xead180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3298485734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 0xead180 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f16ec07aea0 tx=0x7f16ec015040 comp rx=0 tx=0).stop 2023-10-06T04:40:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 -- 172.21.15.37:0/3298485734 shutdown_connections 2023-10-06T04:40:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3298485734 >> [v2:172.21.15.83:6836/1183217493,v1:172.21.15.83:6837/1183217493] conn(0xe642c0 0xeb7de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3298485734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xe62c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f16e1ffb700 0 client.5313 ms_handle_reset on v2:172.21.15.83:6836/1183217493 2023-10-06T04:40:21.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3298485734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 0xead180 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3298485734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2b710 0xeacc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 -- 172.21.15.37:0/3298485734 >> 172.21.15.37:0/3298485734 conn(0xc2beb0 msgr2=0xe8c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 -- 172.21.15.37:0/3298485734 shutdown_connections 2023-10-06T04:40:21.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 1 -- 172.21.15.37:0/3298485734 wait complete. 2023-10-06T04:40:21.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.872+0000 7f170bdbb740 20 client.5313 trim_cache size 0 max 16384 2023-10-06T04:40:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.892+0000 7f170bdbb740 1 Processor -- start 2023-10-06T04:40:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 -- start start 2023-10-06T04:40:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc2b710 0xeab650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2bae0 0xeabb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc76790 0xe64690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0xdaa550 con 0xc76790 2023-10-06T04:40:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0xda8550 con 0xc2b710 2023-10-06T04:40:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0xdfa110 con 0xc2bae0 2023-10-06T04:40:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f1703fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc76790 0xe64690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f1703fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc76790 0xe64690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32850/0 (socket says 172.21.15.37:32850) 2023-10-06T04:40:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f1703fff700 1 -- 172.21.15.37:0/116962169 learned_addr learned my addr 172.21.15.37:0/116962169 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f17037fe700 1 --2- 172.21.15.37:0/116962169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc2b710 0xeab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f16faffd700 1 --2- 172.21.15.37:0/116962169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2bae0 0xeabb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f1703fff700 1 -- 172.21.15.37:0/116962169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2bae0 msgr2=0xeabb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f1703fff700 1 --2- 172.21.15.37:0/116962169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2bae0 0xeabb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f1703fff700 1 -- 172.21.15.37:0/116962169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc2b710 msgr2=0xeab650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f1703fff700 1 --2- 172.21.15.37:0/116962169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc2b710 0xeab650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f1703fff700 1 -- 172.21.15.37:0/116962169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd87d80 con 0xc76790 2023-10-06T04:40:21.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f1703fff700 1 --2- 172.21.15.37:0/116962169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc76790 0xe64690 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f170406cd10 tx=0x7f16fc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492873f4d908f3d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f16f97fa700 1 -- 172.21.15.37:0/116962169 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc022040 con 0xc76790 2023-10-06T04:40:21.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f16f97fa700 1 -- 172.21.15.37:0/116962169 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc023040 con 0xc76790 2023-10-06T04:40:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f16f97fa700 1 -- 172.21.15.37:0/116962169 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc00bee0 con 0xc76790 2023-10-06T04:40:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 -- 172.21.15.37:0/116962169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc76790 msgr2=0xe64690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 --2- 172.21.15.37:0/116962169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc76790 0xe64690 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f170406cd10 tx=0x7f16fc019000 comp rx=0 tx=0).stop 2023-10-06T04:40:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 -- 172.21.15.37:0/116962169 shutdown_connections 2023-10-06T04:40:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 --2- 172.21.15.37:0/116962169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc76790 0xe64690 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 --2- 172.21.15.37:0/116962169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2bae0 0xeabb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 --2- 172.21.15.37:0/116962169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc2b710 0xeab650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 -- 172.21.15.37:0/116962169 >> 172.21.15.37:0/116962169 conn(0xc2beb0 msgr2=0xe5e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 -- 172.21.15.37:0/116962169 shutdown_connections 2023-10-06T04:40:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.896+0000 7f170bdbb740 1 -- 172.21.15.37:0/116962169 wait complete. 2023-10-06T04:40:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 1 -- start start 2023-10-06T04:40:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 1 Processor -- start 2023-10-06T04:40:21.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2b710 0xee19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 0xee1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xeb6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0xdd1d60 con 0xc2bae0 2023-10-06T04:40:21.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0xdd5590 con 0xc76790 2023-10-06T04:40:21.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0xda8010 con 0xc2b710 2023-10-06T04:40:21.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 10 client.0 _ll_register_callbacks cb 0xd9e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:40:21.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16faffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 0xee1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16faffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 0xee1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32864/0 (socket says 172.21.15.37:32864) 2023-10-06T04:40:21.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16faffd700 1 -- 172.21.15.37:0/3513862226 learned_addr learned my addr 172.21.15.37:0/3513862226 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:21.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f17037fe700 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2b710 0xee19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f1703fff700 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xeb6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16faffd700 1 -- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2b710 msgr2=0xee19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16faffd700 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2b710 0xee19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16faffd700 1 -- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 msgr2=0xeb6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16faffd700 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xeb6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16faffd700 1 -- 172.21.15.37:0/3513862226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17040ac400 con 0xc2bae0 2023-10-06T04:40:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f1703fff700 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xeb6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:40:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16faffd700 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 0xee1f30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00ec80 tx=0x7f16ec066000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a844572d9c85648 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16e1ffb700 1 -- 172.21.15.37:0/3513862226 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec053f20 con 0xc2bae0 2023-10-06T04:40:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 1 -- 172.21.15.37:0/3513862226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16f4006520 con 0xc2bae0 2023-10-06T04:40:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16e1ffb700 1 -- 172.21.15.37:0/3513862226 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f16ec057c10 con 0xc2bae0 2023-10-06T04:40:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16e1ffb700 1 -- 172.21.15.37:0/3513862226 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16ec00e020 con 0xc2bae0 2023-10-06T04:40:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 10 client.5319 fetch_fsmap learned FSMap version 15 2023-10-06T04:40:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 1 -- 172.21.15.37:0/3513862226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0xd7c130 con 0xc2bae0 2023-10-06T04:40:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16e1ffb700 1 -- 172.21.15.37:0/3513862226 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f4006520 con 0xc2bae0 2023-10-06T04:40:21.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f16e1ffb700 1 -- 172.21.15.37:0/3513862226 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f16ec072070 con 0xc2bae0 2023-10-06T04:40:21.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 10 client.5319 fetch_fsmap finished waiting for FSMap version 15 2023-10-06T04:40:21.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 10 client.5319 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T04:40:21.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 20 client.5319 populate_metadata read hostname 'smithi037' 2023-10-06T04:40:21.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:6836/1183217493,v1:172.21.15.83:6837/1183217493] conn(0xeb72e0 0xeb76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 4 client.5319 mds_command: new command op to 5161 tid=0[{"prefix": "status"}] 2023-10-06T04:40:21.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.900+0000 7f170bdbb740 1 -- 172.21.15.37:0/3513862226 --> [v2:172.21.15.83:6836/1183217493,v1:172.21.15.83:6837/1183217493] -- command(tid 0: {"prefix": "status"}) v1 -- 0xda7410 con 0xeb72e0 2023-10-06T04:40:21.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17037fe700 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:6836/1183217493,v1:172.21.15.83:6837/1183217493] conn(0xeb72e0 0xeb76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f16e1ffb700 10 client.5319 ms_handle_connect on v2:172.21.15.83:6836/1183217493 2023-10-06T04:40:21.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17037fe700 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:6836/1183217493,v1:172.21.15.83:6837/1183217493] conn(0xeb72e0 0xeb76b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26ae75c9f4b5155e server_cookie=263481c369953780 in_seq=0 out_seq=0 2023-10-06T04:40:21.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f16e1ffb700 1 -- 172.21.15.37:0/3513862226 <== mds.0 v2:172.21.15.83:6836/1183217493 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0xda7410 con 0xeb72e0 2023-10-06T04:40:21.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f16e1ffb700 10 client.5319 handle_command_reply: tid=0 2023-10-06T04:40:21.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f170bdbb740 1 client.5319 shutdown 2023-10-06T04:40:21.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f170bdbb740 1 -- 172.21.15.37:0/3513862226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 msgr2=0xee1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 0xee1f30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00ec80 tx=0x7f16ec066000 comp rx=0 tx=0).stop 2023-10-06T04:40:21.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f170bdbb740 1 -- 172.21.15.37:0/3513862226 shutdown_connections 2023-10-06T04:40:21.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:6836/1183217493,v1:172.21.15.83:6837/1183217493] conn(0xeb72e0 0xeb76b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xc76790 0xeb6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f16e1ffb700 0 client.5319 ms_handle_reset on v2:172.21.15.83:6836/1183217493 2023-10-06T04:40:21.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xc2bae0 0xee1f30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f170bdbb740 1 --2- 172.21.15.37:0/3513862226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xc2b710 0xee19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f170bdbb740 1 -- 172.21.15.37:0/3513862226 >> 172.21.15.37:0/3513862226 conn(0xc2beb0 msgr2=0xe64690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f170bdbb740 1 -- 172.21.15.37:0/3513862226 shutdown_connections 2023-10-06T04:40:21.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f170bdbb740 1 -- 172.21.15.37:0/3513862226 wait complete. 2023-10-06T04:40:21.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f170bdbb740 20 client.5319 trim_cache size 0 max 16384 2023-10-06T04:40:21.915 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:40:21.915 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "77bb67cc-15eb-432c-9ac1-b724f40102d2", 2023-10-06T04:40:21.915 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T04:40:21.915 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5161, 2023-10-06T04:40:21.915 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T04:40:21.916 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T04:40:21.916 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T04:40:21.916 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 4.8793768770000003, 2023-10-06T04:40:21.916 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 15, 2023-10-06T04:40:21.916 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 42, 2023-10-06T04:40:21.916 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 42, 2023-10-06T04:40:21.916 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 12.791183317 2023-10-06T04:40:21.916 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:40:21.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17088b0700 1 -- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f16e4060580 msgr2=0x7f16e4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17088b0700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f16e4060580 0x7f16e4062a30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16f4007160 tx=0x7f16f4007f50 comp rx=0 tx=0).stop 2023-10-06T04:40:21.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17088b0700 1 -- 172.21.15.37:0/2245751086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17040b1860 msgr2=0x7f1704154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17088b0700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17040b1860 0x7f1704154a70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00ecb0 tx=0x7f16ec0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17088b0700 1 -- 172.21.15.37:0/2245751086 shutdown_connections 2023-10-06T04:40:21.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17088b0700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f16e4060580 0x7f16e4062a30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17088b0700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170415c240 0x7f1704099270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17088b0700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17040b1860 0x7f1704154a70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17088b0700 1 --2- 172.21.15.37:0/2245751086 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17040667b0 0x7f1704169400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17088b0700 1 -- 172.21.15.37:0/2245751086 >> 172.21.15.37:0/2245751086 conn(0x7f17040ccb50 msgr2=0x7f17040ae3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17088b0700 1 -- 172.21.15.37:0/2245751086 shutdown_connections 2023-10-06T04:40:21.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:21.904+0000 7f17088b0700 1 -- 172.21.15.37:0/2245751086 wait complete. 2023-10-06T04:40:21.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:40:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.032+0000 7f3f5af6d700 1 Processor -- start 2023-10-06T04:40:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.032+0000 7f3f5af6d700 1 -- start start 2023-10-06T04:40:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.032+0000 7f3f5af6d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3f54156800 0x7f3f540cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.032+0000 7f3f5af6d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540c9a80 con 0x7f3f540c9680 2023-10-06T04:40:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.032+0000 7f3f5af6d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f54159800 con 0x7f3f54156bd0 2023-10-06T04:40:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.032+0000 7f3f5af6d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f54159ae0 con 0x7f3f54156800 2023-10-06T04:40:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.032+0000 7f3f5950a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3f540c9680 0x7f3f5415cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40828/0 (socket says 172.21.15.37:40828) 2023-10-06T04:40:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.032+0000 7f3f5950a700 1 -- 172.21.15.37:0/449717776 learned_addr learned my addr 172.21.15.37:0/449717776 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.032+0000 7f3f58d09700 1 --2- 172.21.15.37:0/449717776 >> v2:172.21.15.83:3300/0 conn(0x7f3f54156800 0x7f3f540cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112606276 0 0) 0x7f3f540c9a80 con 0x7f3f540c9680 2023-10-06T04:40:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f44003570 con 0x7f3f540c9680 2023-10-06T04:40:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187209952 0 0) 0x7f3f54159800 con 0x7f3f54156bd0 2023-10-06T04:40:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f540c9a80 con 0x7f3f54156bd0 2023-10-06T04:40:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1362609169 0 0) 0x7f3f44003570 con 0x7f3f540c9680 2023-10-06T04:40:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 >> v2:172.21.15.83:3300/0 conn(0x7f3f54156800 msgr2=0x7f3f540cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 --2- 172.21.15.37:0/449717776 >> v2:172.21.15.83:3300/0 conn(0x7f3f54156800 0x7f3f540cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 >> v1:172.21.15.83:6789/0 conn(0x7f3f54156bd0 legacy=0x7f3f540c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f54159dc0 con 0x7f3f540c9680 2023-10-06T04:40:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f3f4c001810 con 0x7f3f540c9680 2023-10-06T04:40:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f58d09700 1 --2- 172.21.15.37:0/449717776 >> v2:172.21.15.83:3300/0 conn(0x7f3f54156800 0x7f3f540cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 >> v1:172.21.15.37:6789/0 conn(0x7f3f540c9680 legacy=0x7f3f5415cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 --2- 172.21.15.37:0/449717776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f44003bf0 0x7f3f44003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 --2- 172.21.15.37:0/449717776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f44004810 0x7f3f44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 --2- 172.21.15.37:0/449717776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f440051c0 0x7f3f4400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54159ae0 con 0x7f3f44003bf0 2023-10-06T04:40:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4400c0b0 con 0x7f3f440051c0 2023-10-06T04:40:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4400c270 con 0x7f3f44004810 2023-10-06T04:40:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f58d09700 1 --2- 172.21.15.37:0/449717776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f44003bf0 0x7f3f44003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f5950a700 1 --2- 172.21.15.37:0/449717776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f440051c0 0x7f3f4400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f53fff700 1 --2- 172.21.15.37:0/449717776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f44004810 0x7f3f44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f58d09700 1 -- 172.21.15.37:0/449717776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f44004810 msgr2=0x7f3f44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f58d09700 1 --2- 172.21.15.37:0/449717776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f44004810 0x7f3f44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f58d09700 1 -- 172.21.15.37:0/449717776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f440051c0 msgr2=0x7f3f4400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:22.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f58d09700 1 --2- 172.21.15.37:0/449717776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f440051c0 0x7f3f4400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f5950a700 1 -- 172.21.15.37:0/449717776 reap_dead start 2023-10-06T04:40:22.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f58d09700 1 -- 172.21.15.37:0/449717776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f44003570 con 0x7f3f44003bf0 2023-10-06T04:40:22.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f58d09700 1 --2- 172.21.15.37:0/449717776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f44003bf0 0x7f3f44003fe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009df0 tx=0x7f3f480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c074105f85f0f001 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:22.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48009740 con 0x7f3f44003bf0 2023-10-06T04:40:22.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4800e920 con 0x7f3f44003bf0 2023-10-06T04:40:22.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f537fe700 1 -- 172.21.15.37:0/449717776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800ece0 con 0x7f3f44003bf0 2023-10-06T04:40:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f5af6d700 1 -- 172.21.15.37:0/449717776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f44003bf0 msgr2=0x7f3f44003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.036+0000 7f3f5af6d700 1 --2- 172.21.15.37:0/449717776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f44003bf0 0x7f3f44003fe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009df0 tx=0x7f3f480091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.040+0000 7f3f5af6d700 1 -- 172.21.15.37:0/449717776 shutdown_connections 2023-10-06T04:40:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.040+0000 7f3f5af6d700 1 --2- 172.21.15.37:0/449717776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f44003bf0 0x7f3f44003fe0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.040+0000 7f3f5af6d700 1 -- 172.21.15.37:0/449717776 >> 172.21.15.37:0/449717776 conn(0x7f3f540667b0 msgr2=0x7f3f54066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.040+0000 7f3f5af6d700 1 -- 172.21.15.37:0/449717776 shutdown_connections 2023-10-06T04:40:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.040+0000 7f3f5af6d700 1 -- 172.21.15.37:0/449717776 wait complete. 2023-10-06T04:40:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.040+0000 7f3f5af6d700 1 Processor -- start 2023-10-06T04:40:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.040+0000 7f3f5af6d700 1 -- start start 2023-10-06T04:40:22.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f5af6d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f44003bf0 0x7f3f5416aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f5af6d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540b0c40 0x7f3f5414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f5af6d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5414ad10 0x7f3f54169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f5af6d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5414b1b0 con 0x7f3f540b0c40 2023-10-06T04:40:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f5af6d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5414a370 con 0x7f3f44003bf0 2023-10-06T04:40:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f5af6d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540b10d0 con 0x7f3f5414ad10 2023-10-06T04:40:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f53fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540b0c40 0x7f3f5414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f53fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540b0c40 0x7f3f5414a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32890/0 (socket says 172.21.15.37:32890) 2023-10-06T04:40:22.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f53fff700 1 -- 172.21.15.37:0/3264396638 learned_addr learned my addr 172.21.15.37:0/3264396638 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:22.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f58d09700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f44003bf0 0x7f3f5416aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f5950a700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5414ad10 0x7f3f54169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f53fff700 1 -- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5414ad10 msgr2=0x7f3f54169de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f53fff700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5414ad10 0x7f3f54169de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f53fff700 1 -- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f44003bf0 msgr2=0x7f3f5416aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f53fff700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f44003bf0 0x7f3f5416aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f53fff700 1 -- 172.21.15.37:0/3264396638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f540ae9e0 con 0x7f3f540b0c40 2023-10-06T04:40:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f58d09700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f44003bf0 0x7f3f5416aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f53fff700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540b0c40 0x7f3f5414a7d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000e5e0 tx=0x7f3f40009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f50ff9700 1 -- 172.21.15.37:0/3264396638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40012590 con 0x7f3f540b0c40 2023-10-06T04:40:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f50ff9700 1 -- 172.21.15.37:0/3264396638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f40012710 con 0x7f3f540b0c40 2023-10-06T04:40:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f5af6d700 1 -- 172.21.15.37:0/3264396638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f540aecc0 con 0x7f3f540b0c40 2023-10-06T04:40:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f5af6d700 1 -- 172.21.15.37:0/3264396638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5416a320 con 0x7f3f540b0c40 2023-10-06T04:40:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.044+0000 7f3f50ff9700 1 -- 172.21.15.37:0/3264396638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40012ad0 con 0x7f3f540b0c40 2023-10-06T04:40:22.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.048+0000 7f3f5af6d700 1 -- 172.21.15.37:0/3264396638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f540ae840 con 0x7f3f540b0c40 2023-10-06T04:40:22.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.048+0000 7f3f50ff9700 1 -- 172.21.15.37:0/3264396638 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3f4001d460 con 0x7f3f540b0c40 2023-10-06T04:40:22.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.048+0000 7f3f50ff9700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3f38060550 0x7f3f38062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.048+0000 7f3f50ff9700 1 -- 172.21.15.37:0/3264396638 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3f4007cd60 con 0x7f3f540b0c40 2023-10-06T04:40:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.048+0000 7f3f58d09700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3f38060550 0x7f3f38062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.048+0000 7f3f58d09700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3f38060550 0x7f3f38062a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3f54158020 tx=0x7f3f4801a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.052+0000 7f3f50ff9700 1 -- 172.21.15.37:0/3264396638 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3f540ae840 con 0x7f3f540b0c40 2023-10-06T04:40:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 -- 172.21.15.37:0/3264396638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3f540ae840 con 0x7f3f540b0c40 2023-10-06T04:40:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f50ff9700 1 -- 172.21.15.37:0/3264396638 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3f540ae840 con 0x7f3f540b0c40 2023-10-06T04:40:22.257 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:40:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 -- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3f38060550 msgr2=0x7f3f38062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3f38060550 0x7f3f38062a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3f54158020 tx=0x7f3f4801a000 comp rx=0 tx=0).stop 2023-10-06T04:40:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 -- 172.21.15.37:0/3264396638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540b0c40 msgr2=0x7f3f5414a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540b0c40 0x7f3f5414a7d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000e5e0 tx=0x7f3f40009040 comp rx=0 tx=0).stop 2023-10-06T04:40:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 -- 172.21.15.37:0/3264396638 shutdown_connections 2023-10-06T04:40:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3f38060550 0x7f3f38062a00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f5414ad10 0x7f3f54169de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540b0c40 0x7f3f5414a7d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 --2- 172.21.15.37:0/3264396638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f44003bf0 0x7f3f5416aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 -- 172.21.15.37:0/3264396638 >> 172.21.15.37:0/3264396638 conn(0x7f3f540667b0 msgr2=0x7f3f54152250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 -- 172.21.15.37:0/3264396638 shutdown_connections 2023-10-06T04:40:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:22.252+0000 7f3f5af6d700 1 -- 172.21.15.37:0/3264396638 wait complete. 2023-10-06T04:40:22.272 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:40:22.272 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:40:22.272 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T04:40:22.272 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:40:22.272 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:22.272 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:40:22.272 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:40:22.272 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:40:22.273 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:40:22.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:22.273 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T04:40:22.278 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:40:22.278 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:40:22.278 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:40:22.278 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:22.278 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:40:22.278 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:22.278 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:40:22.279 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:22.279 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:40:22.279 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:22.279 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T04:40:22.279 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42525sec preferred_lft 42525sec 2023-10-06T04:40:22.279 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T04:40:22.279 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:22.279 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:40:22.279 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:22.279 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:40:22.279 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:22.280 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T04:40:22.280 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:e0:81:f4:d2 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:22.280 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T04:40:22.280 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:22.280 INFO:teuthology.orchestra.run.smithi037.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:40:22.280 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:7a:01:84:5a:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:22.280 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:40:22.280 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:22.280 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::f0f6:45ff:fe62:bcd0/64 scope link 2023-10-06T04:40:22.280 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:22.280 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:40:22.280 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:7a:01:84:5a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:40:22.281 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a47a:1ff:fe84:5afc/64 scope link 2023-10-06T04:40:22.281 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:22.281 INFO:teuthology.orchestra.run.smithi037.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:40:22.281 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether fa:90:64:f2:f5:58 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:40:22.281 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::f890:64ff:fef2:f558/64 scope link 2023-10-06T04:40:22.282 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:22.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:22.283 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:40:22.339 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T04:40:22.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:22.341 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T04:40:22.349 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T04:40:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:40:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T04:40:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T04:40:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T04:40:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:40:22.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:22.350 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:40:22.351 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:40:22.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:40:22.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:40:22.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:40:22.351 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:40:22.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:22.388 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:40:22.393 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:40:22.393 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:40:22.394 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:40:22.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:22.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T04:40:22.451 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T04:40:22.451 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:40:22.451 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:22.456 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:40:22.457 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:40:22.457 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:22.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:40:22.524 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:40:22.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:40:22.535 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:40:22.536 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:40:22.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:22.537 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:40:22.544 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T04:40:22.544 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T04:40:22.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:40:22.563 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:40:22.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:40:22.618 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:40:22.618 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:40:22.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:22.619 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:40:22.627 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T04:40:22.620+0000 7fa772316380 -1 init, newargv = 0x563f5746e130 newargc=15 2023-10-06T04:40:22.627 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[42810]: starting ceph client 2023-10-06T04:40:22.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[42810]: starting fuse 2023-10-06T04:40:23.725 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:40:23.743 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:40:23.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:40:23.799 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:40:23.800 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:40:23.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:23.801 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:40:23.808 INFO:teuthology.orchestra.run.smithi037.stdout:52 2023-10-06T04:40:23.808 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T04:40:23.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:40:23.809 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T04:40:23.809 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T04:40:23.809 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T04:40:23.809 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T04:40:23.809 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:40:23.809 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T04:40:23.809 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T04:40:23.809 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T04:40:23.809 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T04:40:23.809 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:40:23.809 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T04:40:23.810 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T04:40:23.810 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T04:40:23.810 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T04:40:23.810 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:40:23.810 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T04:40:23.810 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T04:40:23.810 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T04:40:23.810 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T04:40:23.810 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T04:40:23.810 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T04:40:23.810 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T04:40:23.811 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T04:40:23.811 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:40:23.811 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T04:40:23.811 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T04:40:23.897 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.42810.asok 2023-10-06T04:40:24.078 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42810.asok 2023-10-06T04:40:24.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:24.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42810.asok status 2023-10-06T04:40:24.216 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:40:24.219 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T04:40:24.219 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T04:40:24.219 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T04:40:24.219 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T04:40:24.219 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T04:40:24.219 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T04:40:24.219 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "42810", 2023-10-06T04:40:24.219 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T04:40:24.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:24.219 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T04:40:24.220 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T04:40:24.220 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5331, 2023-10-06T04:40:24.220 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T04:40:24.220 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T04:40:24.220 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T04:40:24.220 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 5331 2023-10-06T04:40:24.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:24.220 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T04:40:24.220 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T04:40:24.220 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:40:24.221 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3227435493 2023-10-06T04:40:24.221 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:24.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:24.221 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T04:40:24.221 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T04:40:24.221 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:40:24.221 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3227435493 2023-10-06T04:40:24.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:24.221 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.5331 192.168.0.1:0/3227435493", 2023-10-06T04:40:24.221 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/3227435493", 2023-10-06T04:40:24.222 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T04:40:24.222 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 15, 2023-10-06T04:40:24.222 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 42, 2023-10-06T04:40:24.222 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T04:40:24.222 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T04:40:24.222 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T04:40:24.222 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:40:24.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:24.234 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T04:40:24.234 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:24.240 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T04:40:24.240 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:24.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:24.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:24.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:24.253 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir1) 2023-10-06T04:40:24.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:24.318 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch testdir1/testfile) 2023-10-06T04:40:24.333 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:40:24.333 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T04:40:24.333 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T04:40:24.333 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:40:24.333 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir1").st_ino) 2023-10-06T04:40:24.333 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T04:40:24.401 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2023-10-06T04:40:24.591 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T04:40:24.592 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:40:24.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:24.608 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[42810]: fuse finished with error 0 and tester_r 0 2023-10-06T04:40:24.610 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T04:40:30.711 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:30.712 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:40:30.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d6a5b1700 1 Processor -- start 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d6a5b1700 1 -- start start 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d6a5b1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640c7600 0x7f8d640b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d6a5b1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6406a0b0 con 0x7f8d640b0ca0 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d6a5b1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d64069780 con 0x7f8d640c7a70 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d6a5b1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d640c0aa0 con 0x7f8d640c7600 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d695af700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8d640b0ca0 0x7f8d6406a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50648/0 (socket says 172.21.15.37:50648) 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d695af700 1 -- 172.21.15.37:0/2681794958 learned_addr learned my addr 172.21.15.37:0/2681794958 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d68dae700 1 --2- 172.21.15.37:0/2681794958 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640c7600 0x7f8d640b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d68dae700 1 -- 172.21.15.37:0/2681794958 >> v1:172.21.15.83:6789/0 conn(0x7f8d640c7a70 legacy=0x7f8d641566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d68dae700 1 -- 172.21.15.37:0/2681794958 >> v1:172.21.15.37:6789/0 conn(0x7f8d640b0ca0 legacy=0x7f8d6406a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d63fff700 1 -- 172.21.15.37:0/2681794958 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259042932 0 0) 0x7f8d6406a0b0 con 0x7f8d640b0ca0 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.880+0000 7f8d68dae700 1 -- 172.21.15.37:0/2681794958 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64069a60 con 0x7f8d640c7600 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.884+0000 7f8d68dae700 1 --2- 172.21.15.37:0/2681794958 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640c7600 0x7f8d640b1070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009e90 tx=0x7f8d5c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8638292f095149ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.884+0000 7f8d63fff700 1 -- 172.21.15.37:0/2681794958 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c00e070 con 0x7f8d640c7600 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.884+0000 7f8d63fff700 1 -- 172.21.15.37:0/2681794958 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c00bc90 con 0x7f8d640c7600 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.884+0000 7f8d63fff700 1 -- 172.21.15.37:0/2681794958 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c012680 con 0x7f8d640c7600 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.884+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/2681794958 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640c7600 msgr2=0x7f8d640b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.884+0000 7f8d6a5b1700 1 --2- 172.21.15.37:0/2681794958 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640c7600 0x7f8d640b1070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009e90 tx=0x7f8d5c009780 comp rx=0 tx=0).stop 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.884+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/2681794958 shutdown_connections 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.884+0000 7f8d6a5b1700 1 --2- 172.21.15.37:0/2681794958 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640c7600 0x7f8d640b1070 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.884+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/2681794958 >> 172.21.15.37:0/2681794958 conn(0x7f8d64067cf0 msgr2=0x7f8d640680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.884+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/2681794958 shutdown_connections 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.884+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/2681794958 wait complete. 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d6a5b1700 1 Processor -- start 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d6a5b1700 1 -- start start 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d6a5b1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640b0ca0 0x7f8d6415bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d6a5b1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d640c7600 0x7f8d6414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d6a5b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d640c7a70 0x7f8d6414eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d6a5b1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6415b710 con 0x7f8d640c7a70 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d6a5b1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6414d810 con 0x7f8d640c7600 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d6a5b1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6414e650 con 0x7f8d640b0ca0 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d69db0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d640c7a70 0x7f8d6414eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d695af700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640b0ca0 0x7f8d6415bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d695af700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640b0ca0 0x7f8d6415bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:46848/0 (socket says 172.21.15.37:46848) 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d69db0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d640c7a70 0x7f8d6414eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34466/0 (socket says 172.21.15.37:34466) 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d695af700 1 -- 172.21.15.37:0/1473898638 learned_addr learned my addr 172.21.15.37:0/1473898638 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.888+0000 7f8d68dae700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d640c7600 0x7f8d6414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d69db0700 1 -- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640b0ca0 msgr2=0x7f8d6415bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d69db0700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640b0ca0 0x7f8d6415bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d69db0700 1 -- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d640c7600 msgr2=0x7f8d6414d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d69db0700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d640c7600 0x7f8d6414d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d69db0700 1 -- 172.21.15.37:0/1473898638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c009a20 con 0x7f8d640c7a70 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d695af700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640b0ca0 0x7f8d6415bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d69db0700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d640c7a70 0x7f8d6414eae0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00c410 tx=0x7f8d4c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d617fa700 1 -- 172.21.15.37:0/1473898638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c012420 con 0x7f8d640c7a70 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d617fa700 1 -- 172.21.15.37:0/1473898638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c0125a0 con 0x7f8d640c7a70 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/1473898638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6414da40 con 0x7f8d640c7a70 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d617fa700 1 -- 172.21.15.37:0/1473898638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c012960 con 0x7f8d640c7a70 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/1473898638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6414ddd0 con 0x7f8d640c7a70 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/1473898638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d640708a0 con 0x7f8d640c7a70 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.892+0000 7f8d617fa700 1 -- 172.21.15.37:0/1473898638 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8d4c01b3b0 con 0x7f8d640c7a70 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.896+0000 7f8d617fa700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8d44060580 0x7f8d44062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.896+0000 7f8d617fa700 1 -- 172.21.15.37:0/1473898638 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8d4c07c0a0 con 0x7f8d640c7a70 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.896+0000 7f8d695af700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8d44060580 0x7f8d44062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:30.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.896+0000 7f8d695af700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8d44060580 0x7f8d44062a30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d54007fd0 tx=0x7f8d54009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:30.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:30.900+0000 7f8d617fa700 1 -- 172.21.15.37:0/1473898638 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8d4c04c350 con 0x7f8d640c7a70 2023-10-06T04:40:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.104+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/1473898638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d6414e790 con 0x7f8d640c7a70 2023-10-06T04:40:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.104+0000 7f8d617fa700 1 -- 172.21.15.37:0/1473898638 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f8d4c017090 con 0x7f8d640c7a70 2023-10-06T04:40:31.109 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:31.110 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/968432746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":968432746},{"type":"v1","addr":"172.21.15.37:6833","nonce":968432746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2573831912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2573831912},{"type":"v1","addr":"172.21.15.37:6835","nonce":2573831912}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3283827040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3283827040},{"type":"v1","addr":"172.21.15.83:6835","nonce":3283827040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:16.392787+0000","modified":"2023-10-06T04:40:19.047129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5161},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5161":{"gid":5161,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1183217493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1183217493},{"type":"v1","addr":"172.21.15.83:6837","nonce":1183217493}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:31.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.108+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8d44060580 msgr2=0x7f8d44062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.108+0000 7f8d6a5b1700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8d44060580 0x7f8d44062a30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d54007fd0 tx=0x7f8d54009040 comp rx=0 tx=0).stop 2023-10-06T04:40:31.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.108+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/1473898638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d640c7a70 msgr2=0x7f8d6414eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.108+0000 7f8d6a5b1700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d640c7a70 0x7f8d6414eae0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00c410 tx=0x7f8d4c007ec0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.108+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/1473898638 shutdown_connections 2023-10-06T04:40:31.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.108+0000 7f8d6a5b1700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8d44060580 0x7f8d44062a30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.108+0000 7f8d6a5b1700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d640c7600 0x7f8d6414d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.108+0000 7f8d6a5b1700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d640c7a70 0x7f8d6414eae0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.108+0000 7f8d6a5b1700 1 --2- 172.21.15.37:0/1473898638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d640b0ca0 0x7f8d6415bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.108+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/1473898638 >> 172.21.15.37:0/1473898638 conn(0x7f8d64067cf0 msgr2=0x7f8d640b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:31.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.108+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/1473898638 shutdown_connections 2023-10-06T04:40:31.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.108+0000 7f8d6a5b1700 1 -- 172.21.15.37:0/1473898638 wait complete. 2023-10-06T04:40:31.115 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 15 2023-10-06T04:40:31.130 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi083.stdout:{"message":"","return_code":0} 2023-10-06T04:40:31.273 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T04:40:31.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 2:0 2023-10-06T04:40:31.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.376+0000 7f495ac1a700 1 Processor -- start 2023-10-06T04:40:31.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.376+0000 7f495ac1a700 1 -- start start 2023-10-06T04:40:31.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f495ac1a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f495406d5e0 0x7f4954156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f495ac1a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495406dc20 con 0x7f4954157500 2023-10-06T04:40:31.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f495ac1a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49540c28d0 con 0x7f49541578d0 2023-10-06T04:40:31.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f495ac1a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495406df00 con 0x7f495406d5e0 2023-10-06T04:40:31.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4959c18700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4954157500 0x7f495406ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50660/0 (socket says 172.21.15.37:50660) 2023-10-06T04:40:31.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4959c18700 1 -- 172.21.15.37:0/3307581759 learned_addr learned my addr 172.21.15.37:0/3307581759 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:31.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f495a419700 1 --2- 172.21.15.37:0/3307581759 >> v2:172.21.15.83:3300/0 conn(0x7f495406d5e0 0x7f4954156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362863765 0 0) 0x7f495406dc20 con 0x7f4954157500 2023-10-06T04:40:31.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4940003570 con 0x7f4954157500 2023-10-06T04:40:31.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3393192942 0 0) 0x7f4940003570 con 0x7f4954157500 2023-10-06T04:40:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 >> v2:172.21.15.83:3300/0 conn(0x7f495406d5e0 msgr2=0x7f4954156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 --2- 172.21.15.37:0/3307581759 >> v2:172.21.15.83:3300/0 conn(0x7f495406d5e0 0x7f4954156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 >> v1:172.21.15.83:6789/0 conn(0x7f49541578d0 legacy=0x7f4954156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49540c2bb0 con 0x7f4954157500 2023-10-06T04:40:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f4950001470 con 0x7f4954157500 2023-10-06T04:40:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 >> v1:172.21.15.37:6789/0 conn(0x7f4954157500 legacy=0x7f495406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 --2- 172.21.15.37:0/3307581759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4940003a60 0x7f4940003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 --2- 172.21.15.37:0/3307581759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4940004810 0x7f4940004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 --2- 172.21.15.37:0/3307581759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49400051c0 0x7f494000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495406df00 con 0x7f4940004810 2023-10-06T04:40:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494000c160 con 0x7f49400051c0 2023-10-06T04:40:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494000c320 con 0x7f4940003a60 2023-10-06T04:40:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4959417700 1 --2- 172.21.15.37:0/3307581759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4940004810 0x7f4940004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f495a419700 1 --2- 172.21.15.37:0/3307581759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49400051c0 0x7f494000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4959c18700 1 --2- 172.21.15.37:0/3307581759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4940003a60 0x7f4940003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4959417700 1 -- 172.21.15.37:0/3307581759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4940003a60 msgr2=0x7f4940003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4959417700 1 --2- 172.21.15.37:0/3307581759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4940003a60 0x7f4940003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4959417700 1 -- 172.21.15.37:0/3307581759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49400051c0 msgr2=0x7f494000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4959417700 1 --2- 172.21.15.37:0/3307581759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49400051c0 0x7f494000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f495a419700 1 -- 172.21.15.37:0/3307581759 reap_dead start 2023-10-06T04:40:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4959417700 1 -- 172.21.15.37:0/3307581759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4940003570 con 0x7f4940004810 2023-10-06T04:40:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.380+0000 7f4959417700 1 --2- 172.21.15.37:0/3307581759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4940004810 0x7f4940004c80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f49480018b0 tx=0x7f4948007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f34ff5d8406ac4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:31.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.384+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948012420 con 0x7f4940004810 2023-10-06T04:40:31.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.384+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49480125a0 con 0x7f4940004810 2023-10-06T04:40:31.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.384+0000 7f4958c16700 1 -- 172.21.15.37:0/3307581759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948012960 con 0x7f4940004810 2023-10-06T04:40:31.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.384+0000 7f495ac1a700 1 -- 172.21.15.37:0/3307581759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4940004810 msgr2=0x7f4940004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.384+0000 7f495ac1a700 1 --2- 172.21.15.37:0/3307581759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4940004810 0x7f4940004c80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f49480018b0 tx=0x7f4948007d30 comp rx=0 tx=0).stop 2023-10-06T04:40:31.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.384+0000 7f495ac1a700 1 -- 172.21.15.37:0/3307581759 shutdown_connections 2023-10-06T04:40:31.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.384+0000 7f495ac1a700 1 --2- 172.21.15.37:0/3307581759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4940004810 0x7f4940004c80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.384+0000 7f495ac1a700 1 -- 172.21.15.37:0/3307581759 >> 172.21.15.37:0/3307581759 conn(0x7f495406c230 msgr2=0x7f49540cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:31.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.384+0000 7f495ac1a700 1 -- 172.21.15.37:0/3307581759 shutdown_connections 2023-10-06T04:40:31.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.384+0000 7f495ac1a700 1 -- 172.21.15.37:0/3307581759 wait complete. 2023-10-06T04:40:31.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.384+0000 7f495ac1a700 1 Processor -- start 2023-10-06T04:40:31.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.384+0000 7f495ac1a700 1 -- start start 2023-10-06T04:40:31.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495ac1a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4954155a50 0x7f49540ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495ac1a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4954153e50 0x7f49540ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495ac1a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4954068f50 0x7f49540693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495ac1a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495406da40 con 0x7f4954068f50 2023-10-06T04:40:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495ac1a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495414eb40 con 0x7f4954153e50 2023-10-06T04:40:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495ac1a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495414e580 con 0x7f4954155a50 2023-10-06T04:40:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495a419700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4954068f50 0x7f49540693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495a419700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4954068f50 0x7f49540693c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34478/0 (socket says 172.21.15.37:34478) 2023-10-06T04:40:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f4959c18700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4954155a50 0x7f49540ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495a419700 1 -- 172.21.15.37:0/3448696796 learned_addr learned my addr 172.21.15.37:0/3448696796 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f4959417700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4954153e50 0x7f49540ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495a419700 1 -- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4954155a50 msgr2=0x7f49540ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495a419700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4954155a50 0x7f49540ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495a419700 1 -- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4954153e50 msgr2=0x7f49540ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495a419700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4954153e50 0x7f49540ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495a419700 1 -- 172.21.15.37:0/3448696796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4954069c80 con 0x7f4954068f50 2023-10-06T04:40:31.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495a419700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4954068f50 0x7f49540693c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f494c0094d0 tx=0x7f494c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:31.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f4945ffb700 1 -- 172.21.15.37:0/3448696796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c00e040 con 0x7f4954068f50 2023-10-06T04:40:31.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f4945ffb700 1 -- 172.21.15.37:0/3448696796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c00f040 con 0x7f4954068f50 2023-10-06T04:40:31.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495ac1a700 1 -- 172.21.15.37:0/3448696796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4954069f60 con 0x7f4954068f50 2023-10-06T04:40:31.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f4945ffb700 1 -- 172.21.15.37:0/3448696796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c00fe50 con 0x7f4954068f50 2023-10-06T04:40:31.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.388+0000 7f495ac1a700 1 -- 172.21.15.37:0/3448696796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4954069900 con 0x7f4954068f50 2023-10-06T04:40:31.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.392+0000 7f495ac1a700 1 -- 172.21.15.37:0/3448696796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495414ecf0 con 0x7f4954068f50 2023-10-06T04:40:31.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.392+0000 7f4945ffb700 1 -- 172.21.15.37:0/3448696796 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f494c015640 con 0x7f4954068f50 2023-10-06T04:40:31.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.392+0000 7f4945ffb700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4938060580 0x7f4938062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.392+0000 7f4945ffb700 1 -- 172.21.15.37:0/3448696796 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f494c07d200 con 0x7f4954068f50 2023-10-06T04:40:31.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.392+0000 7f4959c18700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4938060580 0x7f4938062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.392+0000 7f4959c18700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4938060580 0x7f4938062a30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4950001ce0 tx=0x7f4950001e50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:31.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.400+0000 7f4945ffb700 1 -- 172.21.15.37:0/3448696796 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f495414ecf0 con 0x7f4954068f50 2023-10-06T04:40:31.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.628+0000 7f495ac1a700 1 -- 172.21.15.37:0/3448696796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "2:0"} v 0) v1 -- 0x7f495414ecf0 con 0x7f4954068f50 2023-10-06T04:40:31.634 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T04:40:31.628+0000 7f2a85d34700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:40:31.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.636+0000 7f4945ffb700 1 -- 172.21.15.37:0/3448696796 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "2:0"}]=0 failed mds gid 5161 v16) v1 ==== 97+0+0 (secure 0 0 0) 0x7f495414ecf0 con 0x7f4954068f50 2023-10-06T04:40:31.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.640+0000 7f495ac1a700 1 -- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4938060580 msgr2=0x7f4938062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.640+0000 7f495ac1a700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4938060580 0x7f4938062a30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4950001ce0 tx=0x7f4950001e50 comp rx=0 tx=0).stop 2023-10-06T04:40:31.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.640+0000 7f495ac1a700 1 -- 172.21.15.37:0/3448696796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4954068f50 msgr2=0x7f49540693c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.640+0000 7f495ac1a700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4954068f50 0x7f49540693c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f494c0094d0 tx=0x7f494c00b040 comp rx=0 tx=0).stop 2023-10-06T04:40:31.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.640+0000 7f495ac1a700 1 -- 172.21.15.37:0/3448696796 shutdown_connections 2023-10-06T04:40:31.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.640+0000 7f495ac1a700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4938060580 0x7f4938062a30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.640+0000 7f495ac1a700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4954153e50 0x7f49540ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.640+0000 7f495ac1a700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4954068f50 0x7f49540693c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.640+0000 7f495ac1a700 1 --2- 172.21.15.37:0/3448696796 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4954155a50 0x7f49540ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.640+0000 7f495ac1a700 1 -- 172.21.15.37:0/3448696796 >> 172.21.15.37:0/3448696796 conn(0x7f495406c230 msgr2=0x7f49540ca640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:31.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.640+0000 7f495ac1a700 1 -- 172.21.15.37:0/3448696796 shutdown_connections 2023-10-06T04:40:31.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.640+0000 7f495ac1a700 1 -- 172.21.15.37:0/3448696796 wait complete. 2023-10-06T04:40:31.647 INFO:tasks.ceph.mds.b.smithi083.stderr: -2773> 2023-10-06T04:40:20.981+0000 7f1a1fe09700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:40:31.647 INFO:teuthology.orchestra.run.smithi037.stderr:failed mds gid 5161 2023-10-06T04:40:31.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:31.682 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T04:40:31.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.756+0000 7fa640446700 1 Processor -- start 2023-10-06T04:40:31.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.756+0000 7fa640446700 1 -- start start 2023-10-06T04:40:31.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.756+0000 7fa640446700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa638155bf0 0x7fa6380afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.756+0000 7fa640446700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6380ac670 0x7fa6380ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.756+0000 7fa640446700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa6380adf30 0x7fa6380aba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.756+0000 7fa640446700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa638155fc0 con 0x7fa6380adf30 2023-10-06T04:40:31.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.756+0000 7fa640446700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6380a9ea0 con 0x7fa638155bf0 2023-10-06T04:40:31.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.756+0000 7fa640446700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6380ae3b0 con 0x7fa6380ac670 2023-10-06T04:40:31.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63e9e3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa6380adf30 0x7fa6380aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63e1e2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa638155bf0 0x7fa6380afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63d9e1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6380ac670 0x7fa6380ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63e9e3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa6380adf30 0x7fa6380aba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34490/0 (socket says 172.21.15.37:34490) 2023-10-06T04:40:31.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63e9e3700 1 -- 172.21.15.37:0/139433679 learned_addr learned my addr 172.21.15.37:0/139433679 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:31.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63e1e2700 1 -- 172.21.15.37:0/139433679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6380ac670 msgr2=0x7fa6380ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:31.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63e1e2700 1 --2- 172.21.15.37:0/139433679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6380ac670 0x7fa6380ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63e1e2700 1 -- 172.21.15.37:0/139433679 >> v2:172.21.15.37:3300/0 conn(0x7fa6380adf30 msgr2=0x7fa6380aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:31.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63e1e2700 1 --2- 172.21.15.37:0/139433679 >> v2:172.21.15.37:3300/0 conn(0x7fa6380adf30 0x7fa6380aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63e1e2700 1 -- 172.21.15.37:0/139433679 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6380aa160 con 0x7fa638155bf0 2023-10-06T04:40:31.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63d9e1700 1 --2- 172.21.15.37:0/139433679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6380ac670 0x7fa6380ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:31.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63e1e2700 1 --2- 172.21.15.37:0/139433679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa638155bf0 0x7fa6380afe90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa638068fe0 tx=0x7fa6340090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fce9523600873b2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63d1e0700 1 -- 172.21.15.37:0/139433679 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63400c8d0 con 0x7fa638155bf0 2023-10-06T04:40:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63d1e0700 1 -- 172.21.15.37:0/139433679 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63400ca30 con 0x7fa638155bf0 2023-10-06T04:40:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa63d1e0700 1 -- 172.21.15.37:0/139433679 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63400cdf0 con 0x7fa638155bf0 2023-10-06T04:40:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa640446700 1 -- 172.21.15.37:0/139433679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa638155bf0 msgr2=0x7fa6380afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa640446700 1 --2- 172.21.15.37:0/139433679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa638155bf0 0x7fa6380afe90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa638068fe0 tx=0x7fa6340090f0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa640446700 1 -- 172.21.15.37:0/139433679 shutdown_connections 2023-10-06T04:40:31.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa640446700 1 --2- 172.21.15.37:0/139433679 >> v2:172.21.15.37:3300/0 conn(0x7fa6380adf30 0x7fa6380aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa640446700 1 --2- 172.21.15.37:0/139433679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6380ac670 0x7fa6380ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa640446700 1 --2- 172.21.15.37:0/139433679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa638155bf0 0x7fa6380afe90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa640446700 1 -- 172.21.15.37:0/139433679 >> 172.21.15.37:0/139433679 conn(0x7fa6380ccc60 msgr2=0x7fa63806c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:31.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa640446700 1 -- 172.21.15.37:0/139433679 shutdown_connections 2023-10-06T04:40:31.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.760+0000 7fa640446700 1 -- 172.21.15.37:0/139433679 wait complete. 2023-10-06T04:40:31.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa640446700 1 Processor -- start 2023-10-06T04:40:31.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa640446700 1 -- start start 2023-10-06T04:40:31.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa640446700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6380ac670 0x7fa6381655a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa640446700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa638155bf0 0x7fa638151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa640446700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa63806b190 0x7fa6380b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa640446700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa638095da0 con 0x7fa638155bf0 2023-10-06T04:40:31.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa640446700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63806c2a0 con 0x7fa6380ac670 2023-10-06T04:40:31.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa640446700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa638165ae0 con 0x7fa63806b190 2023-10-06T04:40:31.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa63d9e1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa638155bf0 0x7fa638151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa63d9e1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa638155bf0 0x7fa638151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34502/0 (socket says 172.21.15.37:34502) 2023-10-06T04:40:31.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa63d9e1700 1 -- 172.21.15.37:0/3508935232 learned_addr learned my addr 172.21.15.37:0/3508935232 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:31.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa63e9e3700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa63806b190 0x7fa6380b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa63e1e2700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6380ac670 0x7fa6381655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa63d9e1700 1 -- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa63806b190 msgr2=0x7fa6380b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa63d9e1700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa63806b190 0x7fa6380b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa63d9e1700 1 -- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6380ac670 msgr2=0x7fa6381655a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa63d9e1700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6380ac670 0x7fa6381655a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa63d9e1700 1 -- 172.21.15.37:0/3508935232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62800d8d0 con 0x7fa638155bf0 2023-10-06T04:40:31.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa63e1e2700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6380ac670 0x7fa6381655a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:31.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa63d9e1700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa638155bf0 0x7fa638151f20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa62800def0 tx=0x7fa62800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:31.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa62e7fc700 1 -- 172.21.15.37:0/3508935232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62800d2e0 con 0x7fa638155bf0 2023-10-06T04:40:31.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa62e7fc700 1 -- 172.21.15.37:0/3508935232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa628013040 con 0x7fa638155bf0 2023-10-06T04:40:31.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa640446700 1 -- 172.21.15.37:0/3508935232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63400b4e0 con 0x7fa638155bf0 2023-10-06T04:40:31.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.764+0000 7fa62e7fc700 1 -- 172.21.15.37:0/3508935232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628010c40 con 0x7fa638155bf0 2023-10-06T04:40:31.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.768+0000 7fa640446700 1 -- 172.21.15.37:0/3508935232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63806b690 con 0x7fa638155bf0 2023-10-06T04:40:31.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.768+0000 7fa62e7fc700 1 -- 172.21.15.37:0/3508935232 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa628018480 con 0x7fa638155bf0 2023-10-06T04:40:31.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.768+0000 7fa640446700 1 -- 172.21.15.37:0/3508935232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa638165d40 con 0x7fa638155bf0 2023-10-06T04:40:31.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.768+0000 7fa62e7fc700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa61c060550 0x7fa61c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:31.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.768+0000 7fa62e7fc700 1 -- 172.21.15.37:0/3508935232 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa628080d80 con 0x7fa638155bf0 2023-10-06T04:40:31.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.768+0000 7fa63e1e2700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa61c060550 0x7fa61c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:31.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.768+0000 7fa63e1e2700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa61c060550 0x7fa61c062a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa63400bfd0 tx=0x7fa634017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:31.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.776+0000 7fa62e7fc700 1 -- 172.21.15.37:0/3508935232 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa638165d40 con 0x7fa638155bf0 2023-10-06T04:40:31.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 -- 172.21.15.37:0/3508935232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa638165d40 con 0x7fa638155bf0 2023-10-06T04:40:31.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa62e7fc700 1 -- 172.21.15.37:0/3508935232 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3838 (secure 0 0 0) 0x7fa638165d40 con 0x7fa638155bf0 2023-10-06T04:40:31.981 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:31.981 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/968432746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":968432746},{"type":"v1","addr":"172.21.15.37:6833","nonce":968432746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2573831912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2573831912},{"type":"v1","addr":"172.21.15.37:6835","nonce":2573831912}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:16.392787+0000","modified":"2023-10-06T04:40:31.641470+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":43,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":17,"state":"up:replay","state_seq":1,"addr":"172.21.15.83:6835/3283827040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3283827040},{"type":"v1","addr":"172.21.15.83:6835","nonce":3283827040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 -- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa61c060550 msgr2=0x7fa61c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa61c060550 0x7fa61c062a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa63400bfd0 tx=0x7fa634017000 comp rx=0 tx=0).stop 2023-10-06T04:40:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 -- 172.21.15.37:0/3508935232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa638155bf0 msgr2=0x7fa638151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa638155bf0 0x7fa638151f20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa62800def0 tx=0x7fa62800f040 comp rx=0 tx=0).stop 2023-10-06T04:40:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 -- 172.21.15.37:0/3508935232 shutdown_connections 2023-10-06T04:40:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa61c060550 0x7fa61c062a00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa63806b190 0x7fa6380b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa638155bf0 0x7fa638151f20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 --2- 172.21.15.37:0/3508935232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6380ac670 0x7fa6381655a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 -- 172.21.15.37:0/3508935232 >> 172.21.15.37:0/3508935232 conn(0x7fa6380ccc60 msgr2=0x7fa6380b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 -- 172.21.15.37:0/3508935232 shutdown_connections 2023-10-06T04:40:31.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:31.976+0000 7fa640446700 1 -- 172.21.15.37:0/3508935232 wait complete. 2023-10-06T04:40:31.985 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-10-06T04:40:32.398 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:40:16.392787+0000', 'modified': '2023-10-06T04:40:31.641470+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 43, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5158}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5158': {'gid': 5158, 'name': 'd', 'rank': 0, 'incarnation': 17, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.83:6835/3283827040', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6834', 'nonce': 3283827040}, {'type': 'v1', 'addr': '172.21.15.83:6835', 'nonce': 3283827040}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:40:32.398 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5158:up:replay 2023-10-06T04:40:33.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:33.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.512+0000 7fbbfbfff700 1 Processor -- start 2023-10-06T04:40:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.512+0000 7fbbfbfff700 1 -- start start 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.512+0000 7fbbfbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbfc068400 0x7fbbfc15d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.512+0000 7fbbfbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbbfc158ba0 0x7fbbfc0ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.512+0000 7fbbfbfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc159040 con 0x7fbbfc1587d0 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.512+0000 7fbbfbfff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc15d6d0 con 0x7fbbfc068400 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.512+0000 7fbbfbfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0af7f0 con 0x7fbbfc158ba0 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.512+0000 7fbbfaffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbbfc1587d0 0x7fbbfc067cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50670/0 (socket says 172.21.15.37:50670) 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.512+0000 7fbbfa7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbfc068400 0x7fbbfc15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.512+0000 7fbbfaffd700 1 -- 172.21.15.37:0/313331273 learned_addr learned my addr 172.21.15.37:0/313331273 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfb7fe700 1 --2- 172.21.15.37:0/313331273 >> v2:172.21.15.83:3300/0 conn(0x7fbbfc158ba0 0x7fbbfc0ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbf9ffb700 1 -- 172.21.15.37:0/313331273 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137263233 0 0) 0x7fbbfc159040 con 0x7fbbfc1587d0 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbf9ffb700 1 -- 172.21.15.37:0/313331273 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe4003570 con 0x7fbbfc1587d0 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfb7fe700 1 -- 172.21.15.37:0/313331273 >> v2:172.21.15.37:3300/0 conn(0x7fbbfc068400 msgr2=0x7fbbfc15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfb7fe700 1 --2- 172.21.15.37:0/313331273 >> v2:172.21.15.37:3300/0 conn(0x7fbbfc068400 0x7fbbfc15d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfb7fe700 1 -- 172.21.15.37:0/313331273 >> v1:172.21.15.37:6789/0 conn(0x7fbbfc1587d0 legacy=0x7fbbfc067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfb7fe700 1 -- 172.21.15.37:0/313331273 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc0afad0 con 0x7fbbfc158ba0 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfb7fe700 1 --2- 172.21.15.37:0/313331273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbfc158ba0 0x7fbbfc0ae510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0b12e0 tx=0x7fbbec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=547b9c90acda9086 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbf9ffb700 1 -- 172.21.15.37:0/313331273 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec011630 con 0x7fbbfc158ba0 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbf9ffb700 1 -- 172.21.15.37:0/313331273 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec0117b0 con 0x7fbbfc158ba0 2023-10-06T04:40:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbf9ffb700 1 -- 172.21.15.37:0/313331273 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec011b70 con 0x7fbbfc158ba0 2023-10-06T04:40:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfbfff700 1 -- 172.21.15.37:0/313331273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbfc158ba0 msgr2=0x7fbbfc0ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfbfff700 1 --2- 172.21.15.37:0/313331273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbfc158ba0 0x7fbbfc0ae510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0b12e0 tx=0x7fbbec0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfbfff700 1 -- 172.21.15.37:0/313331273 shutdown_connections 2023-10-06T04:40:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfbfff700 1 --2- 172.21.15.37:0/313331273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbfc158ba0 0x7fbbfc0ae510 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfbfff700 1 --2- 172.21.15.37:0/313331273 >> v2:172.21.15.37:3300/0 conn(0x7fbbfc068400 0x7fbbfc15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfbfff700 1 -- 172.21.15.37:0/313331273 >> 172.21.15.37:0/313331273 conn(0x7fbbfc0cc5f0 msgr2=0x7fbbfc0cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfbfff700 1 -- 172.21.15.37:0/313331273 shutdown_connections 2023-10-06T04:40:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.516+0000 7fbbfbfff700 1 -- 172.21.15.37:0/313331273 wait complete. 2023-10-06T04:40:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfbfff700 1 Processor -- start 2023-10-06T04:40:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfbfff700 1 -- start start 2023-10-06T04:40:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbfc068400 0x7fbbfc0c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbfc1587d0 0x7fbbfc15bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbfc158ba0 0x7fbbfc168dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfbfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc153a50 con 0x7fbbfc068400 2023-10-06T04:40:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfbfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc156390 con 0x7fbbfc1587d0 2023-10-06T04:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0c9340 con 0x7fbbfc158ba0 2023-10-06T04:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbfc068400 0x7fbbfc0c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbfc068400 0x7fbbfc0c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34532/0 (socket says 172.21.15.37:34532) 2023-10-06T04:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfaffd700 1 -- 172.21.15.37:0/2099668368 learned_addr learned my addr 172.21.15.37:0/2099668368 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfa7fc700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbfc1587d0 0x7fbbfc15bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfb7fe700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbfc158ba0 0x7fbbfc168dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfaffd700 1 -- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbfc158ba0 msgr2=0x7fbbfc168dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfaffd700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbfc158ba0 0x7fbbfc168dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfaffd700 1 -- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbfc1587d0 msgr2=0x7fbbfc15bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfaffd700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbfc1587d0 0x7fbbfc15bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfaffd700 1 -- 172.21.15.37:0/2099668368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec009420 con 0x7fbbfc068400 2023-10-06T04:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfaffd700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbfc068400 0x7fbbfc0c8d50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400cc40 tx=0x7fbbf4001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbe2ffd700 1 -- 172.21.15.37:0/2099668368 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400a8b0 con 0x7fbbfc068400 2023-10-06T04:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbe2ffd700 1 -- 172.21.15.37:0/2099668368 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf400aa30 con 0x7fbbfc068400 2023-10-06T04:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfbfff700 1 -- 172.21.15.37:0/2099668368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc0c9620 con 0x7fbbfc068400 2023-10-06T04:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbe2ffd700 1 -- 172.21.15.37:0/2099668368 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400adf0 con 0x7fbbfc068400 2023-10-06T04:40:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.520+0000 7fbbfbfff700 1 -- 172.21.15.37:0/2099668368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc0c9be0 con 0x7fbbfc068400 2023-10-06T04:40:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.524+0000 7fbbfbfff700 1 -- 172.21.15.37:0/2099668368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc0708a0 con 0x7fbbfc068400 2023-10-06T04:40:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.524+0000 7fbbe2ffd700 1 -- 172.21.15.37:0/2099668368 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbbf4007300 con 0x7fbbfc068400 2023-10-06T04:40:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.524+0000 7fbbe2ffd700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbbe8060550 0x7fbbe8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.524+0000 7fbbe2ffd700 1 -- 172.21.15.37:0/2099668368 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fbbf407cd80 con 0x7fbbfc068400 2023-10-06T04:40:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.524+0000 7fbbfa7fc700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbbe8060550 0x7fbbe8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.528+0000 7fbbfa7fc700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbbe8060550 0x7fbbe8062a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc15c390 tx=0x7fbbf00091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.532+0000 7fbbe2ffd700 1 -- 172.21.15.37:0/2099668368 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbbf404d100 con 0x7fbbfc068400 2023-10-06T04:40:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.736+0000 7fbbfbfff700 1 -- 172.21.15.37:0/2099668368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbfc0afdb0 con 0x7fbbfc068400 2023-10-06T04:40:33.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.736+0000 7fbbe2ffd700 1 -- 172.21.15.37:0/2099668368 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fbbf4050720 con 0x7fbbfc068400 2023-10-06T04:40:33.742 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:33.742 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3094155806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3094155806},{"type":"v1","addr":"172.21.15.83:6837","nonce":3094155806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/968432746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":968432746},{"type":"v1","addr":"172.21.15.37:6833","nonce":968432746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2573831912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2573831912},{"type":"v1","addr":"172.21.15.37:6835","nonce":2573831912}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:16.392787+0000","modified":"2023-10-06T04:40:33.658014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":43,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":17,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.83:6835/3283827040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3283827040},{"type":"v1","addr":"172.21.15.83:6835","nonce":3283827040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:33.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.740+0000 7fbbfbfff700 1 -- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbbe8060550 msgr2=0x7fbbe8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.740+0000 7fbbfbfff700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbbe8060550 0x7fbbe8062a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc15c390 tx=0x7fbbf00091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.740+0000 7fbbfbfff700 1 -- 172.21.15.37:0/2099668368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbfc068400 msgr2=0x7fbbfc0c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.740+0000 7fbbfbfff700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbfc068400 0x7fbbfc0c8d50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400cc40 tx=0x7fbbf4001a70 comp rx=0 tx=0).stop 2023-10-06T04:40:33.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.740+0000 7fbbfbfff700 1 -- 172.21.15.37:0/2099668368 shutdown_connections 2023-10-06T04:40:33.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.740+0000 7fbbfbfff700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbbe8060550 0x7fbbe8062a00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.740+0000 7fbbfbfff700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbfc1587d0 0x7fbbfc15bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.740+0000 7fbbfbfff700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbfc158ba0 0x7fbbfc168dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.740+0000 7fbbfbfff700 1 --2- 172.21.15.37:0/2099668368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbfc068400 0x7fbbfc0c8d50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.740+0000 7fbbfbfff700 1 -- 172.21.15.37:0/2099668368 >> 172.21.15.37:0/2099668368 conn(0x7fbbfc0cc5f0 msgr2=0x7fbbfc067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:33.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.740+0000 7fbbfbfff700 1 -- 172.21.15.37:0/2099668368 shutdown_connections 2023-10-06T04:40:33.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:33.740+0000 7fbbfbfff700 1 -- 172.21.15.37:0/2099668368 wait complete. 2023-10-06T04:40:33.746 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 19 2023-10-06T04:40:34.159 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:40:16.392787+0000', 'modified': '2023-10-06T04:40:33.658014+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 43, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5158}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5158': {'gid': 5158, 'name': 'd', 'rank': 0, 'incarnation': 17, 'state': 'up:rejoin', 'state_seq': 8, 'addr': '172.21.15.83:6835/3283827040', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6834', 'nonce': 3283827040}, {'type': 'v1', 'addr': '172.21.15.83:6835', 'nonce': 3283827040}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:40:34.159 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5158:up:rejoin 2023-10-06T04:40:35.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.268+0000 7ff64627a700 1 Processor -- start 2023-10-06T04:40:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.268+0000 7ff64627a700 1 -- start start 2023-10-06T04:40:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.268+0000 7ff64627a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff640068400 0x7ff64015d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.268+0000 7ff64627a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff640159040 con 0x7ff6401587d0 2023-10-06T04:40:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.268+0000 7ff64627a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6400af7f0 con 0x7ff640158ba0 2023-10-06T04:40:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.268+0000 7ff64627a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64015d6d0 con 0x7ff640068400 2023-10-06T04:40:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.268+0000 7ff645278700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff6401587d0 0x7ff640067cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50672/0 (socket says 172.21.15.37:50672) 2023-10-06T04:40:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.268+0000 7ff645278700 1 -- 172.21.15.37:0/1000825927 learned_addr learned my addr 172.21.15.37:0/1000825927 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff644a77700 1 --2- 172.21.15.37:0/1000825927 >> v2:172.21.15.83:3300/0 conn(0x7ff640068400 0x7ff64015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff637fff700 1 -- 172.21.15.37:0/1000825927 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757431167 0 0) 0x7ff640159040 con 0x7ff6401587d0 2023-10-06T04:40:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff637fff700 1 -- 172.21.15.37:0/1000825927 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff62c003570 con 0x7ff6401587d0 2023-10-06T04:40:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff644a77700 1 -- 172.21.15.37:0/1000825927 >> v1:172.21.15.83:6789/0 conn(0x7ff640158ba0 legacy=0x7ff6400ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff637fff700 1 -- 172.21.15.37:0/1000825927 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94065887 0 0) 0x7ff6400af7f0 con 0x7ff640158ba0 2023-10-06T04:40:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff644a77700 1 -- 172.21.15.37:0/1000825927 >> v1:172.21.15.37:6789/0 conn(0x7ff6401587d0 legacy=0x7ff640067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff644a77700 1 -- 172.21.15.37:0/1000825927 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400afad0 con 0x7ff640068400 2023-10-06T04:40:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff644a77700 1 --2- 172.21.15.37:0/1000825927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff640068400 0x7ff64015d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0098e0 tx=0x7ff63c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8a0a31971e7ec08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff637fff700 1 -- 172.21.15.37:0/1000825927 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630001470 con 0x7ff640068400 2023-10-06T04:40:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff637fff700 1 -- 172.21.15.37:0/1000825927 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c011420 con 0x7ff640068400 2023-10-06T04:40:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff637fff700 1 -- 172.21.15.37:0/1000825927 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0117c0 con 0x7ff640068400 2023-10-06T04:40:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff64627a700 1 -- 172.21.15.37:0/1000825927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff640068400 msgr2=0x7ff64015d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff64627a700 1 --2- 172.21.15.37:0/1000825927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff640068400 0x7ff64015d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0098e0 tx=0x7ff63c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff64627a700 1 -- 172.21.15.37:0/1000825927 shutdown_connections 2023-10-06T04:40:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff64627a700 1 --2- 172.21.15.37:0/1000825927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff640068400 0x7ff64015d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff64627a700 1 -- 172.21.15.37:0/1000825927 >> 172.21.15.37:0/1000825927 conn(0x7ff6400cc5f0 msgr2=0x7ff6400cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff64627a700 1 -- 172.21.15.37:0/1000825927 shutdown_connections 2023-10-06T04:40:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.272+0000 7ff64627a700 1 -- 172.21.15.37:0/1000825927 wait complete. 2023-10-06T04:40:35.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff64627a700 1 Processor -- start 2023-10-06T04:40:35.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff64627a700 1 -- start start 2023-10-06T04:40:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff64627a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff640068400 0x7ff6400c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff64627a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401587d0 0x7ff6400c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff64627a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff640158ba0 0x7ff640144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff64627a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400c9ee0 con 0x7ff6401587d0 2023-10-06T04:40:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff64627a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64015a910 con 0x7ff640158ba0 2023-10-06T04:40:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff64627a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400c9640 con 0x7ff640068400 2023-10-06T04:40:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff644a77700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401587d0 0x7ff6400c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff644a77700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401587d0 0x7ff6400c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34536/0 (socket says 172.21.15.37:34536) 2023-10-06T04:40:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff644a77700 1 -- 172.21.15.37:0/2644690334 learned_addr learned my addr 172.21.15.37:0/2644690334 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff645a79700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff640158ba0 0x7ff640144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff645278700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff640068400 0x7ff6400c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff644a77700 1 -- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff640068400 msgr2=0x7ff6400c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff644a77700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff640068400 0x7ff6400c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff644a77700 1 -- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff640158ba0 msgr2=0x7ff640144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff644a77700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff640158ba0 0x7ff640144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff644a77700 1 -- 172.21.15.37:0/2644690334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c009420 con 0x7ff6401587d0 2023-10-06T04:40:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff644a77700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401587d0 0x7ff6400c8b80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0030c0 tx=0x7ff63c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff6357fa700 1 -- 172.21.15.37:0/2644690334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c010b70 con 0x7ff6401587d0 2023-10-06T04:40:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff6357fa700 1 -- 172.21.15.37:0/2644690334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c010cd0 con 0x7ff6401587d0 2023-10-06T04:40:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff64627a700 1 -- 172.21.15.37:0/2644690334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6400c9920 con 0x7ff6401587d0 2023-10-06T04:40:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff6357fa700 1 -- 172.21.15.37:0/2644690334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c01d680 con 0x7ff6401587d0 2023-10-06T04:40:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.276+0000 7ff64627a700 1 -- 172.21.15.37:0/2644690334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff640156570 con 0x7ff6401587d0 2023-10-06T04:40:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.280+0000 7ff64627a700 1 -- 172.21.15.37:0/2644690334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64015aa80 con 0x7ff6401587d0 2023-10-06T04:40:35.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.280+0000 7ff6357fa700 1 -- 172.21.15.37:0/2644690334 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff63c01d9f0 con 0x7ff6401587d0 2023-10-06T04:40:35.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.280+0000 7ff6357fa700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff624060580 0x7ff624062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.280+0000 7ff6357fa700 1 -- 172.21.15.37:0/2644690334 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff63c07e440 con 0x7ff6401587d0 2023-10-06T04:40:35.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.280+0000 7ff645278700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff624060580 0x7ff624062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.284+0000 7ff645278700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff624060580 0x7ff624062a30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff630001200 tx=0x7ff630000bc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.288+0000 7ff6357fa700 1 -- 172.21.15.37:0/2644690334 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff63c04e6c0 con 0x7ff6401587d0 2023-10-06T04:40:35.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.484+0000 7ff64627a700 1 -- 172.21.15.37:0/2644690334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6400708a0 con 0x7ff6401587d0 2023-10-06T04:40:35.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.484+0000 7ff6357fa700 1 -- 172.21.15.37:0/2644690334 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4595 (secure 0 0 0) 0x7ff63c051ce0 con 0x7ff6401587d0 2023-10-06T04:40:35.490 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:35.491 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3094155806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3094155806},{"type":"v1","addr":"172.21.15.83:6837","nonce":3094155806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/968432746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":968432746},{"type":"v1","addr":"172.21.15.37:6833","nonce":968432746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2573831912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2573831912},{"type":"v1","addr":"172.21.15.37:6835","nonce":2573831912}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:16.392787+0000","modified":"2023-10-06T04:40:34.660873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":43,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6835/3283827040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3283827040},{"type":"v1","addr":"172.21.15.83:6835","nonce":3283827040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.488+0000 7ff64627a700 1 -- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff624060580 msgr2=0x7ff624062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.488+0000 7ff64627a700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff624060580 0x7ff624062a30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff630001200 tx=0x7ff630000bc0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.488+0000 7ff64627a700 1 -- 172.21.15.37:0/2644690334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401587d0 msgr2=0x7ff6400c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.488+0000 7ff64627a700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401587d0 0x7ff6400c8b80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0030c0 tx=0x7ff63c017000 comp rx=0 tx=0).stop 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.488+0000 7ff64627a700 1 -- 172.21.15.37:0/2644690334 shutdown_connections 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.488+0000 7ff64627a700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff624060580 0x7ff624062a30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.488+0000 7ff64627a700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff640158ba0 0x7ff640144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.488+0000 7ff64627a700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6401587d0 0x7ff6400c8b80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.488+0000 7ff64627a700 1 --2- 172.21.15.37:0/2644690334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff640068400 0x7ff6400c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.488+0000 7ff64627a700 1 -- 172.21.15.37:0/2644690334 >> 172.21.15.37:0/2644690334 conn(0x7ff6400cc5f0 msgr2=0x7ff6401571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:35.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.488+0000 7ff64627a700 1 -- 172.21.15.37:0/2644690334 shutdown_connections 2023-10-06T04:40:35.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:35.488+0000 7ff64627a700 1 -- 172.21.15.37:0/2644690334 wait complete. 2023-10-06T04:40:35.494 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2023-10-06T04:40:35.907 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:40:16.392787+0000', 'modified': '2023-10-06T04:40:34.660873+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 43, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5158}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5158': {'gid': 5158, 'name': 'd', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.83:6835/3283827040', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6834', 'nonce': 3283827040}, {'type': 'v1', 'addr': '172.21.15.83:6835', 'nonce': 3283827040}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:40:35.907 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:40:35.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T04:40:35.986 INFO:tasks.ceph.mds.d.smithi083.stderr:2023-10-06T04:40:35.984+0000 7f5509f99700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:40:36.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.020+0000 7f5e5946a700 1 Processor -- start 2023-10-06T04:40:36.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.020+0000 7f5e5946a700 1 -- start start 2023-10-06T04:40:36.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e5946a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e541501d0 0x7f5e541575b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e5946a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5e540cc2e0 0x7f5e540ca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e5946a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e540c9750 con 0x7f5e54157af0 2023-10-06T04:40:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e5946a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e540c9ff0 con 0x7f5e541501d0 2023-10-06T04:40:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e5946a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5415a7f0 con 0x7f5e540cc2e0 2023-10-06T04:40:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e527fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5e54157af0 0x7f5e540cbbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50682/0 (socket says 172.21.15.37:50682) 2023-10-06T04:40:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e52ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e541501d0 0x7f5e541575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e527fc700 1 -- 172.21.15.37:0/3899042901 learned_addr learned my addr 172.21.15.37:0/3899042901 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:36.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e537fe700 1 --2- 172.21.15.37:0/3899042901 >> v2:172.21.15.83:3300/0 conn(0x7f5e540cc2e0 0x7f5e540ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e51ffb700 1 -- 172.21.15.37:0/3899042901 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85035047 0 0) 0x7f5e540c9750 con 0x7f5e54157af0 2023-10-06T04:40:36.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e51ffb700 1 -- 172.21.15.37:0/3899042901 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e40003570 con 0x7f5e54157af0 2023-10-06T04:40:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e52ffd700 1 -- 172.21.15.37:0/3899042901 >> v2:172.21.15.83:3300/0 conn(0x7f5e540cc2e0 msgr2=0x7f5e540ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/3899042901 >> v2:172.21.15.83:3300/0 conn(0x7f5e540cc2e0 0x7f5e540ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e52ffd700 1 -- 172.21.15.37:0/3899042901 >> v1:172.21.15.37:6789/0 conn(0x7f5e54157af0 legacy=0x7f5e540cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e52ffd700 1 -- 172.21.15.37:0/3899042901 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e540c99a0 con 0x7f5e541501d0 2023-10-06T04:40:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e537fe700 1 --2- 172.21.15.37:0/3899042901 >> v2:172.21.15.83:3300/0 conn(0x7f5e540cc2e0 0x7f5e540ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/3899042901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e541501d0 0x7f5e541575b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5e5406d580 tx=0x7f5e3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e31c8a2d423982 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e51ffb700 1 -- 172.21.15.37:0/3899042901 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c011630 con 0x7f5e541501d0 2023-10-06T04:40:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e51ffb700 1 -- 172.21.15.37:0/3899042901 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c0117b0 con 0x7f5e541501d0 2023-10-06T04:40:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e51ffb700 1 -- 172.21.15.37:0/3899042901 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c011b70 con 0x7f5e541501d0 2023-10-06T04:40:36.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e5946a700 1 -- 172.21.15.37:0/3899042901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e541501d0 msgr2=0x7f5e541575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e5946a700 1 --2- 172.21.15.37:0/3899042901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e541501d0 0x7f5e541575b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5e5406d580 tx=0x7f5e3c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e5946a700 1 -- 172.21.15.37:0/3899042901 shutdown_connections 2023-10-06T04:40:36.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e5946a700 1 --2- 172.21.15.37:0/3899042901 >> v2:172.21.15.83:3300/0 conn(0x7f5e540cc2e0 0x7f5e540ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e5946a700 1 --2- 172.21.15.37:0/3899042901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e541501d0 0x7f5e541575b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.024+0000 7f5e5946a700 1 -- 172.21.15.37:0/3899042901 >> 172.21.15.37:0/3899042901 conn(0x7f5e540667b0 msgr2=0x7f5e54066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.028+0000 7f5e5946a700 1 -- 172.21.15.37:0/3899042901 shutdown_connections 2023-10-06T04:40:36.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.028+0000 7f5e5946a700 1 -- 172.21.15.37:0/3899042901 wait complete. 2023-10-06T04:40:36.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.028+0000 7f5e5946a700 1 Processor -- start 2023-10-06T04:40:36.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.028+0000 7f5e5946a700 1 -- start start 2023-10-06T04:40:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e5946a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e540cc2e0 0x7f5e540c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e5946a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e541501d0 0x7f5e54152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e5946a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e54157af0 0x7f5e5413a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e5946a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e54152b40 con 0x7f5e541501d0 2023-10-06T04:40:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e5946a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e541536c0 con 0x7f5e54157af0 2023-10-06T04:40:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e5946a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e54152d90 con 0x7f5e540cc2e0 2023-10-06T04:40:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e527fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e541501d0 0x7f5e54152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e527fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e541501d0 0x7f5e54152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34542/0 (socket says 172.21.15.37:34542) 2023-10-06T04:40:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e527fc700 1 -- 172.21.15.37:0/323633307 learned_addr learned my addr 172.21.15.37:0/323633307 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e537fe700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e54157af0 0x7f5e5413a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e540cc2e0 0x7f5e540c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e527fc700 1 -- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e540cc2e0 msgr2=0x7f5e540c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e527fc700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e540cc2e0 0x7f5e540c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e527fc700 1 -- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e54157af0 msgr2=0x7f5e5413a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e527fc700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e54157af0 0x7f5e5413a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e527fc700 1 -- 172.21.15.37:0/323633307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c009420 con 0x7f5e541501d0 2023-10-06T04:40:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e527fc700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e541501d0 0x7f5e54152060 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400cc70 tx=0x7f5e44001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e4affd700 1 -- 172.21.15.37:0/323633307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400a8a0 con 0x7f5e541501d0 2023-10-06T04:40:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e4affd700 1 -- 172.21.15.37:0/323633307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4400aa20 con 0x7f5e541501d0 2023-10-06T04:40:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e5946a700 1 -- 172.21.15.37:0/323633307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c009420 con 0x7f5e541501d0 2023-10-06T04:40:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e4affd700 1 -- 172.21.15.37:0/323633307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400ade0 con 0x7f5e541501d0 2023-10-06T04:40:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.032+0000 7f5e5946a700 1 -- 172.21.15.37:0/323633307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e54153350 con 0x7f5e541501d0 2023-10-06T04:40:36.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e4affd700 1 -- 172.21.15.37:0/323633307 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5e44007300 con 0x7f5e541501d0 2023-10-06T04:40:36.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e4affd700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e34060550 0x7f5e34062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e4affd700 1 -- 172.21.15.37:0/323633307 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f5e4407cdb0 con 0x7f5e541501d0 2023-10-06T04:40:36.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e34060550 0x7f5e34062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e5b713740 1 Processor -- start 2023-10-06T04:40:36.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e5b713740 1 -- start start 2023-10-06T04:40:36.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e34060550 0x7f5e34062a00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5e5406d580 tx=0x7f5e3c017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e5b713740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18ddae0 0x1b5ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e5b713740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18dd710 0x1b5f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e5b713740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 0x1b5f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e5b713740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a88f30 con 0x1928790 2023-10-06T04:40:36.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e5b713740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a84ed0 con 0x18dd710 2023-10-06T04:40:36.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e5b713740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a4b0b0 con 0x18ddae0 2023-10-06T04:40:36.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e537fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 0x1b5f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e537fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 0x1b5f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34558/0 (socket says 172.21.15.37:34558) 2023-10-06T04:40:36.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e527fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18dd710 0x1b5f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e537fe700 1 -- 172.21.15.37:0/3889162884 learned_addr learned my addr 172.21.15.37:0/3889162884 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:36.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/3889162884 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18ddae0 0x1b5ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e537fe700 1 -- 172.21.15.37:0/3889162884 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18ddae0 msgr2=0x1b5ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e537fe700 1 --2- 172.21.15.37:0/3889162884 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18ddae0 0x1b5ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e537fe700 1 -- 172.21.15.37:0/3889162884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18dd710 msgr2=0x1b5f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e537fe700 1 --2- 172.21.15.37:0/3889162884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18dd710 0x1b5f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e537fe700 1 -- 172.21.15.37:0/3889162884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19299e0 con 0x1928790 2023-10-06T04:40:36.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e537fe700 1 --2- 172.21.15.37:0/3889162884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 0x1b5f6b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009e10 tx=0x7f5e4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46a985592c67f0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.036+0000 7f5e33fff700 1 -- 172.21.15.37:0/3889162884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c011ca0 con 0x1928790 2023-10-06T04:40:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e33fff700 1 -- 172.21.15.37:0/3889162884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c011e00 con 0x1928790 2023-10-06T04:40:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e33fff700 1 -- 172.21.15.37:0/3889162884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c014650 con 0x1928790 2023-10-06T04:40:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 -- 172.21.15.37:0/3889162884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 msgr2=0x1b5f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 --2- 172.21.15.37:0/3889162884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 0x1b5f6b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009e10 tx=0x7f5e4c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 -- 172.21.15.37:0/3889162884 shutdown_connections 2023-10-06T04:40:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 --2- 172.21.15.37:0/3889162884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18dd710 0x1b5f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 --2- 172.21.15.37:0/3889162884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 0x1b5f6b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 --2- 172.21.15.37:0/3889162884 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18ddae0 0x1b5ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 -- 172.21.15.37:0/3889162884 >> 172.21.15.37:0/3889162884 conn(0x18ddeb0 msgr2=0x1b17060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 -- 172.21.15.37:0/3889162884 shutdown_connections 2023-10-06T04:40:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 -- 172.21.15.37:0/3889162884 wait complete. 2023-10-06T04:40:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 -- start start 2023-10-06T04:40:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 Processor -- start 2023-10-06T04:40:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18dd710 0x1b14c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18ddae0 0x1b151a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 0x1b156e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a4ad50 con 0x1928790 2023-10-06T04:40:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a23970 con 0x18ddae0 2023-10-06T04:40:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x18b4060 con 0x18dd710 2023-10-06T04:40:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.040+0000 7f5e5b713740 10 client.0 _ll_register_callbacks cb 0x1a27b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:40:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e537fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 0x1b156e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e537fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 0x1b156e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34574/0 (socket says 172.21.15.37:34574) 2023-10-06T04:40:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e537fe700 1 -- 172.21.15.37:0/1550753988 learned_addr learned my addr 172.21.15.37:0/1550753988 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18dd710 0x1b14c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e527fc700 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18ddae0 0x1b151a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e537fe700 1 -- 172.21.15.37:0/1550753988 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18dd710 msgr2=0x1b14c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e537fe700 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18dd710 0x1b14c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e537fe700 1 -- 172.21.15.37:0/1550753988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18ddae0 msgr2=0x1b151a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e537fe700 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18ddae0 0x1b151a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e537fe700 1 -- 172.21.15.37:0/1550753988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c009b40 con 0x1928790 2023-10-06T04:40:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e537fe700 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 0x1b156e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x1a82b50 tx=0x7f5e4c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86da1b0496e172ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e317fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:40:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e317fa700 1 -- 172.21.15.37:0/1550753988 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0099b0 con 0x1928790 2023-10-06T04:40:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e317fa700 1 -- 172.21.15.37:0/1550753988 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f5e4c018070 con 0x1928790 2023-10-06T04:40:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e5b713740 1 -- 172.21.15.37:0/1550753988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a23cc0 con 0x1928790 2023-10-06T04:40:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e317fa700 1 -- 172.21.15.37:0/1550753988 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e4c014ea0 con 0x1928790 2023-10-06T04:40:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e5b713740 10 client.5385 fetch_fsmap learned FSMap version 20 2023-10-06T04:40:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e5b713740 1 -- 172.21.15.37:0/1550753988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x1a53370 con 0x1928790 2023-10-06T04:40:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e317fa700 1 -- 172.21.15.37:0/1550753988 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a23cc0 con 0x1928790 2023-10-06T04:40:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e317fa700 1 -- 172.21.15.37:0/1550753988 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5e4c01c430 con 0x1928790 2023-10-06T04:40:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e5b713740 10 client.5385 fetch_fsmap finished waiting for FSMap version 20 2023-10-06T04:40:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e5b713740 10 client.5385 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:40:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e5b713740 20 client.5385 populate_metadata read hostname 'smithi037' 2023-10-06T04:40:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e5b713740 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.83:6834/3283827040,v1:172.21.15.83:6835/3283827040] conn(0x1b6b6a0 0x1b6da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e5b713740 4 client.5385 mds_command: new command op to 5158 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:40:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e5b713740 1 -- 172.21.15.37:0/1550753988 --> [v2:172.21.15.83:6834/3283827040,v1:172.21.15.83:6835/3283827040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a273e0 con 0x1b6b6a0 2023-10-06T04:40:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.83:6834/3283827040,v1:172.21.15.83:6835/3283827040] conn(0x1b6b6a0 0x1b6da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e317fa700 10 client.5385 ms_handle_connect on v2:172.21.15.83:6834/3283827040 2023-10-06T04:40:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.044+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.83:6834/3283827040,v1:172.21.15.83:6835/3283827040] conn(0x1b6b6a0 0x1b6da80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6f6d842f408395b server_cookie=e843a90dc317175 in_seq=0 out_seq=0 2023-10-06T04:40:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e317fa700 1 -- 172.21.15.37:0/1550753988 <== mds.0 v2:172.21.15.83:6834/3283827040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1a273e0 con 0x1b6b6a0 2023-10-06T04:40:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e317fa700 10 client.5385 handle_command_reply: tid=0 2023-10-06T04:40:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e5b713740 1 client.5385 shutdown 2023-10-06T04:40:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e5b713740 1 -- 172.21.15.37:0/1550753988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 msgr2=0x1b156e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e5b713740 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 0x1b156e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x1a82b50 tx=0x7f5e4c01c000 comp rx=0 tx=0).stop 2023-10-06T04:40:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e5b713740 1 -- 172.21.15.37:0/1550753988 shutdown_connections 2023-10-06T04:40:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e5b713740 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.83:6834/3283827040,v1:172.21.15.83:6835/3283827040] conn(0x1b6b6a0 0x1b6da80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e5b713740 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18ddae0 0x1b151a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e5b713740 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1928790 0x1b156e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e317fa700 0 client.5385 ms_handle_reset on v2:172.21.15.83:6834/3283827040 2023-10-06T04:40:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e5b713740 1 --2- 172.21.15.37:0/1550753988 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18dd710 0x1b14c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e5b713740 1 -- 172.21.15.37:0/1550753988 >> 172.21.15.37:0/1550753988 conn(0x18ddeb0 msgr2=0x1b3c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e5b713740 1 -- 172.21.15.37:0/1550753988 shutdown_connections 2023-10-06T04:40:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e5b713740 1 -- 172.21.15.37:0/1550753988 wait complete. 2023-10-06T04:40:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.048+0000 7f5e5b713740 20 client.5385 trim_cache size 0 max 16384 2023-10-06T04:40:36.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e5b713740 1 Processor -- start 2023-10-06T04:40:36.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e5b713740 1 -- start start 2023-10-06T04:40:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e5b713740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18dd710 0x1b12a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e5b713740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18ddae0 0x1b12f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e5b713740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1928790 0x1b3a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e5b713740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a83d60 con 0x18ddae0 2023-10-06T04:40:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e5b713740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a59610 con 0x1928790 2023-10-06T04:40:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e5b713740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a5a010 con 0x18dd710 2023-10-06T04:40:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e527fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18ddae0 0x1b12f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e537fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1928790 0x1b3a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e52ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18dd710 0x1b12a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e537fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1928790 0x1b3a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:43328/0 (socket says 172.21.15.37:43328) 2023-10-06T04:40:36.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e537fe700 1 -- 172.21.15.37:0/3508822704 learned_addr learned my addr 172.21.15.37:0/3508822704 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e527fc700 1 -- 172.21.15.37:0/3508822704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18dd710 msgr2=0x1b12a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e527fc700 1 --2- 172.21.15.37:0/3508822704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18dd710 0x1b12a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e527fc700 1 -- 172.21.15.37:0/3508822704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1928790 msgr2=0x1b3a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e527fc700 1 --2- 172.21.15.37:0/3508822704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1928790 0x1b3a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e527fc700 1 -- 172.21.15.37:0/3508822704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e541584d0 con 0x18ddae0 2023-10-06T04:40:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e537fe700 1 --2- 172.21.15.37:0/3508822704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1928790 0x1b3a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.068+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/3508822704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18dd710 0x1b12a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e527fc700 1 --2- 172.21.15.37:0/3508822704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18ddae0 0x1b12f50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5e4407b0c0 tx=0x7f5e44056040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d955ccc03a972091 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e48ff9700 1 -- 172.21.15.37:0/3508822704 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44050eb0 con 0x18ddae0 2023-10-06T04:40:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e48ff9700 1 -- 172.21.15.37:0/3508822704 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4404eff0 con 0x18ddae0 2023-10-06T04:40:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e48ff9700 1 -- 172.21.15.37:0/3508822704 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440560b0 con 0x18ddae0 2023-10-06T04:40:36.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e5b713740 1 -- 172.21.15.37:0/3508822704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18ddae0 msgr2=0x1b12f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e5b713740 1 --2- 172.21.15.37:0/3508822704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18ddae0 0x1b12f50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5e4407b0c0 tx=0x7f5e44056040 comp rx=0 tx=0).stop 2023-10-06T04:40:36.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e5b713740 1 -- 172.21.15.37:0/3508822704 shutdown_connections 2023-10-06T04:40:36.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e5b713740 1 --2- 172.21.15.37:0/3508822704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1928790 0x1b3a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e5b713740 1 --2- 172.21.15.37:0/3508822704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18ddae0 0x1b12f50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e5b713740 1 --2- 172.21.15.37:0/3508822704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x18dd710 0x1b12a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e5b713740 1 -- 172.21.15.37:0/3508822704 >> 172.21.15.37:0/3508822704 conn(0x18ddeb0 msgr2=0x1b3e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e5b713740 1 -- 172.21.15.37:0/3508822704 shutdown_connections 2023-10-06T04:40:36.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e5b713740 1 -- 172.21.15.37:0/3508822704 wait complete. 2023-10-06T04:40:36.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e5b713740 1 -- start start 2023-10-06T04:40:36.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.072+0000 7f5e5b713740 1 Processor -- start 2023-10-06T04:40:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18dd710 0x1b6ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18ddae0 0x1b6cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1928790 0x1b6d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a33c90 con 0x18dd710 2023-10-06T04:40:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a5a550 con 0x18ddae0 2023-10-06T04:40:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x195a650 con 0x1928790 2023-10-06T04:40:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 10 client.0 _ll_register_callbacks cb 0x1a50110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:40:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e52ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18dd710 0x1b6ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e52ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18dd710 0x1b6ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34588/0 (socket says 172.21.15.37:34588) 2023-10-06T04:40:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e52ffd700 1 -- 172.21.15.37:0/1056412603 learned_addr learned my addr 172.21.15.37:0/1056412603 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e537fe700 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1928790 0x1b6d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e527fc700 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18ddae0 0x1b6cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e52ffd700 1 -- 172.21.15.37:0/1056412603 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1928790 msgr2=0x1b6d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1928790 0x1b6d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e52ffd700 1 -- 172.21.15.37:0/1056412603 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18ddae0 msgr2=0x1b6cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18ddae0 0x1b6cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e52ffd700 1 -- 172.21.15.37:0/1056412603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e540c99a0 con 0x18dd710 2023-10-06T04:40:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e52ffd700 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18dd710 0x1b6ca40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c013000 tx=0x7f5e3c029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59aae44d5e3b097a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e317fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:40:36.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e317fa700 1 -- 172.21.15.37:0/1056412603 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c02c040 con 0x18dd710 2023-10-06T04:40:36.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e317fa700 1 -- 172.21.15.37:0/1056412603 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f5e3c035520 con 0x18dd710 2023-10-06T04:40:36.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 1 -- 172.21.15.37:0/1056412603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e4c011e00 con 0x18dd710 2023-10-06T04:40:36.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e317fa700 1 -- 172.21.15.37:0/1056412603 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e3c0358f0 con 0x18dd710 2023-10-06T04:40:36.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 10 client.5391 fetch_fsmap learned FSMap version 20 2023-10-06T04:40:36.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 1 -- 172.21.15.37:0/1056412603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x1a53370 con 0x18dd710 2023-10-06T04:40:36.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e317fa700 1 -- 172.21.15.37:0/1056412603 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c011e00 con 0x18dd710 2023-10-06T04:40:36.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e317fa700 1 -- 172.21.15.37:0/1056412603 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5e3c035a50 con 0x18dd710 2023-10-06T04:40:36.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 10 client.5391 fetch_fsmap finished waiting for FSMap version 20 2023-10-06T04:40:36.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 10 client.5391 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:40:36.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 20 client.5391 populate_metadata read hostname 'smithi037' 2023-10-06T04:40:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.83:6834/3283827040,v1:172.21.15.83:6835/3283827040] conn(0x1bbf1f0 0x1bc15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 4 client.5391 mds_command: new command op to 5158 tid=0[{"prefix": "status"}] 2023-10-06T04:40:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.076+0000 7f5e5b713740 1 -- 172.21.15.37:0/1056412603 --> [v2:172.21.15.83:6834/3283827040,v1:172.21.15.83:6835/3283827040] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1a59410 con 0x1bbf1f0 2023-10-06T04:40:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e527fc700 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.83:6834/3283827040,v1:172.21.15.83:6835/3283827040] conn(0x1bbf1f0 0x1bc15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e527fc700 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.83:6834/3283827040,v1:172.21.15.83:6835/3283827040] conn(0x1bbf1f0 0x1bc15d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=719f91937fa04bee server_cookie=de69e7e1fc4921f5 in_seq=0 out_seq=0 2023-10-06T04:40:36.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e317fa700 10 client.5391 ms_handle_connect on v2:172.21.15.83:6834/3283827040 2023-10-06T04:40:36.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e317fa700 1 -- 172.21.15.37:0/1056412603 <== mds.0 v2:172.21.15.83:6834/3283827040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1a59410 con 0x1bbf1f0 2023-10-06T04:40:36.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e317fa700 10 client.5391 handle_command_reply: tid=0 2023-10-06T04:40:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5b713740 1 client.5391 shutdown 2023-10-06T04:40:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5b713740 1 -- 172.21.15.37:0/1056412603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18dd710 msgr2=0x1b6ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5b713740 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18dd710 0x1b6ca40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c013000 tx=0x7f5e3c029040 comp rx=0 tx=0).stop 2023-10-06T04:40:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5b713740 1 -- 172.21.15.37:0/1056412603 shutdown_connections 2023-10-06T04:40:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5b713740 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.83:6834/3283827040,v1:172.21.15.83:6835/3283827040] conn(0x1bbf1f0 0x1bc15d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5b713740 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x18ddae0 0x1b6cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5b713740 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1928790 0x1b6d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5b713740 1 --2- 172.21.15.37:0/1056412603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18dd710 0x1b6ca40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e317fa700 0 client.5391 ms_handle_reset on v2:172.21.15.83:6834/3283827040 2023-10-06T04:40:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5b713740 1 -- 172.21.15.37:0/1056412603 >> 172.21.15.37:0/1056412603 conn(0x18ddeb0 msgr2=0x1b68300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5b713740 1 -- 172.21.15.37:0/1056412603 shutdown_connections 2023-10-06T04:40:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5b713740 1 -- 172.21.15.37:0/1056412603 wait complete. 2023-10-06T04:40:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5b713740 20 client.5391 trim_cache size 0 max 16384 2023-10-06T04:40:36.089 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:40:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "77bb67cc-15eb-432c-9ac1-b724f40102d2", 2023-10-06T04:40:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T04:40:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5158, 2023-10-06T04:40:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T04:40:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T04:40:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T04:40:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 4.4366226739999997, 2023-10-06T04:40:36.090 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 20, 2023-10-06T04:40:36.090 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 43, 2023-10-06T04:40:36.090 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 43, 2023-10-06T04:40:36.090 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 26.971199797000001 2023-10-06T04:40:36.090 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:40:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5946a700 1 -- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e34060550 msgr2=0x7f5e34062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5946a700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e34060550 0x7f5e34062a00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5e5406d580 tx=0x7f5e3c017000 comp rx=0 tx=0).stop 2023-10-06T04:40:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5946a700 1 -- 172.21.15.37:0/323633307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e541501d0 msgr2=0x7f5e54152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5946a700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e541501d0 0x7f5e54152060 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400cc70 tx=0x7f5e44001a70 comp rx=0 tx=0).stop 2023-10-06T04:40:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5946a700 1 -- 172.21.15.37:0/323633307 shutdown_connections 2023-10-06T04:40:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5946a700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e34060550 0x7f5e34062a00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5946a700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e54157af0 0x7f5e5413a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5946a700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e541501d0 0x7f5e54152060 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5946a700 1 --2- 172.21.15.37:0/323633307 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e540cc2e0 0x7f5e540c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5946a700 1 -- 172.21.15.37:0/323633307 >> 172.21.15.37:0/323633307 conn(0x7f5e540667b0 msgr2=0x7f5e54158b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5946a700 1 -- 172.21.15.37:0/323633307 shutdown_connections 2023-10-06T04:40:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.080+0000 7f5e5946a700 1 -- 172.21.15.37:0/323633307 wait complete. 2023-10-06T04:40:36.101 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000000.00000000 parent 2023-10-06T04:40:36.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f1417d46e80 1 Processor -- start 2023-10-06T04:40:36.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f1417d46e80 1 -- start start 2023-10-06T04:40:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f1417d46e80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789d1f8eb0 0x55789d1cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f1417d46e80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55789d29a520 0x55789d292da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f1417d46e80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55789d2a14e0 0x55789d2932e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f1417d46e80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789d115840 con 0x55789d1f8eb0 2023-10-06T04:40:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f1417d46e80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789d1154e0 con 0x55789d29a520 2023-10-06T04:40:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f1417d46e80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55789d10c270 con 0x55789d2a14e0 2023-10-06T04:40:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f141587d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789d1f8eb0 0x55789d1cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f141507c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55789d29a520 0x55789d292da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f141607e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55789d2a14e0 0x55789d2932e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f141507c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55789d29a520 0x55789d292da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:43358/0 (socket says 172.21.15.37:43358) 2023-10-06T04:40:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f141607e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55789d2a14e0 0x55789d2932e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:46958/0 (socket says 172.21.15.37:46958) 2023-10-06T04:40:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.128+0000 7f141507c700 1 -- 172.21.15.37:0/3539459509 learned_addr learned my addr 172.21.15.37:0/3539459509 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f141607e700 1 -- 172.21.15.37:0/3539459509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55789d29a520 msgr2=0x55789d292da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f141607e700 1 --2- 172.21.15.37:0/3539459509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55789d29a520 0x55789d292da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f141607e700 1 -- 172.21.15.37:0/3539459509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789d1f8eb0 msgr2=0x55789d1cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f141607e700 1 --2- 172.21.15.37:0/3539459509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789d1f8eb0 0x55789d1cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f141607e700 1 -- 172.21.15.37:0/3539459509 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141000a180 con 0x55789d2a14e0 2023-10-06T04:40:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f141607e700 1 --2- 172.21.15.37:0/3539459509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55789d2a14e0 0x55789d2932e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55789d1cf5d0 tx=0x7f1410014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51bbd1cdbca869fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f140ffff700 1 -- 172.21.15.37:0/3539459509 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14100032f0 con 0x55789d2a14e0 2023-10-06T04:40:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f140ffff700 1 -- 172.21.15.37:0/3539459509 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141000ed80 con 0x55789d2a14e0 2023-10-06T04:40:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f140ffff700 1 -- 172.21.15.37:0/3539459509 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141001c430 con 0x55789d2a14e0 2023-10-06T04:40:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f1417d46e80 1 -- 172.21.15.37:0/3539459509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55789d2a14e0 msgr2=0x55789d2932e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f1417d46e80 1 --2- 172.21.15.37:0/3539459509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55789d2a14e0 0x55789d2932e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55789d1cf5d0 tx=0x7f1410014000 comp rx=0 tx=0).stop 2023-10-06T04:40:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f1417d46e80 1 -- 172.21.15.37:0/3539459509 shutdown_connections 2023-10-06T04:40:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f1417d46e80 1 --2- 172.21.15.37:0/3539459509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55789d29a520 0x55789d292da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f1417d46e80 1 --2- 172.21.15.37:0/3539459509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55789d2a14e0 0x55789d2932e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f1417d46e80 1 --2- 172.21.15.37:0/3539459509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789d1f8eb0 0x55789d1cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f1417d46e80 1 -- 172.21.15.37:0/3539459509 >> 172.21.15.37:0/3539459509 conn(0x55789d1cf0f0 msgr2=0x55789d29f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f1417d46e80 1 -- 172.21.15.37:0/3539459509 shutdown_connections 2023-10-06T04:40:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f1417d46e80 1 -- 172.21.15.37:0/3539459509 wait complete. 2023-10-06T04:40:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f1417d46e80 1 Processor -- start 2023-10-06T04:40:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.132+0000 7f1417d46e80 1 -- start start 2023-10-06T04:40:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f1417d46e80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55789d1f8eb0 0x55789d297f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f1417d46e80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55789d29a520 0x55789d28e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f1417d46e80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789d2a14e0 0x55789d29ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f1417d46e80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789d28c1f0 con 0x55789d2a14e0 2023-10-06T04:40:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f1417d46e80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789d299250 con 0x55789d29a520 2023-10-06T04:40:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f1417d46e80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55789d298660 con 0x55789d1f8eb0 2023-10-06T04:40:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f141607e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789d2a14e0 0x55789d29ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f141507c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55789d29a520 0x55789d28e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f141607e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789d2a14e0 0x55789d29ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34604/0 (socket says 172.21.15.37:34604) 2023-10-06T04:40:36.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f141507c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55789d29a520 0x55789d28e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:43374/0 (socket says 172.21.15.37:43374) 2023-10-06T04:40:36.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f141587d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55789d1f8eb0 0x55789d297f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f141607e700 1 -- 172.21.15.37:0/3611473263 learned_addr learned my addr 172.21.15.37:0/3611473263 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f141607e700 1 -- 172.21.15.37:0/3611473263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55789d1f8eb0 msgr2=0x55789d297f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f141607e700 1 --2- 172.21.15.37:0/3611473263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55789d1f8eb0 0x55789d297f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f141607e700 1 -- 172.21.15.37:0/3611473263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55789d29a520 msgr2=0x55789d28e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f141607e700 1 --2- 172.21.15.37:0/3611473263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55789d29a520 0x55789d28e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f141607e700 1 -- 172.21.15.37:0/3611473263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55789d13e040 con 0x55789d2a14e0 2023-10-06T04:40:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f141607e700 1 --2- 172.21.15.37:0/3611473263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789d2a14e0 0x55789d29ac50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1410010000 tx=0x7f141001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f140e7fc700 1 -- 172.21.15.37:0/3611473263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141000e9f0 con 0x55789d2a14e0 2023-10-06T04:40:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f140e7fc700 1 -- 172.21.15.37:0/3611473263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141001c430 con 0x55789d2a14e0 2023-10-06T04:40:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f1417d46e80 1 -- 172.21.15.37:0/3611473263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55789d124250 con 0x55789d2a14e0 2023-10-06T04:40:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f140e7fc700 1 -- 172.21.15.37:0/3611473263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410025660 con 0x55789d2a14e0 2023-10-06T04:40:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.136+0000 7f1417d46e80 1 -- 172.21.15.37:0/3611473263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55789d117770 con 0x55789d2a14e0 2023-10-06T04:40:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.140+0000 7f140e7fc700 1 -- 172.21.15.37:0/3611473263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1410003040 con 0x55789d2a14e0 2023-10-06T04:40:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.140+0000 7f140e7fc700 1 --2- 172.21.15.37:0/3611473263 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f13f805eee0 0x7f13f8061390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.140+0000 7f140e7fc700 1 -- 172.21.15.37:0/3611473263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f141007ec90 con 0x55789d2a14e0 2023-10-06T04:40:36.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.140+0000 7f141587d700 1 --2- 172.21.15.37:0/3611473263 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f13f805eee0 0x7f13f8061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.140+0000 7f1417d46e80 1 --2- 172.21.15.37:0/3611473263 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x55789d2996c0 0x55789d29d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.140+0000 7f1417d46e80 1 -- 172.21.15.37:0/3611473263 --> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] -- osd_op(unknown.0.0:1 6.10 6:0cf6ad0f:::10000000000.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43) v8 -- 0x55789d28ebb0 con 0x55789d2996c0 2023-10-06T04:40:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.140+0000 7f141507c700 1 --2- 172.21.15.37:0/3611473263 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x55789d2996c0 0x55789d29d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.140+0000 7f141587d700 1 --2- 172.21.15.37:0/3611473263 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f13f805eee0 0x7f13f8061390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1408000fb0 tx=0x7f1408001790 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f141507c700 1 --2- 172.21.15.37:0/3611473263 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x55789d2996c0 0x55789d29d220 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f141507c700 1 -- 172.21.15.37:0/3611473263 <== osd.0 v2:172.21.15.37:6816/33416 1 ==== osd_op_reply(1 10000000000.00000000 [rmxattr] v43'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f1400012040 con 0x55789d2996c0 2023-10-06T04:40:36.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f1417d46e80 1 -- 172.21.15.37:0/3611473263 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x55789d2996c0 msgr2=0x55789d29d220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f1417d46e80 1 --2- 172.21.15.37:0/3611473263 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x55789d2996c0 0x55789d29d220 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f1417d46e80 1 -- 172.21.15.37:0/3611473263 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f13f805eee0 msgr2=0x7f13f8061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f1417d46e80 1 --2- 172.21.15.37:0/3611473263 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f13f805eee0 0x7f13f8061390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1408000fb0 tx=0x7f1408001790 comp rx=0 tx=0).stop 2023-10-06T04:40:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f1417d46e80 1 -- 172.21.15.37:0/3611473263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789d2a14e0 msgr2=0x55789d29ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f1417d46e80 1 --2- 172.21.15.37:0/3611473263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789d2a14e0 0x55789d29ac50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1410010000 tx=0x7f141001d000 comp rx=0 tx=0).stop 2023-10-06T04:40:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f141607e700 1 -- 172.21.15.37:0/3611473263 reap_dead start 2023-10-06T04:40:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f1417d46e80 1 -- 172.21.15.37:0/3611473263 shutdown_connections 2023-10-06T04:40:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f1417d46e80 1 -- 172.21.15.37:0/3611473263 >> 172.21.15.37:0/3611473263 conn(0x55789d1cf0f0 msgr2=0x55789d216e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f1417d46e80 1 -- 172.21.15.37:0/3611473263 shutdown_connections 2023-10-06T04:40:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.144+0000 7f1417d46e80 1 -- 172.21.15.37:0/3611473263 wait complete. 2023-10-06T04:40:36.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:40:36.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.260+0000 7eff176bd700 1 Processor -- start 2023-10-06T04:40:36.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.260+0000 7eff176bd700 1 -- start start 2023-10-06T04:40:36.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff176bd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7eff101531e0 0x7eff101535b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff176bd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff100ccf80 0x7eff1015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff176bd700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff10153af0 con 0x7eff1015cbd0 2023-10-06T04:40:36.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff176bd700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff100cd3e0 con 0x7eff100ccf80 2023-10-06T04:40:36.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff176bd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1015b1e0 con 0x7eff101531e0 2023-10-06T04:40:36.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff15c5a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff100ccf80 0x7eff1015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff14c58700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7eff1015cbd0 0x7eff100cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50692/0 (socket says 172.21.15.37:50692) 2023-10-06T04:40:36.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff14c58700 1 -- 172.21.15.37:0/133482363 learned_addr learned my addr 172.21.15.37:0/133482363 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:36.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff15459700 1 --2- 172.21.15.37:0/133482363 >> v2:172.21.15.83:3300/0 conn(0x7eff101531e0 0x7eff101535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff15c5a700 1 -- 172.21.15.37:0/133482363 >> v2:172.21.15.83:3300/0 conn(0x7eff101531e0 msgr2=0x7eff101535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff15c5a700 1 --2- 172.21.15.37:0/133482363 >> v2:172.21.15.83:3300/0 conn(0x7eff101531e0 0x7eff101535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff15c5a700 1 -- 172.21.15.37:0/133482363 >> v1:172.21.15.37:6789/0 conn(0x7eff1015cbd0 legacy=0x7eff100cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff15c5a700 1 -- 172.21.15.37:0/133482363 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1015d580 con 0x7eff100ccf80 2023-10-06T04:40:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff07fff700 1 -- 172.21.15.37:0/133482363 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936103986 0 0) 0x7eff10153af0 con 0x7eff1015cbd0 2023-10-06T04:40:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff15c5a700 1 --2- 172.21.15.37:0/133482363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff100ccf80 0x7eff1015d040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7eff100890b0 tx=0x7eff08009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bbda087ee0ad0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff07fff700 1 -- 172.21.15.37:0/133482363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800e070 con 0x7eff100ccf80 2023-10-06T04:40:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff07fff700 1 -- 172.21.15.37:0/133482363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0800bb60 con 0x7eff100ccf80 2023-10-06T04:40:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.264+0000 7eff07fff700 1 -- 172.21.15.37:0/133482363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08012430 con 0x7eff100ccf80 2023-10-06T04:40:36.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.268+0000 7eff176bd700 1 -- 172.21.15.37:0/133482363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff100ccf80 msgr2=0x7eff1015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.268+0000 7eff176bd700 1 --2- 172.21.15.37:0/133482363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff100ccf80 0x7eff1015d040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7eff100890b0 tx=0x7eff08009780 comp rx=0 tx=0).stop 2023-10-06T04:40:36.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.268+0000 7eff176bd700 1 -- 172.21.15.37:0/133482363 shutdown_connections 2023-10-06T04:40:36.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.268+0000 7eff176bd700 1 --2- 172.21.15.37:0/133482363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff100ccf80 0x7eff1015d040 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.268+0000 7eff176bd700 1 --2- 172.21.15.37:0/133482363 >> v2:172.21.15.83:3300/0 conn(0x7eff101531e0 0x7eff101535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.268+0000 7eff176bd700 1 -- 172.21.15.37:0/133482363 >> 172.21.15.37:0/133482363 conn(0x7eff10087ab0 msgr2=0x7eff10067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.268+0000 7eff176bd700 1 -- 172.21.15.37:0/133482363 shutdown_connections 2023-10-06T04:40:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.268+0000 7eff176bd700 1 -- 172.21.15.37:0/133482363 wait complete. 2023-10-06T04:40:36.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.268+0000 7eff176bd700 1 Processor -- start 2023-10-06T04:40:36.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.268+0000 7eff176bd700 1 -- start start 2023-10-06T04:40:36.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff176bd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff101531e0 0x7eff100cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff176bd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff1015cbd0 0x7eff100c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff176bd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff100c9040 0x7eff100c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff176bd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff100c7b00 con 0x7eff100c9040 2023-10-06T04:40:36.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff176bd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff100c9a20 con 0x7eff101531e0 2023-10-06T04:40:36.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff176bd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff100c6e80 con 0x7eff1015cbd0 2023-10-06T04:40:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff15c5a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff100c9040 0x7eff100c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff15c5a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff100c9040 0x7eff100c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34626/0 (socket says 172.21.15.37:34626) 2023-10-06T04:40:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff15c5a700 1 -- 172.21.15.37:0/1250168203 learned_addr learned my addr 172.21.15.37:0/1250168203 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff15459700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff101531e0 0x7eff100cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff14c58700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff1015cbd0 0x7eff100c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff15c5a700 1 -- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff1015cbd0 msgr2=0x7eff100c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff15c5a700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff1015cbd0 0x7eff100c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff15c5a700 1 -- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff101531e0 msgr2=0x7eff100cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff15c5a700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff101531e0 0x7eff100cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff15c5a700 1 -- 172.21.15.37:0/1250168203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08009a20 con 0x7eff100c9040 2023-10-06T04:40:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff15c5a700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff100c9040 0x7eff100c94e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7eff080099f0 tx=0x7eff08019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff057fa700 1 -- 172.21.15.37:0/1250168203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08027470 con 0x7eff100c9040 2023-10-06T04:40:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff057fa700 1 -- 172.21.15.37:0/1250168203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff08027610 con 0x7eff100c9040 2023-10-06T04:40:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff176bd700 1 -- 172.21.15.37:0/1250168203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff100c7160 con 0x7eff100c9040 2023-10-06T04:40:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.272+0000 7eff057fa700 1 -- 172.21.15.37:0/1250168203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff080279d0 con 0x7eff100c9040 2023-10-06T04:40:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.276+0000 7eff176bd700 1 -- 172.21.15.37:0/1250168203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff100c7720 con 0x7eff100c9040 2023-10-06T04:40:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.276+0000 7eff176bd700 1 -- 172.21.15.37:0/1250168203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff100c7c40 con 0x7eff100c9040 2023-10-06T04:40:36.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.276+0000 7eff057fa700 1 -- 172.21.15.37:0/1250168203 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7eff08024070 con 0x7eff100c9040 2023-10-06T04:40:36.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.276+0000 7eff057fa700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efef4060550 0x7efef4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.276+0000 7eff057fa700 1 -- 172.21.15.37:0/1250168203 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7eff0807f140 con 0x7eff100c9040 2023-10-06T04:40:36.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.280+0000 7eff15459700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efef4060550 0x7efef4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.280+0000 7eff15459700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efef4060550 0x7efef4062a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009db0 tx=0x7eff0c0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.284+0000 7eff057fa700 1 -- 172.21.15.37:0/1250168203 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7eff100c7c40 con 0x7eff100c9040 2023-10-06T04:40:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.484+0000 7eff176bd700 1 -- 172.21.15.37:0/1250168203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff100c7c40 con 0x7eff100c9040 2023-10-06T04:40:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.484+0000 7eff057fa700 1 -- 172.21.15.37:0/1250168203 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+73 (secure 0 0 0) 0x7eff100c7c40 con 0x7eff100c9040 2023-10-06T04:40:36.490 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:40:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.488+0000 7eff176bd700 1 -- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efef4060550 msgr2=0x7efef4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.488+0000 7eff176bd700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efef4060550 0x7efef4062a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009db0 tx=0x7eff0c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.488+0000 7eff176bd700 1 -- 172.21.15.37:0/1250168203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff100c9040 msgr2=0x7eff100c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.488+0000 7eff176bd700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff100c9040 0x7eff100c94e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7eff080099f0 tx=0x7eff08019000 comp rx=0 tx=0).stop 2023-10-06T04:40:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.488+0000 7eff176bd700 1 -- 172.21.15.37:0/1250168203 shutdown_connections 2023-10-06T04:40:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.488+0000 7eff176bd700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efef4060550 0x7efef4062a00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.488+0000 7eff176bd700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff100c9040 0x7eff100c94e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.488+0000 7eff176bd700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff1015cbd0 0x7eff100c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.488+0000 7eff176bd700 1 --2- 172.21.15.37:0/1250168203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff101531e0 0x7eff100cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.488+0000 7eff176bd700 1 -- 172.21.15.37:0/1250168203 >> 172.21.15.37:0/1250168203 conn(0x7eff100ccf80 msgr2=0x7eff100c5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.488+0000 7eff176bd700 1 -- 172.21.15.37:0/1250168203 shutdown_connections 2023-10-06T04:40:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:36.488+0000 7eff176bd700 1 -- 172.21.15.37:0/1250168203 wait complete. 2023-10-06T04:40:36.505 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:40:36.505 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:40:36.505 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T04:40:36.505 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:40:36.505 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:36.505 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:40:36.505 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:40:36.505 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:40:36.505 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:40:36.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:36.506 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T04:40:36.513 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:40:36.513 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:40:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:40:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:40:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:36.514 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:40:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:36.514 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:40:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T04:40:36.514 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42511sec preferred_lft 42511sec 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:e0:81:f4:d2 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:7a:01:84:5a:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:36.515 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:40:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::f0f6:45ff:fe62:bcd0/64 scope link 2023-10-06T04:40:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:36.516 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:40:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:7a:01:84:5a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:40:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a47a:1ff:fe84:5afc/64 scope link 2023-10-06T04:40:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:36.516 INFO:teuthology.orchestra.run.smithi037.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:40:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether fa:90:64:f2:f5:58 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:40:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::f890:64ff:fef2:f558/64 scope link 2023-10-06T04:40:36.516 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:36.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:36.517 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:40:36.529 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T04:40:36.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:36.531 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T04:40:36.580 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T04:40:36.580 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:40:36.581 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T04:40:36.581 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T04:40:36.581 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T04:40:36.581 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:40:36.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:36.581 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:40:36.581 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:40:36.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:40:36.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:40:36.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:40:36.582 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:40:36.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:36.621 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:40:36.628 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:40:36.628 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:40:36.628 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:40:36.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:36.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T04:40:36.642 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T04:40:36.642 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:40:36.642 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:36.648 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:40:36.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:40:36.648 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:36.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:40:36.715 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:40:36.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:40:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:40:36.726 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:40:36.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:36.726 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:40:36.731 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T04:40:36.731 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T04:40:36.773 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:40:36.791 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:40:36.791 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:40:36.801 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:40:36.803 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:40:36.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:36.803 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:40:36.858 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T04:40:36.852+0000 7efeb44df380 -1 init, newargv = 0x556e39ec79b0 newargc=15 2023-10-06T04:40:36.859 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[43140]: starting ceph client 2023-10-06T04:40:36.868 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[43140]: starting fuse 2023-10-06T04:40:37.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:40:37.973 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:40:37.973 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:40:37.988 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:40:37.989 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:40:37.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:37.990 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:40:38.038 INFO:teuthology.orchestra.run.smithi037.stdout:52 2023-10-06T04:40:38.039 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T04:40:38.039 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:40:38.039 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T04:40:38.039 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T04:40:38.039 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T04:40:38.039 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T04:40:38.039 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:40:38.039 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T04:40:38.040 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T04:40:38.041 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T04:40:38.041 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T04:40:38.041 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T04:40:38.041 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T04:40:38.041 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:40:38.041 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T04:40:38.041 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T04:40:38.127 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.43140.asok 2023-10-06T04:40:38.311 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43140.asok 2023-10-06T04:40:38.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:38.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43140.asok status 2023-10-06T04:40:38.408 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:40:38.409 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T04:40:38.409 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T04:40:38.409 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T04:40:38.409 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T04:40:38.409 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T04:40:38.409 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T04:40:38.409 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "43140", 2023-10-06T04:40:38.409 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T04:40:38.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:38.409 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T04:40:38.410 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T04:40:38.410 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5412, 2023-10-06T04:40:38.410 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T04:40:38.410 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T04:40:38.410 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T04:40:38.410 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 5412 2023-10-06T04:40:38.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:38.410 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T04:40:38.410 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T04:40:38.410 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:40:38.410 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 837592789 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 837592789 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.5412 192.168.0.1:0/837592789", 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/837592789", 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 20, 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 43, 2023-10-06T04:40:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T04:40:38.412 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T04:40:38.412 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T04:40:38.412 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:40:38.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:38.419 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T04:40:38.419 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:38.427 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T04:40:38.427 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:38.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:38.427 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:38.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:38.438 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls testdir1) 2023-10-06T04:40:38.453 INFO:tasks.ceph.mds.d.smithi083.stderr:2023-10-06T04:40:38.448+0000 7f5506792700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-10-06T04:40:38.454 INFO:teuthology.orchestra.run.smithi037.stdout:testfile 2023-10-06T04:40:38.456 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7facaee2a700 1 Processor -- start 2023-10-06T04:40:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7facaee2a700 1 -- start start 2023-10-06T04:40:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7facaee2a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faca80ab5a0 0x7faca80acd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7facaee2a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faca80aaa90 0x7faca80ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7facaee2a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca80ac6f0 con 0x7faca80aa6c0 2023-10-06T04:40:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7facaee2a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca80abb20 con 0x7faca80aaa90 2023-10-06T04:40:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7facaee2a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca80abdc0 con 0x7faca80ab5a0 2023-10-06T04:40:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7facacbc6700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faca80aa6c0 0x7faca81561f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50704/0 (socket says 172.21.15.37:50704) 2023-10-06T04:40:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7facacbc6700 1 -- 172.21.15.37:0/4213497629 learned_addr learned my addr 172.21.15.37:0/4213497629 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7faca7fff700 1 --2- 172.21.15.37:0/4213497629 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faca80ab5a0 0x7faca80acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7facad3c7700 1 --2- 172.21.15.37:0/4213497629 >> v2:172.21.15.83:3300/0 conn(0x7faca80aaa90 0x7faca80ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7faca77fe700 1 -- 172.21.15.37:0/4213497629 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363821392 0 0) 0x7faca80ac6f0 con 0x7faca80aa6c0 2023-10-06T04:40:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7faca77fe700 1 -- 172.21.15.37:0/4213497629 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac94003570 con 0x7faca80aa6c0 2023-10-06T04:40:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7faca7fff700 1 -- 172.21.15.37:0/4213497629 >> v2:172.21.15.83:3300/0 conn(0x7faca80aaa90 msgr2=0x7faca80ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7faca7fff700 1 --2- 172.21.15.37:0/4213497629 >> v2:172.21.15.83:3300/0 conn(0x7faca80aaa90 0x7faca80ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7faca7fff700 1 -- 172.21.15.37:0/4213497629 >> v1:172.21.15.37:6789/0 conn(0x7faca80aa6c0 legacy=0x7faca81561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7faca77fe700 1 -- 172.21.15.37:0/4213497629 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2013913987 0 0) 0x7fac94003570 con 0x7faca80aa6c0 2023-10-06T04:40:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7faca7fff700 1 -- 172.21.15.37:0/4213497629 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca80ac0a0 con 0x7faca80ab5a0 2023-10-06T04:40:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7faca7fff700 1 --2- 172.21.15.37:0/4213497629 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faca80ab5a0 0x7faca80acd70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faca0009e60 tx=0x7faca0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afe958b641dbc9e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7faca77fe700 1 -- 172.21.15.37:0/4213497629 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca000e070 con 0x7faca80ab5a0 2023-10-06T04:40:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7faca77fe700 1 -- 172.21.15.37:0/4213497629 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca000b7a0 con 0x7faca80ab5a0 2023-10-06T04:40:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.604+0000 7faca77fe700 1 -- 172.21.15.37:0/4213497629 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90001470 con 0x7faca80ab5a0 2023-10-06T04:40:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 -- 172.21.15.37:0/4213497629 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faca80ab5a0 msgr2=0x7faca80acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 --2- 172.21.15.37:0/4213497629 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faca80ab5a0 0x7faca80acd70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faca0009e60 tx=0x7faca0009780 comp rx=0 tx=0).stop 2023-10-06T04:40:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 -- 172.21.15.37:0/4213497629 shutdown_connections 2023-10-06T04:40:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 --2- 172.21.15.37:0/4213497629 >> v2:172.21.15.83:3300/0 conn(0x7faca80aaa90 0x7faca80ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 --2- 172.21.15.37:0/4213497629 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faca80ab5a0 0x7faca80acd70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 -- 172.21.15.37:0/4213497629 >> 172.21.15.37:0/4213497629 conn(0x7faca80ccc60 msgr2=0x7faca806c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 -- 172.21.15.37:0/4213497629 shutdown_connections 2023-10-06T04:40:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 -- 172.21.15.37:0/4213497629 wait complete. 2023-10-06T04:40:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 Processor -- start 2023-10-06T04:40:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 -- start start 2023-10-06T04:40:38.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faca80aa6c0 0x7faca81648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca80aaa90 0x7faca8167540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faca80ab5a0 0x7faca806af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca806ba50 con 0x7faca80aaa90 2023-10-06T04:40:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca8096520 con 0x7faca80aa6c0 2023-10-06T04:40:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.608+0000 7facaee2a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca8095bf0 con 0x7faca80ab5a0 2023-10-06T04:40:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca80aaa90 0x7faca8167540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca80aaa90 0x7faca8167540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34628/0 (socket says 172.21.15.37:34628) 2023-10-06T04:40:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca7fff700 1 -- 172.21.15.37:0/562077247 learned_addr learned my addr 172.21.15.37:0/562077247 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7facacbc6700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faca80aa6c0 0x7faca81648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7facad3c7700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faca80ab5a0 0x7faca806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca7fff700 1 -- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faca80ab5a0 msgr2=0x7faca806af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca7fff700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faca80ab5a0 0x7faca806af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca7fff700 1 -- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faca80aa6c0 msgr2=0x7faca81648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca7fff700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faca80aa6c0 0x7faca81648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca7fff700 1 -- 172.21.15.37:0/562077247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca0009a20 con 0x7faca80aaa90 2023-10-06T04:40:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7facacbc6700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faca80aa6c0 0x7faca81648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca7fff700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca80aaa90 0x7faca8167540 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faca80abf00 tx=0x7faca0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca4ff9700 1 -- 172.21.15.37:0/562077247 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0012a40 con 0x7faca80aaa90 2023-10-06T04:40:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca4ff9700 1 -- 172.21.15.37:0/562077247 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca0012bc0 con 0x7faca80aaa90 2023-10-06T04:40:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7facaee2a700 1 -- 172.21.15.37:0/562077247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca8095ed0 con 0x7faca80aaa90 2023-10-06T04:40:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca4ff9700 1 -- 172.21.15.37:0/562077247 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca001e430 con 0x7faca80aaa90 2023-10-06T04:40:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7facaee2a700 1 -- 172.21.15.37:0/562077247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca806a2b0 con 0x7faca80aaa90 2023-10-06T04:40:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7facaee2a700 1 -- 172.21.15.37:0/562077247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca8096690 con 0x7faca80aaa90 2023-10-06T04:40:38.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.612+0000 7faca4ff9700 1 -- 172.21.15.37:0/562077247 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faca001e7a0 con 0x7faca80aaa90 2023-10-06T04:40:38.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.616+0000 7faca4ff9700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fac88060550 0x7fac88062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.616+0000 7faca4ff9700 1 -- 172.21.15.37:0/562077247 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7faca007e680 con 0x7faca80aaa90 2023-10-06T04:40:38.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.616+0000 7facacbc6700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fac88060550 0x7fac88062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.616+0000 7facacbc6700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fac88060550 0x7fac88062a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac900011e0 tx=0x7fac900015e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.624+0000 7faca4ff9700 1 -- 172.21.15.37:0/562077247 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faca004e980 con 0x7faca80aaa90 2023-10-06T04:40:38.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.824+0000 7facaee2a700 1 -- 172.21.15.37:0/562077247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faca8070ee0 con 0x7faca80aaa90 2023-10-06T04:40:38.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.824+0000 7faca4ff9700 1 -- 172.21.15.37:0/562077247 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4595 (secure 0 0 0) 0x7faca0051fa0 con 0x7faca80aaa90 2023-10-06T04:40:38.830 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:38.831 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3094155806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3094155806},{"type":"v1","addr":"172.21.15.83:6837","nonce":3094155806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/968432746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":968432746},{"type":"v1","addr":"172.21.15.37:6833","nonce":968432746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2573831912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2573831912},{"type":"v1","addr":"172.21.15.37:6835","nonce":2573831912}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:16.392787+0000","modified":"2023-10-06T04:40:34.660873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":43,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6835/3283827040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3283827040},{"type":"v1","addr":"172.21.15.83:6835","nonce":3283827040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:38.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.828+0000 7facaee2a700 1 -- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fac88060550 msgr2=0x7fac88062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.828+0000 7facaee2a700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fac88060550 0x7fac88062a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac900011e0 tx=0x7fac900015e0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.828+0000 7facaee2a700 1 -- 172.21.15.37:0/562077247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca80aaa90 msgr2=0x7faca8167540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.828+0000 7facaee2a700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca80aaa90 0x7faca8167540 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faca80abf00 tx=0x7faca0018000 comp rx=0 tx=0).stop 2023-10-06T04:40:38.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.828+0000 7facaee2a700 1 -- 172.21.15.37:0/562077247 shutdown_connections 2023-10-06T04:40:38.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.828+0000 7facaee2a700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fac88060550 0x7fac88062a00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.828+0000 7facaee2a700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faca80ab5a0 0x7faca806af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.828+0000 7facaee2a700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca80aaa90 0x7faca8167540 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.828+0000 7facaee2a700 1 --2- 172.21.15.37:0/562077247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faca80aa6c0 0x7faca81648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.828+0000 7facaee2a700 1 -- 172.21.15.37:0/562077247 >> 172.21.15.37:0/562077247 conn(0x7faca80ccc60 msgr2=0x7faca81582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:38.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.828+0000 7facaee2a700 1 -- 172.21.15.37:0/562077247 shutdown_connections 2023-10-06T04:40:38.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:38.828+0000 7facaee2a700 1 -- 172.21.15.37:0/562077247 wait complete. 2023-10-06T04:40:38.834 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2023-10-06T04:40:38.844 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-10-06T04:40:38.979 INFO:teuthology.orchestra.run.smithi083.stdout:{"message":"","return_code":0} 2023-10-06T04:40:38.979 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T04:40:38.979 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 parent 2023-10-06T04:40:39.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f42752dce80 1 Processor -- start 2023-10-06T04:40:39.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f42752dce80 1 -- start start 2023-10-06T04:40:39.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f42752dce80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 0x557a206c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f42752dce80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a206c2960 0x557a2061d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f42752dce80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557a206c2d30 0x557a2061cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f42752dce80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a20535840 con 0x557a20618d50 2023-10-06T04:40:39.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f42752dce80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a205354e0 con 0x557a206c2960 2023-10-06T04:40:39.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f42752dce80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a2052c270 con 0x557a206c2d30 2023-10-06T04:40:39.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4272e13700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 0x557a206c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4272e13700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 0x557a206c0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46306/0 (socket says 172.21.15.37:46306) 2023-10-06T04:40:39.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4272e13700 1 -- 172.21.15.37:0/3345795812 learned_addr learned my addr 172.21.15.37:0/3345795812 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:39.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4272612700 1 --2- 172.21.15.37:0/3345795812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a206c2960 0x557a2061d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4273614700 1 --2- 172.21.15.37:0/3345795812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557a206c2d30 0x557a2061cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4272e13700 1 -- 172.21.15.37:0/3345795812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557a206c2d30 msgr2=0x557a2061cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:39.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4272e13700 1 --2- 172.21.15.37:0/3345795812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557a206c2d30 0x557a2061cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4272e13700 1 -- 172.21.15.37:0/3345795812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a206c2960 msgr2=0x557a2061d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:39.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4272e13700 1 --2- 172.21.15.37:0/3345795812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a206c2960 0x557a2061d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4272e13700 1 -- 172.21.15.37:0/3345795812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c005db0 con 0x557a20618d50 2023-10-06T04:40:39.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4273614700 1 --2- 172.21.15.37:0/3345795812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557a206c2d30 0x557a2061cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:39.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4272e13700 1 --2- 172.21.15.37:0/3345795812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 0x557a206c0c90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f426c00a7b0 tx=0x7f426c005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14d784364f317aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:39.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4271610700 1 -- 172.21.15.37:0/3345795812 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c00f070 con 0x557a20618d50 2023-10-06T04:40:39.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4271610700 1 -- 172.21.15.37:0/3345795812 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c008950 con 0x557a20618d50 2023-10-06T04:40:39.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f4271610700 1 -- 172.21.15.37:0/3345795812 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c008cf0 con 0x557a20618d50 2023-10-06T04:40:39.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.012+0000 7f42752dce80 1 -- 172.21.15.37:0/3345795812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 msgr2=0x557a206c0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.016+0000 7f42752dce80 1 --2- 172.21.15.37:0/3345795812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 0x557a206c0c90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f426c00a7b0 tx=0x7f426c005c80 comp rx=0 tx=0).stop 2023-10-06T04:40:39.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.016+0000 7f42752dce80 1 -- 172.21.15.37:0/3345795812 shutdown_connections 2023-10-06T04:40:39.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.016+0000 7f42752dce80 1 --2- 172.21.15.37:0/3345795812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a206c2960 0x557a2061d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.016+0000 7f42752dce80 1 --2- 172.21.15.37:0/3345795812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557a206c2d30 0x557a2061cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.016+0000 7f42752dce80 1 --2- 172.21.15.37:0/3345795812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 0x557a206c0c90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.016+0000 7f42752dce80 1 -- 172.21.15.37:0/3345795812 >> 172.21.15.37:0/3345795812 conn(0x557a205ef6c0 msgr2=0x557a205e8540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:39.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.016+0000 7f42752dce80 1 -- 172.21.15.37:0/3345795812 shutdown_connections 2023-10-06T04:40:39.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.016+0000 7f42752dce80 1 -- 172.21.15.37:0/3345795812 wait complete. 2023-10-06T04:40:39.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.016+0000 7f42752dce80 1 Processor -- start 2023-10-06T04:40:39.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.016+0000 7f42752dce80 1 -- start start 2023-10-06T04:40:39.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.016+0000 7f42752dce80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 0x557a2061cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.016+0000 7f42752dce80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a206c2960 0x557a206bf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f42752dce80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557a206c2d30 0x557a206bf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f42752dce80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a20632f70 con 0x557a20618d50 2023-10-06T04:40:39.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f42752dce80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a206c5c20 con 0x557a206c2960 2023-10-06T04:40:39.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f42752dce80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a206329b0 con 0x557a206c2d30 2023-10-06T04:40:39.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f4272e13700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 0x557a2061cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f4272e13700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 0x557a2061cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46316/0 (socket says 172.21.15.37:46316) 2023-10-06T04:40:39.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f4272e13700 1 -- 172.21.15.37:0/410111374 learned_addr learned my addr 172.21.15.37:0/410111374 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:39.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f4272612700 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a206c2960 0x557a206bf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f4273614700 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557a206c2d30 0x557a206bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f4273614700 1 -- 172.21.15.37:0/410111374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a206c2960 msgr2=0x557a206bf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f4273614700 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a206c2960 0x557a206bf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f4273614700 1 -- 172.21.15.37:0/410111374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 msgr2=0x557a2061cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f4273614700 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 0x557a2061cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f4273614700 1 -- 172.21.15.37:0/410111374 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c00a440 con 0x557a206c2d30 2023-10-06T04:40:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f4272e13700 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557a20618d50 0x557a2061cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f4273614700 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557a206c2d30 0x557a206bf800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f426400c200 tx=0x7f4264008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f426b7fe700 1 -- 172.21.15.37:0/410111374 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426400a070 con 0x557a206c2d30 2023-10-06T04:40:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f426b7fe700 1 -- 172.21.15.37:0/410111374 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426400cce0 con 0x557a206c2d30 2023-10-06T04:40:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f42752dce80 1 -- 172.21.15.37:0/410111374 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a20544250 con 0x557a206c2d30 2023-10-06T04:40:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f426b7fe700 1 -- 172.21.15.37:0/410111374 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264011640 con 0x557a206c2d30 2023-10-06T04:40:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.020+0000 7f42752dce80 1 -- 172.21.15.37:0/410111374 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a20537770 con 0x557a206c2d30 2023-10-06T04:40:39.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f426b7fe700 1 -- 172.21.15.37:0/410111374 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4264003030 con 0x557a206c2d30 2023-10-06T04:40:39.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f426b7fe700 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f425805eeb0 0x7f4258061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f426b7fe700 1 -- 172.21.15.37:0/410111374 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f426407b120 con 0x557a206c2d30 2023-10-06T04:40:39.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f42752dce80 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x557a206c16f0 0x557a20635d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f4272e13700 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f425805eeb0 0x7f4258061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f42752dce80 1 -- 172.21.15.37:0/410111374 --> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] -- osd_op(unknown.0.0:1 6.10 6:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) v8 -- 0x557a206de000 con 0x557a206c16f0 2023-10-06T04:40:39.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f4272612700 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x557a206c16f0 0x557a20635d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f4272e13700 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f425805eeb0 0x7f4258061360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f426c005ce0 tx=0x7f426c019000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:39.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f4272612700 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x557a206c16f0 0x557a20635d80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:39.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f4272612700 1 -- 172.21.15.37:0/410111374 <== osd.0 v2:172.21.15.37:6816/33416 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (64) out=64b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+64 (crc 0 0 0) 0x7f425c000bc0 con 0x557a206c16f0 2023-10-06T04:40:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f42752dce80 1 -- 172.21.15.37:0/410111374 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x557a206c16f0 msgr2=0x557a20635d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f42752dce80 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x557a206c16f0 0x557a20635d80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f42752dce80 1 -- 172.21.15.37:0/410111374 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f425805eeb0 msgr2=0x7f4258061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f42752dce80 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f425805eeb0 0x7f4258061360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f426c005ce0 tx=0x7f426c019000 comp rx=0 tx=0).stop 2023-10-06T04:40:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f42752dce80 1 -- 172.21.15.37:0/410111374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557a206c2d30 msgr2=0x557a206bf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f42752dce80 1 --2- 172.21.15.37:0/410111374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557a206c2d30 0x557a206bf800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f426400c200 tx=0x7f4264008040 comp rx=0 tx=0).stop 2023-10-06T04:40:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f4273614700 1 -- 172.21.15.37:0/410111374 reap_dead start 2023-10-06T04:40:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f42752dce80 1 -- 172.21.15.37:0/410111374 shutdown_connections 2023-10-06T04:40:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f42752dce80 1 -- 172.21.15.37:0/410111374 >> 172.21.15.37:0/410111374 conn(0x557a205ef6c0 msgr2=0x557a205e8540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f42752dce80 1 -- 172.21.15.37:0/410111374 shutdown_connections 2023-10-06T04:40:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.024+0000 7f42752dce80 1 -- 172.21.15.37:0/410111374 wait complete. 2023-10-06T04:40:39.034 INFO:teuthology.orchestra.run.smithi037.stdout::testdir1 2023-10-06T04:40:39.034 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:40:39.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:40:39.052 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:40:39.073 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:40:39.073 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T04:40:39.073 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:40:39.074 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:39.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[43140]: fuse finished with error 0 and tester_r 0 2023-10-06T04:40:39.089 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:40:39.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:39.090 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:40:39.253 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:40:39.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:39.253 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T04:40:39.260 INFO:teuthology.orchestra.run.smithi083.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T04:40:39.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:40:39.261 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:40:39.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:39.261 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T04:40:39.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:40:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T04:40:39.303 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:40:39.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:39.304 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T04:40:39.310 INFO:teuthology.orchestra.run.smithi083.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T04:40:39.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:40:39.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:39.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.420+0000 7f8fdbfff700 1 Processor -- start 2023-10-06T04:40:39.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.420+0000 7f8fdbfff700 1 -- start start 2023-10-06T04:40:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8fdc15d240 0x7f8fdc0aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fdc06dbf0 0x7f8fdc0c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fdc15e0e0 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc15d7b0 con 0x7f8fdc15d240 2023-10-06T04:40:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc15da90 con 0x7f8fdc06dbf0 2023-10-06T04:40:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdaffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8fdc15d240 0x7f8fdc0aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdaffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8fdc15d240 0x7f8fdc0aa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46330/0 (socket says 172.21.15.37:46330) 2023-10-06T04:40:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdaffd700 1 -- 172.21.15.37:0/1318098362 learned_addr learned my addr 172.21.15.37:0/1318098362 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:39.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdb7fe700 1 --2- 172.21.15.37:0/1318098362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fdc06dbf0 0x7f8fdc0c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdaffd700 1 -- 172.21.15.37:0/1318098362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fdc06dbf0 msgr2=0x7f8fdc0c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:39.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdaffd700 1 --2- 172.21.15.37:0/1318098362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fdc06dbf0 0x7f8fdc0c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdaffd700 1 -- 172.21.15.37:0/1318098362 >> v1:172.21.15.83:6789/0 conn(0x7f8fdc0cc0d0 legacy=0x7f8fdc06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fd9ffb700 1 -- 172.21.15.37:0/1318098362 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175091973 0 0) 0x7f8fdc15e0e0 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdaffd700 1 -- 172.21.15.37:0/1318098362 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc15dd70 con 0x7f8fdc15d240 2023-10-06T04:40:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdb7fe700 1 --2- 172.21.15.37:0/1318098362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fdc06dbf0 0x7f8fdc0c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdaffd700 1 --2- 172.21.15.37:0/1318098362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc15d240 0x7f8fdc0aa740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009f20 tx=0x7f8fcc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b5826d90398e6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fd9ffb700 1 -- 172.21.15.37:0/1318098362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00e070 con 0x7f8fdc15d240 2023-10-06T04:40:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fd9ffb700 1 -- 172.21.15.37:0/1318098362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc00ba80 con 0x7f8fdc15d240 2023-10-06T04:40:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fd9ffb700 1 -- 172.21.15.37:0/1318098362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0092e0 con 0x7f8fdc15d240 2023-10-06T04:40:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 -- 172.21.15.37:0/1318098362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc15d240 msgr2=0x7f8fdc0aa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 --2- 172.21.15.37:0/1318098362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc15d240 0x7f8fdc0aa740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009f20 tx=0x7f8fcc009840 comp rx=0 tx=0).stop 2023-10-06T04:40:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 -- 172.21.15.37:0/1318098362 shutdown_connections 2023-10-06T04:40:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 --2- 172.21.15.37:0/1318098362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fdc06dbf0 0x7f8fdc0c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 --2- 172.21.15.37:0/1318098362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc15d240 0x7f8fdc0aa740 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 -- 172.21.15.37:0/1318098362 >> 172.21.15.37:0/1318098362 conn(0x7f8fdc068780 msgr2=0x7f8fdc0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 -- 172.21.15.37:0/1318098362 shutdown_connections 2023-10-06T04:40:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.424+0000 7f8fdbfff700 1 -- 172.21.15.37:0/1318098362 wait complete. 2023-10-06T04:40:39.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fdbfff700 1 Processor -- start 2023-10-06T04:40:39.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fdbfff700 1 -- start start 2023-10-06T04:40:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fdbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fdc06dbf0 0x7f8fdc0c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fdbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc0cc0d0 0x7f8fdc0ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fdbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fdc15d240 0x7f8fdc15fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fdbfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc0c4880 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fdbfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc0b01f0 con 0x7f8fdc06dbf0 2023-10-06T04:40:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fdbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc0b04d0 con 0x7f8fdc15d240 2023-10-06T04:40:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fda7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc0cc0d0 0x7f8fdc0ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fda7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc0cc0d0 0x7f8fdc0ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46336/0 (socket says 172.21.15.37:46336) 2023-10-06T04:40:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fda7fc700 1 -- 172.21.15.37:0/412525165 learned_addr learned my addr 172.21.15.37:0/412525165 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fdb7fe700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fdc15d240 0x7f8fdc15fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fdaffd700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fdc06dbf0 0x7f8fdc0c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fda7fc700 1 -- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fdc15d240 msgr2=0x7f8fdc15fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fda7fc700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fdc15d240 0x7f8fdc15fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fda7fc700 1 -- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fdc06dbf0 msgr2=0x7f8fdc0c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fda7fc700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fdc06dbf0 0x7f8fdc0c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.428+0000 7f8fda7fc700 1 -- 172.21.15.37:0/412525165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc009ae0 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.432+0000 7f8fda7fc700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc0cc0d0 0x7f8fdc0ae770 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400c7e0 tx=0x7f8fc4007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.432+0000 7f8fd2ffd700 1 -- 172.21.15.37:0/412525165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4011590 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.432+0000 7f8fd2ffd700 1 -- 172.21.15.37:0/412525165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc4011710 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.432+0000 7f8fdbfff700 1 -- 172.21.15.37:0/412525165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc0c4510 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.432+0000 7f8fd2ffd700 1 -- 172.21.15.37:0/412525165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4011ad0 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.432+0000 7f8fdbfff700 1 -- 172.21.15.37:0/412525165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc0aecb0 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.432+0000 7f8fdbfff700 1 -- 172.21.15.37:0/412525165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc0708a0 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.432+0000 7f8fd2ffd700 1 -- 172.21.15.37:0/412525165 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8fc401b3b0 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.432+0000 7f8fd2ffd700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8fc0060550 0x7f8fc0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.432+0000 7f8fd2ffd700 1 -- 172.21.15.37:0/412525165 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f8fc407bf20 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.432+0000 7f8fdaffd700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8fc0060550 0x7f8fc0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.436+0000 7f8fdaffd700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8fc0060550 0x7f8fc0062a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009880 tx=0x7f8fcc018000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.440+0000 7f8fd2ffd700 1 -- 172.21.15.37:0/412525165 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8fc404c220 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.632+0000 7f8fdbfff700 1 -- 172.21.15.37:0/412525165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fdc0cc640 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.632+0000 7f8fd2ffd700 1 -- 172.21.15.37:0/412525165 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f8fc4017020 con 0x7f8fdc0cc0d0 2023-10-06T04:40:39.639 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:39.639 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3094155806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3094155806},{"type":"v1","addr":"172.21.15.83:6837","nonce":3094155806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/968432746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":968432746},{"type":"v1","addr":"172.21.15.37:6833","nonce":968432746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2573831912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2573831912},{"type":"v1","addr":"172.21.15.37:6835","nonce":2573831912}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:16.392787+0000","modified":"2023-10-06T04:40:34.660873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":43,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6835/3283827040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3283827040},{"type":"v1","addr":"172.21.15.83:6835","nonce":3283827040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:39.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.636+0000 7f8fdbfff700 1 -- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8fc0060550 msgr2=0x7f8fc0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.636+0000 7f8fdbfff700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8fc0060550 0x7f8fc0062a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009880 tx=0x7f8fcc018000 comp rx=0 tx=0).stop 2023-10-06T04:40:39.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.636+0000 7f8fdbfff700 1 -- 172.21.15.37:0/412525165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc0cc0d0 msgr2=0x7f8fdc0ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.636+0000 7f8fdbfff700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc0cc0d0 0x7f8fdc0ae770 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400c7e0 tx=0x7f8fc4007da0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.636+0000 7f8fdbfff700 1 -- 172.21.15.37:0/412525165 shutdown_connections 2023-10-06T04:40:39.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.636+0000 7f8fdbfff700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8fc0060550 0x7f8fc0062a00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.636+0000 7f8fdbfff700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fdc15d240 0x7f8fdc15fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.636+0000 7f8fdbfff700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc0cc0d0 0x7f8fdc0ae770 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.636+0000 7f8fdbfff700 1 --2- 172.21.15.37:0/412525165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fdc06dbf0 0x7f8fdc0c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.636+0000 7f8fdbfff700 1 -- 172.21.15.37:0/412525165 >> 172.21.15.37:0/412525165 conn(0x7f8fdc068780 msgr2=0x7f8fdc0c0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:39.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.636+0000 7f8fdbfff700 1 -- 172.21.15.37:0/412525165 shutdown_connections 2023-10-06T04:40:39.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.636+0000 7f8fdbfff700 1 -- 172.21.15.37:0/412525165 wait complete. 2023-10-06T04:40:39.646 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2023-10-06T04:40:39.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:39.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.756+0000 7faa484a9700 1 Processor -- start 2023-10-06T04:40:39.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.756+0000 7faa484a9700 1 -- start start 2023-10-06T04:40:39.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faa400ac670 0x7faa400ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa400adf30 0x7faa400aba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa400a9ea0 con 0x7faa40155bf0 2023-10-06T04:40:39.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa40155fc0 con 0x7faa400adf30 2023-10-06T04:40:39.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa400ae3b0 con 0x7faa400ac670 2023-10-06T04:40:39.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa46245700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faa40155bf0 0x7faa400afe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55846/0 (socket says 172.21.15.37:55846) 2023-10-06T04:40:39.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa46a46700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa400adf30 0x7faa400aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa46245700 1 -- 172.21.15.37:0/2556318588 learned_addr learned my addr 172.21.15.37:0/2556318588 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:39.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa45a44700 1 --2- 172.21.15.37:0/2556318588 >> v2:172.21.15.83:3300/0 conn(0x7faa400ac670 0x7faa400ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa46a46700 1 -- 172.21.15.37:0/2556318588 >> v2:172.21.15.83:3300/0 conn(0x7faa400ac670 msgr2=0x7faa400ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:39.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa46a46700 1 --2- 172.21.15.37:0/2556318588 >> v2:172.21.15.83:3300/0 conn(0x7faa400ac670 0x7faa400ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa46a46700 1 -- 172.21.15.37:0/2556318588 >> v1:172.21.15.37:6789/0 conn(0x7faa40155bf0 legacy=0x7faa400afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa45243700 1 -- 172.21.15.37:0/2556318588 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245566363 0 0) 0x7faa400a9ea0 con 0x7faa40155bf0 2023-10-06T04:40:39.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa46a46700 1 -- 172.21.15.37:0/2556318588 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400aa160 con 0x7faa400adf30 2023-10-06T04:40:39.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa46a46700 1 --2- 172.21.15.37:0/2556318588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa400adf30 0x7faa400aba50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7faa4006cfb0 tx=0x7faa38009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba284ad86e17d6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:39.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa45243700 1 -- 172.21.15.37:0/2556318588 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800e070 con 0x7faa400adf30 2023-10-06T04:40:39.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa45243700 1 -- 172.21.15.37:0/2556318588 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3800bb60 con 0x7faa400adf30 2023-10-06T04:40:39.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa45243700 1 -- 172.21.15.37:0/2556318588 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38012430 con 0x7faa400adf30 2023-10-06T04:40:39.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 -- 172.21.15.37:0/2556318588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa400adf30 msgr2=0x7faa400aba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 --2- 172.21.15.37:0/2556318588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa400adf30 0x7faa400aba50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7faa4006cfb0 tx=0x7faa38009780 comp rx=0 tx=0).stop 2023-10-06T04:40:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 -- 172.21.15.37:0/2556318588 shutdown_connections 2023-10-06T04:40:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 --2- 172.21.15.37:0/2556318588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa400adf30 0x7faa400aba50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 --2- 172.21.15.37:0/2556318588 >> v2:172.21.15.83:3300/0 conn(0x7faa400ac670 0x7faa400ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 -- 172.21.15.37:0/2556318588 >> 172.21.15.37:0/2556318588 conn(0x7faa400ccc60 msgr2=0x7faa4006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 -- 172.21.15.37:0/2556318588 shutdown_connections 2023-10-06T04:40:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.760+0000 7faa484a9700 1 -- 172.21.15.37:0/2556318588 wait complete. 2023-10-06T04:40:39.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa484a9700 1 Processor -- start 2023-10-06T04:40:39.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa484a9700 1 -- start start 2023-10-06T04:40:39.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa484a9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa400ac670 0x7faa400cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa484a9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40155bf0 0x7faa40141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa484a9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa40097990 0x7faa400c1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa484a9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa40098af0 con 0x7faa40155bf0 2023-10-06T04:40:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa484a9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa400cb960 con 0x7faa40097990 2023-10-06T04:40:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa484a9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa40097ee0 con 0x7faa400ac670 2023-10-06T04:40:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa45a44700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40155bf0 0x7faa40141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa45a44700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40155bf0 0x7faa40141810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46356/0 (socket says 172.21.15.37:46356) 2023-10-06T04:40:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa45a44700 1 -- 172.21.15.37:0/2259316952 learned_addr learned my addr 172.21.15.37:0/2259316952 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa46a46700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa40097990 0x7faa400c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa46245700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa400ac670 0x7faa400cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa45a44700 1 -- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa400ac670 msgr2=0x7faa400cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa45a44700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa400ac670 0x7faa400cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa45a44700 1 -- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa40097990 msgr2=0x7faa400c1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa45a44700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa40097990 0x7faa400c1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa45a44700 1 -- 172.21.15.37:0/2259316952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38009a20 con 0x7faa40155bf0 2023-10-06T04:40:39.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa45a44700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40155bf0 0x7faa40141810 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faa30010e60 tx=0x7faa300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:39.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa367fc700 1 -- 172.21.15.37:0/2259316952 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000edf0 con 0x7faa40155bf0 2023-10-06T04:40:39.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa367fc700 1 -- 172.21.15.37:0/2259316952 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30011450 con 0x7faa40155bf0 2023-10-06T04:40:39.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa484a9700 1 -- 172.21.15.37:0/2259316952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa400981c0 con 0x7faa40155bf0 2023-10-06T04:40:39.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa367fc700 1 -- 172.21.15.37:0/2259316952 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30011810 con 0x7faa40155bf0 2023-10-06T04:40:39.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.764+0000 7faa484a9700 1 -- 172.21.15.37:0/2259316952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa40098780 con 0x7faa40155bf0 2023-10-06T04:40:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.768+0000 7faa484a9700 1 -- 172.21.15.37:0/2259316952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa40098c60 con 0x7faa40155bf0 2023-10-06T04:40:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.768+0000 7faa367fc700 1 -- 172.21.15.37:0/2259316952 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faa30011c00 con 0x7faa40155bf0 2023-10-06T04:40:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.768+0000 7faa367fc700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faa24060550 0x7faa24062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.768+0000 7faa367fc700 1 -- 172.21.15.37:0/2259316952 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7faa3007f340 con 0x7faa40155bf0 2023-10-06T04:40:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.768+0000 7faa46245700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faa24060550 0x7faa24062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.768+0000 7faa46245700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faa24060550 0x7faa24062a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00c8f0 tx=0x7faa3c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:39.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.772+0000 7faa367fc700 1 -- 172.21.15.37:0/2259316952 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faa3004f6f0 con 0x7faa40155bf0 2023-10-06T04:40:39.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.936+0000 7faa484a9700 1 -- 172.21.15.37:0/2259316952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa40070ee0 con 0x7faa40155bf0 2023-10-06T04:40:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.936+0000 7faa367fc700 1 -- 172.21.15.37:0/2259316952 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+17152 (secure 0 0 0) 0x7faa30028090 con 0x7faa40155bf0 2023-10-06T04:40:39.943 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:39.943 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":43,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:40:31.632062+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:14.249153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:15.385254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6837/1183217493":"2023-10-07T04:40:31.632008+0000","172.21.15.83:6836/1183217493":"2023-10-07T04:40:31.632008+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:39.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.940+0000 7faa484a9700 1 -- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faa24060550 msgr2=0x7faa24062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.940+0000 7faa484a9700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faa24060550 0x7faa24062a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00c8f0 tx=0x7faa3c009040 comp rx=0 tx=0).stop 2023-10-06T04:40:39.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.940+0000 7faa484a9700 1 -- 172.21.15.37:0/2259316952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40155bf0 msgr2=0x7faa40141810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:39.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.940+0000 7faa484a9700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40155bf0 0x7faa40141810 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faa30010e60 tx=0x7faa300091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.940+0000 7faa484a9700 1 -- 172.21.15.37:0/2259316952 shutdown_connections 2023-10-06T04:40:39.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.940+0000 7faa484a9700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7faa24060550 0x7faa24062a00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.940+0000 7faa484a9700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa40097990 0x7faa400c1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.940+0000 7faa484a9700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40155bf0 0x7faa40141810 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.940+0000 7faa484a9700 1 --2- 172.21.15.37:0/2259316952 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa400ac670 0x7faa400cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:39.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.940+0000 7faa484a9700 1 -- 172.21.15.37:0/2259316952 >> 172.21.15.37:0/2259316952 conn(0x7faa400ccc60 msgr2=0x7faa4006b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:39.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.940+0000 7faa484a9700 1 -- 172.21.15.37:0/2259316952 shutdown_connections 2023-10-06T04:40:39.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:39.940+0000 7faa484a9700 1 -- 172.21.15.37:0/2259316952 wait complete. 2023-10-06T04:40:39.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:40:14.249153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:40:15.385254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:40:39.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:40:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680d0d8700 1 Processor -- start 2023-10-06T04:40:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680d0d8700 1 -- start start 2023-10-06T04:40:40.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680d0d8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f680813eb90 0x7f680813ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680d0d8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f680806e730 0x7f68080c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680d0d8700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68080c7a60 con 0x7f680806afd0 2023-10-06T04:40:40.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680d0d8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68080c7cc0 con 0x7f680806e730 2023-10-06T04:40:40.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680d0d8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68080c7fa0 con 0x7f680813eb90 2023-10-06T04:40:40.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680659c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f680806afd0 0x7f680806e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55860/0 (socket says 172.21.15.37:55860) 2023-10-06T04:40:40.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680659c700 1 -- 172.21.15.37:0/295992457 learned_addr learned my addr 172.21.15.37:0/295992457 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:40.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680759e700 1 --2- 172.21.15.37:0/295992457 >> v2:172.21.15.83:3300/0 conn(0x7f680806e730 0x7f68080c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f6806d9d700 1 --2- 172.21.15.37:0/295992457 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f680813eb90 0x7f680813ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f6805d9b700 1 -- 172.21.15.37:0/295992457 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344188890 0 0) 0x7f68080c7a60 con 0x7f680806afd0 2023-10-06T04:40:40.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f6805d9b700 1 -- 172.21.15.37:0/295992457 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f4003570 con 0x7f680806afd0 2023-10-06T04:40:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680759e700 1 -- 172.21.15.37:0/295992457 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f680813eb90 msgr2=0x7f680813ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680759e700 1 --2- 172.21.15.37:0/295992457 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f680813eb90 0x7f680813ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680759e700 1 -- 172.21.15.37:0/295992457 >> v1:172.21.15.37:6789/0 conn(0x7f680806afd0 legacy=0x7f680806e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.060+0000 7f680759e700 1 -- 172.21.15.37:0/295992457 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68080c8280 con 0x7f680806e730 2023-10-06T04:40:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f680759e700 1 --2- 172.21.15.37:0/295992457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f680806e730 0x7f68080c7520 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6800009e60 tx=0x7f6800009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a402da9e5eb4c118 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f6805d9b700 1 -- 172.21.15.37:0/295992457 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680000e070 con 0x7f680806e730 2023-10-06T04:40:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f6805d9b700 1 -- 172.21.15.37:0/295992457 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680000bab0 con 0x7f680806e730 2023-10-06T04:40:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f6805d9b700 1 -- 172.21.15.37:0/295992457 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680000be30 con 0x7f680806e730 2023-10-06T04:40:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f680d0d8700 1 -- 172.21.15.37:0/295992457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f680806e730 msgr2=0x7f68080c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f680d0d8700 1 --2- 172.21.15.37:0/295992457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f680806e730 0x7f68080c7520 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6800009e60 tx=0x7f6800009780 comp rx=0 tx=0).stop 2023-10-06T04:40:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f680d0d8700 1 -- 172.21.15.37:0/295992457 shutdown_connections 2023-10-06T04:40:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f680d0d8700 1 --2- 172.21.15.37:0/295992457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f680806e730 0x7f68080c7520 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f680d0d8700 1 --2- 172.21.15.37:0/295992457 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f680813eb90 0x7f680813ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f680d0d8700 1 -- 172.21.15.37:0/295992457 >> 172.21.15.37:0/295992457 conn(0x7f68080cc180 msgr2=0x7f68080cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:40.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f680d0d8700 1 -- 172.21.15.37:0/295992457 shutdown_connections 2023-10-06T04:40:40.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f680d0d8700 1 -- 172.21.15.37:0/295992457 wait complete. 2023-10-06T04:40:40.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f680d0d8700 1 Processor -- start 2023-10-06T04:40:40.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.064+0000 7f680d0d8700 1 -- start start 2023-10-06T04:40:40.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680d0d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680806afd0 0x7f68081551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680d0d8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f680806e730 0x7f68081598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680d0d8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f680813eb90 0x7f6808138740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680d0d8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6808155700 con 0x7f680806afd0 2023-10-06T04:40:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680d0d8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680813d440 con 0x7f680806e730 2023-10-06T04:40:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680d0d8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68080c4200 con 0x7f680813eb90 2023-10-06T04:40:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f6806d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680806afd0 0x7f68081551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680659c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f680806e730 0x7f68081598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f6806d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680806afd0 0x7f68081551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46366/0 (socket says 172.21.15.37:46366) 2023-10-06T04:40:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680659c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f680806e730 0x7f68081598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:54236/0 (socket says 172.21.15.37:54236) 2023-10-06T04:40:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f6806d9d700 1 -- 172.21.15.37:0/607160846 learned_addr learned my addr 172.21.15.37:0/607160846 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f680813eb90 0x7f6808138740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680659c700 1 -- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f680813eb90 msgr2=0x7f6808138740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680659c700 1 --2- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f680813eb90 0x7f6808138740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680659c700 1 -- 172.21.15.37:0/607160846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680806afd0 msgr2=0x7f68081551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680659c700 1 --2- 172.21.15.37:0/607160846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680806afd0 0x7f68081551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680659c700 1 -- 172.21.15.37:0/607160846 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800009a20 con 0x7f680806e730 2023-10-06T04:40:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680659c700 1 --2- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f680806e730 0x7f68081598b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f67f0001200 tx=0x7f67f0007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f67feffd700 1 -- 172.21.15.37:0/607160846 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0005b30 con 0x7f680806e730 2023-10-06T04:40:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f67feffd700 1 -- 172.21.15.37:0/607160846 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f0005cb0 con 0x7f680806e730 2023-10-06T04:40:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680d0d8700 1 -- 172.21.15.37:0/607160846 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680813c9f0 con 0x7f680806e730 2023-10-06T04:40:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f67feffd700 1 -- 172.21.15.37:0/607160846 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0007320 con 0x7f680806e730 2023-10-06T04:40:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.068+0000 7f680d0d8700 1 -- 172.21.15.37:0/607160846 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680813c3a0 con 0x7f680806e730 2023-10-06T04:40:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.072+0000 7f680d0d8700 1 -- 172.21.15.37:0/607160846 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6808070ee0 con 0x7f680806e730 2023-10-06T04:40:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.072+0000 7f67feffd700 1 -- 172.21.15.37:0/607160846 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f67f0007690 con 0x7f680806e730 2023-10-06T04:40:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.072+0000 7f67feffd700 1 --2- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f67e8060550 0x7f67e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.072+0000 7f67feffd700 1 -- 172.21.15.37:0/607160846 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f67f007be60 con 0x7f680806e730 2023-10-06T04:40:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.072+0000 7f6806d9d700 1 --2- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f67e8060550 0x7f67e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.072+0000 7f6806d9d700 1 --2- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f67e8060550 0x7f67e8062a00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009dd0 tx=0x7f67f80091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:40.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.080+0000 7f67feffd700 1 -- 172.21.15.37:0/607160846 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f67f004c160 con 0x7f680806e730 2023-10-06T04:40:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.248+0000 7f680d0d8700 1 -- 172.21.15.37:0/607160846 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68080c8560 con 0x7f680806e730 2023-10-06T04:40:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.248+0000 7f67feffd700 1 -- 172.21.15.37:0/607160846 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67f00170a0 con 0x7f680806e730 2023-10-06T04:40:40.255 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:40:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.252+0000 7f680d0d8700 1 -- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f67e8060550 msgr2=0x7f67e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.252+0000 7f680d0d8700 1 --2- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f67e8060550 0x7f67e8062a00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009dd0 tx=0x7f67f80091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.252+0000 7f680d0d8700 1 -- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f680806e730 msgr2=0x7f68081598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.252+0000 7f680d0d8700 1 --2- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f680806e730 0x7f68081598b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f67f0001200 tx=0x7f67f0007d10 comp rx=0 tx=0).stop 2023-10-06T04:40:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.252+0000 7f680d0d8700 1 -- 172.21.15.37:0/607160846 shutdown_connections 2023-10-06T04:40:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.252+0000 7f680d0d8700 1 --2- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f67e8060550 0x7f67e8062a00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.252+0000 7f680d0d8700 1 --2- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f680806e730 0x7f68081598b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.252+0000 7f680d0d8700 1 --2- 172.21.15.37:0/607160846 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f680813eb90 0x7f6808138740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.252+0000 7f680d0d8700 1 --2- 172.21.15.37:0/607160846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680806afd0 0x7f68081551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.252+0000 7f680d0d8700 1 -- 172.21.15.37:0/607160846 >> 172.21.15.37:0/607160846 conn(0x7f68080cc180 msgr2=0x7f68080c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.252+0000 7f680d0d8700 1 -- 172.21.15.37:0/607160846 shutdown_connections 2023-10-06T04:40:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.252+0000 7f680d0d8700 1 -- 172.21.15.37:0/607160846 wait complete. 2023-10-06T04:40:40.275 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:40:40.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5646d9b700 1 Processor -- start 2023-10-06T04:40:40.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5646d9b700 1 -- start start 2023-10-06T04:40:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5646d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56400aacd0 0x7f564015a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5646d9b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56400ae980 con 0x7f56400b01e0 2023-10-06T04:40:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5646d9b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5640156c80 con 0x7f5640156760 2023-10-06T04:40:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5646d9b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564015a6c0 con 0x7f56400aacd0 2023-10-06T04:40:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f56400b01e0 0x7f5640156050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55864/0 (socket says 172.21.15.37:55864) 2023-10-06T04:40:40.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563ffff700 1 -- 172.21.15.37:0/3436256209 learned_addr learned my addr 172.21.15.37:0/3436256209 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:40.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5644b37700 1 --2- 172.21.15.37:0/3436256209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56400aacd0 0x7f564015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547440452 0 0) 0x7f56400ae980 con 0x7f56400b01e0 2023-10-06T04:40:40.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5628003570 con 0x7f56400b01e0 2023-10-06T04:40:40.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 343483444 0 0) 0x7f5628003570 con 0x7f56400b01e0 2023-10-06T04:40:40.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56400aacd0 msgr2=0x7f564015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:40.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 --2- 172.21.15.37:0/3436256209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56400aacd0 0x7f564015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 >> v1:172.21.15.83:6789/0 conn(0x7f5640156760 legacy=0x7f5640157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5640156f60 con 0x7f56400b01e0 2023-10-06T04:40:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f5630001470 con 0x7f56400b01e0 2023-10-06T04:40:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 >> v1:172.21.15.37:6789/0 conn(0x7f56400b01e0 legacy=0x7f5640156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 --2- 172.21.15.37:0/3436256209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5628003a90 0x7f5628003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 --2- 172.21.15.37:0/3436256209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5628004810 0x7f5628004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 --2- 172.21.15.37:0/3436256209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56400aacd0 0x7f56280051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564015a6c0 con 0x7f5628004810 2023-10-06T04:40:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562800bb60 con 0x7f5628003a90 2023-10-06T04:40:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562800bd20 con 0x7f56400aacd0 2023-10-06T04:40:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f563ffff700 1 --2- 172.21.15.37:0/3436256209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5628004810 0x7f5628004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5644b37700 1 --2- 172.21.15.37:0/3436256209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5628003a90 0x7f5628003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5645338700 1 --2- 172.21.15.37:0/3436256209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56400aacd0 0x7f56280051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5645338700 1 -- 172.21.15.37:0/3436256209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5628003a90 msgr2=0x7f5628003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5645338700 1 --2- 172.21.15.37:0/3436256209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5628003a90 0x7f5628003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5645338700 1 -- 172.21.15.37:0/3436256209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5628004810 msgr2=0x7f5628004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5645338700 1 --2- 172.21.15.37:0/3436256209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5628004810 0x7f5628004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5645338700 1 -- 172.21.15.37:0/3436256209 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628003570 con 0x7f56400aacd0 2023-10-06T04:40:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.376+0000 7f5645338700 1 --2- 172.21.15.37:0/3436256209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56400aacd0 0x7f56280051e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5638001fc0 tx=0x7f5638001640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea36752b11b6a1cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.380+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638001950 con 0x7f56400aacd0 2023-10-06T04:40:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.380+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800c8b0 con 0x7f56400aacd0 2023-10-06T04:40:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.380+0000 7f563f7fe700 1 -- 172.21.15.37:0/3436256209 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800cc50 con 0x7f56400aacd0 2023-10-06T04:40:40.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.380+0000 7f5646d9b700 1 -- 172.21.15.37:0/3436256209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56400aacd0 msgr2=0x7f56280051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.380+0000 7f5646d9b700 1 --2- 172.21.15.37:0/3436256209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56400aacd0 0x7f56280051e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5638001fc0 tx=0x7f5638001640 comp rx=0 tx=0).stop 2023-10-06T04:40:40.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.380+0000 7f5645338700 1 -- 172.21.15.37:0/3436256209 reap_dead start 2023-10-06T04:40:40.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.380+0000 7f5646d9b700 1 -- 172.21.15.37:0/3436256209 shutdown_connections 2023-10-06T04:40:40.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.380+0000 7f5646d9b700 1 -- 172.21.15.37:0/3436256209 >> 172.21.15.37:0/3436256209 conn(0x7f5640067cf0 msgr2=0x7f56400680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:40.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.380+0000 7f5646d9b700 1 -- 172.21.15.37:0/3436256209 shutdown_connections 2023-10-06T04:40:40.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.380+0000 7f5646d9b700 1 -- 172.21.15.37:0/3436256209 wait complete. 2023-10-06T04:40:40.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5646d9b700 1 Processor -- start 2023-10-06T04:40:40.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5646d9b700 1 -- start start 2023-10-06T04:40:40.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5646d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f564013fef0 0x7f5640149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5646d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5640149950 0x7f56400cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5646d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56401402c0 0x7f56400cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5646d9b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564014aaf0 con 0x7f564013fef0 2023-10-06T04:40:40.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5646d9b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5640155b80 con 0x7f5640149950 2023-10-06T04:40:40.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5646d9b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56400a6c50 con 0x7f56401402c0 2023-10-06T04:40:40.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5644b37700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f564013fef0 0x7f5640149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5644b37700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f564013fef0 0x7f5640149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46374/0 (socket says 172.21.15.37:46374) 2023-10-06T04:40:40.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5644b37700 1 -- 172.21.15.37:0/1839197949 learned_addr learned my addr 172.21.15.37:0/1839197949 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:40.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f563ffff700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5640149950 0x7f56400cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5645338700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56401402c0 0x7f56400cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5644b37700 1 -- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56401402c0 msgr2=0x7f56400cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5644b37700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56401402c0 0x7f56400cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5644b37700 1 -- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5640149950 msgr2=0x7f56400cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5644b37700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5640149950 0x7f56400cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5644b37700 1 -- 172.21.15.37:0/1839197949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5640149ee0 con 0x7f564013fef0 2023-10-06T04:40:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f563ffff700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5640149950 0x7f56400cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5644b37700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f564013fef0 0x7f5640149410 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5634011b10 tx=0x7f56340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f563cff9700 1 -- 172.21.15.37:0/1839197949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563400f940 con 0x7f564013fef0 2023-10-06T04:40:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f563cff9700 1 -- 172.21.15.37:0/1839197949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563400faa0 con 0x7f564013fef0 2023-10-06T04:40:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5646d9b700 1 -- 172.21.15.37:0/1839197949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564014a1c0 con 0x7f564013fef0 2023-10-06T04:40:40.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f563cff9700 1 -- 172.21.15.37:0/1839197949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563400fe20 con 0x7f564013fef0 2023-10-06T04:40:40.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.384+0000 7f5646d9b700 1 -- 172.21.15.37:0/1839197949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564014a780 con 0x7f564013fef0 2023-10-06T04:40:40.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.388+0000 7f5646d9b700 1 -- 172.21.15.37:0/1839197949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5640070ee0 con 0x7f564013fef0 2023-10-06T04:40:40.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.388+0000 7f563cff9700 1 -- 172.21.15.37:0/1839197949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5634014650 con 0x7f564013fef0 2023-10-06T04:40:40.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.388+0000 7f563cff9700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f562c060550 0x7f562c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.388+0000 7f563cff9700 1 -- 172.21.15.37:0/1839197949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f5634018030 con 0x7f564013fef0 2023-10-06T04:40:40.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.388+0000 7f563ffff700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f562c060550 0x7f562c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.392+0000 7f563ffff700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f562c060550 0x7f562c062a00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5630000e10 tx=0x7f5630009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.400+0000 7f563cff9700 1 -- 172.21.15.37:0/1839197949 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f563404d7e0 con 0x7f564013fef0 2023-10-06T04:40:40.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.560+0000 7f5646d9b700 1 -- 172.21.15.37:0/1839197949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f56401596a0 con 0x7f564013fef0 2023-10-06T04:40:40.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.560+0000 7f563cff9700 1 -- 172.21.15.37:0/1839197949 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5634050e00 con 0x7f564013fef0 2023-10-06T04:40:40.568 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:40:40.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.564+0000 7f5646d9b700 1 -- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f562c060550 msgr2=0x7f562c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.564+0000 7f5646d9b700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f562c060550 0x7f562c062a00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5630000e10 tx=0x7f5630009040 comp rx=0 tx=0).stop 2023-10-06T04:40:40.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.564+0000 7f5646d9b700 1 -- 172.21.15.37:0/1839197949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f564013fef0 msgr2=0x7f5640149410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.564+0000 7f5646d9b700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f564013fef0 0x7f5640149410 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5634011b10 tx=0x7f56340091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.564+0000 7f5646d9b700 1 -- 172.21.15.37:0/1839197949 shutdown_connections 2023-10-06T04:40:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.564+0000 7f5646d9b700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f562c060550 0x7f562c062a00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.564+0000 7f5646d9b700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5640149950 0x7f56400cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.564+0000 7f5646d9b700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56401402c0 0x7f56400cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.564+0000 7f5646d9b700 1 --2- 172.21.15.37:0/1839197949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f564013fef0 0x7f5640149410 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.564+0000 7f5646d9b700 1 -- 172.21.15.37:0/1839197949 >> 172.21.15.37:0/1839197949 conn(0x7f5640067cf0 msgr2=0x7f56400af310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.564+0000 7f5646d9b700 1 -- 172.21.15.37:0/1839197949 shutdown_connections 2023-10-06T04:40:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.564+0000 7f5646d9b700 1 -- 172.21.15.37:0/1839197949 wait complete. 2023-10-06T04:40:40.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:40:40.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.688+0000 7f48bb77b700 1 Processor -- start 2023-10-06T04:40:40.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.688+0000 7f48bb77b700 1 -- start start 2023-10-06T04:40:40.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48b406b610 0x7f48b4155f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f48b40c7da0 0x7f48b40c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b406b180 con 0x7f48b4155b70 2023-10-06T04:40:40.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b406ba60 con 0x7f48b40c7da0 2023-10-06T04:40:40.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40cb920 con 0x7f48b406b610 2023-10-06T04:40:40.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b9517700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f48b4155b70 0x7f48b40cb210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55870/0 (socket says 172.21.15.37:55870) 2023-10-06T04:40:40.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b9517700 1 -- 172.21.15.37:0/2076749267 learned_addr learned my addr 172.21.15.37:0/2076749267 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:40.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b9d18700 1 --2- 172.21.15.37:0/2076749267 >> v2:172.21.15.37:3300/0 conn(0x7f48b40c7da0 0x7f48b40c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b8d16700 1 --2- 172.21.15.37:0/2076749267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48b406b610 0x7f48b4155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b3fff700 1 -- 172.21.15.37:0/2076749267 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613005833 0 0) 0x7f48b406b180 con 0x7f48b4155b70 2023-10-06T04:40:40.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b3fff700 1 -- 172.21.15.37:0/2076749267 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f489c003570 con 0x7f48b4155b70 2023-10-06T04:40:40.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b9d18700 1 -- 172.21.15.37:0/2076749267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48b406b610 msgr2=0x7f48b4155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:40.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b9d18700 1 --2- 172.21.15.37:0/2076749267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48b406b610 0x7f48b4155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b9d18700 1 -- 172.21.15.37:0/2076749267 >> v1:172.21.15.37:6789/0 conn(0x7f48b4155b70 legacy=0x7f48b40cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b9d18700 1 -- 172.21.15.37:0/2076749267 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b406aba0 con 0x7f48b40c7da0 2023-10-06T04:40:40.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b9d18700 1 --2- 172.21.15.37:0/2076749267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48b40c7da0 0x7f48b40c8220 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0098e0 tx=0x7f48ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7395b237037cbd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:40.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b3fff700 1 -- 172.21.15.37:0/2076749267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac011630 con 0x7f48b40c7da0 2023-10-06T04:40:40.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b3fff700 1 -- 172.21.15.37:0/2076749267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac011790 con 0x7f48b40c7da0 2023-10-06T04:40:40.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48b3fff700 1 -- 172.21.15.37:0/2076749267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac011b30 con 0x7f48b40c7da0 2023-10-06T04:40:40.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 -- 172.21.15.37:0/2076749267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48b40c7da0 msgr2=0x7f48b40c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 --2- 172.21.15.37:0/2076749267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48b40c7da0 0x7f48b40c8220 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0098e0 tx=0x7f48ac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 -- 172.21.15.37:0/2076749267 shutdown_connections 2023-10-06T04:40:40.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 --2- 172.21.15.37:0/2076749267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48b40c7da0 0x7f48b40c8220 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 --2- 172.21.15.37:0/2076749267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48b406b610 0x7f48b4155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 -- 172.21.15.37:0/2076749267 >> 172.21.15.37:0/2076749267 conn(0x7f48b40cc180 msgr2=0x7f48b40cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:40.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 -- 172.21.15.37:0/2076749267 shutdown_connections 2023-10-06T04:40:40.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.692+0000 7f48bb77b700 1 -- 172.21.15.37:0/2076749267 wait complete. 2023-10-06T04:40:40.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48bb77b700 1 Processor -- start 2023-10-06T04:40:40.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48bb77b700 1 -- start start 2023-10-06T04:40:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48bb77b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48b406b610 0x7f48b41665e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48bb77b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48b40c7da0 0x7f48b4153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48bb77b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4155b70 0x7f48b40c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48bb77b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b4166150 con 0x7f48b40c7da0 2023-10-06T04:40:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48bb77b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b4157ec0 con 0x7f48b4155b70 2023-10-06T04:40:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48bb77b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b41581a0 con 0x7f48b406b610 2023-10-06T04:40:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48b8d16700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48b40c7da0 0x7f48b4153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48b8d16700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48b40c7da0 0x7f48b4153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46392/0 (socket says 172.21.15.37:46392) 2023-10-06T04:40:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48b9517700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48b406b610 0x7f48b41665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48b8d16700 1 -- 172.21.15.37:0/2531959873 learned_addr learned my addr 172.21.15.37:0/2531959873 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.696+0000 7f48b9d18700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4155b70 0x7f48b40c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.700+0000 7f48b8d16700 1 -- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48b406b610 msgr2=0x7f48b41665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.700+0000 7f48b8d16700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48b406b610 0x7f48b41665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.700+0000 7f48b8d16700 1 -- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4155b70 msgr2=0x7f48b40c0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.700+0000 7f48b8d16700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4155b70 0x7f48b40c0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.700+0000 7f48b8d16700 1 -- 172.21.15.37:0/2531959873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac009420 con 0x7f48b40c7da0 2023-10-06T04:40:40.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.700+0000 7f48b8d16700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48b40c7da0 0x7f48b4153de0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f48a800ec80 tx=0x7f48a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:40.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.700+0000 7f48b17fa700 1 -- 172.21.15.37:0/2531959873 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800c850 con 0x7f48b40c7da0 2023-10-06T04:40:40.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.700+0000 7f48b17fa700 1 -- 172.21.15.37:0/2531959873 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a800c9b0 con 0x7f48b40c7da0 2023-10-06T04:40:40.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.700+0000 7f48bb77b700 1 -- 172.21.15.37:0/2531959873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b4165b00 con 0x7f48b40c7da0 2023-10-06T04:40:40.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.700+0000 7f48b17fa700 1 -- 172.21.15.37:0/2531959873 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800cd50 con 0x7f48b40c7da0 2023-10-06T04:40:40.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.700+0000 7f48bb77b700 1 -- 172.21.15.37:0/2531959873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b4157bb0 con 0x7f48b40c7da0 2023-10-06T04:40:40.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.704+0000 7f48bb77b700 1 -- 172.21.15.37:0/2531959873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b41662c0 con 0x7f48b40c7da0 2023-10-06T04:40:40.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.704+0000 7f48b17fa700 1 -- 172.21.15.37:0/2531959873 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f48a8013680 con 0x7f48b40c7da0 2023-10-06T04:40:40.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.704+0000 7f48b17fa700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f48a0060550 0x7f48a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:40.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.704+0000 7f48b17fa700 1 -- 172.21.15.37:0/2531959873 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f48a807d030 con 0x7f48b40c7da0 2023-10-06T04:40:40.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.704+0000 7f48b9517700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f48a0060550 0x7f48a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:40.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.708+0000 7f48b9517700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f48a0060550 0x7f48a0062a00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f48b40c1c60 tx=0x7f48a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:40.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.716+0000 7f48b17fa700 1 -- 172.21.15.37:0/2531959873 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f48a804d330 con 0x7f48b40c7da0 2023-10-06T04:40:40.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.880+0000 7f48bb77b700 1 -- 172.21.15.37:0/2531959873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48b4070ee0 con 0x7f48b40c7da0 2023-10-06T04:40:40.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.880+0000 7f48b17fa700 1 -- 172.21.15.37:0/2531959873 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f48a8050950 con 0x7f48b40c7da0 2023-10-06T04:40:40.887 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:40:40.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.884+0000 7f48bb77b700 1 -- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f48a0060550 msgr2=0x7f48a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.884+0000 7f48bb77b700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f48a0060550 0x7f48a0062a00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f48b40c1c60 tx=0x7f48a4009040 comp rx=0 tx=0).stop 2023-10-06T04:40:40.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.884+0000 7f48bb77b700 1 -- 172.21.15.37:0/2531959873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48b40c7da0 msgr2=0x7f48b4153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:40.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.884+0000 7f48bb77b700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48b40c7da0 0x7f48b4153de0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f48a800ec80 tx=0x7f48a80091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.884+0000 7f48bb77b700 1 -- 172.21.15.37:0/2531959873 shutdown_connections 2023-10-06T04:40:40.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.884+0000 7f48bb77b700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f48a0060550 0x7f48a0062a00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.884+0000 7f48bb77b700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4155b70 0x7f48b40c0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.884+0000 7f48bb77b700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48b40c7da0 0x7f48b4153de0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.884+0000 7f48bb77b700 1 --2- 172.21.15.37:0/2531959873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48b406b610 0x7f48b41665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:40.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.884+0000 7f48bb77b700 1 -- 172.21.15.37:0/2531959873 >> 172.21.15.37:0/2531959873 conn(0x7f48b40cc180 msgr2=0x7f48b40c2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:40.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.884+0000 7f48bb77b700 1 -- 172.21.15.37:0/2531959873 shutdown_connections 2023-10-06T04:40:40.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:40.884+0000 7f48bb77b700 1 -- 172.21.15.37:0/2531959873 wait complete. 2023-10-06T04:40:40.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:40:41.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94ffff700 1 Processor -- start 2023-10-06T04:40:41.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94ffff700 1 -- start start 2023-10-06T04:40:41.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa95009b2b0 0x7fa950068e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa9500cab70 0x7fa950069340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94ffff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95006bae0 con 0x7fa9500ca7a0 2023-10-06T04:40:41.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94ffff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9501592a0 con 0x7fa9500cab70 2023-10-06T04:40:41.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94ffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95006b8d0 con 0x7fa95009b2b0 2023-10-06T04:40:41.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94effd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa9500ca7a0 0x7fa95009a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55878/0 (socket says 172.21.15.37:55878) 2023-10-06T04:40:41.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94effd700 1 -- 172.21.15.37:0/2182265637 learned_addr learned my addr 172.21.15.37:0/2182265637 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:41.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94e7fc700 1 --2- 172.21.15.37:0/2182265637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa95009b2b0 0x7fa950068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94f7fe700 1 --2- 172.21.15.37:0/2182265637 >> v2:172.21.15.83:3300/0 conn(0x7fa9500cab70 0x7fa950069340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94dffb700 1 -- 172.21.15.37:0/2182265637 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579284056 0 0) 0x7fa95006bae0 con 0x7fa9500ca7a0 2023-10-06T04:40:41.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.012+0000 7fa94dffb700 1 -- 172.21.15.37:0/2182265637 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa938003570 con 0x7fa9500ca7a0 2023-10-06T04:40:41.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94e7fc700 1 -- 172.21.15.37:0/2182265637 >> v2:172.21.15.83:3300/0 conn(0x7fa9500cab70 msgr2=0x7fa950069340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:41.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94e7fc700 1 --2- 172.21.15.37:0/2182265637 >> v2:172.21.15.83:3300/0 conn(0x7fa9500cab70 0x7fa950069340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94e7fc700 1 -- 172.21.15.37:0/2182265637 >> v1:172.21.15.37:6789/0 conn(0x7fa9500ca7a0 legacy=0x7fa95009a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94e7fc700 1 -- 172.21.15.37:0/2182265637 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95006bdc0 con 0x7fa95009b2b0 2023-10-06T04:40:41.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94e7fc700 1 --2- 172.21.15.37:0/2182265637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa95009b2b0 0x7fa950068e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa9400098e0 tx=0x7fa9400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e875c1cf745d520 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94dffb700 1 -- 172.21.15.37:0/2182265637 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940011630 con 0x7fa95009b2b0 2023-10-06T04:40:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94dffb700 1 -- 172.21.15.37:0/2182265637 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa940011790 con 0x7fa95009b2b0 2023-10-06T04:40:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94dffb700 1 -- 172.21.15.37:0/2182265637 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940011b30 con 0x7fa95009b2b0 2023-10-06T04:40:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94ffff700 1 -- 172.21.15.37:0/2182265637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa95009b2b0 msgr2=0x7fa950068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94ffff700 1 --2- 172.21.15.37:0/2182265637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa95009b2b0 0x7fa950068e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa9400098e0 tx=0x7fa9400091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94ffff700 1 -- 172.21.15.37:0/2182265637 shutdown_connections 2023-10-06T04:40:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94ffff700 1 --2- 172.21.15.37:0/2182265637 >> v2:172.21.15.83:3300/0 conn(0x7fa9500cab70 0x7fa950069340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94ffff700 1 --2- 172.21.15.37:0/2182265637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa95009b2b0 0x7fa950068e00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94ffff700 1 -- 172.21.15.37:0/2182265637 >> 172.21.15.37:0/2182265637 conn(0x7fa9500667b0 msgr2=0x7fa950066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94ffff700 1 -- 172.21.15.37:0/2182265637 shutdown_connections 2023-10-06T04:40:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.016+0000 7fa94ffff700 1 -- 172.21.15.37:0/2182265637 wait complete. 2023-10-06T04:40:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94ffff700 1 Processor -- start 2023-10-06T04:40:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94ffff700 1 -- start start 2023-10-06T04:40:41.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa95009b2b0 0x7fa950155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9500ca7a0 0x7fa9500c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9500cab70 0x7fa9500c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94ffff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9500c99b0 con 0x7fa95009b2b0 2023-10-06T04:40:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94ffff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9500c4f00 con 0x7fa9500cab70 2023-10-06T04:40:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94ffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501557b0 con 0x7fa9500ca7a0 2023-10-06T04:40:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa95009b2b0 0x7fa950155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa95009b2b0 0x7fa950155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46398/0 (socket says 172.21.15.37:46398) 2023-10-06T04:40:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94effd700 1 -- 172.21.15.37:0/915804267 learned_addr learned my addr 172.21.15.37:0/915804267 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94f7fe700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9500cab70 0x7fa9500c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94e7fc700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9500ca7a0 0x7fa9500c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94effd700 1 -- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9500ca7a0 msgr2=0x7fa9500c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94effd700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9500ca7a0 0x7fa9500c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94effd700 1 -- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9500cab70 msgr2=0x7fa9500c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94effd700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9500cab70 0x7fa9500c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94effd700 1 -- 172.21.15.37:0/915804267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa940009420 con 0x7fa95009b2b0 2023-10-06T04:40:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94e7fc700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9500ca7a0 0x7fa9500c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94effd700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa95009b2b0 0x7fa950155270 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa94400c7c0 tx=0x7fa944007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa936ffd700 1 -- 172.21.15.37:0/915804267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440072e0 con 0x7fa95009b2b0 2023-10-06T04:40:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa936ffd700 1 -- 172.21.15.37:0/915804267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa944007440 con 0x7fa95009b2b0 2023-10-06T04:40:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94ffff700 1 -- 172.21.15.37:0/915804267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95015b5f0 con 0x7fa95009b2b0 2023-10-06T04:40:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa936ffd700 1 -- 172.21.15.37:0/915804267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440057f0 con 0x7fa95009b2b0 2023-10-06T04:40:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.020+0000 7fa94ffff700 1 -- 172.21.15.37:0/915804267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9500c96d0 con 0x7fa95009b2b0 2023-10-06T04:40:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.024+0000 7fa94ffff700 1 -- 172.21.15.37:0/915804267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9500708a0 con 0x7fa95009b2b0 2023-10-06T04:40:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.024+0000 7fa936ffd700 1 -- 172.21.15.37:0/915804267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa944005c20 con 0x7fa95009b2b0 2023-10-06T04:40:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.024+0000 7fa936ffd700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa93c060580 0x7fa93c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.024+0000 7fa936ffd700 1 -- 172.21.15.37:0/915804267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa94407bf70 con 0x7fa95009b2b0 2023-10-06T04:40:41.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.024+0000 7fa94e7fc700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa93c060580 0x7fa93c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.028+0000 7fa94e7fc700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa93c060580 0x7fa93c062a30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa95009b680 tx=0x7fa940017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:41.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.032+0000 7fa936ffd700 1 -- 172.21.15.37:0/915804267 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa944049be0 con 0x7fa95009b2b0 2023-10-06T04:40:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.192+0000 7fa94ffff700 1 -- 172.21.15.37:0/915804267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa95006c0a0 con 0x7fa95009b2b0 2023-10-06T04:40:41.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.192+0000 7fa936ffd700 1 -- 172.21.15.37:0/915804267 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9440170a0 con 0x7fa95009b2b0 2023-10-06T04:40:41.198 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:40:41.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.192+0000 7fa94ffff700 1 -- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa93c060580 msgr2=0x7fa93c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.192+0000 7fa94ffff700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa93c060580 0x7fa93c062a30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa95009b680 tx=0x7fa940017000 comp rx=0 tx=0).stop 2023-10-06T04:40:41.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.192+0000 7fa94ffff700 1 -- 172.21.15.37:0/915804267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa95009b2b0 msgr2=0x7fa950155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.192+0000 7fa94ffff700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa95009b2b0 0x7fa950155270 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa94400c7c0 tx=0x7fa944007c80 comp rx=0 tx=0).stop 2023-10-06T04:40:41.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.192+0000 7fa94ffff700 1 -- 172.21.15.37:0/915804267 shutdown_connections 2023-10-06T04:40:41.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.192+0000 7fa94ffff700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa93c060580 0x7fa93c062a30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.192+0000 7fa94ffff700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9500cab70 0x7fa9500c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.192+0000 7fa94ffff700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9500ca7a0 0x7fa9500c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.192+0000 7fa94ffff700 1 --2- 172.21.15.37:0/915804267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa95009b2b0 0x7fa950155270 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.192+0000 7fa94ffff700 1 -- 172.21.15.37:0/915804267 >> 172.21.15.37:0/915804267 conn(0x7fa9500667b0 msgr2=0x7fa950156050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:41.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.196+0000 7fa94ffff700 1 -- 172.21.15.37:0/915804267 shutdown_connections 2023-10-06T04:40:41.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.196+0000 7fa94ffff700 1 -- 172.21.15.37:0/915804267 wait complete. 2023-10-06T04:40:41.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:41.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.308+0000 7fb143fff700 1 Processor -- start 2023-10-06T04:40:41.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.308+0000 7fb143fff700 1 -- start start 2023-10-06T04:40:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb144158b30 0x7fb14406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1440cb460 0x7fb14406ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1440cd620 con 0x7fb144158f00 2023-10-06T04:40:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14406f530 con 0x7fb1440cb460 2023-10-06T04:40:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1440c7b00 con 0x7fb144158b30 2023-10-06T04:40:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb1437fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1440cb460 0x7fb14406ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb142ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb144158b30 0x7fb14406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb1437fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1440cb460 0x7fb14406ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46412/0 (socket says 172.21.15.37:46412) 2023-10-06T04:40:41.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb1437fe700 1 -- 172.21.15.37:0/3087900731 learned_addr learned my addr 172.21.15.37:0/3087900731 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:41.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb1427fc700 1 --1- 172.21.15.37:0/3087900731 >> v1:172.21.15.83:6789/0 conn(0x7fb144158f00 0x7fb1440cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:37192/0 (socket says 172.21.15.37:37192) 2023-10-06T04:40:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb1437fe700 1 -- 172.21.15.37:0/3087900731 >> v2:172.21.15.83:3300/0 conn(0x7fb144158b30 msgr2=0x7fb14406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb1437fe700 1 --2- 172.21.15.37:0/3087900731 >> v2:172.21.15.83:3300/0 conn(0x7fb144158b30 0x7fb14406e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb1437fe700 1 -- 172.21.15.37:0/3087900731 >> v1:172.21.15.83:6789/0 conn(0x7fb144158f00 legacy=0x7fb1440cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb1437fe700 1 -- 172.21.15.37:0/3087900731 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440c7210 con 0x7fb1440cb460 2023-10-06T04:40:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb141ffb700 1 -- 172.21.15.37:0/3087900731 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232586524 0 0) 0x7fb1440cd620 con 0x7fb144158f00 2023-10-06T04:40:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb1437fe700 1 --2- 172.21.15.37:0/3087900731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440cb460 0x7fb14406ebd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb14406d800 tx=0x7fb13c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1813a66703d5291f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb141ffb700 1 -- 172.21.15.37:0/3087900731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00e070 con 0x7fb1440cb460 2023-10-06T04:40:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb141ffb700 1 -- 172.21.15.37:0/3087900731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c00ba20 con 0x7fb1440cb460 2023-10-06T04:40:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb141ffb700 1 -- 172.21.15.37:0/3087900731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0092e0 con 0x7fb1440cb460 2023-10-06T04:40:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 -- 172.21.15.37:0/3087900731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440cb460 msgr2=0x7fb14406ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 --2- 172.21.15.37:0/3087900731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440cb460 0x7fb14406ebd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb14406d800 tx=0x7fb13c009840 comp rx=0 tx=0).stop 2023-10-06T04:40:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 -- 172.21.15.37:0/3087900731 shutdown_connections 2023-10-06T04:40:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 --2- 172.21.15.37:0/3087900731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440cb460 0x7fb14406ebd0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 --2- 172.21.15.37:0/3087900731 >> v2:172.21.15.83:3300/0 conn(0x7fb144158b30 0x7fb14406e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 -- 172.21.15.37:0/3087900731 >> 172.21.15.37:0/3087900731 conn(0x7fb14406b210 msgr2=0x7fb1440cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 -- 172.21.15.37:0/3087900731 shutdown_connections 2023-10-06T04:40:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.312+0000 7fb143fff700 1 -- 172.21.15.37:0/3087900731 wait complete. 2023-10-06T04:40:41.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.316+0000 7fb143fff700 1 Processor -- start 2023-10-06T04:40:41.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.316+0000 7fb143fff700 1 -- start start 2023-10-06T04:40:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.316+0000 7fb143fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440cb460 0x7fb14413fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.316+0000 7fb143fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb144158b30 0x7fb14415c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.316+0000 7fb143fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb144158f00 0x7fb14415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.316+0000 7fb143fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440b0870 con 0x7fb1440cb460 2023-10-06T04:40:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.316+0000 7fb143fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440aff80 con 0x7fb144158f00 2023-10-06T04:40:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.316+0000 7fb143fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440b0220 con 0x7fb144158b30 2023-10-06T04:40:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.316+0000 7fb142ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440cb460 0x7fb14413fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.316+0000 7fb142ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440cb460 0x7fb14413fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46420/0 (socket says 172.21.15.37:46420) 2023-10-06T04:40:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.316+0000 7fb142ffd700 1 -- 172.21.15.37:0/2523420246 learned_addr learned my addr 172.21.15.37:0/2523420246 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb1437fe700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb144158f00 0x7fb14415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb1427fc700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb144158b30 0x7fb14415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb142ffd700 1 -- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb144158b30 msgr2=0x7fb14415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb142ffd700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb144158b30 0x7fb14415c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb142ffd700 1 -- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb144158f00 msgr2=0x7fb14415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb142ffd700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb144158f00 0x7fb14415cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb142ffd700 1 -- 172.21.15.37:0/2523420246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c009ae0 con 0x7fb1440cb460 2023-10-06T04:40:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb142ffd700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440cb460 0x7fb14413fcc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb13400ec80 tx=0x7fb1340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb13affd700 1 -- 172.21.15.37:0/2523420246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13400c850 con 0x7fb1440cb460 2023-10-06T04:40:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb13affd700 1 -- 172.21.15.37:0/2523420246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13400c9d0 con 0x7fb1440cb460 2023-10-06T04:40:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb143fff700 1 -- 172.21.15.37:0/2523420246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1440b0500 con 0x7fb1440cb460 2023-10-06T04:40:41.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb13affd700 1 -- 172.21.15.37:0/2523420246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13400cd90 con 0x7fb1440cb460 2023-10-06T04:40:41.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb143fff700 1 -- 172.21.15.37:0/2523420246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb144140200 con 0x7fb1440cb460 2023-10-06T04:40:41.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb13affd700 1 -- 172.21.15.37:0/2523420246 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb134013680 con 0x7fb1440cb460 2023-10-06T04:40:41.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.320+0000 7fb143fff700 1 -- 172.21.15.37:0/2523420246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1440708a0 con 0x7fb1440cb460 2023-10-06T04:40:41.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.324+0000 7fb13affd700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb124060580 0x7fb124062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.324+0000 7fb13affd700 1 -- 172.21.15.37:0/2523420246 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fb13407cd50 con 0x7fb1440cb460 2023-10-06T04:40:41.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.324+0000 7fb1427fc700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb124060580 0x7fb124062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.324+0000 7fb1427fc700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb124060580 0x7fb124062a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb1441545d0 tx=0x7fb12c007ef0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:41.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.332+0000 7fb13affd700 1 -- 172.21.15.37:0/2523420246 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb134080030 con 0x7fb1440cb460 2023-10-06T04:40:41.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 -- 172.21.15.37:0/2523420246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb14406f250 con 0x7fb1440cb460 2023-10-06T04:40:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb13affd700 1 -- 172.21.15.37:0/2523420246 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fb13404d050 con 0x7fb1440cb460 2023-10-06T04:40:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:41.525 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3094155806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3094155806},{"type":"v1","addr":"172.21.15.83:6837","nonce":3094155806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/968432746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":968432746},{"type":"v1","addr":"172.21.15.37:6833","nonce":968432746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2573831912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2573831912},{"type":"v1","addr":"172.21.15.37:6835","nonce":2573831912}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:16.392787+0000","modified":"2023-10-06T04:40:34.660873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":43,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6835/3283827040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3283827040},{"type":"v1","addr":"172.21.15.83:6835","nonce":3283827040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 -- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb124060580 msgr2=0x7fb124062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb124060580 0x7fb124062a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb1441545d0 tx=0x7fb12c007ef0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 -- 172.21.15.37:0/2523420246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440cb460 msgr2=0x7fb14413fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440cb460 0x7fb14413fcc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb13400ec80 tx=0x7fb1340091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 -- 172.21.15.37:0/2523420246 shutdown_connections 2023-10-06T04:40:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb124060580 0x7fb124062a30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb144158f00 0x7fb14415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb144158b30 0x7fb14415c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 --2- 172.21.15.37:0/2523420246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440cb460 0x7fb14413fcc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 -- 172.21.15.37:0/2523420246 >> 172.21.15.37:0/2523420246 conn(0x7fb14406b210 msgr2=0x7fb144067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 -- 172.21.15.37:0/2523420246 shutdown_connections 2023-10-06T04:40:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.520+0000 7fb143fff700 1 -- 172.21.15.37:0/2523420246 wait complete. 2023-10-06T04:40:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2023-10-06T04:40:41.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:41.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 Processor -- start 2023-10-06T04:40:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 -- start start 2023-10-06T04:40:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f40cc120 0x7f89f406e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89f406e740 0x7f89f415cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f406dd70 con 0x7f89f40cbd50 2023-10-06T04:40:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f406ebc0 con 0x7f89f406e740 2023-10-06T04:40:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f40add50 con 0x7f89f40cc120 2023-10-06T04:40:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89f406e740 0x7f89f415cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89f406e740 0x7f89f415cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46428/0 (socket says 172.21.15.37:46428) 2023-10-06T04:40:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f3fff700 1 -- 172.21.15.37:0/288798191 learned_addr learned my addr 172.21.15.37:0/288798191 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f2ffd700 1 --2- 172.21.15.37:0/288798191 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f40cc120 0x7f89f406e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f2ffd700 1 -- 172.21.15.37:0/288798191 >> v2:172.21.15.37:3300/0 conn(0x7f89f406e740 msgr2=0x7f89f415cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f2ffd700 1 --2- 172.21.15.37:0/288798191 >> v2:172.21.15.37:3300/0 conn(0x7f89f406e740 0x7f89f415cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f2ffd700 1 -- 172.21.15.37:0/288798191 >> v1:172.21.15.83:6789/0 conn(0x7f89f40cbd50 legacy=0x7f89f40c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f2ffd700 1 -- 172.21.15.37:0/288798191 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f40ae030 con 0x7f89f40cc120 2023-10-06T04:40:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f2ffd700 1 --2- 172.21.15.37:0/288798191 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f40cc120 0x7f89f406e200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89e40098e0 tx=0x7f89e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38e0d3e7fd6db6b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f27fc700 1 -- 172.21.15.37:0/288798191 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e400b640 con 0x7f89f40cc120 2023-10-06T04:40:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f27fc700 1 -- 172.21.15.37:0/288798191 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e400b7a0 con 0x7f89f40cc120 2023-10-06T04:40:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f27fc700 1 -- 172.21.15.37:0/288798191 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e400bb40 con 0x7f89f40cc120 2023-10-06T04:40:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 -- 172.21.15.37:0/288798191 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f40cc120 msgr2=0x7f89f406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 --2- 172.21.15.37:0/288798191 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f40cc120 0x7f89f406e200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89e40098e0 tx=0x7f89e40091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 -- 172.21.15.37:0/288798191 shutdown_connections 2023-10-06T04:40:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 --2- 172.21.15.37:0/288798191 >> v2:172.21.15.37:3300/0 conn(0x7f89f406e740 0x7f89f415cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 --2- 172.21.15.37:0/288798191 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f40cc120 0x7f89f406e200 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 -- 172.21.15.37:0/288798191 >> 172.21.15.37:0/288798191 conn(0x7f89f40667b0 msgr2=0x7f89f4066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 -- 172.21.15.37:0/288798191 shutdown_connections 2023-10-06T04:40:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.640+0000 7f89f9df1700 1 -- 172.21.15.37:0/288798191 wait complete. 2023-10-06T04:40:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f9df1700 1 Processor -- start 2023-10-06T04:40:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f9df1700 1 -- start start 2023-10-06T04:40:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f9df1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89f406e740 0x7f89f4146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f9df1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f40cbd50 0x7f89f4160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f9df1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f40cc120 0x7f89f4146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f9df1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f415ed90 con 0x7f89f40cbd50 2023-10-06T04:40:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f9df1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f415e1a0 con 0x7f89f406e740 2023-10-06T04:40:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f9df1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f415e460 con 0x7f89f40cc120 2023-10-06T04:40:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f40cbd50 0x7f89f4160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f40cbd50 0x7f89f4160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46432/0 (socket says 172.21.15.37:46432) 2023-10-06T04:40:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f2ffd700 1 -- 172.21.15.37:0/771912678 learned_addr learned my addr 172.21.15.37:0/771912678 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f3fff700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f40cc120 0x7f89f4146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f37fe700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89f406e740 0x7f89f4146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f3fff700 1 -- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89f406e740 msgr2=0x7f89f4146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f3fff700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89f406e740 0x7f89f4146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f3fff700 1 -- 172.21.15.37:0/771912678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f40cbd50 msgr2=0x7f89f4160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f3fff700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f40cbd50 0x7f89f4160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f3fff700 1 -- 172.21.15.37:0/771912678 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e4009420 con 0x7f89f40cc120 2023-10-06T04:40:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.644+0000 7f89f2ffd700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f40cbd50 0x7f89f4160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.648+0000 7f89f3fff700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f40cc120 0x7f89f4146d30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009e50 tx=0x7f89ec00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.648+0000 7f89db7fe700 1 -- 172.21.15.37:0/771912678 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00c890 con 0x7f89f40cc120 2023-10-06T04:40:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.648+0000 7f89db7fe700 1 -- 172.21.15.37:0/771912678 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec00f040 con 0x7f89f40cc120 2023-10-06T04:40:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.648+0000 7f89db7fe700 1 -- 172.21.15.37:0/771912678 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00cc40 con 0x7f89f40cc120 2023-10-06T04:40:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.648+0000 7f89f9df1700 1 -- 172.21.15.37:0/771912678 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f415e740 con 0x7f89f40cc120 2023-10-06T04:40:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.648+0000 7f89f9df1700 1 -- 172.21.15.37:0/771912678 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f41468a0 con 0x7f89f40cc120 2023-10-06T04:40:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.648+0000 7f89f9df1700 1 -- 172.21.15.37:0/771912678 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f415ef40 con 0x7f89f40cc120 2023-10-06T04:40:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.648+0000 7f89db7fe700 1 -- 172.21.15.37:0/771912678 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f89ec014440 con 0x7f89f40cc120 2023-10-06T04:40:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.648+0000 7f89db7fe700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f89e00605d0 0x7f89e0062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.648+0000 7f89db7fe700 1 -- 172.21.15.37:0/771912678 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f89ec07d170 con 0x7f89f40cc120 2023-10-06T04:40:41.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.648+0000 7f89f37fe700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f89e00605d0 0x7f89e0062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.652+0000 7f89f37fe700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f89e00605d0 0x7f89e0062a80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f89e8003a10 tx=0x7f89e8000bc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.660+0000 7f89db7fe700 1 -- 172.21.15.37:0/771912678 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f89ec04d3f0 con 0x7f89f40cc120 2023-10-06T04:40:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.824+0000 7f89f9df1700 1 -- 172.21.15.37:0/771912678 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89f4070ee0 con 0x7f89f40cc120 2023-10-06T04:40:41.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89db7fe700 1 -- 172.21.15.37:0/771912678 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+17152 (secure 0 0 0) 0x7f89ec050a10 con 0x7f89f40cc120 2023-10-06T04:40:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":43,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:40:31.632062+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:14.249153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:15.385254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6837/1183217493":"2023-10-07T04:40:31.632008+0000","172.21.15.83:6836/1183217493":"2023-10-07T04:40:31.632008+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:41.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89f9df1700 1 -- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f89e00605d0 msgr2=0x7f89e0062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89f9df1700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f89e00605d0 0x7f89e0062a80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f89e8003a10 tx=0x7f89e8000bc0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89f9df1700 1 -- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f40cc120 msgr2=0x7f89f4146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89f9df1700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f40cc120 0x7f89f4146d30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009e50 tx=0x7f89ec00b040 comp rx=0 tx=0).stop 2023-10-06T04:40:41.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89f9df1700 1 -- 172.21.15.37:0/771912678 shutdown_connections 2023-10-06T04:40:41.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89f9df1700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f89e00605d0 0x7f89e0062a80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89f9df1700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f40cc120 0x7f89f4146d30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89f9df1700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f40cbd50 0x7f89f4160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89f9df1700 1 --2- 172.21.15.37:0/771912678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89f406e740 0x7f89f4146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89f9df1700 1 -- 172.21.15.37:0/771912678 >> 172.21.15.37:0/771912678 conn(0x7f89f40667b0 msgr2=0x7f89f40ca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:41.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89f9df1700 1 -- 172.21.15.37:0/771912678 shutdown_connections 2023-10-06T04:40:41.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.828+0000 7f89f9df1700 1 -- 172.21.15.37:0/771912678 wait complete. 2023-10-06T04:40:41.848 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:40:41.849 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.944+0000 7f7f93169700 1 Processor -- start 2023-10-06T04:40:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.944+0000 7f7f93169700 1 -- start start 2023-10-06T04:40:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.944+0000 7f7f93169700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c0acdc0 0x7f7f8c0ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.944+0000 7f7f93169700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f8c06d9a0 0x7f7f8c158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.944+0000 7f7f93169700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8c0cd7c0 con 0x7f7f8c0ca820 2023-10-06T04:40:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.944+0000 7f7f93169700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8c158050 con 0x7f7f8c06d9a0 2023-10-06T04:40:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.944+0000 7f7f93169700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0ccbb0 con 0x7f7f8c0acdc0 2023-10-06T04:40:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.944+0000 7f7f91706700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f8c06d9a0 0x7f7f8c158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.944+0000 7f7f91706700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f8c06d9a0 0x7f7f8c158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46436/0 (socket says 172.21.15.37:46436) 2023-10-06T04:40:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.944+0000 7f7f91706700 1 -- 172.21.15.37:0/3337656937 learned_addr learned my addr 172.21.15.37:0/3337656937 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.944+0000 7f7f8bfff700 1 --1- 172.21.15.37:0/3337656937 >> v1:172.21.15.37:6789/0 conn(0x7f7f8c0ca820 0x7f7f8c06d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55884/0 (socket says 172.21.15.37:55884) 2023-10-06T04:40:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f90f05700 1 --2- 172.21.15.37:0/3337656937 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c0acdc0 0x7f7f8c0ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f91706700 1 -- 172.21.15.37:0/3337656937 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c0acdc0 msgr2=0x7f7f8c0ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f91706700 1 --2- 172.21.15.37:0/3337656937 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c0acdc0 0x7f7f8c0ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f91706700 1 -- 172.21.15.37:0/3337656937 >> v1:172.21.15.37:6789/0 conn(0x7f7f8c0ca820 legacy=0x7f7f8c06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f91706700 1 -- 172.21.15.37:0/3337656937 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c0cce90 con 0x7f7f8c06d9a0 2023-10-06T04:40:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f91706700 1 --2- 172.21.15.37:0/3337656937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8c06d9a0 0x7f7f8c158410 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009f20 tx=0x7f7f84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3def50835d615357 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f8b7fe700 1 -- 172.21.15.37:0/3337656937 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8400e070 con 0x7f7f8c06d9a0 2023-10-06T04:40:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f8b7fe700 1 -- 172.21.15.37:0/3337656937 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8400ba80 con 0x7f7f8c06d9a0 2023-10-06T04:40:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f8b7fe700 1 -- 172.21.15.37:0/3337656937 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840092e0 con 0x7f7f8c06d9a0 2023-10-06T04:40:41.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f93169700 1 -- 172.21.15.37:0/3337656937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8c06d9a0 msgr2=0x7f7f8c158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f93169700 1 --2- 172.21.15.37:0/3337656937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8c06d9a0 0x7f7f8c158410 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009f20 tx=0x7f7f84009840 comp rx=0 tx=0).stop 2023-10-06T04:40:41.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f93169700 1 -- 172.21.15.37:0/3337656937 shutdown_connections 2023-10-06T04:40:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f93169700 1 --2- 172.21.15.37:0/3337656937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8c06d9a0 0x7f7f8c158410 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f93169700 1 --2- 172.21.15.37:0/3337656937 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c0acdc0 0x7f7f8c0ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f93169700 1 -- 172.21.15.37:0/3337656937 >> 172.21.15.37:0/3337656937 conn(0x7f7f8c06c430 msgr2=0x7f7f8c0af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f93169700 1 -- 172.21.15.37:0/3337656937 shutdown_connections 2023-10-06T04:40:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f93169700 1 -- 172.21.15.37:0/3337656937 wait complete. 2023-10-06T04:40:41.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f93169700 1 Processor -- start 2023-10-06T04:40:41.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.948+0000 7f7f93169700 1 -- start start 2023-10-06T04:40:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f93169700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c06d9a0 0x7f7f8c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f93169700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8c0acdc0 0x7f7f8c151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f93169700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f8c0ca820 0x7f7f8c0c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f93169700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0c7c10 con 0x7f7f8c0acdc0 2023-10-06T04:40:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f93169700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0c7930 con 0x7f7f8c0ca820 2023-10-06T04:40:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f93169700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0c8130 con 0x7f7f8c06d9a0 2023-10-06T04:40:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f8bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8c0acdc0 0x7f7f8c151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f8bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8c0acdc0 0x7f7f8c151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46450/0 (socket says 172.21.15.37:46450) 2023-10-06T04:40:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f8bfff700 1 -- 172.21.15.37:0/3607553939 learned_addr learned my addr 172.21.15.37:0/3607553939 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f91706700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f8c0ca820 0x7f7f8c0c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f90f05700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c06d9a0 0x7f7f8c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f8bfff700 1 -- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c06d9a0 msgr2=0x7f7f8c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f8bfff700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c06d9a0 0x7f7f8c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f8bfff700 1 -- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f8c0ca820 msgr2=0x7f7f8c0c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f8bfff700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f8c0ca820 0x7f7f8c0c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:41.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f8bfff700 1 -- 172.21.15.37:0/3607553939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f84009ae0 con 0x7f7f8c0acdc0 2023-10-06T04:40:41.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f8bfff700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8c0acdc0 0x7f7f8c151ff0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800c590 tx=0x7f7f78007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:41.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f88ff9700 1 -- 172.21.15.37:0/3607553939 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78005a70 con 0x7f7f8c0acdc0 2023-10-06T04:40:41.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f88ff9700 1 -- 172.21.15.37:0/3607553939 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f78005bd0 con 0x7f7f8c0acdc0 2023-10-06T04:40:41.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f93169700 1 -- 172.21.15.37:0/3607553939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8c0c8410 con 0x7f7f8c0acdc0 2023-10-06T04:40:41.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f88ff9700 1 -- 172.21.15.37:0/3607553939 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f780070d0 con 0x7f7f8c0acdc0 2023-10-06T04:40:41.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.952+0000 7f7f93169700 1 -- 172.21.15.37:0/3607553939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8c0aede0 con 0x7f7f8c0acdc0 2023-10-06T04:40:41.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.956+0000 7f7f93169700 1 -- 172.21.15.37:0/3607553939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8c070ee0 con 0x7f7f8c0acdc0 2023-10-06T04:40:41.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.956+0000 7f7f88ff9700 1 -- 172.21.15.37:0/3607553939 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7f78007440 con 0x7f7f8c0acdc0 2023-10-06T04:40:41.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.956+0000 7f7f88ff9700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7f74060550 0x7f7f74062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:41.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.956+0000 7f7f88ff9700 1 -- 172.21.15.37:0/3607553939 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7f7807bd70 con 0x7f7f8c0acdc0 2023-10-06T04:40:41.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.956+0000 7f7f90f05700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7f74060550 0x7f7f74062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:41.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.956+0000 7f7f90f05700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7f74060550 0x7f7f74062a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c006fd0 tx=0x7f7f7c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:41.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:41.964+0000 7f7f88ff9700 1 -- 172.21.15.37:0/3607553939 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7f7804c070 con 0x7f7f8c0acdc0 2023-10-06T04:40:42.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 -- 172.21.15.37:0/3607553939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f8c0cd170 con 0x7f7f8c0acdc0 2023-10-06T04:40:42.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f88ff9700 1 -- 172.21.15.37:0/3607553939 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f7f7804f690 con 0x7f7f8c0acdc0 2023-10-06T04:40:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:42.165 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3094155806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3094155806},{"type":"v1","addr":"172.21.15.83:6837","nonce":3094155806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/968432746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":968432746},{"type":"v1","addr":"172.21.15.37:6833","nonce":968432746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2573831912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2573831912},{"type":"v1","addr":"172.21.15.37:6835","nonce":2573831912}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:16.392787+0000","modified":"2023-10-06T04:40:34.660873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":43,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6835/3283827040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3283827040},{"type":"v1","addr":"172.21.15.83:6835","nonce":3283827040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:42.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 -- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7f74060550 msgr2=0x7f7f74062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7f74060550 0x7f7f74062a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c006fd0 tx=0x7f7f7c008040 comp rx=0 tx=0).stop 2023-10-06T04:40:42.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 -- 172.21.15.37:0/3607553939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8c0acdc0 msgr2=0x7f7f8c151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8c0acdc0 0x7f7f8c151ff0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800c590 tx=0x7f7f78007f90 comp rx=0 tx=0).stop 2023-10-06T04:40:42.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 -- 172.21.15.37:0/3607553939 shutdown_connections 2023-10-06T04:40:42.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7f74060550 0x7f7f74062a00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f8c0ca820 0x7f7f8c0c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8c0acdc0 0x7f7f8c151ff0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 --2- 172.21.15.37:0/3607553939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c06d9a0 0x7f7f8c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 -- 172.21.15.37:0/3607553939 >> 172.21.15.37:0/3607553939 conn(0x7f7f8c06c430 msgr2=0x7f7f8c0cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:42.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 -- 172.21.15.37:0/3607553939 shutdown_connections 2023-10-06T04:40:42.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.160+0000 7f7f93169700 1 -- 172.21.15.37:0/3607553939 wait complete. 2023-10-06T04:40:42.169 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2023-10-06T04:40:42.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:42.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 Processor -- start 2023-10-06T04:40:42.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 -- start start 2023-10-06T04:40:42.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56881501d0 0x7f56881575b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5688157af0 0x7f56880cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56880c9750 con 0x7f56881505a0 2023-10-06T04:40:42.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56880c9ff0 con 0x7f56881501d0 2023-10-06T04:40:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568815a7f0 con 0x7f5688157af0 2023-10-06T04:40:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f5687fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56881501d0 0x7f56881575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f5687fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56881501d0 0x7f56881575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46460/0 (socket says 172.21.15.37:46460) 2023-10-06T04:40:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f5687fff700 1 -- 172.21.15.37:0/773575437 learned_addr learned my addr 172.21.15.37:0/773575437 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f56877fe700 1 --2- 172.21.15.37:0/773575437 >> v2:172.21.15.83:3300/0 conn(0x7f5688157af0 0x7f56880cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f5687fff700 1 -- 172.21.15.37:0/773575437 >> v2:172.21.15.83:3300/0 conn(0x7f5688157af0 msgr2=0x7f56880cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f5687fff700 1 --2- 172.21.15.37:0/773575437 >> v2:172.21.15.83:3300/0 conn(0x7f5688157af0 0x7f56880cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f5687fff700 1 -- 172.21.15.37:0/773575437 >> v1:172.21.15.83:6789/0 conn(0x7f56881505a0 legacy=0x7f56880ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f5687fff700 1 -- 172.21.15.37:0/773575437 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56880c99a0 con 0x7f56881501d0 2023-10-06T04:40:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f56877fe700 1 --2- 172.21.15.37:0/773575437 >> v2:172.21.15.83:3300/0 conn(0x7f5688157af0 0x7f56880cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f5687fff700 1 --2- 172.21.15.37:0/773575437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56881501d0 0x7f56881575b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5688159940 tx=0x7f5678009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b917fec0c8674cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f5686ffd700 1 -- 172.21.15.37:0/773575437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567800b860 con 0x7f56881501d0 2023-10-06T04:40:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f5686ffd700 1 -- 172.21.15.37:0/773575437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567800b9c0 con 0x7f56881501d0 2023-10-06T04:40:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f5686ffd700 1 -- 172.21.15.37:0/773575437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567800bd60 con 0x7f56881501d0 2023-10-06T04:40:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 -- 172.21.15.37:0/773575437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56881501d0 msgr2=0x7f56881575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 --2- 172.21.15.37:0/773575437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56881501d0 0x7f56881575b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5688159940 tx=0x7f5678009250 comp rx=0 tx=0).stop 2023-10-06T04:40:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 -- 172.21.15.37:0/773575437 shutdown_connections 2023-10-06T04:40:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 --2- 172.21.15.37:0/773575437 >> v2:172.21.15.83:3300/0 conn(0x7f5688157af0 0x7f56880cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 --2- 172.21.15.37:0/773575437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56881501d0 0x7f56881575b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 -- 172.21.15.37:0/773575437 >> 172.21.15.37:0/773575437 conn(0x7f56880667b0 msgr2=0x7f5688066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:42.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 -- 172.21.15.37:0/773575437 shutdown_connections 2023-10-06T04:40:42.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.284+0000 7f568e459700 1 -- 172.21.15.37:0/773575437 wait complete. 2023-10-06T04:40:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568e459700 1 Processor -- start 2023-10-06T04:40:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568e459700 1 -- start start 2023-10-06T04:40:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568e459700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56881501d0 0x7f56881549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568e459700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56881505a0 0x7f5688152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568e459700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5688157af0 0x7f5688149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568e459700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5688163fa0 con 0x7f5688157af0 2023-10-06T04:40:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568e459700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56881534f0 con 0x7f56881501d0 2023-10-06T04:40:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568e459700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5688155c50 con 0x7f56881505a0 2023-10-06T04:40:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568c9f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5688157af0 0x7f5688149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f5687fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56881501d0 0x7f56881549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568c9f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5688157af0 0x7f5688149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46464/0 (socket says 172.21.15.37:46464) 2023-10-06T04:40:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f5687fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56881501d0 0x7f56881549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:54302/0 (socket says 172.21.15.37:54302) 2023-10-06T04:40:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568c9f6700 1 -- 172.21.15.37:0/1585002111 learned_addr learned my addr 172.21.15.37:0/1585002111 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f56877fe700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56881505a0 0x7f5688152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568c9f6700 1 -- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56881505a0 msgr2=0x7f5688152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568c9f6700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56881505a0 0x7f5688152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568c9f6700 1 -- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56881501d0 msgr2=0x7f56881549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568c9f6700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56881501d0 0x7f56881549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568c9f6700 1 -- 172.21.15.37:0/1585002111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780094f0 con 0x7f5688157af0 2023-10-06T04:40:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568c9f6700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5688157af0 0x7f5688149640 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f568000c8e0 tx=0x7f5680001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f566ffff700 1 -- 172.21.15.37:0/1585002111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680012630 con 0x7f5688157af0 2023-10-06T04:40:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f566ffff700 1 -- 172.21.15.37:0/1585002111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5680012790 con 0x7f5688157af0 2023-10-06T04:40:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f568e459700 1 -- 172.21.15.37:0/1585002111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5688149b80 con 0x7f5688157af0 2023-10-06T04:40:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.288+0000 7f566ffff700 1 -- 172.21.15.37:0/1585002111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680012b50 con 0x7f5688157af0 2023-10-06T04:40:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.292+0000 7f568e459700 1 -- 172.21.15.37:0/1585002111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5688155320 con 0x7f5688157af0 2023-10-06T04:40:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.292+0000 7f568e459700 1 -- 172.21.15.37:0/1585002111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5688070ee0 con 0x7f5688157af0 2023-10-06T04:40:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.292+0000 7f566ffff700 1 -- 172.21.15.37:0/1585002111 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f568001a3a0 con 0x7f5688157af0 2023-10-06T04:40:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.292+0000 7f566ffff700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5674060550 0x7f5674062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.292+0000 7f566ffff700 1 -- 172.21.15.37:0/1585002111 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f568007cbe0 con 0x7f5688157af0 2023-10-06T04:40:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.292+0000 7f5687fff700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5674060550 0x7f5674062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.296+0000 7f5687fff700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5674060550 0x7f5674062a00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5688159940 tx=0x7f5678017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:42.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.300+0000 7f566ffff700 1 -- 172.21.15.37:0/1585002111 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f568004cee0 con 0x7f5688157af0 2023-10-06T04:40:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.492+0000 7f568e459700 1 -- 172.21.15.37:0/1585002111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56880c9c80 con 0x7f5688157af0 2023-10-06T04:40:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.492+0000 7f566ffff700 1 -- 172.21.15.37:0/1585002111 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f5680050500 con 0x7f5688157af0 2023-10-06T04:40:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:42.499 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3094155806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3094155806},{"type":"v1","addr":"172.21.15.83:6837","nonce":3094155806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/968432746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":968432746},{"type":"v1","addr":"172.21.15.37:6833","nonce":968432746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2573831912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2573831912},{"type":"v1","addr":"172.21.15.37:6835","nonce":2573831912}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:16.392787+0000","modified":"2023-10-06T04:40:34.660873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":43,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6835/3283827040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3283827040},{"type":"v1","addr":"172.21.15.83:6835","nonce":3283827040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.496+0000 7f568e459700 1 -- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5674060550 msgr2=0x7f5674062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.496+0000 7f568e459700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5674060550 0x7f5674062a00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5688159940 tx=0x7f5678017000 comp rx=0 tx=0).stop 2023-10-06T04:40:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.496+0000 7f568e459700 1 -- 172.21.15.37:0/1585002111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5688157af0 msgr2=0x7f5688149640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.496+0000 7f568e459700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5688157af0 0x7f5688149640 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f568000c8e0 tx=0x7f5680001710 comp rx=0 tx=0).stop 2023-10-06T04:40:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.496+0000 7f568e459700 1 -- 172.21.15.37:0/1585002111 shutdown_connections 2023-10-06T04:40:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.496+0000 7f568e459700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5674060550 0x7f5674062a00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.496+0000 7f568e459700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5688157af0 0x7f5688149640 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.496+0000 7f568e459700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56881505a0 0x7f5688152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.496+0000 7f568e459700 1 --2- 172.21.15.37:0/1585002111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56881501d0 0x7f56881549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.496+0000 7f568e459700 1 -- 172.21.15.37:0/1585002111 >> 172.21.15.37:0/1585002111 conn(0x7f56880667b0 msgr2=0x7f56880ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:42.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.496+0000 7f568e459700 1 -- 172.21.15.37:0/1585002111 shutdown_connections 2023-10-06T04:40:42.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.496+0000 7f568e459700 1 -- 172.21.15.37:0/1585002111 wait complete. 2023-10-06T04:40:42.503 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2023-10-06T04:40:42.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.616+0000 7f472359e700 1 Processor -- start 2023-10-06T04:40:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.616+0000 7f472359e700 1 -- start start 2023-10-06T04:40:42.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f472406ece0 0x7f47241560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47240c6e70 0x7f4724159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240cd250 con 0x7f47240ccdb0 2023-10-06T04:40:42.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4724156710 con 0x7f47240c6e70 2023-10-06T04:40:42.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47241569f0 con 0x7f472406ece0 2023-10-06T04:40:42.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f4722d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47240c6e70 0x7f4724159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f4722d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47240c6e70 0x7f4724159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46474/0 (socket says 172.21.15.37:46474) 2023-10-06T04:40:42.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f4722d9d700 1 -- 172.21.15.37:0/2968865037 learned_addr learned my addr 172.21.15.37:0/2968865037 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:42.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472259c700 1 --2- 172.21.15.37:0/2968865037 >> v2:172.21.15.83:3300/0 conn(0x7f472406ece0 0x7f47241560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472159a700 1 -- 172.21.15.37:0/2968865037 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054815793 0 0) 0x7f47240cd250 con 0x7f47240ccdb0 2023-10-06T04:40:42.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472159a700 1 -- 172.21.15.37:0/2968865037 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f470c003570 con 0x7f47240ccdb0 2023-10-06T04:40:42.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f4722d9d700 1 -- 172.21.15.37:0/2968865037 >> v2:172.21.15.83:3300/0 conn(0x7f472406ece0 msgr2=0x7f47241560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:42.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f4722d9d700 1 --2- 172.21.15.37:0/2968865037 >> v2:172.21.15.83:3300/0 conn(0x7f472406ece0 0x7f47241560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f4722d9d700 1 -- 172.21.15.37:0/2968865037 >> v1:172.21.15.83:6789/0 conn(0x7f47240ccdb0 legacy=0x7f472406f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f4722d9d700 1 -- 172.21.15.37:0/2968865037 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4724156cd0 con 0x7f47240c6e70 2023-10-06T04:40:42.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f4722d9d700 1 --2- 172.21.15.37:0/2968865037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47240c6e70 0x7f4724159c80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f472406ddc0 tx=0x7f471c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd5491d5a139708 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:42.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472159a700 1 -- 172.21.15.37:0/2968865037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c00e070 con 0x7f47240c6e70 2023-10-06T04:40:42.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472159a700 1 -- 172.21.15.37:0/2968865037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c00b970 con 0x7f47240c6e70 2023-10-06T04:40:42.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472159a700 1 -- 172.21.15.37:0/2968865037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0092e0 con 0x7f47240c6e70 2023-10-06T04:40:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 -- 172.21.15.37:0/2968865037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47240c6e70 msgr2=0x7f4724159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 --2- 172.21.15.37:0/2968865037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47240c6e70 0x7f4724159c80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f472406ddc0 tx=0x7f471c009840 comp rx=0 tx=0).stop 2023-10-06T04:40:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 -- 172.21.15.37:0/2968865037 shutdown_connections 2023-10-06T04:40:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 --2- 172.21.15.37:0/2968865037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47240c6e70 0x7f4724159c80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 --2- 172.21.15.37:0/2968865037 >> v2:172.21.15.83:3300/0 conn(0x7f472406ece0 0x7f47241560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 -- 172.21.15.37:0/2968865037 >> 172.21.15.37:0/2968865037 conn(0x7f4724068e00 msgr2=0x7f4724069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 -- 172.21.15.37:0/2968865037 shutdown_connections 2023-10-06T04:40:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.620+0000 7f472359e700 1 -- 172.21.15.37:0/2968865037 wait complete. 2023-10-06T04:40:42.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f472359e700 1 Processor -- start 2023-10-06T04:40:42.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f472359e700 1 -- start start 2023-10-06T04:40:42.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f472359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f472406ece0 0x7f47241490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f472359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47240c6e70 0x7f47240b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f472359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47240ccdb0 0x7f47240c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f472359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240b24e0 con 0x7f472406ece0 2023-10-06T04:40:42.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f472359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240b18d0 con 0x7f47240c6e70 2023-10-06T04:40:42.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f472359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47240b1bb0 con 0x7f47240ccdb0 2023-10-06T04:40:42.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f472259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f472406ece0 0x7f47241490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f472259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f472406ece0 0x7f47241490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46488/0 (socket says 172.21.15.37:46488) 2023-10-06T04:40:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f472259c700 1 -- 172.21.15.37:0/1747048727 learned_addr learned my addr 172.21.15.37:0/1747048727 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f4722d9d700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47240ccdb0 0x7f47240c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f4721d9b700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47240c6e70 0x7f47240b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f4721d9b700 1 -- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47240ccdb0 msgr2=0x7f47240c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f4721d9b700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47240ccdb0 0x7f47240c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f4721d9b700 1 -- 172.21.15.37:0/1747048727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f472406ece0 msgr2=0x7f47241490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f4721d9b700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f472406ece0 0x7f47241490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f4721d9b700 1 -- 172.21.15.37:0/1747048727 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c009ae0 con 0x7f47240c6e70 2023-10-06T04:40:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.624+0000 7f472259c700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f472406ece0 0x7f47241490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.628+0000 7f4721d9b700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47240c6e70 0x7f47240b0f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f471800c560 tx=0x7f4718007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.628+0000 7f47127fc700 1 -- 172.21.15.37:0/1747048727 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718011590 con 0x7f47240c6e70 2023-10-06T04:40:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.628+0000 7f47127fc700 1 -- 172.21.15.37:0/1747048727 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47180116f0 con 0x7f47240c6e70 2023-10-06T04:40:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.628+0000 7f472359e700 1 -- 172.21.15.37:0/1747048727 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47240b1e90 con 0x7f47240c6e70 2023-10-06T04:40:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.628+0000 7f47127fc700 1 -- 172.21.15.37:0/1747048727 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718011ab0 con 0x7f47240c6e70 2023-10-06T04:40:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.628+0000 7f472359e700 1 -- 172.21.15.37:0/1747048727 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47240b1470 con 0x7f47240c6e70 2023-10-06T04:40:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.628+0000 7f472359e700 1 -- 172.21.15.37:0/1747048727 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47240c0310 con 0x7f47240c6e70 2023-10-06T04:40:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.628+0000 7f47127fc700 1 -- 172.21.15.37:0/1747048727 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f471801c460 con 0x7f47240c6e70 2023-10-06T04:40:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.628+0000 7f47127fc700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4704060550 0x7f4704062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.632+0000 7f47127fc700 1 -- 172.21.15.37:0/1747048727 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f471807c660 con 0x7f47240c6e70 2023-10-06T04:40:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.632+0000 7f472259c700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4704060550 0x7f4704062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.632+0000 7f472259c700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4704060550 0x7f4704062a00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4714009fd0 tx=0x7f47140091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:42.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.640+0000 7f47127fc700 1 -- 172.21.15.37:0/1747048727 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f47240c0310 con 0x7f47240c6e70 2023-10-06T04:40:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.804+0000 7f472359e700 1 -- 172.21.15.37:0/1747048727 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47240c0310 con 0x7f47240c6e70 2023-10-06T04:40:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.808+0000 7f47127fc700 1 -- 172.21.15.37:0/1747048727 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+17152 (secure 0 0 0) 0x7f47240c0310 con 0x7f47240c6e70 2023-10-06T04:40:42.814 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:42.814 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":43,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:40:31.632062+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:14.249153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:15.385254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6837/1183217493":"2023-10-07T04:40:31.632008+0000","172.21.15.83:6836/1183217493":"2023-10-07T04:40:31.632008+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:42.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.808+0000 7f472359e700 1 -- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4704060550 msgr2=0x7f4704062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.812+0000 7f472359e700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4704060550 0x7f4704062a00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4714009fd0 tx=0x7f47140091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.812+0000 7f472359e700 1 -- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47240c6e70 msgr2=0x7f47240b0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.812+0000 7f472359e700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47240c6e70 0x7f47240b0f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f471800c560 tx=0x7f4718007d50 comp rx=0 tx=0).stop 2023-10-06T04:40:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.812+0000 7f472359e700 1 -- 172.21.15.37:0/1747048727 shutdown_connections 2023-10-06T04:40:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.812+0000 7f472359e700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4704060550 0x7f4704062a00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.812+0000 7f472359e700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47240c6e70 0x7f47240b0f30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.812+0000 7f472359e700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47240ccdb0 0x7f47240c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.812+0000 7f472359e700 1 --2- 172.21.15.37:0/1747048727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f472406ece0 0x7f47241490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.812+0000 7f472359e700 1 -- 172.21.15.37:0/1747048727 >> 172.21.15.37:0/1747048727 conn(0x7f4724068e00 msgr2=0x7f47240ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.812+0000 7f472359e700 1 -- 172.21.15.37:0/1747048727 shutdown_connections 2023-10-06T04:40:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.812+0000 7f472359e700 1 -- 172.21.15.37:0/1747048727 wait complete. 2023-10-06T04:40:42.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:40:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36422dd700 1 Processor -- start 2023-10-06T04:40:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36422dd700 1 -- start start 2023-10-06T04:40:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36422dd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f363c1558d0 0x7f363c0cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36422dd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f363c155ca0 0x7f363c06e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36422dd700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363c0ca5f0 con 0x7f363c159640 2023-10-06T04:40:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36422dd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363c0ca890 con 0x7f363c155ca0 2023-10-06T04:40:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36422dd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363c0cab70 con 0x7f363c1558d0 2023-10-06T04:40:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36412db700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f363c1558d0 0x7f363c0cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36412db700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f363c1558d0 0x7f363c0cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:54794/0 (socket says 172.21.15.37:54794) 2023-10-06T04:40:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36412db700 1 -- 172.21.15.37:0/1373796292 learned_addr learned my addr 172.21.15.37:0/1373796292 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f3640ada700 1 --2- 172.21.15.37:0/1373796292 >> v2:172.21.15.83:3300/0 conn(0x7f363c155ca0 0x7f363c06e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f363bfff700 1 -- 172.21.15.37:0/1373796292 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508876753 0 0) 0x7f363c0ca5f0 con 0x7f363c159640 2023-10-06T04:40:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36412db700 1 -- 172.21.15.37:0/1373796292 >> v2:172.21.15.83:3300/0 conn(0x7f363c155ca0 msgr2=0x7f363c06e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36412db700 1 --2- 172.21.15.37:0/1373796292 >> v2:172.21.15.83:3300/0 conn(0x7f363c155ca0 0x7f363c06e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36412db700 1 -- 172.21.15.37:0/1373796292 >> v1:172.21.15.83:6789/0 conn(0x7f363c159640 legacy=0x7f363c06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.932+0000 7f36412db700 1 -- 172.21.15.37:0/1373796292 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c0cae50 con 0x7f363c1558d0 2023-10-06T04:40:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f36412db700 1 --2- 172.21.15.37:0/1373796292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f363c1558d0 0x7f363c0cd020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f362c009f20 tx=0x7f362c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8637acbc497e778f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f363bfff700 1 -- 172.21.15.37:0/1373796292 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c00e070 con 0x7f363c1558d0 2023-10-06T04:40:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f363bfff700 1 -- 172.21.15.37:0/1373796292 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c00b9d0 con 0x7f363c1558d0 2023-10-06T04:40:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f363bfff700 1 -- 172.21.15.37:0/1373796292 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c0092e0 con 0x7f363c1558d0 2023-10-06T04:40:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f36422dd700 1 -- 172.21.15.37:0/1373796292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f363c1558d0 msgr2=0x7f363c0cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f36422dd700 1 --2- 172.21.15.37:0/1373796292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f363c1558d0 0x7f363c0cd020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f362c009f20 tx=0x7f362c009840 comp rx=0 tx=0).stop 2023-10-06T04:40:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f36422dd700 1 -- 172.21.15.37:0/1373796292 shutdown_connections 2023-10-06T04:40:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f36422dd700 1 --2- 172.21.15.37:0/1373796292 >> v2:172.21.15.83:3300/0 conn(0x7f363c155ca0 0x7f363c06e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f36422dd700 1 --2- 172.21.15.37:0/1373796292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f363c1558d0 0x7f363c0cd020 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f36422dd700 1 -- 172.21.15.37:0/1373796292 >> 172.21.15.37:0/1373796292 conn(0x7f363c06b210 msgr2=0x7f363c0cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f36422dd700 1 -- 172.21.15.37:0/1373796292 shutdown_connections 2023-10-06T04:40:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f36422dd700 1 -- 172.21.15.37:0/1373796292 wait complete. 2023-10-06T04:40:42.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f36422dd700 1 Processor -- start 2023-10-06T04:40:42.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.936+0000 7f36422dd700 1 -- start start 2023-10-06T04:40:42.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36422dd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f363c1558d0 0x7f363c1423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36422dd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f363c155ca0 0x7f363c1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36422dd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c159640 0x7f363c0c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36422dd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c142920 con 0x7f363c159640 2023-10-06T04:40:42.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36422dd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c1433c0 con 0x7f363c1558d0 2023-10-06T04:40:42.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36422dd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363c1525a0 con 0x7f363c155ca0 2023-10-06T04:40:42.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f3641adc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c159640 0x7f363c0c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f3641adc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c159640 0x7f363c0c1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46502/0 (socket says 172.21.15.37:46502) 2023-10-06T04:40:42.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f3641adc700 1 -- 172.21.15.37:0/1245939917 learned_addr learned my addr 172.21.15.37:0/1245939917 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:42.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36412db700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f363c1558d0 0x7f363c1423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f3640ada700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f363c155ca0 0x7f363c1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f3641adc700 1 -- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f363c155ca0 msgr2=0x7f363c1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f3641adc700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f363c155ca0 0x7f363c1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f3641adc700 1 -- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f363c1558d0 msgr2=0x7f363c1423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:42.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f3641adc700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f363c1558d0 0x7f363c1423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:42.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f3641adc700 1 -- 172.21.15.37:0/1245939917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c009ae0 con 0x7f363c159640 2023-10-06T04:40:42.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f3641adc700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c159640 0x7f363c0c1bd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f363400c4f0 tx=0x7f3634007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:42.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36397fa700 1 -- 172.21.15.37:0/1245939917 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363400ce40 con 0x7f363c159640 2023-10-06T04:40:42.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36397fa700 1 -- 172.21.15.37:0/1245939917 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3634011590 con 0x7f363c159640 2023-10-06T04:40:42.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36422dd700 1 -- 172.21.15.37:0/1245939917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c1522c0 con 0x7f363c159640 2023-10-06T04:40:42.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36397fa700 1 -- 172.21.15.37:0/1245939917 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3634011950 con 0x7f363c159640 2023-10-06T04:40:42.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36422dd700 1 -- 172.21.15.37:0/1245939917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c143050 con 0x7f363c159640 2023-10-06T04:40:42.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.940+0000 7f36422dd700 1 -- 172.21.15.37:0/1245939917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363c143570 con 0x7f363c159640 2023-10-06T04:40:42.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.944+0000 7f36397fa700 1 -- 172.21.15.37:0/1245939917 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3634011d40 con 0x7f363c159640 2023-10-06T04:40:42.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.944+0000 7f36397fa700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f361c060550 0x7f361c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:42.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.944+0000 7f36397fa700 1 -- 172.21.15.37:0/1245939917 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f363407bd30 con 0x7f363c159640 2023-10-06T04:40:42.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.944+0000 7f36412db700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f361c060550 0x7f361c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:42.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.944+0000 7f36412db700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f361c060550 0x7f361c062a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f362c009880 tx=0x7f362c018000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:42.952+0000 7f36397fa700 1 -- 172.21.15.37:0/1245939917 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f363c143570 con 0x7f363c159640 2023-10-06T04:40:43.013 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:40:43.016 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:40:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.148+0000 7f36422dd700 1 -- 172.21.15.37:0/1245939917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f363c143530 con 0x7f363c159640 2023-10-06T04:40:43.156 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T04:40:43.152+0000 7f2a85d34700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:40:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36397fa700 1 -- 172.21.15.37:0/1245939917 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7f363404c030 con 0x7f363c159640 2023-10-06T04:40:43.170 INFO:tasks.ceph.mds.d.smithi083.stderr: -1071> 2023-10-06T04:40:35.984+0000 7f5509f99700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:40:43.171 INFO:tasks.ceph.mds.d.smithi083.stderr: -588> 2023-10-06T04:40:38.448+0000 7f5506792700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-10-06T04:40:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36422dd700 1 -- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f361c060550 msgr2=0x7f361c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36422dd700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f361c060550 0x7f361c062a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f362c009880 tx=0x7f362c018000 comp rx=0 tx=0).stop 2023-10-06T04:40:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36422dd700 1 -- 172.21.15.37:0/1245939917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c159640 msgr2=0x7f363c0c1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36422dd700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c159640 0x7f363c0c1bd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f363400c4f0 tx=0x7f3634007f00 comp rx=0 tx=0).stop 2023-10-06T04:40:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36422dd700 1 -- 172.21.15.37:0/1245939917 shutdown_connections 2023-10-06T04:40:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36422dd700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f361c060550 0x7f361c062a00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36422dd700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c159640 0x7f363c0c1bd0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36422dd700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f363c155ca0 0x7f363c1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36422dd700 1 --2- 172.21.15.37:0/1245939917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f363c1558d0 0x7f363c1423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36422dd700 1 -- 172.21.15.37:0/1245939917 >> 172.21.15.37:0/1245939917 conn(0x7f363c06b210 msgr2=0x7f363c0c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36422dd700 1 -- 172.21.15.37:0/1245939917 shutdown_connections 2023-10-06T04:40:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.164+0000 7f36422dd700 1 -- 172.21.15.37:0/1245939917 wait complete. 2023-10-06T04:40:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:40:43.184 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:40:43.194 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T04:40:43.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.288+0000 7f2459ea1700 1 Processor -- start 2023-10-06T04:40:43.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f2459ea1700 1 -- start start 2023-10-06T04:40:43.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f2459ea1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f24540c68f0 0x7f24540c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:43.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f2459ea1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2454159820 0x7f2454159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:43.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f2459ea1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24540ad700 con 0x7f24540669c0 2023-10-06T04:40:43.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f2459ea1700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24540ad9e0 con 0x7f2454159820 2023-10-06T04:40:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f2459ea1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24540adcc0 con 0x7f24540c68f0 2023-10-06T04:40:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f24596a0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2454159820 0x7f2454159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f24596a0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2454159820 0x7f2454159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46504/0 (socket says 172.21.15.37:46504) 2023-10-06T04:40:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f24596a0700 1 -- 172.21.15.37:0/2262343905 learned_addr learned my addr 172.21.15.37:0/2262343905 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f2458e9f700 1 --2- 172.21.15.37:0/2262343905 >> v2:172.21.15.83:3300/0 conn(0x7f24540c68f0 0x7f24540c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f24596a0700 1 -- 172.21.15.37:0/2262343905 >> v2:172.21.15.83:3300/0 conn(0x7f24540c68f0 msgr2=0x7f24540c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f24596a0700 1 --2- 172.21.15.37:0/2262343905 >> v2:172.21.15.83:3300/0 conn(0x7f24540c68f0 0x7f24540c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f24596a0700 1 -- 172.21.15.37:0/2262343905 >> v1:172.21.15.83:6789/0 conn(0x7f24540669c0 legacy=0x7f24540ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f24596a0700 1 -- 172.21.15.37:0/2262343905 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24540adfa0 con 0x7f2454159820 2023-10-06T04:40:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f2458e9f700 1 --2- 172.21.15.37:0/2262343905 >> v2:172.21.15.83:3300/0 conn(0x7f24540c68f0 0x7f24540c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f24596a0700 1 --2- 172.21.15.37:0/2262343905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2454159820 0x7f2454159c80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f24540647d0 tx=0x7f244c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4cbfd6be5b1a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f24537fe700 1 -- 172.21.15.37:0/2262343905 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00e070 con 0x7f2454159820 2023-10-06T04:40:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f24537fe700 1 -- 172.21.15.37:0/2262343905 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c00bae0 con 0x7f2454159820 2023-10-06T04:40:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.292+0000 7f24537fe700 1 -- 172.21.15.37:0/2262343905 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0092e0 con 0x7f2454159820 2023-10-06T04:40:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.296+0000 7f2459ea1700 1 -- 172.21.15.37:0/2262343905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2454159820 msgr2=0x7f2454159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.296+0000 7f2459ea1700 1 --2- 172.21.15.37:0/2262343905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2454159820 0x7f2454159c80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f24540647d0 tx=0x7f244c009840 comp rx=0 tx=0).stop 2023-10-06T04:40:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.296+0000 7f2459ea1700 1 -- 172.21.15.37:0/2262343905 shutdown_connections 2023-10-06T04:40:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.296+0000 7f2459ea1700 1 --2- 172.21.15.37:0/2262343905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2454159820 0x7f2454159c80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.296+0000 7f2459ea1700 1 --2- 172.21.15.37:0/2262343905 >> v2:172.21.15.83:3300/0 conn(0x7f24540c68f0 0x7f24540c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.296+0000 7f2459ea1700 1 -- 172.21.15.37:0/2262343905 >> 172.21.15.37:0/2262343905 conn(0x7f24540c9570 msgr2=0x7f2454067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.296+0000 7f2459ea1700 1 -- 172.21.15.37:0/2262343905 shutdown_connections 2023-10-06T04:40:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.296+0000 7f2459ea1700 1 -- 172.21.15.37:0/2262343905 wait complete. 2023-10-06T04:40:43.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.296+0000 7f2459ea1700 1 Processor -- start 2023-10-06T04:40:43.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.296+0000 7f2459ea1700 1 -- start start 2023-10-06T04:40:43.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2459ea1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24540669c0 0x7f24540c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:43.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2459ea1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24540c68f0 0x7f24540af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:43.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2459ea1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2454159820 0x7f24540afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:43.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2459ea1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24540c0660 con 0x7f24540c68f0 2023-10-06T04:40:43.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2459ea1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24540c0f00 con 0x7f24540669c0 2023-10-06T04:40:43.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2459ea1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24540c3670 con 0x7f2454159820 2023-10-06T04:40:43.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2453fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24540c68f0 0x7f24540af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:43.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2458e9f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24540669c0 0x7f24540c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2458e9f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24540669c0 0x7f24540c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:54380/0 (socket says 172.21.15.37:54380) 2023-10-06T04:40:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2453fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24540c68f0 0x7f24540af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46518/0 (socket says 172.21.15.37:46518) 2023-10-06T04:40:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2458e9f700 1 -- 172.21.15.37:0/1545893400 learned_addr learned my addr 172.21.15.37:0/1545893400 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f24596a0700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2454159820 0x7f24540afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2453fff700 1 -- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2454159820 msgr2=0x7f24540afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:43.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2453fff700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2454159820 0x7f24540afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:43.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2453fff700 1 -- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24540669c0 msgr2=0x7f24540c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:43.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2453fff700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24540669c0 0x7f24540c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:43.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2453fff700 1 -- 172.21.15.37:0/1545893400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c009ae0 con 0x7f24540c68f0 2023-10-06T04:40:43.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2458e9f700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24540669c0 0x7f24540c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:43.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2453fff700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24540c68f0 0x7f24540af5d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f244000c5f0 tx=0x7f2440007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:43.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2450ff9700 1 -- 172.21.15.37:0/1545893400 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440011590 con 0x7f24540c68f0 2023-10-06T04:40:43.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2450ff9700 1 -- 172.21.15.37:0/1545893400 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2440011710 con 0x7f24540c68f0 2023-10-06T04:40:43.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2459ea1700 1 -- 172.21.15.37:0/1545893400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2454156610 con 0x7f24540c68f0 2023-10-06T04:40:43.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2450ff9700 1 -- 172.21.15.37:0/1545893400 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440011ad0 con 0x7f24540c68f0 2023-10-06T04:40:43.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2459ea1700 1 -- 172.21.15.37:0/1545893400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24540c0b90 con 0x7f24540c68f0 2023-10-06T04:40:43.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.300+0000 7f2459ea1700 1 -- 172.21.15.37:0/1545893400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24540708a0 con 0x7f24540c68f0 2023-10-06T04:40:43.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.304+0000 7f2450ff9700 1 -- 172.21.15.37:0/1545893400 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f244001b3b0 con 0x7f24540c68f0 2023-10-06T04:40:43.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.304+0000 7f2450ff9700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2438060550 0x7f2438062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:43.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.304+0000 7f2450ff9700 1 -- 172.21.15.37:0/1545893400 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f244007c230 con 0x7f24540c68f0 2023-10-06T04:40:43.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.304+0000 7f2458e9f700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2438060550 0x7f2438062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:43.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.304+0000 7f2458e9f700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2438060550 0x7f2438062a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f24540af380 tx=0x7f2448008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:43.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.312+0000 7f2450ff9700 1 -- 172.21.15.37:0/1545893400 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f244004c550 con 0x7f24540c68f0 2023-10-06T04:40:43.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:43.512+0000 7f2459ea1700 1 -- 172.21.15.37:0/1545893400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f24540af3b0 con 0x7f24540c68f0 2023-10-06T04:40:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.164+0000 7f2450ff9700 1 -- 172.21.15.37:0/1545893400 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f24400170a0 con 0x7f24540c68f0 2023-10-06T04:40:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.168+0000 7f2459ea1700 1 -- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2438060550 msgr2=0x7f2438062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.168+0000 7f2459ea1700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2438060550 0x7f2438062a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f24540af380 tx=0x7f2448008040 comp rx=0 tx=0).stop 2023-10-06T04:40:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.168+0000 7f2459ea1700 1 -- 172.21.15.37:0/1545893400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24540c68f0 msgr2=0x7f24540af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.168+0000 7f2459ea1700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24540c68f0 0x7f24540af5d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f244000c5f0 tx=0x7f2440007ec0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.168+0000 7f2459ea1700 1 -- 172.21.15.37:0/1545893400 shutdown_connections 2023-10-06T04:40:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.168+0000 7f2459ea1700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2438060550 0x7f2438062a00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.168+0000 7f2459ea1700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2454159820 0x7f24540afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.168+0000 7f2459ea1700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24540c68f0 0x7f24540af5d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.168+0000 7f2459ea1700 1 --2- 172.21.15.37:0/1545893400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24540669c0 0x7f24540c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.168+0000 7f2459ea1700 1 -- 172.21.15.37:0/1545893400 >> 172.21.15.37:0/1545893400 conn(0x7f24540c9570 msgr2=0x7f24540c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.168+0000 7f2459ea1700 1 -- 172.21.15.37:0/1545893400 shutdown_connections 2023-10-06T04:40:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.168+0000 7f2459ea1700 1 -- 172.21.15.37:0/1545893400 wait complete. 2023-10-06T04:40:44.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:40:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d1ba4700 1 Processor -- start 2023-10-06T04:40:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d1ba4700 1 -- start start 2023-10-06T04:40:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d1ba4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89cc15d000 0x7f89cc0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d1ba4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89cc0ae540 0x7f89cc0af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d1ba4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f89cc0af540 0x7f89cc0ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d1ba4700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc0af9c0 con 0x7f89cc15d000 2023-10-06T04:40:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d1ba4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc0ac340 con 0x7f89cc0af540 2023-10-06T04:40:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d1ba4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0aba50 con 0x7f89cc0ae540 2023-10-06T04:40:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d0ba2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89cc15d000 0x7f89cc0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d0ba2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89cc15d000 0x7f89cc0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46530/0 (socket says 172.21.15.37:46530) 2023-10-06T04:40:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d0ba2700 1 -- 172.21.15.37:0/1374305153 learned_addr learned my addr 172.21.15.37:0/1374305153 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d13a3700 1 --2- 172.21.15.37:0/1374305153 >> v2:172.21.15.83:3300/0 conn(0x7f89cc0af540 0x7f89cc0ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89cbfff700 1 --2- 172.21.15.37:0/1374305153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89cc0ae540 0x7f89cc0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d13a3700 1 -- 172.21.15.37:0/1374305153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89cc0ae540 msgr2=0x7f89cc0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d13a3700 1 --2- 172.21.15.37:0/1374305153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89cc0ae540 0x7f89cc0af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d13a3700 1 -- 172.21.15.37:0/1374305153 >> v2:172.21.15.37:3300/0 conn(0x7f89cc15d000 msgr2=0x7f89cc0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d13a3700 1 --2- 172.21.15.37:0/1374305153 >> v2:172.21.15.37:3300/0 conn(0x7f89cc15d000 0x7f89cc0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d13a3700 1 -- 172.21.15.37:0/1374305153 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc0aea40 con 0x7f89cc0af540 2023-10-06T04:40:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d0ba2700 1 --2- 172.21.15.37:0/1374305153 >> v2:172.21.15.37:3300/0 conn(0x7f89cc15d000 0x7f89cc0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89d13a3700 1 --2- 172.21.15.37:0/1374305153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89cc0af540 0x7f89cc0ac7d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0098e0 tx=0x7f89bc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11369c776bdab45a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89cb7fe700 1 -- 172.21.15.37:0/1374305153 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc011630 con 0x7f89cc0af540 2023-10-06T04:40:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89cb7fe700 1 -- 172.21.15.37:0/1374305153 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc011790 con 0x7f89cc0af540 2023-10-06T04:40:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.308+0000 7f89cb7fe700 1 -- 172.21.15.37:0/1374305153 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc011b30 con 0x7f89cc0af540 2023-10-06T04:40:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 -- 172.21.15.37:0/1374305153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89cc0af540 msgr2=0x7f89cc0ac7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 --2- 172.21.15.37:0/1374305153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89cc0af540 0x7f89cc0ac7d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0098e0 tx=0x7f89bc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 -- 172.21.15.37:0/1374305153 shutdown_connections 2023-10-06T04:40:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 --2- 172.21.15.37:0/1374305153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89cc0af540 0x7f89cc0ac7d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 --2- 172.21.15.37:0/1374305153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89cc0ae540 0x7f89cc0af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 --2- 172.21.15.37:0/1374305153 >> v2:172.21.15.37:3300/0 conn(0x7f89cc15d000 0x7f89cc0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 -- 172.21.15.37:0/1374305153 >> 172.21.15.37:0/1374305153 conn(0x7f89cc0687b0 msgr2=0x7f89cc0cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:44.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 -- 172.21.15.37:0/1374305153 shutdown_connections 2023-10-06T04:40:44.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 -- 172.21.15.37:0/1374305153 wait complete. 2023-10-06T04:40:44.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 Processor -- start 2023-10-06T04:40:44.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 -- start start 2023-10-06T04:40:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89cc0ae540 0x7f89cc143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89cc0af540 0x7f89cc0a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.312+0000 7f89d1ba4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89cc15d000 0x7f89cc16f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:44.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d1ba4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0a7980 con 0x7f89cc0af540 2023-10-06T04:40:44.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d1ba4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0a7670 con 0x7f89cc0ae540 2023-10-06T04:40:44.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d1ba4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0a5910 con 0x7f89cc15d000 2023-10-06T04:40:44.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89cbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89cc0af540 0x7f89cc0a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:44.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d0ba2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89cc0ae540 0x7f89cc143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:44.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d13a3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89cc15d000 0x7f89cc16f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:44.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d0ba2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89cc0ae540 0x7f89cc143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:54396/0 (socket says 172.21.15.37:54396) 2023-10-06T04:40:44.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d0ba2700 1 -- 172.21.15.37:0/2895634585 learned_addr learned my addr 172.21.15.37:0/2895634585 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:44.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d0ba2700 1 -- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89cc15d000 msgr2=0x7f89cc16f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:44.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d0ba2700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89cc15d000 0x7f89cc16f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d0ba2700 1 -- 172.21.15.37:0/2895634585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89cc0af540 msgr2=0x7f89cc0a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:44.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d0ba2700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89cc0af540 0x7f89cc0a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:44.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d0ba2700 1 -- 172.21.15.37:0/2895634585 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b40094f0 con 0x7f89cc0ae540 2023-10-06T04:40:44.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89cbfff700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89cc0af540 0x7f89cc0a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:44.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d0ba2700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89cc0ae540 0x7f89cc143d30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f89b400ec50 tx=0x7f89b4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:44.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89c8ff9700 1 -- 172.21.15.37:0/2895634585 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b400c850 con 0x7f89cc0ae540 2023-10-06T04:40:44.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89c8ff9700 1 -- 172.21.15.37:0/2895634585 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b400c9b0 con 0x7f89cc0ae540 2023-10-06T04:40:44.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d1ba4700 1 -- 172.21.15.37:0/2895634585 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89bc009420 con 0x7f89cc0ae540 2023-10-06T04:40:44.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89c8ff9700 1 -- 172.21.15.37:0/2895634585 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b400cd50 con 0x7f89cc0ae540 2023-10-06T04:40:44.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d1ba4700 1 -- 172.21.15.37:0/2895634585 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc0a5f50 con 0x7f89cc0ae540 2023-10-06T04:40:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.316+0000 7f89d1ba4700 1 -- 172.21.15.37:0/2895634585 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89cc04be00 con 0x7f89cc0ae540 2023-10-06T04:40:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.320+0000 7f89c8ff9700 1 -- 172.21.15.37:0/2895634585 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f89b4013680 con 0x7f89cc0ae540 2023-10-06T04:40:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.320+0000 7f89c8ff9700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f89ac060550 0x7f89ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.320+0000 7f89c8ff9700 1 -- 172.21.15.37:0/2895634585 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f89b407cb60 con 0x7f89cc0ae540 2023-10-06T04:40:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.320+0000 7f89cbfff700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f89ac060550 0x7f89ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.320+0000 7f89cbfff700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f89ac060550 0x7f89ac062a00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0a7460 tx=0x7f89c400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:44.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.328+0000 7f89c8ff9700 1 -- 172.21.15.37:0/2895634585 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f89b404ce00 con 0x7f89cc0ae540 2023-10-06T04:40:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:44.492+0000 7f89d1ba4700 1 -- 172.21.15.37:0/2895634585 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f89cc15a650 con 0x7f89cc0ae540 2023-10-06T04:40:45.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.172+0000 7f89c8ff9700 1 -- 172.21.15.37:0/2895634585 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7f89b40170d0 con 0x7f89cc0ae540 2023-10-06T04:40:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.180+0000 7f89d1ba4700 1 -- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f89ac060550 msgr2=0x7f89ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.180+0000 7f89d1ba4700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f89ac060550 0x7f89ac062a00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0a7460 tx=0x7f89c400b040 comp rx=0 tx=0).stop 2023-10-06T04:40:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.180+0000 7f89d1ba4700 1 -- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89cc0ae540 msgr2=0x7f89cc143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.180+0000 7f89d1ba4700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89cc0ae540 0x7f89cc143d30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f89b400ec50 tx=0x7f89b4009250 comp rx=0 tx=0).stop 2023-10-06T04:40:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.180+0000 7f89d1ba4700 1 -- 172.21.15.37:0/2895634585 shutdown_connections 2023-10-06T04:40:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.180+0000 7f89d1ba4700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f89ac060550 0x7f89ac062a00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.180+0000 7f89d1ba4700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89cc15d000 0x7f89cc16f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.180+0000 7f89d1ba4700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89cc0af540 0x7f89cc0a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.180+0000 7f89d1ba4700 1 --2- 172.21.15.37:0/2895634585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89cc0ae540 0x7f89cc143d30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.180+0000 7f89d1ba4700 1 -- 172.21.15.37:0/2895634585 >> 172.21.15.37:0/2895634585 conn(0x7f89cc0687b0 msgr2=0x7f89cc1589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.180+0000 7f89d1ba4700 1 -- 172.21.15.37:0/2895634585 shutdown_connections 2023-10-06T04:40:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.180+0000 7f89d1ba4700 1 -- 172.21.15.37:0/2895634585 wait complete. 2023-10-06T04:40:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:40:45.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:40:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.304+0000 7f5e9ec2d700 1 Processor -- start 2023-10-06T04:40:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.304+0000 7f5e9ec2d700 1 -- start start 2023-10-06T04:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5e981557f0 0x7f5e980c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e980b0680 0x7f5e980af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e980aca00 con 0x7f5e980aef50 2023-10-06T04:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e980afcf0 con 0x7f5e980b0680 2023-10-06T04:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e980c8fb0 con 0x7f5e981557f0 2023-10-06T04:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9e42c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e980b0680 0x7f5e980af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9e42c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e980b0680 0x7f5e980af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46552/0 (socket says 172.21.15.37:46552) 2023-10-06T04:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9e42c700 1 -- 172.21.15.37:0/582566373 learned_addr learned my addr 172.21.15.37:0/582566373 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9dc2b700 1 --2- 172.21.15.37:0/582566373 >> v2:172.21.15.83:3300/0 conn(0x7f5e981557f0 0x7f5e980c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9e42c700 1 -- 172.21.15.37:0/582566373 >> v2:172.21.15.83:3300/0 conn(0x7f5e981557f0 msgr2=0x7f5e980c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9e42c700 1 --2- 172.21.15.37:0/582566373 >> v2:172.21.15.83:3300/0 conn(0x7f5e981557f0 0x7f5e980c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9e42c700 1 -- 172.21.15.37:0/582566373 >> v1:172.21.15.83:6789/0 conn(0x7f5e980aef50 legacy=0x7f5e980aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9e42c700 1 -- 172.21.15.37:0/582566373 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e980cc5d0 con 0x7f5e980b0680 2023-10-06T04:40:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9e42c700 1 --2- 172.21.15.37:0/582566373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e980b0680 0x7f5e980af3d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5e98063780 tx=0x7f5e9000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63c491766d7a3f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9cc29700 1 -- 172.21.15.37:0/582566373 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90010070 con 0x7f5e980b0680 2023-10-06T04:40:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9cc29700 1 -- 172.21.15.37:0/582566373 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9000dde0 con 0x7f5e980b0680 2023-10-06T04:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9cc29700 1 -- 172.21.15.37:0/582566373 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9000b320 con 0x7f5e980b0680 2023-10-06T04:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/582566373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e980b0680 msgr2=0x7f5e980af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 --2- 172.21.15.37:0/582566373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e980b0680 0x7f5e980af3d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5e98063780 tx=0x7f5e9000ba50 comp rx=0 tx=0).stop 2023-10-06T04:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/582566373 shutdown_connections 2023-10-06T04:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 --2- 172.21.15.37:0/582566373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e980b0680 0x7f5e980af3d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 --2- 172.21.15.37:0/582566373 >> v2:172.21.15.83:3300/0 conn(0x7f5e981557f0 0x7f5e980c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/582566373 >> 172.21.15.37:0/582566373 conn(0x7f5e980687b0 msgr2=0x7f5e980cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/582566373 shutdown_connections 2023-10-06T04:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.308+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/582566373 wait complete. 2023-10-06T04:40:45.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.312+0000 7f5e9ec2d700 1 Processor -- start 2023-10-06T04:40:45.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.312+0000 7f5e9ec2d700 1 -- start start 2023-10-06T04:40:45.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9ec2d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e980aef50 0x7f5e981582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:45.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9ec2d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e980b0680 0x7f5e98146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:45.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9ec2d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981557f0 0x7f5e980a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:45.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9ec2d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e981573f0 con 0x7f5e981557f0 2023-10-06T04:40:45.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9ec2d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98156580 con 0x7f5e980b0680 2023-10-06T04:40:45.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9ec2d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98158800 con 0x7f5e980aef50 2023-10-06T04:40:45.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9e42c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981557f0 0x7f5e980a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:45.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9dc2b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e980aef50 0x7f5e981582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:45.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9d42a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e980b0680 0x7f5e98146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:45.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9e42c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981557f0 0x7f5e980a5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46566/0 (socket says 172.21.15.37:46566) 2023-10-06T04:40:45.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9e42c700 1 -- 172.21.15.37:0/2513004715 learned_addr learned my addr 172.21.15.37:0/2513004715 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:45.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9e42c700 1 -- 172.21.15.37:0/2513004715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e980aef50 msgr2=0x7f5e981582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:45.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9e42c700 1 --2- 172.21.15.37:0/2513004715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e980aef50 0x7f5e981582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:45.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9e42c700 1 -- 172.21.15.37:0/2513004715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e980b0680 msgr2=0x7f5e98146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:45.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9e42c700 1 --2- 172.21.15.37:0/2513004715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e980b0680 0x7f5e98146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:45.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9e42c700 1 -- 172.21.15.37:0/2513004715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9000bcf0 con 0x7f5e981557f0 2023-10-06T04:40:45.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9e42c700 1 --2- 172.21.15.37:0/2513004715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981557f0 0x7f5e980a5c50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5e90014000 tx=0x7f5e9001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e8dffb700 1 -- 172.21.15.37:0/2513004715 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e900032f0 con 0x7f5e981557f0 2023-10-06T04:40:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e8dffb700 1 -- 172.21.15.37:0/2513004715 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9000b4d0 con 0x7f5e981557f0 2023-10-06T04:40:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/2513004715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e981567e0 con 0x7f5e981557f0 2023-10-06T04:40:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e8dffb700 1 -- 172.21.15.37:0/2513004715 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90028690 con 0x7f5e981557f0 2023-10-06T04:40:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.316+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/2513004715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e98156da0 con 0x7f5e981557f0 2023-10-06T04:40:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.320+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/2513004715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e981575a0 con 0x7f5e981557f0 2023-10-06T04:40:45.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.320+0000 7f5e8dffb700 1 -- 172.21.15.37:0/2513004715 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5e90003040 con 0x7f5e981557f0 2023-10-06T04:40:45.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.320+0000 7f5e8dffb700 1 --2- 172.21.15.37:0/2513004715 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e7c060550 0x7f5e7c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:45.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.320+0000 7f5e8dffb700 1 -- 172.21.15.37:0/2513004715 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6112+0+0 (secure 0 0 0) 0x7f5e900808d0 con 0x7f5e981557f0 2023-10-06T04:40:45.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.320+0000 7f5e9dc2b700 1 --2- 172.21.15.37:0/2513004715 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e7c060550 0x7f5e7c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:45.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.320+0000 7f5e9dc2b700 1 --2- 172.21.15.37:0/2513004715 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e7c060550 0x7f5e7c062a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009db0 tx=0x7f5e940091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.324+0000 7f5e8dffb700 1 -- 172.21.15.37:0/2513004715 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5e90050cb0 con 0x7f5e981557f0 2023-10-06T04:40:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:45.488+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/2513004715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5e9804be00 con 0x7f5e981557f0 2023-10-06T04:40:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.180+0000 7f5e8dffb700 1 -- 172.21.15.37:0/2513004715 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5e9000af30 con 0x7f5e981557f0 2023-10-06T04:40:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.188+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/2513004715 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e7c060550 msgr2=0x7f5e7c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.188+0000 7f5e9ec2d700 1 --2- 172.21.15.37:0/2513004715 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e7c060550 0x7f5e7c062a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009db0 tx=0x7f5e940091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.188+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/2513004715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981557f0 msgr2=0x7f5e980a5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.188+0000 7f5e9ec2d700 1 --2- 172.21.15.37:0/2513004715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981557f0 0x7f5e980a5c50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5e90014000 tx=0x7f5e9001a000 comp rx=0 tx=0).stop 2023-10-06T04:40:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.192+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/2513004715 shutdown_connections 2023-10-06T04:40:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.192+0000 7f5e9ec2d700 1 --2- 172.21.15.37:0/2513004715 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5e7c060550 0x7f5e7c062a00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.192+0000 7f5e9ec2d700 1 --2- 172.21.15.37:0/2513004715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e980b0680 0x7f5e98146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.192+0000 7f5e9ec2d700 1 --2- 172.21.15.37:0/2513004715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981557f0 0x7f5e980a5c50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.192+0000 7f5e9ec2d700 1 --2- 172.21.15.37:0/2513004715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e980aef50 0x7f5e981582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.192+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/2513004715 >> 172.21.15.37:0/2513004715 conn(0x7f5e980687b0 msgr2=0x7f5e9806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.192+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/2513004715 shutdown_connections 2023-10-06T04:40:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.192+0000 7f5e9ec2d700 1 -- 172.21.15.37:0/2513004715 wait complete. 2023-10-06T04:40:46.199 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-10-06T04:40:46.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T04:40:46.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.316+0000 7f61fdbf5700 1 Processor -- start 2023-10-06T04:40:46.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.316+0000 7f61fdbf5700 1 -- start start 2023-10-06T04:40:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.316+0000 7f61fdbf5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61f80cca60 0x7f61f80af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.316+0000 7f61fdbf5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f80cf240 con 0x7f61f80ce1a0 2023-10-06T04:40:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.316+0000 7f61fdbf5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f80ce630 con 0x7f61f80aece0 2023-10-06T04:40:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.316+0000 7f61fdbf5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f81594a0 con 0x7f61f80cca60 2023-10-06T04:40:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61fd3f4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61f80cca60 0x7f61f80af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61f7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f61f80ce1a0 0x7f61f80cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55892/0 (socket says 172.21.15.37:55892) 2023-10-06T04:40:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61f7fff700 1 -- 172.21.15.37:0/673376286 learned_addr learned my addr 172.21.15.37:0/673376286 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61f77fe700 1 -- 172.21.15.37:0/673376286 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645849837 0 0) 0x7f61f80cf240 con 0x7f61f80ce1a0 2023-10-06T04:40:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61f77fe700 1 -- 172.21.15.37:0/673376286 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e4003570 con 0x7f61f80ce1a0 2023-10-06T04:40:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61f77fe700 1 -- 172.21.15.37:0/673376286 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089919147 0 0) 0x7f61f80ce630 con 0x7f61f80aece0 2023-10-06T04:40:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61f77fe700 1 -- 172.21.15.37:0/673376286 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f80cf240 con 0x7f61f80aece0 2023-10-06T04:40:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61fd3f4700 1 -- 172.21.15.37:0/673376286 >> v1:172.21.15.83:6789/0 conn(0x7f61f80aece0 legacy=0x7f61f80cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61fd3f4700 1 -- 172.21.15.37:0/673376286 >> v1:172.21.15.37:6789/0 conn(0x7f61f80ce1a0 legacy=0x7f61f80cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61fd3f4700 1 -- 172.21.15.37:0/673376286 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f80ce910 con 0x7f61f80cca60 2023-10-06T04:40:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61fd3f4700 1 --2- 172.21.15.37:0/673376286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f80cca60 0x7f61f80af0b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009e60 tx=0x7f61f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70edacb4444ce69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61f77fe700 1 -- 172.21.15.37:0/673376286 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f000e070 con 0x7f61f80cca60 2023-10-06T04:40:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61f77fe700 1 -- 172.21.15.37:0/673376286 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f000bab0 con 0x7f61f80cca60 2023-10-06T04:40:46.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61f77fe700 1 -- 172.21.15.37:0/673376286 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f000be70 con 0x7f61f80cca60 2023-10-06T04:40:46.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61fdbf5700 1 -- 172.21.15.37:0/673376286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f80cca60 msgr2=0x7f61f80af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61fdbf5700 1 --2- 172.21.15.37:0/673376286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f80cca60 0x7f61f80af0b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009e60 tx=0x7f61f0009780 comp rx=0 tx=0).stop 2023-10-06T04:40:46.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61fdbf5700 1 -- 172.21.15.37:0/673376286 shutdown_connections 2023-10-06T04:40:46.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61fdbf5700 1 --2- 172.21.15.37:0/673376286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f80cca60 0x7f61f80af0b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61fdbf5700 1 -- 172.21.15.37:0/673376286 >> 172.21.15.37:0/673376286 conn(0x7f61f8069d90 msgr2=0x7f61f8067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:46.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61fdbf5700 1 -- 172.21.15.37:0/673376286 shutdown_connections 2023-10-06T04:40:46.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.320+0000 7f61fdbf5700 1 -- 172.21.15.37:0/673376286 wait complete. 2023-10-06T04:40:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fdbf5700 1 Processor -- start 2023-10-06T04:40:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fdbf5700 1 -- start start 2023-10-06T04:40:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fdbf5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61f80aece0 0x7f61f80b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fdbf5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f80cca60 0x7f61f814a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fdbf5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61f80ce1a0 0x7f61f815c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fdbf5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80b4f30 con 0x7f61f80cca60 2023-10-06T04:40:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fdbf5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80b4560 con 0x7f61f80aece0 2023-10-06T04:40:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fdbf5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f81581d0 con 0x7f61f80ce1a0 2023-10-06T04:40:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61f7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f80cca60 0x7f61f814a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61f7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f80cca60 0x7f61f814a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46584/0 (socket says 172.21.15.37:46584) 2023-10-06T04:40:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fd3f4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61f80ce1a0 0x7f61f815c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fcbf3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61f80aece0 0x7f61f80b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61f7fff700 1 -- 172.21.15.37:0/4263767851 learned_addr learned my addr 172.21.15.37:0/4263767851 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fcbf3700 1 -- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61f80ce1a0 msgr2=0x7f61f815c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fcbf3700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61f80ce1a0 0x7f61f815c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fcbf3700 1 -- 172.21.15.37:0/4263767851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f80cca60 msgr2=0x7f61f814a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fcbf3700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f80cca60 0x7f61f814a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fcbf3700 1 -- 172.21.15.37:0/4263767851 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f0009a20 con 0x7f61f80aece0 2023-10-06T04:40:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61f7fff700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f80cca60 0x7f61f814a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fcbf3700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61f80aece0 0x7f61f80b49f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f61e800c560 tx=0x7f61e8007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61f4ff9700 1 -- 172.21.15.37:0/4263767851 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8011590 con 0x7f61f80aece0 2023-10-06T04:40:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61f4ff9700 1 -- 172.21.15.37:0/4263767851 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e80116f0 con 0x7f61f80aece0 2023-10-06T04:40:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fdbf5700 1 -- 172.21.15.37:0/4263767851 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f80b3950 con 0x7f61f80aece0 2023-10-06T04:40:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61f4ff9700 1 -- 172.21.15.37:0/4263767851 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8011ab0 con 0x7f61f80aece0 2023-10-06T04:40:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.324+0000 7f61fdbf5700 1 -- 172.21.15.37:0/4263767851 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f80b3f10 con 0x7f61f80aece0 2023-10-06T04:40:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.328+0000 7f61fdbf5700 1 -- 172.21.15.37:0/4263767851 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f80708a0 con 0x7f61f80aece0 2023-10-06T04:40:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.328+0000 7f61f4ff9700 1 -- 172.21.15.37:0/4263767851 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f61e8036b50 con 0x7f61f80aece0 2023-10-06T04:40:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.328+0000 7f61f4ff9700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f61d8060550 0x7f61d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.328+0000 7f61f4ff9700 1 -- 172.21.15.37:0/4263767851 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f61e807c6b0 con 0x7f61f80aece0 2023-10-06T04:40:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.328+0000 7f61f7fff700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f61d8060550 0x7f61d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.328+0000 7f61f7fff700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f61d8060550 0x7f61d8062a00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f61f80c9880 tx=0x7f61e0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.340+0000 7f61f4ff9700 1 -- 172.21.15.37:0/4263767851 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f61e804cc80 con 0x7f61f80aece0 2023-10-06T04:40:46.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.504+0000 7f61fdbf5700 1 -- 172.21.15.37:0/4263767851 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f61f80cd390 con 0x7f61f80aece0 2023-10-06T04:40:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.512+0000 7f61f4ff9700 1 -- 172.21.15.37:0/4263767851 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f61e80502a0 con 0x7f61f80aece0 2023-10-06T04:40:46.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.516+0000 7f61fdbf5700 1 -- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f61d8060550 msgr2=0x7f61d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.516+0000 7f61fdbf5700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f61d8060550 0x7f61d8062a00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f61f80c9880 tx=0x7f61e0009040 comp rx=0 tx=0).stop 2023-10-06T04:40:46.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.516+0000 7f61fdbf5700 1 -- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61f80aece0 msgr2=0x7f61f80b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.516+0000 7f61fdbf5700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61f80aece0 0x7f61f80b49f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f61e800c560 tx=0x7f61e8007d50 comp rx=0 tx=0).stop 2023-10-06T04:40:46.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.516+0000 7f61fdbf5700 1 -- 172.21.15.37:0/4263767851 shutdown_connections 2023-10-06T04:40:46.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.516+0000 7f61fdbf5700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f61d8060550 0x7f61d8062a00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.516+0000 7f61fdbf5700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61f80ce1a0 0x7f61f815c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.516+0000 7f61fdbf5700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f80cca60 0x7f61f814a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.516+0000 7f61fdbf5700 1 --2- 172.21.15.37:0/4263767851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61f80aece0 0x7f61f80b49f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.516+0000 7f61fdbf5700 1 -- 172.21.15.37:0/4263767851 >> 172.21.15.37:0/4263767851 conn(0x7f61f8069d90 msgr2=0x7f61f80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:46.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.516+0000 7f61fdbf5700 1 -- 172.21.15.37:0/4263767851 shutdown_connections 2023-10-06T04:40:46.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.516+0000 7f61fdbf5700 1 -- 172.21.15.37:0/4263767851 wait complete. 2023-10-06T04:40:46.536 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_backtrace_repair' 2023-10-06T04:40:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.636+0000 7f9214d93700 1 Processor -- start 2023-10-06T04:40:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.636+0000 7f9214d93700 1 -- start start 2023-10-06T04:40:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9210154660 0x7f92100caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92100cc230 0x7f92101572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92100b1040 con 0x7f921006e880 2023-10-06T04:40:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92100caf90 con 0x7f9210154660 2023-10-06T04:40:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92100c06e0 con 0x7f92100cc230 2023-10-06T04:40:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920dd9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f921006e880 0x7f92100cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55902/0 (socket says 172.21.15.37:55902) 2023-10-06T04:40:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920dd9b700 1 -- 172.21.15.37:0/221211327 learned_addr learned my addr 172.21.15.37:0/221211327 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920e59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9210154660 0x7f92100caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920ed9d700 1 --2- 172.21.15.37:0/221211327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92100cc230 0x7f92101572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920d59a700 1 -- 172.21.15.37:0/221211327 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209946781 0 0) 0x7f92100b1040 con 0x7f921006e880 2023-10-06T04:40:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920d59a700 1 -- 172.21.15.37:0/221211327 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91f8003570 con 0x7f921006e880 2023-10-06T04:40:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920e59c700 1 -- 172.21.15.37:0/221211327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92100cc230 msgr2=0x7f92101572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920e59c700 1 --2- 172.21.15.37:0/221211327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92100cc230 0x7f92101572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920e59c700 1 -- 172.21.15.37:0/221211327 >> v1:172.21.15.37:6789/0 conn(0x7f921006e880 legacy=0x7f92100cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920e59c700 1 -- 172.21.15.37:0/221211327 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92100c0980 con 0x7f9210154660 2023-10-06T04:40:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920e59c700 1 --2- 172.21.15.37:0/221211327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9210154660 0x7f92100caa50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f92000098e0 tx=0x7f92000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b247675d128b3bf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920d59a700 1 -- 172.21.15.37:0/221211327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200011630 con 0x7f9210154660 2023-10-06T04:40:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920d59a700 1 -- 172.21.15.37:0/221211327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9200011790 con 0x7f9210154660 2023-10-06T04:40:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f920d59a700 1 -- 172.21.15.37:0/221211327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200011b30 con 0x7f9210154660 2023-10-06T04:40:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 -- 172.21.15.37:0/221211327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9210154660 msgr2=0x7f92100caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 --2- 172.21.15.37:0/221211327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9210154660 0x7f92100caa50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f92000098e0 tx=0x7f92000091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 -- 172.21.15.37:0/221211327 shutdown_connections 2023-10-06T04:40:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 --2- 172.21.15.37:0/221211327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92100cc230 0x7f92101572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 --2- 172.21.15.37:0/221211327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9210154660 0x7f92100caa50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 -- 172.21.15.37:0/221211327 >> 172.21.15.37:0/221211327 conn(0x7f92100667b0 msgr2=0x7f9210066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 -- 172.21.15.37:0/221211327 shutdown_connections 2023-10-06T04:40:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.640+0000 7f9214d93700 1 -- 172.21.15.37:0/221211327 wait complete. 2023-10-06T04:40:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f9214d93700 1 Processor -- start 2023-10-06T04:40:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f9214d93700 1 -- start start 2023-10-06T04:40:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f9214d93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921006e880 0x7f92101474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f9214d93700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92100cc230 0x7f921014d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f9214d93700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9210154660 0x7f9210146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f9214d93700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9210158280 con 0x7f921006e880 2023-10-06T04:40:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f9214d93700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921014de70 con 0x7f92100cc230 2023-10-06T04:40:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f9214d93700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9210147ba0 con 0x7f9210154660 2023-10-06T04:40:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f920e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921006e880 0x7f92101474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f920e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921006e880 0x7f92101474e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46606/0 (socket says 172.21.15.37:46606) 2023-10-06T04:40:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f920e59c700 1 -- 172.21.15.37:0/2551547021 learned_addr learned my addr 172.21.15.37:0/2551547021 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f920ed9d700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9210154660 0x7f9210146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f920dd9b700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92100cc230 0x7f921014d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f920e59c700 1 -- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9210154660 msgr2=0x7f9210146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f920e59c700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9210154660 0x7f9210146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f920e59c700 1 -- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92100cc230 msgr2=0x7f921014d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f920e59c700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92100cc230 0x7f921014d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.644+0000 7f920e59c700 1 -- 172.21.15.37:0/2551547021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9200009420 con 0x7f921006e880 2023-10-06T04:40:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.648+0000 7f920e59c700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921006e880 0x7f92101474e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f92100cc840 tx=0x7f9200017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.648+0000 7f91fe7fc700 1 -- 172.21.15.37:0/2551547021 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200011900 con 0x7f921006e880 2023-10-06T04:40:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.648+0000 7f91fe7fc700 1 -- 172.21.15.37:0/2551547021 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9200011a60 con 0x7f921006e880 2023-10-06T04:40:46.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.648+0000 7f9214d93700 1 -- 172.21.15.37:0/2551547021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9210147e80 con 0x7f921006e880 2023-10-06T04:40:46.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.648+0000 7f91fe7fc700 1 -- 172.21.15.37:0/2551547021 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200023620 con 0x7f921006e880 2023-10-06T04:40:46.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.648+0000 7f9214d93700 1 -- 172.21.15.37:0/2551547021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9210148440 con 0x7f921006e880 2023-10-06T04:40:46.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.648+0000 7f9214d93700 1 -- 172.21.15.37:0/2551547021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9210070ee0 con 0x7f921006e880 2023-10-06T04:40:46.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.648+0000 7f91fe7fc700 1 -- 172.21.15.37:0/2551547021 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f920002c3b0 con 0x7f921006e880 2023-10-06T04:40:46.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.648+0000 7f91fe7fc700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f91f0060550 0x7f91f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:46.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.648+0000 7f91fe7fc700 1 -- 172.21.15.37:0/2551547021 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f920007da30 con 0x7f921006e880 2023-10-06T04:40:46.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.648+0000 7f920dd9b700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f91f0060550 0x7f91f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:46.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.652+0000 7f920dd9b700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f91f0060550 0x7f91f0062a00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9210063280 tx=0x7f9204009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:46.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.656+0000 7f91fe7fc700 1 -- 172.21.15.37:0/2551547021 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f920004e0e0 con 0x7f921006e880 2023-10-06T04:40:46.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:46.876+0000 7f9214d93700 1 -- 172.21.15.37:0/2551547021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_backtrace_repair"]} v 0) v1 -- 0x7f9210157090 con 0x7f921006e880 2023-10-06T04:40:47.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.184+0000 7f91fe7fc700 1 -- 172.21.15.37:0/2551547021 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_backtrace_repair"]}]=0 v107) v1 ==== 148+0+0 (secure 0 0 0) 0x7f92000150d0 con 0x7f921006e880 2023-10-06T04:40:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.188+0000 7f9214d93700 1 -- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f91f0060550 msgr2=0x7f91f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.188+0000 7f9214d93700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f91f0060550 0x7f91f0062a00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9210063280 tx=0x7f9204009040 comp rx=0 tx=0).stop 2023-10-06T04:40:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.188+0000 7f9214d93700 1 -- 172.21.15.37:0/2551547021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921006e880 msgr2=0x7f92101474e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.188+0000 7f9214d93700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921006e880 0x7f92101474e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f92100cc840 tx=0x7f9200017000 comp rx=0 tx=0).stop 2023-10-06T04:40:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.188+0000 7f9214d93700 1 -- 172.21.15.37:0/2551547021 shutdown_connections 2023-10-06T04:40:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.188+0000 7f9214d93700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f91f0060550 0x7f91f0062a00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.188+0000 7f9214d93700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92100cc230 0x7f921014d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.188+0000 7f9214d93700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9210154660 0x7f9210146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.188+0000 7f9214d93700 1 --2- 172.21.15.37:0/2551547021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921006e880 0x7f92101474e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.188+0000 7f9214d93700 1 -- 172.21.15.37:0/2551547021 >> 172.21.15.37:0/2551547021 conn(0x7f92100667b0 msgr2=0x7f9210152b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.188+0000 7f9214d93700 1 -- 172.21.15.37:0/2551547021 shutdown_connections 2023-10-06T04:40:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.188+0000 7f9214d93700 1 -- 172.21.15.37:0/2551547021 wait complete. 2023-10-06T04:40:47.213 INFO:tasks.cephfs_test_runner:MDS should verify/fix backtrace on fetch dirfrag ... ok 2023-10-06T04:40:47.213 INFO:tasks.cephfs_test_runner:Starting test: test_mds_readonly (tasks.cephfs.test_auto_repair.TestMDSAutoRepair) test if MDS behave correct when it's readonly 2023-10-06T04:40:47.213 INFO:tasks.cephfs_test_runner:test_mds_readonly (tasks.cephfs.test_auto_repair.TestMDSAutoRepair) 2023-10-06T04:40:47.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_mds_readonly' 2023-10-06T04:40:47.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.320+0000 7f058deec700 1 Processor -- start 2023-10-06T04:40:47.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.320+0000 7f058deec700 1 -- start start 2023-10-06T04:40:47.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f058815a230 0x7f05880c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:47.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05880c7b00 0x7f058815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:47.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058815b650 con 0x7f0588159e60 2023-10-06T04:40:47.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058806c500 con 0x7f05880c7b00 2023-10-06T04:40:47.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05880c7f00 con 0x7f058815a230 2023-10-06T04:40:47.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058d6eb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05880c7b00 0x7f058815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:47.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058d6eb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05880c7b00 0x7f058815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46612/0 (socket says 172.21.15.37:46612) 2023-10-06T04:40:47.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058d6eb700 1 -- 172.21.15.37:0/1070758211 learned_addr learned my addr 172.21.15.37:0/1070758211 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:47.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f0587fff700 1 --2- 172.21.15.37:0/1070758211 >> v2:172.21.15.83:3300/0 conn(0x7f058815a230 0x7f05880c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058d6eb700 1 -- 172.21.15.37:0/1070758211 >> v2:172.21.15.83:3300/0 conn(0x7f058815a230 msgr2=0x7f05880c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058d6eb700 1 --2- 172.21.15.37:0/1070758211 >> v2:172.21.15.83:3300/0 conn(0x7f058815a230 0x7f05880c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058d6eb700 1 -- 172.21.15.37:0/1070758211 >> v1:172.21.15.83:6789/0 conn(0x7f0588159e60 legacy=0x7f058806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058d6eb700 1 -- 172.21.15.37:0/1070758211 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058815b370 con 0x7f05880c7b00 2023-10-06T04:40:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058d6eb700 1 --2- 172.21.15.37:0/1070758211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880c7b00 0x7f058815a6f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f05880b2910 tx=0x7f0580009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5663afedfc0a409 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f05877fe700 1 -- 172.21.15.37:0/1070758211 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058000e070 con 0x7f05880c7b00 2023-10-06T04:40:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f05877fe700 1 -- 172.21.15.37:0/1070758211 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058000ba20 con 0x7f05880c7b00 2023-10-06T04:40:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f05877fe700 1 -- 172.21.15.37:0/1070758211 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05800092e0 con 0x7f05880c7b00 2023-10-06T04:40:47.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 -- 172.21.15.37:0/1070758211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880c7b00 msgr2=0x7f058815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:47.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 --2- 172.21.15.37:0/1070758211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880c7b00 0x7f058815a6f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f05880b2910 tx=0x7f0580009840 comp rx=0 tx=0).stop 2023-10-06T04:40:47.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 -- 172.21.15.37:0/1070758211 shutdown_connections 2023-10-06T04:40:47.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 --2- 172.21.15.37:0/1070758211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880c7b00 0x7f058815a6f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:47.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 --2- 172.21.15.37:0/1070758211 >> v2:172.21.15.83:3300/0 conn(0x7f058815a230 0x7f05880c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:47.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 -- 172.21.15.37:0/1070758211 >> 172.21.15.37:0/1070758211 conn(0x7f058806b210 msgr2=0x7f05880cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:47.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 -- 172.21.15.37:0/1070758211 shutdown_connections 2023-10-06T04:40:47.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.324+0000 7f058deec700 1 -- 172.21.15.37:0/1070758211 wait complete. 2023-10-06T04:40:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.328+0000 7f058deec700 1 Processor -- start 2023-10-06T04:40:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.328+0000 7f058deec700 1 -- start start 2023-10-06T04:40:47.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058deec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880c7b00 0x7f0588144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:47.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058deec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0588159e60 0x7f05880c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:47.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058deec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f058815a230 0x7f058814c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:47.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058deec700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0588144c90 con 0x7f05880c7b00 2023-10-06T04:40:47.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058deec700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05880b1570 con 0x7f0588159e60 2023-10-06T04:40:47.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058deec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05880b0680 con 0x7f058815a230 2023-10-06T04:40:47.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058ceea700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880c7b00 0x7f0588144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058ceea700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880c7b00 0x7f0588144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46624/0 (socket says 172.21.15.37:46624) 2023-10-06T04:40:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058ceea700 1 -- 172.21.15.37:0/4066792867 learned_addr learned my addr 172.21.15.37:0/4066792867 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058d6eb700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f058815a230 0x7f058814c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f0587fff700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0588159e60 0x7f05880c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058ceea700 1 -- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f058815a230 msgr2=0x7f058814c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058ceea700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f058815a230 0x7f058814c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058ceea700 1 -- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0588159e60 msgr2=0x7f05880c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058ceea700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0588159e60 0x7f05880c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058ceea700 1 -- 172.21.15.37:0/4066792867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580009ae0 con 0x7f05880c7b00 2023-10-06T04:40:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058ceea700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880c7b00 0x7f0588144750 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f057800c4e0 tx=0x7f057800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:47.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f0584ff9700 1 -- 172.21.15.37:0/4066792867 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578011590 con 0x7f05880c7b00 2023-10-06T04:40:47.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f0584ff9700 1 -- 172.21.15.37:0/4066792867 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0578011710 con 0x7f05880c7b00 2023-10-06T04:40:47.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f0584ff9700 1 -- 172.21.15.37:0/4066792867 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578011ad0 con 0x7f05880c7b00 2023-10-06T04:40:47.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058deec700 1 -- 172.21.15.37:0/4066792867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05880b0960 con 0x7f05880c7b00 2023-10-06T04:40:47.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058deec700 1 -- 172.21.15.37:0/4066792867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05880b0f20 con 0x7f05880c7b00 2023-10-06T04:40:47.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.332+0000 7f058deec700 1 -- 172.21.15.37:0/4066792867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05880708a0 con 0x7f05880c7b00 2023-10-06T04:40:47.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.336+0000 7f0584ff9700 1 -- 172.21.15.37:0/4066792867 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f057801b3b0 con 0x7f05880c7b00 2023-10-06T04:40:47.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.336+0000 7f0584ff9700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f056c060550 0x7f056c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:47.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.336+0000 7f0584ff9700 1 -- 172.21.15.37:0/4066792867 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f057807bc10 con 0x7f05880c7b00 2023-10-06T04:40:47.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.336+0000 7f0587fff700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f056c060550 0x7f056c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:47.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.336+0000 7f0587fff700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f056c060550 0x7f056c062a00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f05881528c0 tx=0x7f05700091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:47.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.344+0000 7f0584ff9700 1 -- 172.21.15.37:0/4066792867 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f057804c160 con 0x7f05880c7b00 2023-10-06T04:40:47.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:47.584+0000 7f058deec700 1 -- 172.21.15.37:0/4066792867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_mds_readonly"]} v 0) v1 -- 0x7f058806ce80 con 0x7f05880c7b00 2023-10-06T04:40:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.184+0000 7f0584ff9700 1 -- 172.21.15.37:0/4066792867 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_mds_readonly"]}]=0 v108) v1 ==== 147+0+0 (secure 0 0 0) 0x7f057804f780 con 0x7f05880c7b00 2023-10-06T04:40:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.192+0000 7f058deec700 1 -- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f056c060550 msgr2=0x7f056c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.192+0000 7f058deec700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f056c060550 0x7f056c062a00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f05881528c0 tx=0x7f05700091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.192+0000 7f058deec700 1 -- 172.21.15.37:0/4066792867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880c7b00 msgr2=0x7f0588144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.192+0000 7f058deec700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880c7b00 0x7f0588144750 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f057800c4e0 tx=0x7f057800c7f0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.192+0000 7f058deec700 1 -- 172.21.15.37:0/4066792867 shutdown_connections 2023-10-06T04:40:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.192+0000 7f058deec700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f056c060550 0x7f056c062a00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.192+0000 7f058deec700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0588159e60 0x7f05880c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.192+0000 7f058deec700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f058815a230 0x7f058814c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.192+0000 7f058deec700 1 --2- 172.21.15.37:0/4066792867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880c7b00 0x7f0588144750 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.192+0000 7f058deec700 1 -- 172.21.15.37:0/4066792867 >> 172.21.15.37:0/4066792867 conn(0x7f058806b210 msgr2=0x7f058815a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.192+0000 7f058deec700 1 -- 172.21.15.37:0/4066792867 shutdown_connections 2023-10-06T04:40:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.192+0000 7f058deec700 1 -- 172.21.15.37:0/4066792867 wait complete. 2023-10-06T04:40:48.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T04:40:48.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.324+0000 7f84c27e8700 1 Processor -- start 2023-10-06T04:40:48.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.324+0000 7f84c27e8700 1 -- start start 2023-10-06T04:40:48.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84bc0c8b30 0x7f84bc0adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f84bc0c8f00 0x7f84bc0cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84bc0ccd60 0x7f84bc06a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0ad110 con 0x7f84bc0ccd60 2023-10-06T04:40:48.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0c97f0 con 0x7f84bc0c8f00 2023-10-06T04:40:48.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0cd1c0 con 0x7f84bc0c8b30 2023-10-06T04:40:48.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c1fe7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84bc0ccd60 0x7f84bc06a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c1fe7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84bc0ccd60 0x7f84bc06a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46626/0 (socket says 172.21.15.37:46626) 2023-10-06T04:40:48.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c1fe7700 1 -- 172.21.15.37:0/90541931 learned_addr learned my addr 172.21.15.37:0/90541931 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:48.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c17e6700 1 --2- 172.21.15.37:0/90541931 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84bc0c8b30 0x7f84bc0adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c0fe5700 1 --2- 172.21.15.37:0/90541931 >> v2:172.21.15.83:3300/0 conn(0x7f84bc0c8f00 0x7f84bc0cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c1fe7700 1 -- 172.21.15.37:0/90541931 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84bc0c8b30 msgr2=0x7f84bc0adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:48.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c1fe7700 1 --2- 172.21.15.37:0/90541931 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84bc0c8b30 0x7f84bc0adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c1fe7700 1 -- 172.21.15.37:0/90541931 >> v2:172.21.15.83:3300/0 conn(0x7f84bc0c8f00 msgr2=0x7f84bc0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:48.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c1fe7700 1 --2- 172.21.15.37:0/90541931 >> v2:172.21.15.83:3300/0 conn(0x7f84bc0c8f00 0x7f84bc0cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c1fe7700 1 -- 172.21.15.37:0/90541931 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0ac500 con 0x7f84bc0ccd60 2023-10-06T04:40:48.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c0fe5700 1 --2- 172.21.15.37:0/90541931 >> v2:172.21.15.83:3300/0 conn(0x7f84bc0c8f00 0x7f84bc0cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:48.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c1fe7700 1 --2- 172.21.15.37:0/90541931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84bc0ccd60 0x7f84bc06a300 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f84bc067560 tx=0x7f84b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa88b9454256990f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:48.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84affff700 1 -- 172.21.15.37:0/90541931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b400e070 con 0x7f84bc0ccd60 2023-10-06T04:40:48.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84affff700 1 -- 172.21.15.37:0/90541931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b400b990 con 0x7f84bc0ccd60 2023-10-06T04:40:48.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84affff700 1 -- 172.21.15.37:0/90541931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b40092e0 con 0x7f84bc0ccd60 2023-10-06T04:40:48.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 -- 172.21.15.37:0/90541931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84bc0ccd60 msgr2=0x7f84bc06a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 --2- 172.21.15.37:0/90541931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84bc0ccd60 0x7f84bc06a300 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f84bc067560 tx=0x7f84b4009840 comp rx=0 tx=0).stop 2023-10-06T04:40:48.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 -- 172.21.15.37:0/90541931 shutdown_connections 2023-10-06T04:40:48.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 --2- 172.21.15.37:0/90541931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84bc0ccd60 0x7f84bc06a300 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 --2- 172.21.15.37:0/90541931 >> v2:172.21.15.83:3300/0 conn(0x7f84bc0c8f00 0x7f84bc0cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 --2- 172.21.15.37:0/90541931 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84bc0c8b30 0x7f84bc0adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 -- 172.21.15.37:0/90541931 >> 172.21.15.37:0/90541931 conn(0x7f84bc06e7c0 msgr2=0x7f84bc06ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:48.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 -- 172.21.15.37:0/90541931 shutdown_connections 2023-10-06T04:40:48.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.328+0000 7f84c27e8700 1 -- 172.21.15.37:0/90541931 wait complete. 2023-10-06T04:40:48.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c27e8700 1 Processor -- start 2023-10-06T04:40:48.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c27e8700 1 -- start start 2023-10-06T04:40:48.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c27e8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84bc0c8b30 0x7f84bc150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c27e8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84bc0c8f00 0x7f84bc0a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c27e8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84bc0ccd60 0x7f84bc0a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c27e8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc150c40 con 0x7f84bc0c8f00 2023-10-06T04:40:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c27e8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc152d10 con 0x7f84bc0ccd60 2023-10-06T04:40:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c27e8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc152ff0 con 0x7f84bc0c8b30 2023-10-06T04:40:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c0fe5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84bc0c8f00 0x7f84bc0a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c0fe5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84bc0c8f00 0x7f84bc0a8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46640/0 (socket says 172.21.15.37:46640) 2023-10-06T04:40:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c0fe5700 1 -- 172.21.15.37:0/1457281344 learned_addr learned my addr 172.21.15.37:0/1457281344 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c17e6700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84bc0c8b30 0x7f84bc150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c1fe7700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84bc0ccd60 0x7f84bc0a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c0fe5700 1 -- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84bc0c8b30 msgr2=0x7f84bc150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c0fe5700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84bc0c8b30 0x7f84bc150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c0fe5700 1 -- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84bc0ccd60 msgr2=0x7f84bc0a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.332+0000 7f84c0fe5700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84bc0ccd60 0x7f84bc0a92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.336+0000 7f84c0fe5700 1 -- 172.21.15.37:0/1457281344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4009ae0 con 0x7f84bc0c8f00 2023-10-06T04:40:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.336+0000 7f84c1fe7700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84bc0ccd60 0x7f84bc0a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.336+0000 7f84c0fe5700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84bc0c8f00 0x7f84bc0a8db0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f84b800e8d0 tx=0x7f84b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.336+0000 7f84ad7fa700 1 -- 172.21.15.37:0/1457281344 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8013410 con 0x7f84bc0c8f00 2023-10-06T04:40:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.336+0000 7f84ad7fa700 1 -- 172.21.15.37:0/1457281344 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b8013570 con 0x7f84bc0c8f00 2023-10-06T04:40:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.336+0000 7f84c27e8700 1 -- 172.21.15.37:0/1457281344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc1532d0 con 0x7f84bc0c8f00 2023-10-06T04:40:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.336+0000 7f84ad7fa700 1 -- 172.21.15.37:0/1457281344 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8013910 con 0x7f84bc0c8f00 2023-10-06T04:40:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.336+0000 7f84c27e8700 1 -- 172.21.15.37:0/1457281344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc0a9b10 con 0x7f84bc0c8f00 2023-10-06T04:40:48.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.336+0000 7f84c27e8700 1 -- 172.21.15.37:0/1457281344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc153ad0 con 0x7f84bc0c8f00 2023-10-06T04:40:48.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.336+0000 7f84ad7fa700 1 -- 172.21.15.37:0/1457281344 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f84b8013d00 con 0x7f84bc0c8f00 2023-10-06T04:40:48.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.340+0000 7f84ad7fa700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f84a0060550 0x7f84a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.340+0000 7f84ad7fa700 1 -- 172.21.15.37:0/1457281344 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f84b807c5b0 con 0x7f84bc0c8f00 2023-10-06T04:40:48.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.340+0000 7f84c17e6700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f84a0060550 0x7f84a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.340+0000 7f84c17e6700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f84a0060550 0x7f84a0062a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009da0 tx=0x7f84b0009120 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:48.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.348+0000 7f84ad7fa700 1 -- 172.21.15.37:0/1457281344 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f84bc153ad0 con 0x7f84bc0c8f00 2023-10-06T04:40:48.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.508+0000 7f84c27e8700 1 -- 172.21.15.37:0/1457281344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f84bc153ad0 con 0x7f84bc0c8f00 2023-10-06T04:40:48.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.516+0000 7f84ad7fa700 1 -- 172.21.15.37:0/1457281344 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f84bc153ad0 con 0x7f84bc0c8f00 2023-10-06T04:40:48.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.520+0000 7f84c27e8700 1 -- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f84a0060550 msgr2=0x7f84a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.520+0000 7f84c27e8700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f84a0060550 0x7f84a0062a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009da0 tx=0x7f84b0009120 comp rx=0 tx=0).stop 2023-10-06T04:40:48.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.520+0000 7f84c27e8700 1 -- 172.21.15.37:0/1457281344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84bc0c8f00 msgr2=0x7f84bc0a8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.520+0000 7f84c27e8700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84bc0c8f00 0x7f84bc0a8db0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f84b800e8d0 tx=0x7f84b8008040 comp rx=0 tx=0).stop 2023-10-06T04:40:48.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.520+0000 7f84c27e8700 1 -- 172.21.15.37:0/1457281344 shutdown_connections 2023-10-06T04:40:48.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.520+0000 7f84c27e8700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f84a0060550 0x7f84a0062a00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.520+0000 7f84c27e8700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84bc0ccd60 0x7f84bc0a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.520+0000 7f84c27e8700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84bc0c8f00 0x7f84bc0a8db0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.520+0000 7f84c27e8700 1 --2- 172.21.15.37:0/1457281344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84bc0c8b30 0x7f84bc150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.520+0000 7f84c27e8700 1 -- 172.21.15.37:0/1457281344 >> 172.21.15.37:0/1457281344 conn(0x7f84bc06e7c0 msgr2=0x7f84bc068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.520+0000 7f84c27e8700 1 -- 172.21.15.37:0/1457281344 shutdown_connections 2023-10-06T04:40:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.520+0000 7f84c27e8700 1 -- 172.21.15.37:0/1457281344 wait complete. 2023-10-06T04:40:48.542 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:40:48.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:40:48.560 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:40:48.581 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:40:48.581 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T04:40:48.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:48.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60fb0a6700 1 Processor -- start 2023-10-06T04:40:48.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60fb0a6700 1 -- start start 2023-10-06T04:40:48.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60fb0a6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60f40c79c0 0x7f60f40c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60fb0a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60f40cc1a0 0x7f60f40c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60fb0a6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f40ca610 con 0x7f60f40aa8d0 2023-10-06T04:40:48.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60fb0a6700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f40c9a00 con 0x7f60f40c79c0 2023-10-06T04:40:48.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60fb0a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40c9ce0 con 0x7f60f40cc1a0 2023-10-06T04:40:48.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60f98a3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60f40c79c0 0x7f60f40c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60f98a3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60f40c79c0 0x7f60f40c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46642/0 (socket says 172.21.15.37:46642) 2023-10-06T04:40:48.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60f98a3700 1 -- 172.21.15.37:0/2775550665 learned_addr learned my addr 172.21.15.37:0/2775550665 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:48.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60fa8a5700 1 --2- 172.21.15.37:0/2775550665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60f40cc1a0 0x7f60f40c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60f98a3700 1 -- 172.21.15.37:0/2775550665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60f40cc1a0 msgr2=0x7f60f40c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:48.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60f98a3700 1 --2- 172.21.15.37:0/2775550665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60f40cc1a0 0x7f60f40c06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60f98a3700 1 -- 172.21.15.37:0/2775550665 >> v1:172.21.15.83:6789/0 conn(0x7f60f40aa8d0 legacy=0x7f60f40c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60f98a3700 1 -- 172.21.15.37:0/2775550665 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40c9fc0 con 0x7f60f40c79c0 2023-10-06T04:40:48.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.688+0000 7f60f98a3700 1 --2- 172.21.15.37:0/2775550665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40c79c0 0x7f60f40c9370 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f60e400bc50 tx=0x7f60e400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f857d4683b18b095 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:48.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60f90a2700 1 -- 172.21.15.37:0/2775550665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e400dbf0 con 0x7f60f40c79c0 2023-10-06T04:40:48.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60f90a2700 1 -- 172.21.15.37:0/2775550665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e400dd50 con 0x7f60f40c79c0 2023-10-06T04:40:48.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60f90a2700 1 -- 172.21.15.37:0/2775550665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e40196b0 con 0x7f60f40c79c0 2023-10-06T04:40:48.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 -- 172.21.15.37:0/2775550665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40c79c0 msgr2=0x7f60f40c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 --2- 172.21.15.37:0/2775550665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40c79c0 0x7f60f40c9370 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f60e400bc50 tx=0x7f60e400b4f0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 -- 172.21.15.37:0/2775550665 shutdown_connections 2023-10-06T04:40:48.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 --2- 172.21.15.37:0/2775550665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60f40cc1a0 0x7f60f40c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 --2- 172.21.15.37:0/2775550665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40c79c0 0x7f60f40c9370 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 -- 172.21.15.37:0/2775550665 >> 172.21.15.37:0/2775550665 conn(0x7f60f4068780 msgr2=0x7f60f40cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 -- 172.21.15.37:0/2775550665 shutdown_connections 2023-10-06T04:40:48.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 -- 172.21.15.37:0/2775550665 wait complete. 2023-10-06T04:40:48.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 Processor -- start 2023-10-06T04:40:48.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 -- start start 2023-10-06T04:40:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f40aa8d0 0x7f60f4153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40c79c0 0x7f60f40af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60f40cc1a0 0x7f60f40afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40b0c90 con 0x7f60f40c79c0 2023-10-06T04:40:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40b1120 con 0x7f60f40aa8d0 2023-10-06T04:40:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fb0a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40b0080 con 0x7f60f40cc1a0 2023-10-06T04:40:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60f98a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40c79c0 0x7f60f40af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60f98a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40c79c0 0x7f60f40af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46650/0 (socket says 172.21.15.37:46650) 2023-10-06T04:40:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60f98a3700 1 -- 172.21.15.37:0/1213936783 learned_addr learned my addr 172.21.15.37:0/1213936783 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.692+0000 7f60fa0a4700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f40aa8d0 0x7f60f4153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60fa8a5700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60f40cc1a0 0x7f60f40afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60f98a3700 1 -- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60f40cc1a0 msgr2=0x7f60f40afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60f98a3700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60f40cc1a0 0x7f60f40afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60f98a3700 1 -- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f40aa8d0 msgr2=0x7f60f4153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60f98a3700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f40aa8d0 0x7f60f4153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60f98a3700 1 -- 172.21.15.37:0/1213936783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e400b790 con 0x7f60f40c79c0 2023-10-06T04:40:48.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60f98a3700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40c79c0 0x7f60f40af510 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f60e400b760 tx=0x7f60e401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:48.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60ea7fc700 1 -- 172.21.15.37:0/1213936783 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4010470 con 0x7f60f40c79c0 2023-10-06T04:40:48.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60ea7fc700 1 -- 172.21.15.37:0/1213936783 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e40105d0 con 0x7f60f40c79c0 2023-10-06T04:40:48.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60fb0a6700 1 -- 172.21.15.37:0/1213936783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f40b0360 con 0x7f60f40c79c0 2023-10-06T04:40:48.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60ea7fc700 1 -- 172.21.15.37:0/1213936783 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4010950 con 0x7f60f40c79c0 2023-10-06T04:40:48.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60fb0a6700 1 -- 172.21.15.37:0/1213936783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f40b0920 con 0x7f60f40c79c0 2023-10-06T04:40:48.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60fb0a6700 1 -- 172.21.15.37:0/1213936783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f40708a0 con 0x7f60f40c79c0 2023-10-06T04:40:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.696+0000 7f60ea7fc700 1 -- 172.21.15.37:0/1213936783 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f60e4022030 con 0x7f60f40c79c0 2023-10-06T04:40:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.700+0000 7f60ea7fc700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f60d8060550 0x7f60d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.700+0000 7f60ea7fc700 1 -- 172.21.15.37:0/1213936783 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f60e4014070 con 0x7f60f40c79c0 2023-10-06T04:40:48.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.700+0000 7f60fa0a4700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f60d8060550 0x7f60d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:48.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.700+0000 7f60fa0a4700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f60d8060550 0x7f60d8062a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60f00039e0 tx=0x7f60f0007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:48.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.708+0000 7f60ea7fc700 1 -- 172.21.15.37:0/1213936783 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f60e4050ec0 con 0x7f60f40c79c0 2023-10-06T04:40:48.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.900+0000 7f60fb0a6700 1 -- 172.21.15.37:0/1213936783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60f40c2290 con 0x7f60f40c79c0 2023-10-06T04:40:48.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.904+0000 7f60ea7fc700 1 -- 172.21.15.37:0/1213936783 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f60e40544e0 con 0x7f60f40c79c0 2023-10-06T04:40:48.909 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:48.909 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3094155806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3094155806},{"type":"v1","addr":"172.21.15.83:6837","nonce":3094155806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/968432746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":968432746},{"type":"v1","addr":"172.21.15.37:6833","nonce":968432746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2573831912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2573831912},{"type":"v1","addr":"172.21.15.37:6835","nonce":2573831912}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5192,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3433284261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3433284261},{"type":"v1","addr":"172.21.15.83:6835","nonce":3433284261}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[]} 2023-10-06T04:40:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.908+0000 7f60fb0a6700 1 -- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f60d8060550 msgr2=0x7f60d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.908+0000 7f60fb0a6700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f60d8060550 0x7f60d8062a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60f00039e0 tx=0x7f60f0007ec0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.908+0000 7f60fb0a6700 1 -- 172.21.15.37:0/1213936783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40c79c0 msgr2=0x7f60f40af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.908+0000 7f60fb0a6700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40c79c0 0x7f60f40af510 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f60e400b760 tx=0x7f60e401b000 comp rx=0 tx=0).stop 2023-10-06T04:40:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.908+0000 7f60fb0a6700 1 -- 172.21.15.37:0/1213936783 shutdown_connections 2023-10-06T04:40:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.908+0000 7f60fb0a6700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f60d8060550 0x7f60d8062a00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.908+0000 7f60fb0a6700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60f40cc1a0 0x7f60f40afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.908+0000 7f60fb0a6700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40c79c0 0x7f60f40af510 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.908+0000 7f60fb0a6700 1 --2- 172.21.15.37:0/1213936783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f40aa8d0 0x7f60f4153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.908+0000 7f60fb0a6700 1 -- 172.21.15.37:0/1213936783 >> 172.21.15.37:0/1213936783 conn(0x7f60f4068780 msgr2=0x7f60f4069050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:48.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.908+0000 7f60fb0a6700 1 -- 172.21.15.37:0/1213936783 shutdown_connections 2023-10-06T04:40:48.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:48.908+0000 7f60fb0a6700 1 -- 172.21.15.37:0/1213936783 wait complete. 2023-10-06T04:40:48.915 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 22 2023-10-06T04:40:48.931 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:40:48.931 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T04:40:48.931 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:40:48.932 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:40:48.932 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:40:48.932 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T04:40:48.932 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:40:48.932 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:40:48.933 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:40:48.933 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T04:40:48.933 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:40:48.933 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:40:48.933 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:40:48.934 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T04:40:48.934 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:40:48.934 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:40:48.944 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:40:48.944 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:40:48.945 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:40:48.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:40:48.953 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:40:48.953 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:40:48.954 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:40:48.954 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:40:48.956 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:40:48.957 DEBUG:teuthology.parallel:result is None 2023-10-06T04:40:48.957 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:40:48.958 DEBUG:teuthology.parallel:result is None 2023-10-06T04:40:48.989 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:40:48.989 DEBUG:teuthology.parallel:result is None 2023-10-06T04:40:48.991 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:40:48.992 DEBUG:teuthology.parallel:result is None 2023-10-06T04:40:48.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T04:40:49.031 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T04:40:49.031 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T04:40:49.063 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T04:40:49.064 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T04:40:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb32968e700 1 Processor -- start 2023-10-06T04:40:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb32968e700 1 -- start start 2023-10-06T04:40:49.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb32968e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb324067f20 0x7fb3240682f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:49.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb32968e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3240abec0 0x7fb324156a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:49.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb32968e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32415aab0 con 0x7fb3240aba40 2023-10-06T04:40:49.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb32968e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb32415ad90 con 0x7fb324067f20 2023-10-06T04:40:49.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb32968e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32415b070 con 0x7fb3240abec0 2023-10-06T04:40:49.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb322ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb324067f20 0x7fb3240682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:49.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb3227fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb3240aba40 0x7fb3241562f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55110/0 (socket says 172.21.15.37:55110) 2023-10-06T04:40:49.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb3227fc700 1 -- 172.21.15.37:0/703819808 learned_addr learned my addr 172.21.15.37:0/703819808 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:49.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb3237fe700 1 --2- 172.21.15.37:0/703819808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3240abec0 0x7fb324156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:49.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb322ffd700 1 -- 172.21.15.37:0/703819808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3240abec0 msgr2=0x7fb324156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:49.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb322ffd700 1 --2- 172.21.15.37:0/703819808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3240abec0 0x7fb324156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:49.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb322ffd700 1 -- 172.21.15.37:0/703819808 >> v1:172.21.15.37:6789/0 conn(0x7fb3240aba40 legacy=0x7fb3241562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:49.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb322ffd700 1 -- 172.21.15.37:0/703819808 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32415b350 con 0x7fb324067f20 2023-10-06T04:40:49.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb322ffd700 1 --2- 172.21.15.37:0/703819808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb324067f20 0x7fb3240682f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb3140098e0 tx=0x7fb3140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4da0cc71bae963 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:49.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.088+0000 7fb321ffb700 1 -- 172.21.15.37:0/703819808 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31400b640 con 0x7fb324067f20 2023-10-06T04:40:49.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.092+0000 7fb321ffb700 1 -- 172.21.15.37:0/703819808 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31400b7a0 con 0x7fb324067f20 2023-10-06T04:40:49.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.092+0000 7fb321ffb700 1 -- 172.21.15.37:0/703819808 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31400bb40 con 0x7fb324067f20 2023-10-06T04:40:49.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.092+0000 7fb32968e700 1 -- 172.21.15.37:0/703819808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb324067f20 msgr2=0x7fb3240682f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:49.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.092+0000 7fb32968e700 1 --2- 172.21.15.37:0/703819808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb324067f20 0x7fb3240682f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb3140098e0 tx=0x7fb3140091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:49.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.092+0000 7fb32968e700 1 -- 172.21.15.37:0/703819808 shutdown_connections 2023-10-06T04:40:49.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.092+0000 7fb32968e700 1 --2- 172.21.15.37:0/703819808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3240abec0 0x7fb324156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:49.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.092+0000 7fb32968e700 1 --2- 172.21.15.37:0/703819808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb324067f20 0x7fb3240682f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:49.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.092+0000 7fb32968e700 1 -- 172.21.15.37:0/703819808 >> 172.21.15.37:0/703819808 conn(0x7fb324068e00 msgr2=0x7fb324069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:49.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.092+0000 7fb32968e700 1 -- 172.21.15.37:0/703819808 shutdown_connections 2023-10-06T04:40:49.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.092+0000 7fb32968e700 1 -- 172.21.15.37:0/703819808 wait complete. 2023-10-06T04:40:49.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.092+0000 7fb32968e700 1 Processor -- start 2023-10-06T04:40:49.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.092+0000 7fb32968e700 1 -- start start 2023-10-06T04:40:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb32968e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb324067f20 0x7fb3240aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb32968e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3240aba40 0x7fb3241530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb32968e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3240abec0 0x7fb324153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb32968e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3241697b0 con 0x7fb324067f20 2023-10-06T04:40:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb32968e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32416a330 con 0x7fb3240aba40 2023-10-06T04:40:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb32968e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb324169a00 con 0x7fb3240abec0 2023-10-06T04:40:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb322ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb324067f20 0x7fb3240aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb322ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb324067f20 0x7fb3240aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50466/0 (socket says 172.21.15.37:50466) 2023-10-06T04:40:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb322ffd700 1 -- 172.21.15.37:0/2175529393 learned_addr learned my addr 172.21.15.37:0/2175529393 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb3237fe700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3240abec0 0x7fb324153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb3227fc700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3240aba40 0x7fb3241530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb322ffd700 1 -- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3240abec0 msgr2=0x7fb324153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb322ffd700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3240abec0 0x7fb324153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb322ffd700 1 -- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3240aba40 msgr2=0x7fb3241530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb322ffd700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3240aba40 0x7fb3241530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb322ffd700 1 -- 172.21.15.37:0/2175529393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb314009420 con 0x7fb324067f20 2023-10-06T04:40:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb322ffd700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb324067f20 0x7fb3240aff80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb314009f80 tx=0x7fb314017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb30affd700 1 -- 172.21.15.37:0/2175529393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31401bd90 con 0x7fb324067f20 2023-10-06T04:40:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb30affd700 1 -- 172.21.15.37:0/2175529393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb314011420 con 0x7fb324067f20 2023-10-06T04:40:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb32968e700 1 -- 172.21.15.37:0/2175529393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb324169ce0 con 0x7fb324067f20 2023-10-06T04:40:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb30affd700 1 -- 172.21.15.37:0/2175529393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3140117e0 con 0x7fb324067f20 2023-10-06T04:40:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.096+0000 7fb32968e700 1 -- 172.21.15.37:0/2175529393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3240b04c0 con 0x7fb324067f20 2023-10-06T04:40:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.100+0000 7fb32968e700 1 -- 172.21.15.37:0/2175529393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb324070ee0 con 0x7fb324067f20 2023-10-06T04:40:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.100+0000 7fb30affd700 1 -- 172.21.15.37:0/2175529393 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb314011b50 con 0x7fb324067f20 2023-10-06T04:40:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.100+0000 7fb30affd700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb310060580 0x7fb310062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.100+0000 7fb30affd700 1 -- 172.21.15.37:0/2175529393 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fb31407dfb0 con 0x7fb324067f20 2023-10-06T04:40:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.100+0000 7fb3227fc700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb310060580 0x7fb310062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:49.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.100+0000 7fb3227fc700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb310060580 0x7fb310062a30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb3240ae200 tx=0x7fb318009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:49.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.108+0000 7fb30affd700 1 -- 172.21.15.37:0/2175529393 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb31404e500 con 0x7fb324067f20 2023-10-06T04:40:49.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:49.284+0000 7fb32968e700 1 -- 172.21.15.37:0/2175529393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb32415b630 con 0x7fb324067f20 2023-10-06T04:40:50.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.212+0000 7fb30affd700 1 -- 172.21.15.37:0/2175529393 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb314051b20 con 0x7fb324067f20 2023-10-06T04:40:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.216+0000 7fb32968e700 1 -- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb310060580 msgr2=0x7fb310062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.216+0000 7fb32968e700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb310060580 0x7fb310062a30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb3240ae200 tx=0x7fb318009040 comp rx=0 tx=0).stop 2023-10-06T04:40:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.216+0000 7fb32968e700 1 -- 172.21.15.37:0/2175529393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb324067f20 msgr2=0x7fb3240aff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.216+0000 7fb32968e700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb324067f20 0x7fb3240aff80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb314009f80 tx=0x7fb314017000 comp rx=0 tx=0).stop 2023-10-06T04:40:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.216+0000 7fb32968e700 1 -- 172.21.15.37:0/2175529393 shutdown_connections 2023-10-06T04:40:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.216+0000 7fb32968e700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb310060580 0x7fb310062a30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.216+0000 7fb32968e700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3240aba40 0x7fb3241530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.216+0000 7fb32968e700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3240abec0 0x7fb324153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.216+0000 7fb32968e700 1 --2- 172.21.15.37:0/2175529393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb324067f20 0x7fb3240aff80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.216+0000 7fb32968e700 1 -- 172.21.15.37:0/2175529393 >> 172.21.15.37:0/2175529393 conn(0x7fb324068e00 msgr2=0x7fb3240cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.216+0000 7fb32968e700 1 -- 172.21.15.37:0/2175529393 shutdown_connections 2023-10-06T04:40:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.216+0000 7fb32968e700 1 -- 172.21.15.37:0/2175529393 wait complete. 2023-10-06T04:40:50.225 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-10-06T04:40:50.238 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T04:40:50.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc97fff700 1 Processor -- start 2023-10-06T04:40:50.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc97fff700 1 -- start start 2023-10-06T04:40:50.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc97fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efc980b0e40 0x7efc980b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:50.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc97fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc980a6790 0x7efc98159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:50.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc97fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc980a56f0 con 0x7efc980b17b0 2023-10-06T04:40:50.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc97fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc980a59d0 con 0x7efc980a6790 2023-10-06T04:40:50.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc97fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc980a5cb0 con 0x7efc980b0e40 2023-10-06T04:40:50.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc977fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc980a6790 0x7efc98159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:50.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc8ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efc980b0e40 0x7efc980b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:50.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc977fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc980a6790 0x7efc98159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50474/0 (socket says 172.21.15.37:50474) 2023-10-06T04:40:50.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc8ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efc980b0e40 0x7efc980b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:53782/0 (socket says 172.21.15.37:53782) 2023-10-06T04:40:50.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc977fe700 1 -- 172.21.15.37:0/143501669 learned_addr learned my addr 172.21.15.37:0/143501669 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:50.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc96ffd700 1 --1- 172.21.15.37:0/143501669 >> v1:172.21.15.83:6789/0 conn(0x7efc980b17b0 0x7efc980b0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:55398/0 (socket says 172.21.15.37:55398) 2023-10-06T04:40:50.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc977fe700 1 -- 172.21.15.37:0/143501669 >> v2:172.21.15.83:3300/0 conn(0x7efc980b0e40 msgr2=0x7efc980b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:50.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc977fe700 1 --2- 172.21.15.37:0/143501669 >> v2:172.21.15.83:3300/0 conn(0x7efc980b0e40 0x7efc980b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc977fe700 1 -- 172.21.15.37:0/143501669 >> v1:172.21.15.83:6789/0 conn(0x7efc980b17b0 legacy=0x7efc980b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc977fe700 1 -- 172.21.15.37:0/143501669 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc980a5f90 con 0x7efc980a6790 2023-10-06T04:40:50.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.352+0000 7efc977fe700 1 --2- 172.21.15.37:0/143501669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc980a6790 0x7efc98159a90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efc9806cab0 tx=0x7efc90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb588e32588188b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:50.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc967fc700 1 -- 172.21.15.37:0/143501669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000e070 con 0x7efc980a6790 2023-10-06T04:40:50.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc967fc700 1 -- 172.21.15.37:0/143501669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9000ba20 con 0x7efc980a6790 2023-10-06T04:40:50.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc967fc700 1 -- 172.21.15.37:0/143501669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc900092e0 con 0x7efc980a6790 2023-10-06T04:40:50.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc97fff700 1 -- 172.21.15.37:0/143501669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc980a6790 msgr2=0x7efc98159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc97fff700 1 --2- 172.21.15.37:0/143501669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc980a6790 0x7efc98159a90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efc9806cab0 tx=0x7efc90009840 comp rx=0 tx=0).stop 2023-10-06T04:40:50.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc97fff700 1 -- 172.21.15.37:0/143501669 shutdown_connections 2023-10-06T04:40:50.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc97fff700 1 --2- 172.21.15.37:0/143501669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc980a6790 0x7efc98159a90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc97fff700 1 --2- 172.21.15.37:0/143501669 >> v2:172.21.15.83:3300/0 conn(0x7efc980b0e40 0x7efc980b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc97fff700 1 -- 172.21.15.37:0/143501669 >> 172.21.15.37:0/143501669 conn(0x7efc980ccad0 msgr2=0x7efc9806be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:50.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc97fff700 1 -- 172.21.15.37:0/143501669 shutdown_connections 2023-10-06T04:40:50.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc97fff700 1 -- 172.21.15.37:0/143501669 wait complete. 2023-10-06T04:40:50.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc97fff700 1 Processor -- start 2023-10-06T04:40:50.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.356+0000 7efc97fff700 1 -- start start 2023-10-06T04:40:50.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc97fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc980a6790 0x7efc980a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc97fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc980b0e40 0x7efc980aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc97fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc980b17b0 0x7efc981469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc97fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc980aa9f0 con 0x7efc980b0e40 2023-10-06T04:40:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc97fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc980c1440 con 0x7efc980a6790 2023-10-06T04:40:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc97fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc980aa150 con 0x7efc980b17b0 2023-10-06T04:40:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc8ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc980b0e40 0x7efc980aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc96ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc980a6790 0x7efc980a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc8ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc980b0e40 0x7efc980aca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50490/0 (socket says 172.21.15.37:50490) 2023-10-06T04:40:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc8ffff700 1 -- 172.21.15.37:0/658500261 learned_addr learned my addr 172.21.15.37:0/658500261 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc977fe700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc980b17b0 0x7efc981469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc8ffff700 1 -- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc980b17b0 msgr2=0x7efc981469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc8ffff700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc980b17b0 0x7efc981469d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc8ffff700 1 -- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc980a6790 msgr2=0x7efc980a9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc8ffff700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc980a6790 0x7efc980a9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc8ffff700 1 -- 172.21.15.37:0/658500261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90009ae0 con 0x7efc980b0e40 2023-10-06T04:40:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc96ffd700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc980a6790 0x7efc980a9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc8ffff700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc980b0e40 0x7efc980aca20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efc8000ecb0 tx=0x7efc800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc8effd700 1 -- 172.21.15.37:0/658500261 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8000c850 con 0x7efc980b0e40 2023-10-06T04:40:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc8effd700 1 -- 172.21.15.37:0/658500261 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8000c9b0 con 0x7efc980b0e40 2023-10-06T04:40:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc97fff700 1 -- 172.21.15.37:0/658500261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc980aa430 con 0x7efc980b0e40 2023-10-06T04:40:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc8effd700 1 -- 172.21.15.37:0/658500261 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8000cd50 con 0x7efc980b0e40 2023-10-06T04:40:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.360+0000 7efc97fff700 1 -- 172.21.15.37:0/658500261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc98146f10 con 0x7efc980b0e40 2023-10-06T04:40:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.364+0000 7efc97fff700 1 -- 172.21.15.37:0/658500261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc980c1230 con 0x7efc980b0e40 2023-10-06T04:40:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.364+0000 7efc8effd700 1 -- 172.21.15.37:0/658500261 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efc80013680 con 0x7efc980b0e40 2023-10-06T04:40:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.364+0000 7efc8effd700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efc78060550 0x7efc78062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.364+0000 7efc8effd700 1 -- 172.21.15.37:0/658500261 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5526+0+0 (secure 0 0 0) 0x7efc8007c910 con 0x7efc980b0e40 2023-10-06T04:40:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.364+0000 7efc96ffd700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efc78060550 0x7efc78062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.364+0000 7efc96ffd700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efc78060550 0x7efc78062a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efc98155860 tx=0x7efc88007eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.372+0000 7efc8effd700 1 -- 172.21.15.37:0/658500261 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efc8004cfb0 con 0x7efc980b0e40 2023-10-06T04:40:50.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.592+0000 7efc97fff700 1 -- 172.21.15.37:0/658500261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efc980708a0 con 0x7efc980b0e40 2023-10-06T04:40:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.592+0000 7efc8effd700 1 -- 172.21.15.37:0/658500261 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7efc800505d0 con 0x7efc980b0e40 2023-10-06T04:40:50.599 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:50.599 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:40:50.599 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-10-06T04:40:50.599 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.599 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-10-06T04:40:50.600 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9lOJ5qARAAsrI6rKjWz9nRWFOt3Y+PqQ==", 2023-10-06T04:40:50.600 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.600 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:50.600 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:40:50.600 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:40:50.600 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.600 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.600 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.600 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-10-06T04:40:50.600 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9lfHbsCBAAtqsK3RVBoxm1lxiD6xvs2Q==", 2023-10-06T04:40:50.601 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.601 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:50.601 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:40:50.601 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:40:50.601 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.601 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.601 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.601 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-10-06T04:40:50.602 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9lUkX8BBAAnme43cfieXYJ9Su7RsbS4Q==", 2023-10-06T04:40:50.602 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.602 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:50.602 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:40:50.602 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:40:50.602 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.602 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.602 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.602 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-10-06T04:40:50.602 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9l58opDBAA35WNoMLpqmtJdWSSZXc64Q==", 2023-10-06T04:40:50.603 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.603 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:50.603 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:40:50.603 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:40:50.603 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.603 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.603 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.603 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-10-06T04:40:50.603 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA4jx9l/DyXOBAAzNFj0ooJ5/gyMftDwzeIlg==", 2023-10-06T04:40:50.603 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.603 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA8jx9lIzTRDhAA0Mk4SuNJdtaRS0kzMweOOQ==", 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.605 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.605 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-10-06T04:40:50.605 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA/jx9lNqwfExAAGO+OBHAP8JCfGnY7jDuP1Q==", 2023-10-06T04:40:50.605 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.605 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:50.605 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:50.605 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.605 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.605 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.605 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.605 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-10-06T04:40:50.605 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBCjx9lGZqMGBAAKlgYTGI0/J4itMisLtuBtQ==", 2023-10-06T04:40:50.606 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.606 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:50.606 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:50.606 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.606 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.606 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.606 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.606 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-10-06T04:40:50.606 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBIjx9le+3tABAAUgbf+fMuquiP3PEQSPwN0g==", 2023-10-06T04:40:50.606 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.606 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:50.606 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:50.607 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.607 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.607 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.607 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.607 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-10-06T04:40:50.607 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBLjx9lo2yUFRAAGTmYOWUH6Z2oGz3iUfbnZQ==", 2023-10-06T04:40:50.607 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.607 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:50.607 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:50.607 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.607 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.607 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.608 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.608 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-10-06T04:40:50.608 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBOjx9lPNTIFxAAplImPCR+TZMSH032LvqX8Q==", 2023-10-06T04:40:50.608 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.608 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:50.608 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:50.608 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.608 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.608 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.608 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.608 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-10-06T04:40:50.608 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBRjx9lSP/+HxAAu8/0hIUn5ltVb2kRHQShag==", 2023-10-06T04:40:50.609 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.609 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:50.609 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:40:50.609 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.609 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.609 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.609 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.609 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-10-06T04:40:50.609 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9lEpkaDxAARPlbdi95Jplvg+MqEnvRtQ==", 2023-10-06T04:40:50.609 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.609 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:50.609 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-10-06T04:40:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T04:40:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-10-06T04:40:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9l7A4oFRAAHbqwpcFGrhOffbCbjsCImw==", 2023-10-06T04:40:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T04:40:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T04:40:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T04:40:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9lODj8ERAAtL4c9GBGm8/aWvdps6m9nQ==", 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.611 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-10-06T04:40:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA2jx9lcZ10FxAAJg1NGICFz7QsIBKg/fPlHg==", 2023-10-06T04:40:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:40:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T04:40:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T04:40:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T04:40:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-10-06T04:40:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA1jx9lDoNZLRAAlxO5acBh/Y2TjiXwDEOmNQ==", 2023-10-06T04:40:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T04:40:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:40:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:40:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-10-06T04:40:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA1jx9lX9oxOhAACDvgyzcGRrnVSVDAx+LzOw==", 2023-10-06T04:40:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T04:40:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T04:40:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-10-06T04:40:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA1jx9lDRlRNxAAXQyULCYNLpCmk2wGrYQdFA==", 2023-10-06T04:40:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:40:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T04:40:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T04:40:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:40:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:50.615 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-06T04:40:50.615 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:40:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.596+0000 7efc97fff700 1 -- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efc78060550 msgr2=0x7efc78062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.596+0000 7efc97fff700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efc78060550 0x7efc78062a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efc98155860 tx=0x7efc88007eb0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.596+0000 7efc97fff700 1 -- 172.21.15.37:0/658500261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc980b0e40 msgr2=0x7efc980aca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.596+0000 7efc97fff700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc980b0e40 0x7efc980aca20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efc8000ecb0 tx=0x7efc800091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.596+0000 7efc97fff700 1 -- 172.21.15.37:0/658500261 shutdown_connections 2023-10-06T04:40:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.596+0000 7efc97fff700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7efc78060550 0x7efc78062a00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.596+0000 7efc97fff700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc980b17b0 0x7efc981469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.596+0000 7efc97fff700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc980b0e40 0x7efc980aca20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.596+0000 7efc97fff700 1 --2- 172.21.15.37:0/658500261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc980a6790 0x7efc980a9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.596+0000 7efc97fff700 1 -- 172.21.15.37:0/658500261 >> 172.21.15.37:0/658500261 conn(0x7efc980ccad0 msgr2=0x7efc98155cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.596+0000 7efc97fff700 1 -- 172.21.15.37:0/658500261 shutdown_connections 2023-10-06T04:40:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.596+0000 7efc97fff700 1 -- 172.21.15.37:0/658500261 wait complete. 2023-10-06T04:40:50.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:50.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.712+0000 7f547708b700 1 Processor -- start 2023-10-06T04:40:50.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.712+0000 7f547708b700 1 -- start start 2023-10-06T04:40:50.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54701587d0 0x7f547015d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:50.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5470068400 0x7f54700ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:50.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5470159040 con 0x7f5470158ba0 2023-10-06T04:40:50.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547015d6d0 con 0x7f54701587d0 2023-10-06T04:40:50.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54700af7f0 con 0x7f5470068400 2023-10-06T04:40:50.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f5476089700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54701587d0 0x7f547015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:50.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f5475888700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5470158ba0 0x7f5470067cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55122/0 (socket says 172.21.15.37:55122) 2023-10-06T04:40:50.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f5475888700 1 -- 172.21.15.37:0/3419187067 learned_addr learned my addr 172.21.15.37:0/3419187067 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:50.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547688a700 1 --2- 172.21.15.37:0/3419187067 >> v2:172.21.15.83:3300/0 conn(0x7f5470068400 0x7f54700ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:50.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f5476089700 1 -- 172.21.15.37:0/3419187067 >> v2:172.21.15.83:3300/0 conn(0x7f5470068400 msgr2=0x7f54700ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f5475087700 1 -- 172.21.15.37:0/3419187067 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319598364 0 0) 0x7f5470159040 con 0x7f5470158ba0 2023-10-06T04:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f5476089700 1 --2- 172.21.15.37:0/3419187067 >> v2:172.21.15.83:3300/0 conn(0x7f5470068400 0x7f54700ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f5476089700 1 -- 172.21.15.37:0/3419187067 >> v1:172.21.15.37:6789/0 conn(0x7f5470158ba0 legacy=0x7f5470067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f5476089700 1 -- 172.21.15.37:0/3419187067 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54700afad0 con 0x7f54701587d0 2023-10-06T04:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547688a700 1 --2- 172.21.15.37:0/3419187067 >> v2:172.21.15.83:3300/0 conn(0x7f5470068400 0x7f54700ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f5476089700 1 --2- 172.21.15.37:0/3419187067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54701587d0 0x7f547015d190 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f54700ca090 tx=0x7f5468009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99898cf3c51260c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f5475087700 1 -- 172.21.15.37:0/3419187067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546800e070 con 0x7f54701587d0 2023-10-06T04:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f5475087700 1 -- 172.21.15.37:0/3419187067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546800bb60 con 0x7f54701587d0 2023-10-06T04:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f5475087700 1 -- 172.21.15.37:0/3419187067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468012430 con 0x7f54701587d0 2023-10-06T04:40:50.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 -- 172.21.15.37:0/3419187067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54701587d0 msgr2=0x7f547015d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 --2- 172.21.15.37:0/3419187067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54701587d0 0x7f547015d190 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f54700ca090 tx=0x7f5468009780 comp rx=0 tx=0).stop 2023-10-06T04:40:50.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 -- 172.21.15.37:0/3419187067 shutdown_connections 2023-10-06T04:40:50.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 --2- 172.21.15.37:0/3419187067 >> v2:172.21.15.83:3300/0 conn(0x7f5470068400 0x7f54700ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 --2- 172.21.15.37:0/3419187067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54701587d0 0x7f547015d190 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 -- 172.21.15.37:0/3419187067 >> 172.21.15.37:0/3419187067 conn(0x7f54700cc5f0 msgr2=0x7f54700cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 -- 172.21.15.37:0/3419187067 shutdown_connections 2023-10-06T04:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.716+0000 7f547708b700 1 -- 172.21.15.37:0/3419187067 wait complete. 2023-10-06T04:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547708b700 1 Processor -- start 2023-10-06T04:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547708b700 1 -- start start 2023-10-06T04:40:50.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547708b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5470068400 0x7f54700c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:50.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547708b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54701587d0 0x7f54701448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:50.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547708b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5470158ba0 0x7f54700c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:50.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547708b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54700c6960 con 0x7f5470158ba0 2023-10-06T04:40:50.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547708b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54701598e0 con 0x7f54701587d0 2023-10-06T04:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547708b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54700c6680 con 0x7f5470068400 2023-10-06T04:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547688a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5470158ba0 0x7f54700c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f5476089700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5470068400 0x7f54700c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f5476089700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5470068400 0x7f54700c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:37146/0 (socket says 172.21.15.37:37146) 2023-10-06T04:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f5476089700 1 -- 172.21.15.37:0/2825960726 learned_addr learned my addr 172.21.15.37:0/2825960726 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f5475888700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54701587d0 0x7f54701448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547688a700 1 -- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5470068400 msgr2=0x7f54700c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547688a700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5470068400 0x7f54700c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547688a700 1 -- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54701587d0 msgr2=0x7f54701448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547688a700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54701587d0 0x7f54701448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.720+0000 7f547688a700 1 -- 172.21.15.37:0/2825960726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460009420 con 0x7f5470158ba0 2023-10-06T04:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.724+0000 7f547688a700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5470158ba0 0x7f54700c7b60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f54700c6b40 tx=0x7f54600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.724+0000 7f546e7fc700 1 -- 172.21.15.37:0/2825960726 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460013680 con 0x7f5470158ba0 2023-10-06T04:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.724+0000 7f546e7fc700 1 -- 172.21.15.37:0/2825960726 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54600137e0 con 0x7f5470158ba0 2023-10-06T04:40:50.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.724+0000 7f547708b700 1 -- 172.21.15.37:0/2825960726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5468009a20 con 0x7f5470158ba0 2023-10-06T04:40:50.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.724+0000 7f546e7fc700 1 -- 172.21.15.37:0/2825960726 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460013b60 con 0x7f5470158ba0 2023-10-06T04:40:50.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.724+0000 7f547708b700 1 -- 172.21.15.37:0/2825960726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5470159e60 con 0x7f5470158ba0 2023-10-06T04:40:50.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.724+0000 7f547708b700 1 -- 172.21.15.37:0/2825960726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547015a050 con 0x7f5470158ba0 2023-10-06T04:40:50.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.724+0000 7f546e7fc700 1 -- 172.21.15.37:0/2825960726 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f546000c3e0 con 0x7f5470158ba0 2023-10-06T04:40:50.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.724+0000 7f546e7fc700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f545c060580 0x7f545c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:50.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.724+0000 7f546e7fc700 1 -- 172.21.15.37:0/2825960726 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f546007c520 con 0x7f5470158ba0 2023-10-06T04:40:50.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.724+0000 7f5476089700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f545c060580 0x7f545c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:50.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.728+0000 7f5476089700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f545c060580 0x7f545c062a30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5468012560 tx=0x7f5468019000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.732+0000 7f546e7fc700 1 -- 172.21.15.37:0/2825960726 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f546004cbc0 con 0x7f5470158ba0 2023-10-06T04:40:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.896+0000 7f547708b700 1 -- 172.21.15.37:0/2825960726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54700708a0 con 0x7f5470158ba0 2023-10-06T04:40:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f546e7fc700 1 -- 172.21.15.37:0/2825960726 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+13807 (secure 0 0 0) 0x7f54600501e0 con 0x7f5470158ba0 2023-10-06T04:40:50.904 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:50.904 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":51,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:40:50.210629+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f547708b700 1 -- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f545c060580 msgr2=0x7f545c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f547708b700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f545c060580 0x7f545c062a30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5468012560 tx=0x7f5468019000 comp rx=0 tx=0).stop 2023-10-06T04:40:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f547708b700 1 -- 172.21.15.37:0/2825960726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5470158ba0 msgr2=0x7f54700c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f547708b700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5470158ba0 0x7f54700c7b60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f54700c6b40 tx=0x7f54600091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f547708b700 1 -- 172.21.15.37:0/2825960726 shutdown_connections 2023-10-06T04:40:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f547708b700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f545c060580 0x7f545c062a30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f547708b700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54701587d0 0x7f54701448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f547708b700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5470158ba0 0x7f54700c7b60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f547708b700 1 --2- 172.21.15.37:0/2825960726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5470068400 0x7f54700c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f547708b700 1 -- 172.21.15.37:0/2825960726 >> 172.21.15.37:0/2825960726 conn(0x7f54700cc5f0 msgr2=0x7f5470157180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f547708b700 1 -- 172.21.15.37:0/2825960726 shutdown_connections 2023-10-06T04:40:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:50.900+0000 7f547708b700 1 -- 172.21.15.37:0/2825960726 wait complete. 2023-10-06T04:40:50.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T04:40:50.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:40:51.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.028+0000 7fe2e0f1f700 1 Processor -- start 2023-10-06T04:40:51.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.028+0000 7fe2e0f1f700 1 -- start start 2023-10-06T04:40:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.028+0000 7fe2e0f1f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2dc0c8180 0x7fe2dc066db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.028+0000 7fe2e0f1f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2dc158bb0 0x7fe2dc159030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.028+0000 7fe2e0f1f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc06aa90 con 0x7fe2dc0669e0 2023-10-06T04:40:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.028+0000 7fe2e0f1f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc069c20 con 0x7fe2dc0c8180 2023-10-06T04:40:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.028+0000 7fe2e0f1f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc069e80 con 0x7fe2dc158bb0 2023-10-06T04:40:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.028+0000 7fe2d9d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2dc0c8180 0x7fe2dc066db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.028+0000 7fe2d9d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2dc0c8180 0x7fe2dc066db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50522/0 (socket says 172.21.15.37:50522) 2023-10-06T04:40:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.028+0000 7fe2d9d9b700 1 -- 172.21.15.37:0/1102012024 learned_addr learned my addr 172.21.15.37:0/1102012024 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2dad9d700 1 --2- 172.21.15.37:0/1102012024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2dc158bb0 0x7fe2dc159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2d9d9b700 1 -- 172.21.15.37:0/1102012024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2dc158bb0 msgr2=0x7fe2dc159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2d9d9b700 1 --2- 172.21.15.37:0/1102012024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2dc158bb0 0x7fe2dc159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2d9d9b700 1 -- 172.21.15.37:0/1102012024 >> v1:172.21.15.83:6789/0 conn(0x7fe2dc0669e0 legacy=0x7fe2dc069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2d9d9b700 1 -- 172.21.15.37:0/1102012024 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc06a160 con 0x7fe2dc0c8180 2023-10-06T04:40:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2d9d9b700 1 --2- 172.21.15.37:0/1102012024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2dc0c8180 0x7fe2dc066db0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0099e0 tx=0x7fe2cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28980b7589f8dcf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2d959a700 1 -- 172.21.15.37:0/1102012024 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc00b820 con 0x7fe2dc0c8180 2023-10-06T04:40:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2d959a700 1 -- 172.21.15.37:0/1102012024 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc00b980 con 0x7fe2dc0c8180 2023-10-06T04:40:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2d959a700 1 -- 172.21.15.37:0/1102012024 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc00bd20 con 0x7fe2dc0c8180 2023-10-06T04:40:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1102012024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2dc0c8180 msgr2=0x7fe2dc066db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2e0f1f700 1 --2- 172.21.15.37:0/1102012024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2dc0c8180 0x7fe2dc066db0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0099e0 tx=0x7fe2cc009250 comp rx=0 tx=0).stop 2023-10-06T04:40:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1102012024 shutdown_connections 2023-10-06T04:40:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2e0f1f700 1 --2- 172.21.15.37:0/1102012024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2dc158bb0 0x7fe2dc159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2e0f1f700 1 --2- 172.21.15.37:0/1102012024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2dc0c8180 0x7fe2dc066db0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1102012024 >> 172.21.15.37:0/1102012024 conn(0x7fe2dc0cdb00 msgr2=0x7fe2dc0cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1102012024 shutdown_connections 2023-10-06T04:40:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1102012024 wait complete. 2023-10-06T04:40:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2e0f1f700 1 Processor -- start 2023-10-06T04:40:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.032+0000 7fe2e0f1f700 1 -- start start 2023-10-06T04:40:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2e0f1f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2dc0669e0 0x7fe2dc0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2e0f1f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2dc0c8180 0x7fe2dc157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2e0f1f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2dc158bb0 0x7fe2dc169310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2e0f1f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0c3910 con 0x7fe2dc0669e0 2023-10-06T04:40:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2e0f1f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0c3e00 con 0x7fe2dc0c8180 2023-10-06T04:40:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2e0f1f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0b0d70 con 0x7fe2dc158bb0 2023-10-06T04:40:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2da59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2dc0669e0 0x7fe2dc0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2da59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2dc0669e0 0x7fe2dc0b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50534/0 (socket says 172.21.15.37:50534) 2023-10-06T04:40:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2da59c700 1 -- 172.21.15.37:0/1915775462 learned_addr learned my addr 172.21.15.37:0/1915775462 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2dad9d700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2dc158bb0 0x7fe2dc169310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2d9d9b700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2dc0c8180 0x7fe2dc157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2da59c700 1 -- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2dc158bb0 msgr2=0x7fe2dc169310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2da59c700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2dc158bb0 0x7fe2dc169310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2da59c700 1 -- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2dc0c8180 msgr2=0x7fe2dc157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2da59c700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2dc0c8180 0x7fe2dc157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2da59c700 1 -- 172.21.15.37:0/1915775462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc0094f0 con 0x7fe2dc0669e0 2023-10-06T04:40:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2da59c700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2dc0669e0 0x7fe2dc0b3360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000c590 tx=0x7fe2d000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2ca7fc700 1 -- 172.21.15.37:0/1915775462 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0011590 con 0x7fe2dc0669e0 2023-10-06T04:40:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2ca7fc700 1 -- 172.21.15.37:0/1915775462 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d0011710 con 0x7fe2dc0669e0 2023-10-06T04:40:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1915775462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc0c3630 con 0x7fe2dc0669e0 2023-10-06T04:40:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2ca7fc700 1 -- 172.21.15.37:0/1915775462 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0011ad0 con 0x7fe2dc0669e0 2023-10-06T04:40:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.036+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1915775462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc0c6b10 con 0x7fe2dc0669e0 2023-10-06T04:40:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.040+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1915775462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc070ee0 con 0x7fe2dc0669e0 2023-10-06T04:40:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.040+0000 7fe2ca7fc700 1 -- 172.21.15.37:0/1915775462 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe2d001b3b0 con 0x7fe2dc0669e0 2023-10-06T04:40:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.040+0000 7fe2ca7fc700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe2bc060550 0x7fe2bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.040+0000 7fe2ca7fc700 1 -- 172.21.15.37:0/1915775462 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fe2d007bb50 con 0x7fe2dc0669e0 2023-10-06T04:40:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.040+0000 7fe2d9d9b700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe2bc060550 0x7fe2bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.044+0000 7fe2d9d9b700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe2bc060550 0x7fe2bc062a00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0099e0 tx=0x7fe2cc017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.048+0000 7fe2ca7fc700 1 -- 172.21.15.37:0/1915775462 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe2d004c150 con 0x7fe2dc0669e0 2023-10-06T04:40:51.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.212+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1915775462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2dc06a440 con 0x7fe2dc0669e0 2023-10-06T04:40:51.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.216+0000 7fe2ca7fc700 1 -- 172.21.15.37:0/1915775462 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2d0017020 con 0x7fe2dc0669e0 2023-10-06T04:40:51.222 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:40:51.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.220+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe2bc060550 msgr2=0x7fe2bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.220+0000 7fe2e0f1f700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe2bc060550 0x7fe2bc062a00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0099e0 tx=0x7fe2cc017000 comp rx=0 tx=0).stop 2023-10-06T04:40:51.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.220+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1915775462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2dc0669e0 msgr2=0x7fe2dc0b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.220+0000 7fe2e0f1f700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2dc0669e0 0x7fe2dc0b3360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000c590 tx=0x7fe2d000c8a0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.220+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1915775462 shutdown_connections 2023-10-06T04:40:51.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.220+0000 7fe2e0f1f700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe2bc060550 0x7fe2bc062a00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.220+0000 7fe2e0f1f700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2dc0c8180 0x7fe2dc157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.220+0000 7fe2e0f1f700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2dc158bb0 0x7fe2dc169310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.220+0000 7fe2e0f1f700 1 --2- 172.21.15.37:0/1915775462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2dc0669e0 0x7fe2dc0b3360 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.220+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1915775462 >> 172.21.15.37:0/1915775462 conn(0x7fe2dc0cdb00 msgr2=0x7fe2dc0ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:51.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.220+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1915775462 shutdown_connections 2023-10-06T04:40:51.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.220+0000 7fe2e0f1f700 1 -- 172.21.15.37:0/1915775462 wait complete. 2023-10-06T04:40:51.238 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:40:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f50a0883700 1 Processor -- start 2023-10-06T04:40:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f50a0883700 1 -- start start 2023-10-06T04:40:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f50a0883700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f509c06dd80 0x7f509c06e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f50a0883700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f509c06af80 0x7f509c0696e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f50a0883700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c06e910 con 0x7f509c158ce0 2023-10-06T04:40:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f50a0883700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c0c80a0 con 0x7f509c06dd80 2023-10-06T04:40:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f50a0883700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c159d50 con 0x7f509c06af80 2023-10-06T04:40:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f509ad9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f509c158ce0 0x7f509c06d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55132/0 (socket says 172.21.15.37:55132) 2023-10-06T04:40:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f509ad9d700 1 -- 172.21.15.37:0/1590741598 learned_addr learned my addr 172.21.15.37:0/1590741598 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f509a59c700 1 --2- 172.21.15.37:0/1590741598 >> v2:172.21.15.83:3300/0 conn(0x7f509c06dd80 0x7f509c06e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f509b59e700 1 --2- 172.21.15.37:0/1590741598 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f509c06af80 0x7f509c0696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f5099d9b700 1 -- 172.21.15.37:0/1590741598 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479331057 0 0) 0x7f509c06e910 con 0x7f509c158ce0 2023-10-06T04:40:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.344+0000 7f5099d9b700 1 -- 172.21.15.37:0/1590741598 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5088003570 con 0x7f509c158ce0 2023-10-06T04:40:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f509a59c700 1 -- 172.21.15.37:0/1590741598 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f509c06af80 msgr2=0x7f509c0696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f5099d9b700 1 -- 172.21.15.37:0/1590741598 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2343020303 0 0) 0x7f5088003570 con 0x7f509c158ce0 2023-10-06T04:40:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f509a59c700 1 --2- 172.21.15.37:0/1590741598 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f509c06af80 0x7f509c0696e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f509a59c700 1 -- 172.21.15.37:0/1590741598 >> v1:172.21.15.37:6789/0 conn(0x7f509c158ce0 legacy=0x7f509c06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f509a59c700 1 -- 172.21.15.37:0/1590741598 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c06eb40 con 0x7f509c06dd80 2023-10-06T04:40:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f509b59e700 1 --2- 172.21.15.37:0/1590741598 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f509c06af80 0x7f509c0696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f509a59c700 1 --2- 172.21.15.37:0/1590741598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f509c06dd80 0x7f509c06e3d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f508c0098e0 tx=0x7f508c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecda554eb0c79947 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f5099d9b700 1 -- 172.21.15.37:0/1590741598 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084001470 con 0x7f509c06dd80 2023-10-06T04:40:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f5099d9b700 1 -- 172.21.15.37:0/1590741598 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c011420 con 0x7f509c06dd80 2023-10-06T04:40:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f5099d9b700 1 -- 172.21.15.37:0/1590741598 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c0117a0 con 0x7f509c06dd80 2023-10-06T04:40:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f50a0883700 1 -- 172.21.15.37:0/1590741598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f509c06dd80 msgr2=0x7f509c06e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f50a0883700 1 --2- 172.21.15.37:0/1590741598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f509c06dd80 0x7f509c06e3d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f508c0098e0 tx=0x7f508c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f50a0883700 1 -- 172.21.15.37:0/1590741598 shutdown_connections 2023-10-06T04:40:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f50a0883700 1 --2- 172.21.15.37:0/1590741598 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f509c06af80 0x7f509c0696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f50a0883700 1 --2- 172.21.15.37:0/1590741598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f509c06dd80 0x7f509c06e3d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f50a0883700 1 -- 172.21.15.37:0/1590741598 >> 172.21.15.37:0/1590741598 conn(0x7f509c068760 msgr2=0x7f509c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f50a0883700 1 -- 172.21.15.37:0/1590741598 shutdown_connections 2023-10-06T04:40:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f50a0883700 1 -- 172.21.15.37:0/1590741598 wait complete. 2023-10-06T04:40:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f50a0883700 1 Processor -- start 2023-10-06T04:40:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.348+0000 7f50a0883700 1 -- start start 2023-10-06T04:40:51.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f50a0883700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f509c06af80 0x7f509c148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f50a0883700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f509c06dd80 0x7f509c0aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f50a0883700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c158ce0 0x7f509c145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f50a0883700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c0b0550 con 0x7f509c158ce0 2023-10-06T04:40:51.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f50a0883700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c1489c0 con 0x7f509c06af80 2023-10-06T04:40:51.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f50a0883700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c0af940 con 0x7f509c06dd80 2023-10-06T04:40:51.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f509b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c158ce0 0x7f509c145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f509b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c158ce0 0x7f509c145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50548/0 (socket says 172.21.15.37:50548) 2023-10-06T04:40:51.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f509b59e700 1 -- 172.21.15.37:0/326847210 learned_addr learned my addr 172.21.15.37:0/326847210 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:51.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f509a59c700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f509c06dd80 0x7f509c0aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f509ad9d700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f509c06af80 0x7f509c148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f509b59e700 1 -- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f509c06dd80 msgr2=0x7f509c0aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f509b59e700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f509c06dd80 0x7f509c0aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f509b59e700 1 -- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f509c06af80 msgr2=0x7f509c148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f509b59e700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f509c06af80 0x7f509c148480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f509b59e700 1 -- 172.21.15.37:0/326847210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5094009a20 con 0x7f509c158ce0 2023-10-06T04:40:51.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f509b59e700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c158ce0 0x7f509c145a80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5094009fc0 tx=0x7f509400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:51.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f5092ffd700 1 -- 172.21.15.37:0/326847210 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509400cbd0 con 0x7f509c158ce0 2023-10-06T04:40:51.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f5092ffd700 1 -- 172.21.15.37:0/326847210 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509400f040 con 0x7f509c158ce0 2023-10-06T04:40:51.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f50a0883700 1 -- 172.21.15.37:0/326847210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c009420 con 0x7f509c158ce0 2023-10-06T04:40:51.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f5092ffd700 1 -- 172.21.15.37:0/326847210 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094014480 con 0x7f509c158ce0 2023-10-06T04:40:51.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.352+0000 7f50a0883700 1 -- 172.21.15.37:0/326847210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c0aff00 con 0x7f509c158ce0 2023-10-06T04:40:51.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.356+0000 7f50a0883700 1 -- 172.21.15.37:0/326847210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509c0b06c0 con 0x7f509c158ce0 2023-10-06T04:40:51.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.356+0000 7f5092ffd700 1 -- 172.21.15.37:0/326847210 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5094003020 con 0x7f509c158ce0 2023-10-06T04:40:51.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.356+0000 7f5092ffd700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f507c060550 0x7f507c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.356+0000 7f5092ffd700 1 -- 172.21.15.37:0/326847210 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f509407d080 con 0x7f509c158ce0 2023-10-06T04:40:51.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.356+0000 7f509ad9d700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f507c060550 0x7f507c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.360+0000 7f509ad9d700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f507c060550 0x7f507c062a00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5084004dd0 tx=0x7f5084001970 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.364+0000 7f5092ffd700 1 -- 172.21.15.37:0/326847210 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f509404d720 con 0x7f509c158ce0 2023-10-06T04:40:51.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.524+0000 7f50a0883700 1 -- 172.21.15.37:0/326847210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f509c0708a0 con 0x7f509c158ce0 2023-10-06T04:40:51.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f5092ffd700 1 -- 172.21.15.37:0/326847210 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5094050d40 con 0x7f509c158ce0 2023-10-06T04:40:51.532 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:40:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f50a0883700 1 -- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f507c060550 msgr2=0x7f507c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f50a0883700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f507c060550 0x7f507c062a00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5084004dd0 tx=0x7f5084001970 comp rx=0 tx=0).stop 2023-10-06T04:40:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f50a0883700 1 -- 172.21.15.37:0/326847210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c158ce0 msgr2=0x7f509c145a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f50a0883700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c158ce0 0x7f509c145a80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5094009fc0 tx=0x7f509400b040 comp rx=0 tx=0).stop 2023-10-06T04:40:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f50a0883700 1 -- 172.21.15.37:0/326847210 shutdown_connections 2023-10-06T04:40:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f50a0883700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f507c060550 0x7f507c062a00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f50a0883700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c158ce0 0x7f509c145a80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f50a0883700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f509c06dd80 0x7f509c0aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f50a0883700 1 --2- 172.21.15.37:0/326847210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f509c06af80 0x7f509c148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f50a0883700 1 -- 172.21.15.37:0/326847210 >> 172.21.15.37:0/326847210 conn(0x7f509c068760 msgr2=0x7f509c0c1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:51.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f50a0883700 1 -- 172.21.15.37:0/326847210 shutdown_connections 2023-10-06T04:40:51.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.528+0000 7f50a0883700 1 -- 172.21.15.37:0/326847210 wait complete. 2023-10-06T04:40:51.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:40:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.644+0000 7fd4925be700 1 Processor -- start 2023-10-06T04:40:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.644+0000 7fd4925be700 1 -- start start 2023-10-06T04:40:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd4925be700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd48c14fca0 0x7fd48c0cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd4925be700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd48c0cb700 0x7fd48c067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd4925be700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0ca370 con 0x7fd48c150070 2023-10-06T04:40:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd4925be700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0ca090 con 0x7fd48c14fca0 2023-10-06T04:40:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd4925be700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0ca700 con 0x7fd48c0cb700 2023-10-06T04:40:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd490b5b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd48c150070 0x7fd48c06be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55138/0 (socket says 172.21.15.37:55138) 2023-10-06T04:40:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd490b5b700 1 -- 172.21.15.37:0/1086674951 learned_addr learned my addr 172.21.15.37:0/1086674951 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48bfff700 1 --2- 172.21.15.37:0/1086674951 >> v2:172.21.15.37:3300/0 conn(0x7fd48c14fca0 0x7fd48c0cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48b7fe700 1 --2- 172.21.15.37:0/1086674951 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd48c0cb700 0x7fd48c067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48affd700 1 -- 172.21.15.37:0/1086674951 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097443918 0 0) 0x7fd48c0ca370 con 0x7fd48c150070 2023-10-06T04:40:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48affd700 1 -- 172.21.15.37:0/1086674951 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd474003570 con 0x7fd48c150070 2023-10-06T04:40:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48bfff700 1 -- 172.21.15.37:0/1086674951 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd48c0cb700 msgr2=0x7fd48c067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48bfff700 1 --2- 172.21.15.37:0/1086674951 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd48c0cb700 0x7fd48c067cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48bfff700 1 -- 172.21.15.37:0/1086674951 >> v1:172.21.15.37:6789/0 conn(0x7fd48c150070 legacy=0x7fd48c06be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48bfff700 1 -- 172.21.15.37:0/1086674951 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c0ca9e0 con 0x7fd48c14fca0 2023-10-06T04:40:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48b7fe700 1 --2- 172.21.15.37:0/1086674951 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd48c0cb700 0x7fd48c067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48bfff700 1 --2- 172.21.15.37:0/1086674951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd48c14fca0 0x7fd48c0cb1c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0098e0 tx=0x7fd47c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6ef82edf174043 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48affd700 1 -- 172.21.15.37:0/1086674951 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c011630 con 0x7fd48c14fca0 2023-10-06T04:40:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48affd700 1 -- 172.21.15.37:0/1086674951 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c011790 con 0x7fd48c14fca0 2023-10-06T04:40:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.648+0000 7fd48affd700 1 -- 172.21.15.37:0/1086674951 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c011b10 con 0x7fd48c14fca0 2023-10-06T04:40:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.652+0000 7fd4925be700 1 -- 172.21.15.37:0/1086674951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd48c14fca0 msgr2=0x7fd48c0cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.652+0000 7fd4925be700 1 --2- 172.21.15.37:0/1086674951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd48c14fca0 0x7fd48c0cb1c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0098e0 tx=0x7fd47c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.652+0000 7fd4925be700 1 -- 172.21.15.37:0/1086674951 shutdown_connections 2023-10-06T04:40:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.652+0000 7fd4925be700 1 --2- 172.21.15.37:0/1086674951 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd48c0cb700 0x7fd48c067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.652+0000 7fd4925be700 1 --2- 172.21.15.37:0/1086674951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd48c14fca0 0x7fd48c0cb1c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.652+0000 7fd4925be700 1 -- 172.21.15.37:0/1086674951 >> 172.21.15.37:0/1086674951 conn(0x7fd48c068e00 msgr2=0x7fd48c069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.652+0000 7fd4925be700 1 -- 172.21.15.37:0/1086674951 shutdown_connections 2023-10-06T04:40:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.652+0000 7fd4925be700 1 -- 172.21.15.37:0/1086674951 wait complete. 2023-10-06T04:40:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.652+0000 7fd4925be700 1 Processor -- start 2023-10-06T04:40:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.652+0000 7fd4925be700 1 -- start start 2023-10-06T04:40:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd4925be700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd48c0cb700 0x7fd48c14e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd4925be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd48c14fca0 0x7fd48c0b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd4925be700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd48c150070 0x7fd48c15a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd4925be700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0a88c0 con 0x7fd48c14fca0 2023-10-06T04:40:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd4925be700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0a9440 con 0x7fd48c0cb700 2023-10-06T04:40:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd4925be700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c14eb60 con 0x7fd48c150070 2023-10-06T04:40:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd48b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd48c14fca0 0x7fd48c0b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd48b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd48c14fca0 0x7fd48c0b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50552/0 (socket says 172.21.15.37:50552) 2023-10-06T04:40:51.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd48b7fe700 1 -- 172.21.15.37:0/391678890 learned_addr learned my addr 172.21.15.37:0/391678890 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:51.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd48bfff700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd48c0cb700 0x7fd48c14e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd490b5b700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd48c150070 0x7fd48c15a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd48b7fe700 1 -- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd48c150070 msgr2=0x7fd48c15a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd48b7fe700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd48c150070 0x7fd48c15a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd48b7fe700 1 -- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd48c0cb700 msgr2=0x7fd48c14e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd48b7fe700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd48c0cb700 0x7fd48c14e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd48b7fe700 1 -- 172.21.15.37:0/391678890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd480009420 con 0x7fd48c14fca0 2023-10-06T04:40:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.656+0000 7fd48b7fe700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd48c14fca0 0x7fd48c0b1ca0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd48000ecb0 tx=0x7fd4800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.660+0000 7fd473fff700 1 -- 172.21.15.37:0/391678890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48000c920 con 0x7fd48c14fca0 2023-10-06T04:40:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.660+0000 7fd473fff700 1 -- 172.21.15.37:0/391678890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48000ca80 con 0x7fd48c14fca0 2023-10-06T04:40:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.660+0000 7fd4925be700 1 -- 172.21.15.37:0/391678890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47c009420 con 0x7fd48c14fca0 2023-10-06T04:40:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.660+0000 7fd473fff700 1 -- 172.21.15.37:0/391678890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48000ce00 con 0x7fd48c14fca0 2023-10-06T04:40:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.660+0000 7fd4925be700 1 -- 172.21.15.37:0/391678890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c0a8bc0 con 0x7fd48c14fca0 2023-10-06T04:40:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.660+0000 7fd4925be700 1 -- 172.21.15.37:0/391678890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48c0a91f0 con 0x7fd48c14fca0 2023-10-06T04:40:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.660+0000 7fd473fff700 1 -- 172.21.15.37:0/391678890 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd480013680 con 0x7fd48c14fca0 2023-10-06T04:40:51.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.664+0000 7fd473fff700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd478060550 0x7fd478062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.664+0000 7fd473fff700 1 -- 172.21.15.37:0/391678890 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd48007ca30 con 0x7fd48c14fca0 2023-10-06T04:40:51.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.664+0000 7fd48bfff700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd478060550 0x7fd478062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.664+0000 7fd48bfff700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd478060550 0x7fd478062a00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0091e0 tx=0x7fd47c017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.668+0000 7fd473fff700 1 -- 172.21.15.37:0/391678890 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd48004d030 con 0x7fd48c14fca0 2023-10-06T04:40:51.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.832+0000 7fd4925be700 1 -- 172.21.15.37:0/391678890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd48c070ee0 con 0x7fd48c14fca0 2023-10-06T04:40:51.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.832+0000 7fd473fff700 1 -- 172.21.15.37:0/391678890 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd480017090 con 0x7fd48c14fca0 2023-10-06T04:40:51.837 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:51.837 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-10-06T04:40:51.837 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:51.838 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-10-06T04:40:51.838 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-10-06T04:40:51.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:40:51.838 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:40:51.838 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-10-06T04:40:51.838 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-10-06T04:40:51.838 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:40:51.838 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-10-06T04:40:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.832+0000 7fd4925be700 1 -- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd478060550 msgr2=0x7fd478062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.832+0000 7fd4925be700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd478060550 0x7fd478062a00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0091e0 tx=0x7fd47c017000 comp rx=0 tx=0).stop 2023-10-06T04:40:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.832+0000 7fd4925be700 1 -- 172.21.15.37:0/391678890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd48c14fca0 msgr2=0x7fd48c0b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.832+0000 7fd4925be700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd48c14fca0 0x7fd48c0b1ca0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd48000ecb0 tx=0x7fd4800091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.832+0000 7fd4925be700 1 -- 172.21.15.37:0/391678890 shutdown_connections 2023-10-06T04:40:51.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.832+0000 7fd4925be700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd478060550 0x7fd478062a00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.832+0000 7fd4925be700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd48c150070 0x7fd48c15a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.832+0000 7fd4925be700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd48c14fca0 0x7fd48c0b1ca0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.832+0000 7fd4925be700 1 --2- 172.21.15.37:0/391678890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd48c0cb700 0x7fd48c14e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.832+0000 7fd4925be700 1 -- 172.21.15.37:0/391678890 >> 172.21.15.37:0/391678890 conn(0x7fd48c068e00 msgr2=0x7fd48c14f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:51.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.836+0000 7fd4925be700 1 -- 172.21.15.37:0/391678890 shutdown_connections 2023-10-06T04:40:51.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.836+0000 7fd4925be700 1 -- 172.21.15.37:0/391678890 wait complete. 2023-10-06T04:40:51.856 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:40:51.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:40:51.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.968+0000 7f51e58bf700 1 Processor -- start 2023-10-06T04:40:51.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.968+0000 7f51e58bf700 1 -- start start 2023-10-06T04:40:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e58bf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0158bf0 0x7f51e00cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e58bf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f51e00ccaa0 0x7f51e00af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e58bf700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e00b0450 con 0x7f51e00afc80 2023-10-06T04:40:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e58bf700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e015d290 con 0x7f51e00ccaa0 2023-10-06T04:40:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e58bf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00cced0 con 0x7f51e0158bf0 2023-10-06T04:40:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e50be700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f51e00afc80 0x7f51e0069030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55154/0 (socket says 172.21.15.37:55154) 2023-10-06T04:40:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e50be700 1 -- 172.21.15.37:0/3572433692 learned_addr learned my addr 172.21.15.37:0/3572433692 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:51.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51dffff700 1 --2- 172.21.15.37:0/3572433692 >> v2:172.21.15.83:3300/0 conn(0x7f51e00ccaa0 0x7f51e00af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e48bd700 1 --2- 172.21.15.37:0/3572433692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0158bf0 0x7f51e00cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632756551 0 0) 0x7f51d8001490 con 0x7f51e00afc80 2023-10-06T04:40:51.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51cc003570 con 0x7f51e00afc80 2023-10-06T04:40:51.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1019300527 0 0) 0x7f51cc003570 con 0x7f51e00afc80 2023-10-06T04:40:51.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0158bf0 msgr2=0x7f51e00cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:51.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 --2- 172.21.15.37:0/3572433692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0158bf0 0x7f51e00cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 >> v2:172.21.15.83:3300/0 conn(0x7f51e00ccaa0 msgr2=0x7f51e00af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:51.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 --2- 172.21.15.37:0/3572433692 >> v2:172.21.15.83:3300/0 conn(0x7f51e00ccaa0 0x7f51e00af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e015d720 con 0x7f51e00afc80 2023-10-06T04:40:51.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f51d8001980 con 0x7f51e00afc80 2023-10-06T04:40:51.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 >> v1:172.21.15.37:6789/0 conn(0x7f51e00afc80 legacy=0x7f51e0069030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 --2- 172.21.15.37:0/3572433692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51cc003a60 0x7f51cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 --2- 172.21.15.37:0/3572433692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51cc004810 0x7f51cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 --2- 172.21.15.37:0/3572433692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0158bf0 0x7f51cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e015d290 con 0x7f51cc003a60 2023-10-06T04:40:51.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00cced0 con 0x7f51cc004810 2023-10-06T04:40:51.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc00ba60 con 0x7f51e0158bf0 2023-10-06T04:40:51.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51dffff700 1 --2- 172.21.15.37:0/3572433692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51cc004810 0x7f51cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e50be700 1 --2- 172.21.15.37:0/3572433692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0158bf0 0x7f51cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e48bd700 1 --2- 172.21.15.37:0/3572433692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51cc003a60 0x7f51cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e50be700 1 -- 172.21.15.37:0/3572433692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51cc004810 msgr2=0x7f51cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e50be700 1 --2- 172.21.15.37:0/3572433692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51cc004810 0x7f51cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e50be700 1 -- 172.21.15.37:0/3572433692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51cc003a60 msgr2=0x7f51cc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e50be700 1 --2- 172.21.15.37:0/3572433692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51cc003a60 0x7f51cc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e50be700 1 -- 172.21.15.37:0/3572433692 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc003570 con 0x7f51e0158bf0 2023-10-06T04:40:51.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51e50be700 1 --2- 172.21.15.37:0/3572433692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0158bf0 0x7f51cc0051c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f51d800ab00 tx=0x7f51d800a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cd723cb2d8343a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:51.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800a490 con 0x7f51e0158bf0 2023-10-06T04:40:51.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d800c5d0 con 0x7f51e0158bf0 2023-10-06T04:40:51.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.972+0000 7f51df7fe700 1 -- 172.21.15.37:0/3572433692 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800c990 con 0x7f51e0158bf0 2023-10-06T04:40:51.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.976+0000 7f51e58bf700 1 -- 172.21.15.37:0/3572433692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0158bf0 msgr2=0x7f51cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.976+0000 7f51e58bf700 1 --2- 172.21.15.37:0/3572433692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0158bf0 0x7f51cc0051c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f51d800ab00 tx=0x7f51d800a1a0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.976+0000 7f51e50be700 1 -- 172.21.15.37:0/3572433692 reap_dead start 2023-10-06T04:40:51.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.976+0000 7f51e58bf700 1 -- 172.21.15.37:0/3572433692 shutdown_connections 2023-10-06T04:40:51.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.976+0000 7f51e58bf700 1 -- 172.21.15.37:0/3572433692 >> 172.21.15.37:0/3572433692 conn(0x7f51e0067cf0 msgr2=0x7f51e00680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:51.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.976+0000 7f51e58bf700 1 -- 172.21.15.37:0/3572433692 shutdown_connections 2023-10-06T04:40:51.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.976+0000 7f51e58bf700 1 -- 172.21.15.37:0/3572433692 wait complete. 2023-10-06T04:40:51.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.976+0000 7f51e58bf700 1 Processor -- start 2023-10-06T04:40:51.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.976+0000 7f51e58bf700 1 -- start start 2023-10-06T04:40:51.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e58bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e0168e20 0x7f51e00c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e58bf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e00c5690 0x7f51e00c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e58bf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e00c3b00 0x7f51e00c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e58bf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c65c0 con 0x7f51e00c3b00 2023-10-06T04:40:51.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e58bf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c5b00 con 0x7f51e0168e20 2023-10-06T04:40:51.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e58bf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c42b0 con 0x7f51e00c5690 2023-10-06T04:40:51.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e50be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e00c3b00 0x7f51e00c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51dffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e00c5690 0x7f51e00c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e50be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e00c3b00 0x7f51e00c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50572/0 (socket says 172.21.15.37:50572) 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e48bd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e0168e20 0x7f51e00c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e50be700 1 -- 172.21.15.37:0/3333739772 learned_addr learned my addr 172.21.15.37:0/3333739772 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e50be700 1 -- 172.21.15.37:0/3333739772 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e00c5690 msgr2=0x7f51e00c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e50be700 1 --2- 172.21.15.37:0/3333739772 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e00c5690 0x7f51e00c35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e50be700 1 -- 172.21.15.37:0/3333739772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e0168e20 msgr2=0x7f51e00c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e50be700 1 --2- 172.21.15.37:0/3333739772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e0168e20 0x7f51e00c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e50be700 1 -- 172.21.15.37:0/3333739772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e00c4590 con 0x7f51e00c3b00 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e50be700 1 --2- 172.21.15.37:0/3333739772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e00c3b00 0x7f51e00c9f30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f51d8001220 tx=0x7f51d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51dcff9700 1 -- 172.21.15.37:0/3333739772 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8001940 con 0x7f51e00c3b00 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51dcff9700 1 -- 172.21.15.37:0/3333739772 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d8021070 con 0x7f51e00c3b00 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e58bf700 1 -- 172.21.15.37:0/3333739772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e00c4870 con 0x7f51e00c3b00 2023-10-06T04:40:51.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51dcff9700 1 -- 172.21.15.37:0/3333739772 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8026430 con 0x7f51e00c3b00 2023-10-06T04:40:51.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.980+0000 7f51e58bf700 1 -- 172.21.15.37:0/3333739772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e00c4e30 con 0x7f51e00c3b00 2023-10-06T04:40:51.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.984+0000 7f51e58bf700 1 -- 172.21.15.37:0/3333739772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e004be00 con 0x7f51e00c3b00 2023-10-06T04:40:51.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.984+0000 7f51dcff9700 1 -- 172.21.15.37:0/3333739772 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f51d8023030 con 0x7f51e00c3b00 2023-10-06T04:40:51.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.984+0000 7f51dcff9700 1 --2- 172.21.15.37:0/3333739772 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f51c0060580 0x7f51c0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:51.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.984+0000 7f51dcff9700 1 -- 172.21.15.37:0/3333739772 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f51d807dbb0 con 0x7f51e00c3b00 2023-10-06T04:40:51.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.984+0000 7f51e48bd700 1 --2- 172.21.15.37:0/3333739772 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f51c0060580 0x7f51c0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:51.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.984+0000 7f51e48bd700 1 --2- 172.21.15.37:0/3333739772 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f51c0060580 0x7f51c0062a30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f51e00cec20 tx=0x7f51d00091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:51.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:51.992+0000 7f51dcff9700 1 -- 172.21.15.37:0/3333739772 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f51d804e300 con 0x7f51e00c3b00 2023-10-06T04:40:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.160+0000 7f51e58bf700 1 -- 172.21.15.37:0/3333739772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f51e00b0450 con 0x7f51e00c3b00 2023-10-06T04:40:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.668+0000 7f51dcff9700 1 -- 172.21.15.37:0/3333739772 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v52) v1 ==== 138+0+0 (secure 0 0 0) 0x7f51e00b0450 con 0x7f51e00c3b00 2023-10-06T04:40:52.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.676+0000 7f51e58bf700 1 -- 172.21.15.37:0/3333739772 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f51c0060580 msgr2=0x7f51c0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:52.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.676+0000 7f51e58bf700 1 --2- 172.21.15.37:0/3333739772 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f51c0060580 0x7f51c0062a30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f51e00cec20 tx=0x7f51d00091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:52.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.676+0000 7f51e58bf700 1 -- 172.21.15.37:0/3333739772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e00c3b00 msgr2=0x7f51e00c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:52.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.676+0000 7f51e58bf700 1 --2- 172.21.15.37:0/3333739772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e00c3b00 0x7f51e00c9f30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f51d8001220 tx=0x7f51d8016000 comp rx=0 tx=0).stop 2023-10-06T04:40:52.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.676+0000 7f51e58bf700 1 -- 172.21.15.37:0/3333739772 shutdown_connections 2023-10-06T04:40:52.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.676+0000 7f51e58bf700 1 --2- 172.21.15.37:0/3333739772 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f51c0060580 0x7f51c0062a30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:52.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.676+0000 7f51e58bf700 1 --2- 172.21.15.37:0/3333739772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e00c3b00 0x7f51e00c9f30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:52.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.676+0000 7f51e58bf700 1 --2- 172.21.15.37:0/3333739772 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e00c5690 0x7f51e00c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:52.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.676+0000 7f51e58bf700 1 --2- 172.21.15.37:0/3333739772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e0168e20 0x7f51e00c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:52.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.676+0000 7f51e58bf700 1 -- 172.21.15.37:0/3333739772 >> 172.21.15.37:0/3333739772 conn(0x7f51e0067cf0 msgr2=0x7f51e00b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:52.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.676+0000 7f51e58bf700 1 -- 172.21.15.37:0/3333739772 shutdown_connections 2023-10-06T04:40:52.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.676+0000 7f51e58bf700 1 -- 172.21.15.37:0/3333739772 wait complete. 2023-10-06T04:40:52.684 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-10-06T04:40:52.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:40:52.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.808+0000 7f7859ca0700 1 Processor -- start 2023-10-06T04:40:52.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.808+0000 7f7859ca0700 1 -- start start 2023-10-06T04:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7859ca0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78540cf900 0x7f78540ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7859ca0700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78540cf470 con 0x7f7854159000 2023-10-06T04:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7859ca0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78540ce860 con 0x7f78540cc8c0 2023-10-06T04:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7859ca0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78540b0ad0 con 0x7f78540cf900 2023-10-06T04:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7853fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7854159000 0x7f78540cdaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55166/0 (socket says 172.21.15.37:55166) 2023-10-06T04:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7853fff700 1 -- 172.21.15.37:0/2908169406 learned_addr learned my addr 172.21.15.37:0/2908169406 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7852ffd700 1 --2- 172.21.15.37:0/2908169406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78540cf900 0x7f78540ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f78527fc700 1 -- 172.21.15.37:0/2908169406 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345648797 0 0) 0x7f78540cf470 con 0x7f7854159000 2023-10-06T04:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f78527fc700 1 -- 172.21.15.37:0/2908169406 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7840003570 con 0x7f7854159000 2023-10-06T04:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f78527fc700 1 -- 172.21.15.37:0/2908169406 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454720656 0 0) 0x7f78540ce860 con 0x7f78540cc8c0 2023-10-06T04:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f78527fc700 1 -- 172.21.15.37:0/2908169406 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78540cf470 con 0x7f78540cc8c0 2023-10-06T04:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7852ffd700 1 -- 172.21.15.37:0/2908169406 >> v1:172.21.15.83:6789/0 conn(0x7f78540cc8c0 legacy=0x7f78541588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7852ffd700 1 -- 172.21.15.37:0/2908169406 >> v1:172.21.15.37:6789/0 conn(0x7f7854159000 legacy=0x7f78540cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f78527fc700 1 -- 172.21.15.37:0/2908169406 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1636709983 0 0) 0x7f7840003570 con 0x7f7854159000 2023-10-06T04:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7852ffd700 1 -- 172.21.15.37:0/2908169406 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78540ceb40 con 0x7f78540cf900 2023-10-06T04:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7852ffd700 1 --2- 172.21.15.37:0/2908169406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78540cf900 0x7f78540ccc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f783c009910 tx=0x7f783c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8f8a6ce353fb4b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f78527fc700 1 -- 172.21.15.37:0/2908169406 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c0017f0 con 0x7f78540cf900 2023-10-06T04:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f78527fc700 1 -- 172.21.15.37:0/2908169406 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c011420 con 0x7f78540cf900 2023-10-06T04:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f78527fc700 1 -- 172.21.15.37:0/2908169406 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c0117a0 con 0x7f78540cf900 2023-10-06T04:40:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7859ca0700 1 -- 172.21.15.37:0/2908169406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78540cf900 msgr2=0x7f78540ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7859ca0700 1 --2- 172.21.15.37:0/2908169406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78540cf900 0x7f78540ccc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f783c009910 tx=0x7f783c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7859ca0700 1 -- 172.21.15.37:0/2908169406 shutdown_connections 2023-10-06T04:40:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7859ca0700 1 --2- 172.21.15.37:0/2908169406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78540cf900 0x7f78540ccc90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7859ca0700 1 -- 172.21.15.37:0/2908169406 >> 172.21.15.37:0/2908169406 conn(0x7f7854068780 msgr2=0x7f78540693e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7859ca0700 1 -- 172.21.15.37:0/2908169406 shutdown_connections 2023-10-06T04:40:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.812+0000 7f7859ca0700 1 -- 172.21.15.37:0/2908169406 wait complete. 2023-10-06T04:40:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f7859ca0700 1 Processor -- start 2023-10-06T04:40:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f7859ca0700 1 -- start start 2023-10-06T04:40:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f7859ca0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78540cc8c0 0x7f785415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f7859ca0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78540cf900 0x7f78540c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f7859ca0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7854159000 0x7f78540b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f7859ca0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78540b5a00 con 0x7f78540cf900 2023-10-06T04:40:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f7859ca0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785415c410 con 0x7f7854159000 2023-10-06T04:40:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f7859ca0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78540c5c00 con 0x7f78540cc8c0 2023-10-06T04:40:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f7852ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78540cf900 0x7f78540c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f7852ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78540cf900 0x7f78540c56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50574/0 (socket says 172.21.15.37:50574) 2023-10-06T04:40:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f7852ffd700 1 -- 172.21.15.37:0/2641705947 learned_addr learned my addr 172.21.15.37:0/2641705947 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f7853fff700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7854159000 0x7f78540b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.816+0000 7f78537fe700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78540cc8c0 0x7f785415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f7852ffd700 1 -- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78540cc8c0 msgr2=0x7f785415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f7852ffd700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78540cc8c0 0x7f785415bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f7852ffd700 1 -- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7854159000 msgr2=0x7f78540b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f7852ffd700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7854159000 0x7f78540b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f7852ffd700 1 -- 172.21.15.37:0/2641705947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c009420 con 0x7f78540cf900 2023-10-06T04:40:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f78537fe700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78540cc8c0 0x7f785415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f7853fff700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7854159000 0x7f78540b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f7852ffd700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78540cf900 0x7f78540c56c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7854068ef0 tx=0x7f783c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f784b7fe700 1 -- 172.21.15.37:0/2641705947 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c01caf0 con 0x7f78540cf900 2023-10-06T04:40:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f784b7fe700 1 -- 172.21.15.37:0/2641705947 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c01cc50 con 0x7f78540cf900 2023-10-06T04:40:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f7859ca0700 1 -- 172.21.15.37:0/2641705947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78540b4df0 con 0x7f78540cf900 2023-10-06T04:40:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f784b7fe700 1 -- 172.21.15.37:0/2641705947 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c01a450 con 0x7f78540cf900 2023-10-06T04:40:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f7859ca0700 1 -- 172.21.15.37:0/2641705947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78540b53b0 con 0x7f78540cf900 2023-10-06T04:40:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.820+0000 7f7859ca0700 1 -- 172.21.15.37:0/2641705947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7854070ee0 con 0x7f78540cf900 2023-10-06T04:40:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.824+0000 7f784b7fe700 1 -- 172.21.15.37:0/2641705947 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f783c01a860 con 0x7f78540cf900 2023-10-06T04:40:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.824+0000 7f784b7fe700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7834060580 0x7f7834062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.824+0000 7f784b7fe700 1 -- 172.21.15.37:0/2641705947 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f783c07e440 con 0x7f78540cf900 2023-10-06T04:40:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.824+0000 7f78537fe700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7834060580 0x7f7834062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.824+0000 7f78537fe700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7834060580 0x7f7834062a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7844007fd0 tx=0x7f7844007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.828+0000 7f784b7fe700 1 -- 172.21.15.37:0/2641705947 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f783c04e950 con 0x7f78540cf900 2023-10-06T04:40:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:52.992+0000 7f7859ca0700 1 -- 172.21.15.37:0/2641705947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7854069020 con 0x7f78540cf900 2023-10-06T04:40:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.684+0000 7f784b7fe700 1 -- 172.21.15.37:0/2641705947 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v53) v1 ==== 170+0+0 (secure 0 0 0) 0x7f783c051f70 con 0x7f78540cf900 2023-10-06T04:40:53.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.708+0000 7f7859ca0700 1 -- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7834060580 msgr2=0x7f7834062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:53.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.708+0000 7f7859ca0700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7834060580 0x7f7834062a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7844007fd0 tx=0x7f7844007d50 comp rx=0 tx=0).stop 2023-10-06T04:40:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.708+0000 7f7859ca0700 1 -- 172.21.15.37:0/2641705947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78540cf900 msgr2=0x7f78540c56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.708+0000 7f7859ca0700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78540cf900 0x7f78540c56c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7854068ef0 tx=0x7f783c016000 comp rx=0 tx=0).stop 2023-10-06T04:40:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.708+0000 7f7859ca0700 1 -- 172.21.15.37:0/2641705947 shutdown_connections 2023-10-06T04:40:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.708+0000 7f7859ca0700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7834060580 0x7f7834062a30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.708+0000 7f7859ca0700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7854159000 0x7f78540b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.708+0000 7f7859ca0700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78540cf900 0x7f78540c56c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.708+0000 7f7859ca0700 1 --2- 172.21.15.37:0/2641705947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78540cc8c0 0x7f785415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.708+0000 7f7859ca0700 1 -- 172.21.15.37:0/2641705947 >> 172.21.15.37:0/2641705947 conn(0x7f7854068780 msgr2=0x7f7854155a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.708+0000 7f7859ca0700 1 -- 172.21.15.37:0/2641705947 shutdown_connections 2023-10-06T04:40:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.708+0000 7f7859ca0700 1 -- 172.21.15.37:0/2641705947 wait complete. 2023-10-06T04:40:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-10-06T04:40:53.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:40:53.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad2056c700 1 Processor -- start 2023-10-06T04:40:53.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad2056c700 1 -- start start 2023-10-06T04:40:53.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad2056c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad18153400 0x7fad18069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:53.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad2056c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad180b48f0 0x7fad18069970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:53.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad2056c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad180b5a60 con 0x7fad181537d0 2023-10-06T04:40:53.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad2056c700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1815a680 con 0x7fad18153400 2023-10-06T04:40:53.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad2056c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad18159950 con 0x7fad180b48f0 2023-10-06T04:40:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad1e308700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad18153400 0x7fad18069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad1e308700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad18153400 0x7fad18069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50580/0 (socket says 172.21.15.37:50580) 2023-10-06T04:40:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad1e308700 1 -- 172.21.15.37:0/1499239597 learned_addr learned my addr 172.21.15.37:0/1499239597 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad1db07700 1 --1- 172.21.15.37:0/1499239597 >> v1:172.21.15.37:6789/0 conn(0x7fad181537d0 0x7fad180b41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55176/0 (socket says 172.21.15.37:55176) 2023-10-06T04:40:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad1eb09700 1 --2- 172.21.15.37:0/1499239597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad180b48f0 0x7fad18069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad1e308700 1 -- 172.21.15.37:0/1499239597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad180b48f0 msgr2=0x7fad18069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad1e308700 1 --2- 172.21.15.37:0/1499239597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad180b48f0 0x7fad18069970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad1e308700 1 -- 172.21.15.37:0/1499239597 >> v1:172.21.15.37:6789/0 conn(0x7fad181537d0 legacy=0x7fad180b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.828+0000 7fad1e308700 1 -- 172.21.15.37:0/1499239597 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad180b4e50 con 0x7fad18153400 2023-10-06T04:40:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.832+0000 7fad1e308700 1 --2- 172.21.15.37:0/1499239597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad18153400 0x7fad18069430 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fad1815a7c0 tx=0x7fad08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548513de07a3b577 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.832+0000 7fad1d306700 1 -- 172.21.15.37:0/1499239597 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08009e70 con 0x7fad18153400 2023-10-06T04:40:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.832+0000 7fad1d306700 1 -- 172.21.15.37:0/1499239597 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0800b860 con 0x7fad18153400 2023-10-06T04:40:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.832+0000 7fad1d306700 1 -- 172.21.15.37:0/1499239597 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0800bc20 con 0x7fad18153400 2023-10-06T04:40:53.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.832+0000 7fad2056c700 1 -- 172.21.15.37:0/1499239597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad18153400 msgr2=0x7fad18069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:53.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.832+0000 7fad2056c700 1 --2- 172.21.15.37:0/1499239597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad18153400 0x7fad18069430 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fad1815a7c0 tx=0x7fad08009250 comp rx=0 tx=0).stop 2023-10-06T04:40:53.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.832+0000 7fad2056c700 1 -- 172.21.15.37:0/1499239597 shutdown_connections 2023-10-06T04:40:53.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.832+0000 7fad2056c700 1 --2- 172.21.15.37:0/1499239597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad180b48f0 0x7fad18069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:53.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.832+0000 7fad2056c700 1 --2- 172.21.15.37:0/1499239597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad18153400 0x7fad18069430 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:53.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.832+0000 7fad2056c700 1 -- 172.21.15.37:0/1499239597 >> 172.21.15.37:0/1499239597 conn(0x7fad18067cf0 msgr2=0x7fad180680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:53.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.832+0000 7fad2056c700 1 -- 172.21.15.37:0/1499239597 shutdown_connections 2023-10-06T04:40:53.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.832+0000 7fad2056c700 1 -- 172.21.15.37:0/1499239597 wait complete. 2023-10-06T04:40:53.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad2056c700 1 Processor -- start 2023-10-06T04:40:53.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad2056c700 1 -- start start 2023-10-06T04:40:53.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad2056c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad180b48f0 0x7fad18154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:53.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad2056c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad18153400 0x7fad1816c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:53.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad2056c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad181537d0 0x7fad18156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:53.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad2056c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1815e190 con 0x7fad180b48f0 2023-10-06T04:40:53.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad2056c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1815d2e0 con 0x7fad18153400 2023-10-06T04:40:53.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad2056c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1815d580 con 0x7fad181537d0 2023-10-06T04:40:53.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad1e308700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad180b48f0 0x7fad18154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:53.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad1e308700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad180b48f0 0x7fad18154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50586/0 (socket says 172.21.15.37:50586) 2023-10-06T04:40:53.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad1e308700 1 -- 172.21.15.37:0/2636092293 learned_addr learned my addr 172.21.15.37:0/2636092293 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:53.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad1eb09700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad181537d0 0x7fad18156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:53.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad1db07700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad18153400 0x7fad1816c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:53.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad1e308700 1 -- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad181537d0 msgr2=0x7fad18156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:53.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad1e308700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad181537d0 0x7fad18156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:53.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad1e308700 1 -- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad18153400 msgr2=0x7fad1816c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:53.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.836+0000 7fad1e308700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad18153400 0x7fad1816c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:53.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad1e308700 1 -- 172.21.15.37:0/2636092293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080094f0 con 0x7fad180b48f0 2023-10-06T04:40:53.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad1db07700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad18153400 0x7fad1816c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:53.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad1e308700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad180b48f0 0x7fad18154050 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fad0800c010 tx=0x7fad08016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:53.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad167fc700 1 -- 172.21.15.37:0/2636092293 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08011b10 con 0x7fad180b48f0 2023-10-06T04:40:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad167fc700 1 -- 172.21.15.37:0/2636092293 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad08020070 con 0x7fad180b48f0 2023-10-06T04:40:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad2056c700 1 -- 172.21.15.37:0/2636092293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1815d860 con 0x7fad180b48f0 2023-10-06T04:40:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad167fc700 1 -- 172.21.15.37:0/2636092293 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0801b450 con 0x7fad180b48f0 2023-10-06T04:40:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad2056c700 1 -- 172.21.15.37:0/2636092293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1815de20 con 0x7fad180b48f0 2023-10-06T04:40:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad167fc700 1 -- 172.21.15.37:0/2636092293 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fad08022030 con 0x7fad180b48f0 2023-10-06T04:40:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad2056c700 1 -- 172.21.15.37:0/2636092293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad18070ee0 con 0x7fad180b48f0 2023-10-06T04:40:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad167fc700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fad04060550 0x7fad04062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad167fc700 1 -- 172.21.15.37:0/2636092293 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fad0807e7b0 con 0x7fad180b48f0 2023-10-06T04:40:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.840+0000 7fad1db07700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fad04060550 0x7fad04062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:53.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.844+0000 7fad1db07700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fad04060550 0x7fad04062a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fad0c007fd0 tx=0x7fad0c007e10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:53.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:53.852+0000 7fad167fc700 1 -- 172.21.15.37:0/2636092293 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fad0804eb60 con 0x7fad180b48f0 2023-10-06T04:40:54.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.048+0000 7fad2056c700 1 -- 172.21.15.37:0/2636092293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fad18068d00 con 0x7fad180b48f0 2023-10-06T04:40:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.700+0000 7fad167fc700 1 -- 172.21.15.37:0/2636092293 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v24) v1 ==== 172+0+0 (secure 0 0 0) 0x7fad08052180 con 0x7fad180b48f0 2023-10-06T04:40:54.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.720+0000 7fad2056c700 1 -- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fad04060550 msgr2=0x7fad04062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:54.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.720+0000 7fad2056c700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fad04060550 0x7fad04062a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fad0c007fd0 tx=0x7fad0c007e10 comp rx=0 tx=0).stop 2023-10-06T04:40:54.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.720+0000 7fad2056c700 1 -- 172.21.15.37:0/2636092293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad180b48f0 msgr2=0x7fad18154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:54.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.720+0000 7fad2056c700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad180b48f0 0x7fad18154050 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fad0800c010 tx=0x7fad08016000 comp rx=0 tx=0).stop 2023-10-06T04:40:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.720+0000 7fad2056c700 1 -- 172.21.15.37:0/2636092293 shutdown_connections 2023-10-06T04:40:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.720+0000 7fad2056c700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fad04060550 0x7fad04062a00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.720+0000 7fad2056c700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad18153400 0x7fad1816c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.720+0000 7fad2056c700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad181537d0 0x7fad18156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.720+0000 7fad2056c700 1 --2- 172.21.15.37:0/2636092293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad180b48f0 0x7fad18154050 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.720+0000 7fad2056c700 1 -- 172.21.15.37:0/2636092293 >> 172.21.15.37:0/2636092293 conn(0x7fad18067cf0 msgr2=0x7fad18069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:54.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.724+0000 7fad2056c700 1 -- 172.21.15.37:0/2636092293 shutdown_connections 2023-10-06T04:40:54.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.724+0000 7fad2056c700 1 -- 172.21.15.37:0/2636092293 wait complete. 2023-10-06T04:40:54.730 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 8 and data pool 9 2023-10-06T04:40:54.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:54.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.840+0000 7f1e8ea53700 1 Processor -- start 2023-10-06T04:40:54.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.840+0000 7f1e8ea53700 1 -- start start 2023-10-06T04:40:54.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.840+0000 7f1e8ea53700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8815d240 0x7f1e880aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:54.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.840+0000 7f1e8ea53700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1e880cc0d0 0x7f1e8806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:54.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.840+0000 7f1e8ea53700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8815e0e0 con 0x7f1e8806da20 2023-10-06T04:40:54.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.840+0000 7f1e8ea53700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8806de60 con 0x7f1e880cc0d0 2023-10-06T04:40:54.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.840+0000 7f1e8ea53700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8815d7b0 con 0x7f1e8815d240 2023-10-06T04:40:54.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.840+0000 7f1e8e252700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1e8806da20 0x7f1e88160ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55188/0 (socket says 172.21.15.37:55188) 2023-10-06T04:40:54.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.840+0000 7f1e8e252700 1 -- 172.21.15.37:0/2810922500 learned_addr learned my addr 172.21.15.37:0/2810922500 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:54.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.840+0000 7f1e8da51700 1 --2- 172.21.15.37:0/2810922500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8815d240 0x7f1e880aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:54.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.840+0000 7f1e8d250700 1 --2- 172.21.15.37:0/2810922500 >> v2:172.21.15.83:3300/0 conn(0x7f1e880cc0d0 0x7f1e8806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:54.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ca4f700 1 -- 172.21.15.37:0/2810922500 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975175887 0 0) 0x7f1e8815e0e0 con 0x7f1e8806da20 2023-10-06T04:40:54.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ca4f700 1 -- 172.21.15.37:0/2810922500 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e74003570 con 0x7f1e8806da20 2023-10-06T04:40:54.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8d250700 1 -- 172.21.15.37:0/2810922500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8815d240 msgr2=0x7f1e880aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:54.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8d250700 1 --2- 172.21.15.37:0/2810922500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8815d240 0x7f1e880aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:54.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8d250700 1 -- 172.21.15.37:0/2810922500 >> v1:172.21.15.37:6789/0 conn(0x7f1e8806da20 legacy=0x7f1e88160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:54.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8d250700 1 -- 172.21.15.37:0/2810922500 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8815da90 con 0x7f1e880cc0d0 2023-10-06T04:40:54.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8da51700 1 --2- 172.21.15.37:0/2810922500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8815d240 0x7f1e880aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:54.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8d250700 1 --2- 172.21.15.37:0/2810922500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e880cc0d0 0x7f1e8806d4e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c009e60 tx=0x7f1e7c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ffd2c798cf314cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:54.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ca4f700 1 -- 172.21.15.37:0/2810922500 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c00e070 con 0x7f1e880cc0d0 2023-10-06T04:40:54.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ca4f700 1 -- 172.21.15.37:0/2810922500 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c00bab0 con 0x7f1e880cc0d0 2023-10-06T04:40:54.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ca4f700 1 -- 172.21.15.37:0/2810922500 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c00be30 con 0x7f1e880cc0d0 2023-10-06T04:40:54.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2810922500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e880cc0d0 msgr2=0x7f1e8806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:54.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ea53700 1 --2- 172.21.15.37:0/2810922500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e880cc0d0 0x7f1e8806d4e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c009e60 tx=0x7f1e7c009780 comp rx=0 tx=0).stop 2023-10-06T04:40:54.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2810922500 shutdown_connections 2023-10-06T04:40:54.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ea53700 1 --2- 172.21.15.37:0/2810922500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e880cc0d0 0x7f1e8806d4e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:54.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ea53700 1 --2- 172.21.15.37:0/2810922500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8815d240 0x7f1e880aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:54.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2810922500 >> 172.21.15.37:0/2810922500 conn(0x7f1e88068780 msgr2=0x7f1e880cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:54.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2810922500 shutdown_connections 2023-10-06T04:40:54.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2810922500 wait complete. 2023-10-06T04:40:54.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ea53700 1 Processor -- start 2023-10-06T04:40:54.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.844+0000 7f1e8ea53700 1 -- start start 2023-10-06T04:40:54.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8ea53700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e8806da20 0x7f1e880aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:54.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8ea53700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880cc0d0 0x7f1e880a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:54.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8ea53700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8815d240 0x7f1e880a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:54.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8ea53700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8816eec0 con 0x7f1e880cc0d0 2023-10-06T04:40:54.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8ea53700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8816e2b0 con 0x7f1e8806da20 2023-10-06T04:40:54.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8ea53700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8816e590 con 0x7f1e8815d240 2023-10-06T04:40:54.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8d250700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880cc0d0 0x7f1e880a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:54.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8d250700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880cc0d0 0x7f1e880a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50590/0 (socket says 172.21.15.37:50590) 2023-10-06T04:40:54.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8d250700 1 -- 172.21.15.37:0/2074704876 learned_addr learned my addr 172.21.15.37:0/2074704876 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:54.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8da51700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e8806da20 0x7f1e880aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:54.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8e252700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8815d240 0x7f1e880a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:54.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8d250700 1 -- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8815d240 msgr2=0x7f1e880a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:54.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8d250700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8815d240 0x7f1e880a49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:54.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8d250700 1 -- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e8806da20 msgr2=0x7f1e880aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:54.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8d250700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e8806da20 0x7f1e880aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:54.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8d250700 1 -- 172.21.15.37:0/2074704876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84009420 con 0x7f1e880cc0d0 2023-10-06T04:40:54.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8d250700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880cc0d0 0x7f1e880a44b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c0097c0 tx=0x7f1e7c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:54.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e79ffb700 1 -- 172.21.15.37:0/2074704876 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c00bd90 con 0x7f1e880cc0d0 2023-10-06T04:40:54.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e79ffb700 1 -- 172.21.15.37:0/2074704876 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c021070 con 0x7f1e880cc0d0 2023-10-06T04:40:54.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2074704876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c009a20 con 0x7f1e880cc0d0 2023-10-06T04:40:54.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e79ffb700 1 -- 172.21.15.37:0/2074704876 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c012dc0 con 0x7f1e880cc0d0 2023-10-06T04:40:54.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2074704876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8816eb50 con 0x7f1e880cc0d0 2023-10-06T04:40:54.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.848+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2074704876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8816f070 con 0x7f1e880cc0d0 2023-10-06T04:40:54.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.852+0000 7f1e79ffb700 1 -- 172.21.15.37:0/2074704876 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1e7c023030 con 0x7f1e880cc0d0 2023-10-06T04:40:54.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.852+0000 7f1e79ffb700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e6c060550 0x7f1e6c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:54.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.852+0000 7f1e79ffb700 1 -- 172.21.15.37:0/2074704876 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1e7c07e760 con 0x7f1e880cc0d0 2023-10-06T04:40:54.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.852+0000 7f1e8da51700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e6c060550 0x7f1e6c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:54.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.852+0000 7f1e8da51700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e6c060550 0x7f1e6c062a00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009ea0 tx=0x7f1e840091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:54.856+0000 7f1e79ffb700 1 -- 172.21.15.37:0/2074704876 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1e8816f070 con 0x7f1e880cc0d0 2023-10-06T04:40:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.020+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2074704876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e880708a0 con 0x7f1e880cc0d0 2023-10-06T04:40:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e79ffb700 1 -- 172.21.15.37:0/2074704876 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f1e7c052540 con 0x7f1e880cc0d0 2023-10-06T04:40:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:55.031 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":54,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:40:54.052800+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:52.204019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:53.038979+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e6c060550 msgr2=0x7f1e6c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e8ea53700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e6c060550 0x7f1e6c062a00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009ea0 tx=0x7f1e840091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2074704876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880cc0d0 msgr2=0x7f1e880a44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e8ea53700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880cc0d0 0x7f1e880a44b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c0097c0 tx=0x7f1e7c019000 comp rx=0 tx=0).stop 2023-10-06T04:40:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2074704876 shutdown_connections 2023-10-06T04:40:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e8ea53700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e6c060550 0x7f1e6c062a00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e8ea53700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8815d240 0x7f1e880a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e8ea53700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880cc0d0 0x7f1e880a44b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e8ea53700 1 --2- 172.21.15.37:0/2074704876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e8806da20 0x7f1e880aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2074704876 >> 172.21.15.37:0/2074704876 conn(0x7f1e88068780 msgr2=0x7f1e880c14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2074704876 shutdown_connections 2023-10-06T04:40:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.024+0000 7f1e8ea53700 1 -- 172.21.15.37:0/2074704876 wait complete. 2023-10-06T04:40:55.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:55.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.144+0000 7f02db2d4700 1 Processor -- start 2023-10-06T04:40:55.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.144+0000 7f02db2d4700 1 -- start start 2023-10-06T04:40:55.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02db2d4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f02d41505a0 0x7f02d40cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02db2d4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d40c9750 con 0x7f02d40cc110 2023-10-06T04:40:55.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02db2d4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d40c9ff0 con 0x7f02d41501d0 2023-10-06T04:40:55.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02db2d4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d40cc590 con 0x7f02d41505a0 2023-10-06T04:40:55.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d9871700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f02d40cc110 0x7f02d40ca480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55202/0 (socket says 172.21.15.37:55202) 2023-10-06T04:40:55.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d9871700 1 -- 172.21.15.37:0/2394754428 learned_addr learned my addr 172.21.15.37:0/2394754428 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:55.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d886f700 1 --2- 172.21.15.37:0/2394754428 >> v2:172.21.15.83:3300/0 conn(0x7f02d41505a0 0x7f02d40cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965171688 0 0) 0x7f02d40c9750 con 0x7f02d40cc110 2023-10-06T04:40:55.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02c0003570 con 0x7f02d40cc110 2023-10-06T04:40:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2317090109 0 0) 0x7f02c0003570 con 0x7f02d40cc110 2023-10-06T04:40:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 >> v2:172.21.15.83:3300/0 conn(0x7f02d41505a0 msgr2=0x7f02d40cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 --2- 172.21.15.37:0/2394754428 >> v2:172.21.15.83:3300/0 conn(0x7f02d41505a0 0x7f02d40cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 >> v1:172.21.15.83:6789/0 conn(0x7f02d41501d0 legacy=0x7f02d41575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d415a7f0 con 0x7f02d40cc110 2023-10-06T04:40:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f02cc0017f0 con 0x7f02d40cc110 2023-10-06T04:40:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 >> v1:172.21.15.37:6789/0 conn(0x7f02d40cc110 legacy=0x7f02d40ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 --2- 172.21.15.37:0/2394754428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02c0003a60 0x7f02c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 --2- 172.21.15.37:0/2394754428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c0004810 0x7f02c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 --2- 172.21.15.37:0/2394754428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02c00051c0 0x7f02c000dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d40cc590 con 0x7f02c0004810 2023-10-06T04:40:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c000e2e0 con 0x7f02c0003a60 2023-10-06T04:40:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c000e4a0 con 0x7f02c00051c0 2023-10-06T04:40:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d886f700 1 --2- 172.21.15.37:0/2394754428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c0004810 0x7f02c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d9871700 1 --2- 172.21.15.37:0/2394754428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02c00051c0 0x7f02c000dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d9070700 1 --2- 172.21.15.37:0/2394754428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02c0003a60 0x7f02c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d886f700 1 -- 172.21.15.37:0/2394754428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02c00051c0 msgr2=0x7f02c000dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d886f700 1 --2- 172.21.15.37:0/2394754428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02c00051c0 0x7f02c000dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d886f700 1 -- 172.21.15.37:0/2394754428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02c0003a60 msgr2=0x7f02c0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d886f700 1 --2- 172.21.15.37:0/2394754428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02c0003a60 0x7f02c0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d9871700 1 -- 172.21.15.37:0/2394754428 reap_dead start 2023-10-06T04:40:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d886f700 1 -- 172.21.15.37:0/2394754428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0003570 con 0x7f02c0004810 2023-10-06T04:40:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02d886f700 1 --2- 172.21.15.37:0/2394754428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c0004810 0x7f02c0004c80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009c00 tx=0x7f02c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed25b356d7c156a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c800e710 con 0x7f02c0004810 2023-10-06T04:40:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c800e870 con 0x7f02c0004810 2023-10-06T04:40:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.148+0000 7f02c7fff700 1 -- 172.21.15.37:0/2394754428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c800ec30 con 0x7f02c0004810 2023-10-06T04:40:55.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.152+0000 7f02db2d4700 1 -- 172.21.15.37:0/2394754428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c0004810 msgr2=0x7f02c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.152+0000 7f02db2d4700 1 --2- 172.21.15.37:0/2394754428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c0004810 0x7f02c0004c80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009c00 tx=0x7f02c80091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.152+0000 7f02db2d4700 1 -- 172.21.15.37:0/2394754428 shutdown_connections 2023-10-06T04:40:55.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.152+0000 7f02db2d4700 1 --2- 172.21.15.37:0/2394754428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c0004810 0x7f02c0004c80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.152+0000 7f02db2d4700 1 -- 172.21.15.37:0/2394754428 >> 172.21.15.37:0/2394754428 conn(0x7f02d40667b0 msgr2=0x7f02d4066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:55.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.152+0000 7f02db2d4700 1 -- 172.21.15.37:0/2394754428 shutdown_connections 2023-10-06T04:40:55.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.152+0000 7f02db2d4700 1 -- 172.21.15.37:0/2394754428 wait complete. 2023-10-06T04:40:55.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.152+0000 7f02db2d4700 1 Processor -- start 2023-10-06T04:40:55.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.152+0000 7f02db2d4700 1 -- start start 2023-10-06T04:40:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02db2d4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02c0004810 0x7f02d416c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02db2d4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02d414c610 0x7f02d40af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02db2d4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d414ca60 0x7f02d40afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02db2d4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d4155ba0 con 0x7f02d414ca60 2023-10-06T04:40:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02db2d4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d4154f20 con 0x7f02c0004810 2023-10-06T04:40:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02db2d4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d4155200 con 0x7f02d414c610 2023-10-06T04:40:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02d9871700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d414ca60 0x7f02d40afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02d9070700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02c0004810 0x7f02d416c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02d9871700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d414ca60 0x7f02d40afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50608/0 (socket says 172.21.15.37:50608) 2023-10-06T04:40:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02d9871700 1 -- 172.21.15.37:0/3893049985 learned_addr learned my addr 172.21.15.37:0/3893049985 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02d886f700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02d414c610 0x7f02d40af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02d9871700 1 -- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02d414c610 msgr2=0x7f02d40af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02d9871700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02d414c610 0x7f02d40af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02d9871700 1 -- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02c0004810 msgr2=0x7f02d416c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02d9871700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02c0004810 0x7f02d416c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02d9871700 1 -- 172.21.15.37:0/3893049985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d41554e0 con 0x7f02d414ca60 2023-10-06T04:40:55.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02d9871700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d414ca60 0x7f02d40afec0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f02cc000f80 tx=0x7f02d40c9f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:55.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02c57fa700 1 -- 172.21.15.37:0/3893049985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc00ac90 con 0x7f02d414ca60 2023-10-06T04:40:55.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02c57fa700 1 -- 172.21.15.37:0/3893049985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc00ae50 con 0x7f02d414ca60 2023-10-06T04:40:55.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02db2d4700 1 -- 172.21.15.37:0/3893049985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d41557c0 con 0x7f02d414ca60 2023-10-06T04:40:55.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02c57fa700 1 -- 172.21.15.37:0/3893049985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc013640 con 0x7f02d414ca60 2023-10-06T04:40:55.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.156+0000 7f02db2d4700 1 -- 172.21.15.37:0/3893049985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d40b0900 con 0x7f02d414ca60 2023-10-06T04:40:55.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.160+0000 7f02db2d4700 1 -- 172.21.15.37:0/3893049985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d414f720 con 0x7f02d414ca60 2023-10-06T04:40:55.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.160+0000 7f02c57fa700 1 -- 172.21.15.37:0/3893049985 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f02cc0139b0 con 0x7f02d414ca60 2023-10-06T04:40:55.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.160+0000 7f02c57fa700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f02b8060580 0x7f02b8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.160+0000 7f02c57fa700 1 -- 172.21.15.37:0/3893049985 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f02cc07d680 con 0x7f02d414ca60 2023-10-06T04:40:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.160+0000 7f02d9070700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f02b8060580 0x7f02b8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.160+0000 7f02d9070700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f02b8060580 0x7f02b8062a30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f02d0007fd0 tx=0x7f02d0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:55.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.168+0000 7f02c57fa700 1 -- 172.21.15.37:0/3893049985 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f02cc051440 con 0x7f02d414ca60 2023-10-06T04:40:55.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.328+0000 7f02db2d4700 1 -- 172.21.15.37:0/3893049985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02d4070ee0 con 0x7f02d414ca60 2023-10-06T04:40:55.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.328+0000 7f02c57fa700 1 -- 172.21.15.37:0/3893049985 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f02cc050fd0 con 0x7f02d414ca60 2023-10-06T04:40:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:55.336 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":54,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:40:54.052800+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:52.204019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:53.038979+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.332+0000 7f02db2d4700 1 -- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f02b8060580 msgr2=0x7f02b8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.332+0000 7f02db2d4700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f02b8060580 0x7f02b8062a30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f02d0007fd0 tx=0x7f02d0009040 comp rx=0 tx=0).stop 2023-10-06T04:40:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.332+0000 7f02db2d4700 1 -- 172.21.15.37:0/3893049985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d414ca60 msgr2=0x7f02d40afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.332+0000 7f02db2d4700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d414ca60 0x7f02d40afec0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f02cc000f80 tx=0x7f02d40c9f60 comp rx=0 tx=0).stop 2023-10-06T04:40:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.332+0000 7f02db2d4700 1 -- 172.21.15.37:0/3893049985 shutdown_connections 2023-10-06T04:40:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.332+0000 7f02db2d4700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f02b8060580 0x7f02b8062a30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.332+0000 7f02db2d4700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d414ca60 0x7f02d40afec0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.332+0000 7f02db2d4700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02d414c610 0x7f02d40af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.332+0000 7f02db2d4700 1 --2- 172.21.15.37:0/3893049985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02c0004810 0x7f02d416c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.332+0000 7f02db2d4700 1 -- 172.21.15.37:0/3893049985 >> 172.21.15.37:0/3893049985 conn(0x7f02d40667b0 msgr2=0x7f02d4069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:55.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.332+0000 7f02db2d4700 1 -- 172.21.15.37:0/3893049985 shutdown_connections 2023-10-06T04:40:55.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.332+0000 7f02db2d4700 1 -- 172.21.15.37:0/3893049985 wait complete. 2023-10-06T04:40:55.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:40:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.460+0000 7fbb7b59e700 1 Processor -- start 2023-10-06T04:40:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.460+0000 7fbb7b59e700 1 -- start start 2023-10-06T04:40:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7b59e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb7c0c68f0 0x7fbb7c0c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb7c0669c0 0x7fbb7c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7b59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c0ad700 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7b59e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7c0ad9e0 con 0x7fbb7c0c68f0 2023-10-06T04:40:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0adcc0 con 0x7fbb7c0669c0 2023-10-06T04:40:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7a59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb7c0c68f0 0x7fbb7c0c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7a59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb7c0c68f0 0x7fbb7c0c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50618/0 (socket says 172.21.15.37:50618) 2023-10-06T04:40:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7a59c700 1 -- 172.21.15.37:0/3283405725 learned_addr learned my addr 172.21.15.37:0/3283405725 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb73fff700 1 --2- 172.21.15.37:0/3283405725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb7c0669c0 0x7fbb7c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7a59c700 1 -- 172.21.15.37:0/3283405725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb7c0669c0 msgr2=0x7fbb7c0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:55.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7a59c700 1 --2- 172.21.15.37:0/3283405725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb7c0669c0 0x7fbb7c0ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7a59c700 1 -- 172.21.15.37:0/3283405725 >> v1:172.21.15.83:6789/0 conn(0x7fbb7c0c78e0 legacy=0x7fbb7c0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7a59c700 1 -- 172.21.15.37:0/3283405725 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0adfa0 con 0x7fbb7c0c68f0 2023-10-06T04:40:55.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb79d9b700 1 -- 172.21.15.37:0/3283405725 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228135817 0 0) 0x7fbb7c0ad700 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb7a59c700 1 --2- 172.21.15.37:0/3283405725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c0c68f0 0x7fbb7c0c6cc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00bc50 tx=0x7fbb6c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58672d5e5a3cd50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb79d9b700 1 -- 172.21.15.37:0/3283405725 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c00dc80 con 0x7fbb7c0c68f0 2023-10-06T04:40:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb79d9b700 1 -- 172.21.15.37:0/3283405725 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c00dde0 con 0x7fbb7c0c68f0 2023-10-06T04:40:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.464+0000 7fbb79d9b700 1 -- 172.21.15.37:0/3283405725 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0196b0 con 0x7fbb7c0c68f0 2023-10-06T04:40:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.468+0000 7fbb7b59e700 1 -- 172.21.15.37:0/3283405725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c0c68f0 msgr2=0x7fbb7c0c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.468+0000 7fbb7b59e700 1 --2- 172.21.15.37:0/3283405725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c0c68f0 0x7fbb7c0c6cc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00bc50 tx=0x7fbb6c00b4f0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.468+0000 7fbb7b59e700 1 -- 172.21.15.37:0/3283405725 shutdown_connections 2023-10-06T04:40:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.468+0000 7fbb7b59e700 1 --2- 172.21.15.37:0/3283405725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb7c0669c0 0x7fbb7c0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.468+0000 7fbb7b59e700 1 --2- 172.21.15.37:0/3283405725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c0c68f0 0x7fbb7c0c6cc0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.468+0000 7fbb7b59e700 1 -- 172.21.15.37:0/3283405725 >> 172.21.15.37:0/3283405725 conn(0x7fbb7c0c9570 msgr2=0x7fbb7c067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.468+0000 7fbb7b59e700 1 -- 172.21.15.37:0/3283405725 shutdown_connections 2023-10-06T04:40:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.468+0000 7fbb7b59e700 1 -- 172.21.15.37:0/3283405725 wait complete. 2023-10-06T04:40:55.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.468+0000 7fbb7b59e700 1 Processor -- start 2023-10-06T04:40:55.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.468+0000 7fbb7b59e700 1 -- start start 2023-10-06T04:40:55.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7b59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb7c0669c0 0x7fbb7c0c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb7c0c68f0 0x7fbb7c14a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c0c78e0 0x7fbb7c0c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7b59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0c5660 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7b59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0c6030 con 0x7fbb7c0669c0 2023-10-06T04:40:55.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0c4a50 con 0x7fbb7c0c68f0 2023-10-06T04:40:55.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c0c78e0 0x7fbb7c0c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c0c78e0 0x7fbb7c0c23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50632/0 (socket says 172.21.15.37:50632) 2023-10-06T04:40:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7a59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb7c0669c0 0x7fbb7c0c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7ad9d700 1 -- 172.21.15.37:0/481961956 learned_addr learned my addr 172.21.15.37:0/481961956 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb73fff700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb7c0c68f0 0x7fbb7c14a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7ad9d700 1 -- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb7c0c68f0 msgr2=0x7fbb7c14a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7ad9d700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb7c0c68f0 0x7fbb7c14a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7ad9d700 1 -- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb7c0669c0 msgr2=0x7fbb7c0c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7ad9d700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb7c0669c0 0x7fbb7c0c5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7ad9d700 1 -- 172.21.15.37:0/481961956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c00b790 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7ad9d700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c0c78e0 0x7fbb7c0c23e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400c890 tx=0x7fbb74001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb727fc700 1 -- 172.21.15.37:0/481961956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74012630 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb727fc700 1 -- 172.21.15.37:0/481961956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb74012790 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7b59e700 1 -- 172.21.15.37:0/481961956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c0c4d30 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb727fc700 1 -- 172.21.15.37:0/481961956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74012b50 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7b59e700 1 -- 172.21.15.37:0/481961956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c0c52f0 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.472+0000 7fbb7b59e700 1 -- 172.21.15.37:0/481961956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7c0c5810 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.476+0000 7fbb727fc700 1 -- 172.21.15.37:0/481961956 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbb7401a3a0 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.476+0000 7fbb727fc700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbb5c060550 0x7fbb5c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.476+0000 7fbb727fc700 1 -- 172.21.15.37:0/481961956 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbb7407cc80 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.476+0000 7fbb7a59c700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbb5c060550 0x7fbb5c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.476+0000 7fbb7a59c700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbb5c060550 0x7fbb5c062a00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00bc50 tx=0x7fbb6c01b000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:55.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.480+0000 7fbb727fc700 1 -- 172.21.15.37:0/481961956 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbb7c0c5810 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.676+0000 7fbb7b59e700 1 -- 172.21.15.37:0/481961956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbb7c0c57a0 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.724+0000 7fbb727fc700 1 -- 172.21.15.37:0/481961956 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbb7404cf30 con 0x7fbb7c0c78e0 2023-10-06T04:40:55.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.724+0000 7fbb7b59e700 1 -- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbb5c060550 msgr2=0x7fbb5c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.728+0000 7fbb7b59e700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbb5c060550 0x7fbb5c062a00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00bc50 tx=0x7fbb6c01b000 comp rx=0 tx=0).stop 2023-10-06T04:40:55.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.728+0000 7fbb7b59e700 1 -- 172.21.15.37:0/481961956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c0c78e0 msgr2=0x7fbb7c0c23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.728+0000 7fbb7b59e700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c0c78e0 0x7fbb7c0c23e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400c890 tx=0x7fbb74001670 comp rx=0 tx=0).stop 2023-10-06T04:40:55.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.728+0000 7fbb7b59e700 1 -- 172.21.15.37:0/481961956 shutdown_connections 2023-10-06T04:40:55.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.728+0000 7fbb7b59e700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbb5c060550 0x7fbb5c062a00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.728+0000 7fbb7b59e700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c0c78e0 0x7fbb7c0c23e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.728+0000 7fbb7b59e700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb7c0c68f0 0x7fbb7c14a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.728+0000 7fbb7b59e700 1 --2- 172.21.15.37:0/481961956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb7c0669c0 0x7fbb7c0c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.728+0000 7fbb7b59e700 1 -- 172.21.15.37:0/481961956 >> 172.21.15.37:0/481961956 conn(0x7fbb7c0c9570 msgr2=0x7fbb7c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:55.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.728+0000 7fbb7b59e700 1 -- 172.21.15.37:0/481961956 shutdown_connections 2023-10-06T04:40:55.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.728+0000 7fbb7b59e700 1 -- 172.21.15.37:0/481961956 wait complete. 2023-10-06T04:40:55.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:40:55.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.852+0000 7f663de43700 1 Processor -- start 2023-10-06T04:40:55.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.852+0000 7f663de43700 1 -- start start 2023-10-06T04:40:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663de43700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66380cca60 0x7f66380af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663de43700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66380cf240 con 0x7f66380aece0 2023-10-06T04:40:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663de43700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66380ce630 con 0x7f66380ce1a0 2023-10-06T04:40:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663de43700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66381594a0 con 0x7f66380cca60 2023-10-06T04:40:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663ce41700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f66380aece0 0x7f66380cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55210/0 (socket says 172.21.15.37:55210) 2023-10-06T04:40:55.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663ce41700 1 -- 172.21.15.37:0/4045379847 learned_addr learned my addr 172.21.15.37:0/4045379847 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:55.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663d642700 1 --2- 172.21.15.37:0/4045379847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66380cca60 0x7f66380af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f662f7fe700 1 -- 172.21.15.37:0/4045379847 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592950559 0 0) 0x7f66380cf240 con 0x7f66380aece0 2023-10-06T04:40:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f662f7fe700 1 -- 172.21.15.37:0/4045379847 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6620003570 con 0x7f66380aece0 2023-10-06T04:40:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f662f7fe700 1 -- 172.21.15.37:0/4045379847 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816872294 0 0) 0x7f66380ce630 con 0x7f66380ce1a0 2023-10-06T04:40:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f662f7fe700 1 -- 172.21.15.37:0/4045379847 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66380cf240 con 0x7f66380ce1a0 2023-10-06T04:40:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663d642700 1 -- 172.21.15.37:0/4045379847 >> v1:172.21.15.83:6789/0 conn(0x7f66380ce1a0 legacy=0x7f66380cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f662f7fe700 1 -- 172.21.15.37:0/4045379847 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2421489705 0 0) 0x7f6620003570 con 0x7f66380aece0 2023-10-06T04:40:55.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663d642700 1 -- 172.21.15.37:0/4045379847 >> v1:172.21.15.37:6789/0 conn(0x7f66380aece0 legacy=0x7f66380cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663d642700 1 -- 172.21.15.37:0/4045379847 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66380ce910 con 0x7f66380cca60 2023-10-06T04:40:55.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663d642700 1 --2- 172.21.15.37:0/4045379847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66380cca60 0x7f66380af0b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6630009e90 tx=0x7f6630009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32e80881736d7173 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:55.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f662f7fe700 1 -- 172.21.15.37:0/4045379847 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663000e070 con 0x7f66380cca60 2023-10-06T04:40:55.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f662f7fe700 1 -- 172.21.15.37:0/4045379847 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663000b870 con 0x7f66380cca60 2023-10-06T04:40:55.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f662f7fe700 1 -- 172.21.15.37:0/4045379847 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634001470 con 0x7f66380cca60 2023-10-06T04:40:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663de43700 1 -- 172.21.15.37:0/4045379847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66380cca60 msgr2=0x7f66380af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.856+0000 7f663de43700 1 --2- 172.21.15.37:0/4045379847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66380cca60 0x7f66380af0b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6630009e90 tx=0x7f6630009780 comp rx=0 tx=0).stop 2023-10-06T04:40:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 -- 172.21.15.37:0/4045379847 shutdown_connections 2023-10-06T04:40:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 --2- 172.21.15.37:0/4045379847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66380cca60 0x7f66380af0b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 -- 172.21.15.37:0/4045379847 >> 172.21.15.37:0/4045379847 conn(0x7f6638069d90 msgr2=0x7f6638067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 -- 172.21.15.37:0/4045379847 shutdown_connections 2023-10-06T04:40:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 -- 172.21.15.37:0/4045379847 wait complete. 2023-10-06T04:40:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 Processor -- start 2023-10-06T04:40:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 -- start start 2023-10-06T04:40:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66380aece0 0x7f663815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66380cca60 0x7f66381474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66380ce1a0 0x7f6638159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663815c420 con 0x7f66380aece0 2023-10-06T04:40:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66380b4a40 con 0x7f66380ce1a0 2023-10-06T04:40:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663de43700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66380b4460 con 0x7f66380cca60 2023-10-06T04:40:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663ce41700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66380aece0 0x7f663815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663ce41700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66380aece0 0x7f663815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50638/0 (socket says 172.21.15.37:50638) 2023-10-06T04:40:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663ce41700 1 -- 172.21.15.37:0/1297174759 learned_addr learned my addr 172.21.15.37:0/1297174759 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f662ffff700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66380cca60 0x7f66381474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663d642700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66380ce1a0 0x7f6638159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663ce41700 1 -- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66380cca60 msgr2=0x7f66381474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663ce41700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66380cca60 0x7f66381474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663ce41700 1 -- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66380ce1a0 msgr2=0x7f6638159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:55.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663ce41700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66380ce1a0 0x7f6638159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:55.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.860+0000 7f663ce41700 1 -- 172.21.15.37:0/1297174759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6630009a20 con 0x7f66380aece0 2023-10-06T04:40:55.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.864+0000 7f663ce41700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66380aece0 0x7f663815bee0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f663400cbc0 tx=0x7f6634001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:55.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.864+0000 7f662cff9700 1 -- 172.21.15.37:0/1297174759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634007150 con 0x7f66380aece0 2023-10-06T04:40:55.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.864+0000 7f662cff9700 1 -- 172.21.15.37:0/1297174759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66340072b0 con 0x7f66380aece0 2023-10-06T04:40:55.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.864+0000 7f663de43700 1 -- 172.21.15.37:0/1297174759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663816cea0 con 0x7f66380aece0 2023-10-06T04:40:55.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.864+0000 7f662cff9700 1 -- 172.21.15.37:0/1297174759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634007670 con 0x7f66380aece0 2023-10-06T04:40:55.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.864+0000 7f663de43700 1 -- 172.21.15.37:0/1297174759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663816d180 con 0x7f66380aece0 2023-10-06T04:40:55.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.864+0000 7f663de43700 1 -- 172.21.15.37:0/1297174759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66380b42c0 con 0x7f66380aece0 2023-10-06T04:40:55.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.864+0000 7f662cff9700 1 -- 172.21.15.37:0/1297174759 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6634004a40 con 0x7f66380aece0 2023-10-06T04:40:55.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.868+0000 7f662cff9700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6624060580 0x7f6624062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:55.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.868+0000 7f662cff9700 1 -- 172.21.15.37:0/1297174759 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f663407c090 con 0x7f66380aece0 2023-10-06T04:40:55.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.868+0000 7f662ffff700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6624060580 0x7f6624062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:55.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.868+0000 7f662ffff700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6624060580 0x7f6624062a30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f66380b40b0 tx=0x7f6628007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:55.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:55.876+0000 7f662cff9700 1 -- 172.21.15.37:0/1297174759 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f66380b42c0 con 0x7f66380aece0 2023-10-06T04:40:56.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.076+0000 7f663de43700 1 -- 172.21.15.37:0/1297174759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f66380b42c0 con 0x7f66380aece0 2023-10-06T04:40:56.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.740+0000 7f662cff9700 1 -- 172.21.15.37:0/1297174759 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f66380b42c0 con 0x7f66380aece0 2023-10-06T04:40:56.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.744+0000 7f663de43700 1 -- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6624060580 msgr2=0x7f6624062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:56.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.744+0000 7f663de43700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6624060580 0x7f6624062a30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f66380b40b0 tx=0x7f6628007d50 comp rx=0 tx=0).stop 2023-10-06T04:40:56.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.744+0000 7f663de43700 1 -- 172.21.15.37:0/1297174759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66380aece0 msgr2=0x7f663815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:56.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.744+0000 7f663de43700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66380aece0 0x7f663815bee0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f663400cbc0 tx=0x7f6634001b50 comp rx=0 tx=0).stop 2023-10-06T04:40:56.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.744+0000 7f663de43700 1 -- 172.21.15.37:0/1297174759 shutdown_connections 2023-10-06T04:40:56.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.744+0000 7f663de43700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6624060580 0x7f6624062a30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:56.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.744+0000 7f663de43700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66380ce1a0 0x7f6638159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:56.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.744+0000 7f663de43700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66380cca60 0x7f66381474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:56.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.744+0000 7f663de43700 1 --2- 172.21.15.37:0/1297174759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66380aece0 0x7f663815bee0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:56.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.744+0000 7f663de43700 1 -- 172.21.15.37:0/1297174759 >> 172.21.15.37:0/1297174759 conn(0x7f6638069d90 msgr2=0x7f66380b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:56.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.744+0000 7f663de43700 1 -- 172.21.15.37:0/1297174759 shutdown_connections 2023-10-06T04:40:56.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.744+0000 7f663de43700 1 -- 172.21.15.37:0/1297174759 wait complete. 2023-10-06T04:40:56.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:56.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 Processor -- start 2023-10-06T04:40:56.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 -- start start 2023-10-06T04:40:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcd00154660 0x7fcd000caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd0006e880 0x7fcd000cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd00154a30 0x7fcd000cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd000caf90 con 0x7fcd0006e880 2023-10-06T04:40:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd000b1040 con 0x7fcd00154660 2023-10-06T04:40:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000c06e0 con 0x7fcd00154a30 2023-10-06T04:40:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd04bde700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd0006e880 0x7fcd000cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd04bde700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd0006e880 0x7fcd000cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50652/0 (socket says 172.21.15.37:50652) 2023-10-06T04:40:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd04bde700 1 -- 172.21.15.37:0/1040782499 learned_addr learned my addr 172.21.15.37:0/1040782499 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd053df700 1 --2- 172.21.15.37:0/1040782499 >> v2:172.21.15.83:3300/0 conn(0x7fcd00154660 0x7fcd000caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd05be0700 1 --2- 172.21.15.37:0/1040782499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd00154a30 0x7fcd000cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd04bde700 1 -- 172.21.15.37:0/1040782499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd00154a30 msgr2=0x7fcd000cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd04bde700 1 --2- 172.21.15.37:0/1040782499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd00154a30 0x7fcd000cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd04bde700 1 -- 172.21.15.37:0/1040782499 >> v2:172.21.15.83:3300/0 conn(0x7fcd00154660 msgr2=0x7fcd000caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd04bde700 1 --2- 172.21.15.37:0/1040782499 >> v2:172.21.15.83:3300/0 conn(0x7fcd00154660 0x7fcd000caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd04bde700 1 -- 172.21.15.37:0/1040782499 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd000c0980 con 0x7fcd0006e880 2023-10-06T04:40:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd053df700 1 --2- 172.21.15.37:0/1040782499 >> v2:172.21.15.83:3300/0 conn(0x7fcd00154660 0x7fcd000caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd04bde700 1 --2- 172.21.15.37:0/1040782499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd0006e880 0x7fcd000cbb20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcd0006e7e0 tx=0x7fccf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6d67a03da7d834 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fccf7fff700 1 -- 172.21.15.37:0/1040782499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000b860 con 0x7fcd0006e880 2023-10-06T04:40:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fccf7fff700 1 -- 172.21.15.37:0/1040782499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf000b9c0 con 0x7fcd0006e880 2023-10-06T04:40:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fccf7fff700 1 -- 172.21.15.37:0/1040782499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000bd60 con 0x7fcd0006e880 2023-10-06T04:40:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 -- 172.21.15.37:0/1040782499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd0006e880 msgr2=0x7fcd000cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 --2- 172.21.15.37:0/1040782499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd0006e880 0x7fcd000cbb20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcd0006e7e0 tx=0x7fccf0009250 comp rx=0 tx=0).stop 2023-10-06T04:40:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 -- 172.21.15.37:0/1040782499 shutdown_connections 2023-10-06T04:40:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 --2- 172.21.15.37:0/1040782499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd00154a30 0x7fcd000cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 --2- 172.21.15.37:0/1040782499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd0006e880 0x7fcd000cbb20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 --2- 172.21.15.37:0/1040782499 >> v2:172.21.15.83:3300/0 conn(0x7fcd00154660 0x7fcd000caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 -- 172.21.15.37:0/1040782499 >> 172.21.15.37:0/1040782499 conn(0x7fcd000667b0 msgr2=0x7fcd00066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 -- 172.21.15.37:0/1040782499 shutdown_connections 2023-10-06T04:40:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.876+0000 7fcd07643700 1 -- 172.21.15.37:0/1040782499 wait complete. 2023-10-06T04:40:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd07643700 1 Processor -- start 2023-10-06T04:40:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd07643700 1 -- start start 2023-10-06T04:40:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd07643700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd0006e880 0x7fcd000c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd07643700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd00154660 0x7fcd0013f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd07643700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd00154a30 0x7fcd000c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd07643700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000c8950 con 0x7fcd0006e880 2023-10-06T04:40:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd07643700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0014ff60 con 0x7fcd00154a30 2023-10-06T04:40:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd07643700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000ca050 con 0x7fcd00154660 2023-10-06T04:40:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd053df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd0006e880 0x7fcd000c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd053df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd0006e880 0x7fcd000c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50662/0 (socket says 172.21.15.37:50662) 2023-10-06T04:40:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd053df700 1 -- 172.21.15.37:0/1436618592 learned_addr learned my addr 172.21.15.37:0/1436618592 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd04bde700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd00154660 0x7fcd0013f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd05be0700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd00154a30 0x7fcd000c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd053df700 1 -- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd00154660 msgr2=0x7fcd0013f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd053df700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd00154660 0x7fcd0013f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd053df700 1 -- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd00154a30 msgr2=0x7fcd000c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd053df700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd00154a30 0x7fcd000c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd053df700 1 -- 172.21.15.37:0/1436618592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf00094f0 con 0x7fcd0006e880 2023-10-06T04:40:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd05be0700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd00154a30 0x7fcd000c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd053df700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd0006e880 0x7fcd000c8370 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00e8d0 tx=0x7fccfc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fccf57fa700 1 -- 172.21.15.37:0/1436618592 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc013410 con 0x7fcd0006e880 2023-10-06T04:40:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fccf57fa700 1 -- 172.21.15.37:0/1436618592 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc013570 con 0x7fcd0006e880 2023-10-06T04:40:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd07643700 1 -- 172.21.15.37:0/1436618592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd000ca330 con 0x7fcd0006e880 2023-10-06T04:40:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fccf57fa700 1 -- 172.21.15.37:0/1436618592 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc013910 con 0x7fcd0006e880 2023-10-06T04:40:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.880+0000 7fcd07643700 1 -- 172.21.15.37:0/1436618592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0015f170 con 0x7fcd0006e880 2023-10-06T04:40:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.884+0000 7fcd07643700 1 -- 172.21.15.37:0/1436618592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd00070ee0 con 0x7fcd0006e880 2023-10-06T04:40:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.884+0000 7fccf57fa700 1 -- 172.21.15.37:0/1436618592 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fccfc013d00 con 0x7fcd0006e880 2023-10-06T04:40:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.884+0000 7fccf57fa700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fcce4060550 0x7fcce4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.884+0000 7fccf57fa700 1 -- 172.21.15.37:0/1436618592 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fccfc07c820 con 0x7fcd0006e880 2023-10-06T04:40:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.884+0000 7fcd04bde700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fcce4060550 0x7fcce4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.884+0000 7fcd04bde700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fcce4060550 0x7fcce4062a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcd0006e7e0 tx=0x7fccf0017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:56.892+0000 7fccf57fa700 1 -- 172.21.15.37:0/1436618592 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fccfc050600 con 0x7fcd0006e880 2023-10-06T04:40:57.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.092+0000 7fcd07643700 1 -- 172.21.15.37:0/1436618592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd000b09f0 con 0x7fcd0006e880 2023-10-06T04:40:57.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.096+0000 7fccf57fa700 1 -- 172.21.15.37:0/1436618592 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fccfc050190 con 0x7fcd0006e880 2023-10-06T04:40:57.101 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:57.101 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3641721079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":3641721079},{"type":"v1","addr":"172.21.15.83:6836","nonce":3641721079}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/204975667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":204975667},{"type":"v1","addr":"172.21.15.83:6837","nonce":204975667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4106618910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4106618910},{"type":"v1","addr":"172.21.15.37:6833","nonce":4106618910}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:54.053558+0000","modified":"2023-10-06T04:40:56.731365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5249":{"gid":5249,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3410822358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3410822358},{"type":"v1","addr":"172.21.15.37:6835","nonce":3410822358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:40:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.100+0000 7fcd07643700 1 -- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fcce4060550 msgr2=0x7fcce4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.100+0000 7fcd07643700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fcce4060550 0x7fcce4062a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcd0006e7e0 tx=0x7fccf0017000 comp rx=0 tx=0).stop 2023-10-06T04:40:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.100+0000 7fcd07643700 1 -- 172.21.15.37:0/1436618592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd0006e880 msgr2=0x7fcd000c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.100+0000 7fcd07643700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd0006e880 0x7fcd000c8370 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00e8d0 tx=0x7fccfc008040 comp rx=0 tx=0).stop 2023-10-06T04:40:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.100+0000 7fcd07643700 1 -- 172.21.15.37:0/1436618592 shutdown_connections 2023-10-06T04:40:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.100+0000 7fcd07643700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fcce4060550 0x7fcce4062a00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.100+0000 7fcd07643700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd00154a30 0x7fcd000c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.100+0000 7fcd07643700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd00154660 0x7fcd0013f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.100+0000 7fcd07643700 1 --2- 172.21.15.37:0/1436618592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd0006e880 0x7fcd000c8370 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.100+0000 7fcd07643700 1 -- 172.21.15.37:0/1436618592 >> 172.21.15.37:0/1436618592 conn(0x7fcd000667b0 msgr2=0x7fcd00154ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:57.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.100+0000 7fcd07643700 1 -- 172.21.15.37:0/1436618592 shutdown_connections 2023-10-06T04:40:57.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.100+0000 7fcd07643700 1 -- 172.21.15.37:0/1436618592 wait complete. 2023-10-06T04:40:57.106 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2023-10-06T04:40:57.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf9b09700 1 Processor -- start 2023-10-06T04:40:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf9b09700 1 -- start start 2023-10-06T04:40:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf9b09700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fadf415d240 0x7fadf40aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf9b09700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf415e0e0 con 0x7fadf406dbf0 2023-10-06T04:40:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf9b09700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf415d7b0 con 0x7fadf40cc0d0 2023-10-06T04:40:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf9b09700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf415da90 con 0x7fadf415d240 2023-10-06T04:40:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf9308700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fadf406dbf0 0x7fadf40c61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55222/0 (socket says 172.21.15.37:55222) 2023-10-06T04:40:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf9308700 1 -- 172.21.15.37:0/3297136920 learned_addr learned my addr 172.21.15.37:0/3297136920 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf8b07700 1 --2- 172.21.15.37:0/3297136920 >> v2:172.21.15.83:3300/0 conn(0x7fadf415d240 0x7fadf40aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadeb7fe700 1 -- 172.21.15.37:0/3297136920 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176826783 0 0) 0x7fadf415e0e0 con 0x7fadf406dbf0 2023-10-06T04:40:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadeb7fe700 1 -- 172.21.15.37:0/3297136920 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faddc003570 con 0x7fadf406dbf0 2023-10-06T04:40:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf8b07700 1 -- 172.21.15.37:0/3297136920 >> v1:172.21.15.83:6789/0 conn(0x7fadf40cc0d0 legacy=0x7fadf406d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf8b07700 1 -- 172.21.15.37:0/3297136920 >> v1:172.21.15.37:6789/0 conn(0x7fadf406dbf0 legacy=0x7fadf40c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf8b07700 1 -- 172.21.15.37:0/3297136920 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf415dd70 con 0x7fadf415d240 2023-10-06T04:40:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadf8b07700 1 --2- 172.21.15.37:0/3297136920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadf415d240 0x7fadf40aa740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009e60 tx=0x7fadf0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c45312b542c477 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadeb7fe700 1 -- 172.21.15.37:0/3297136920 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf000e070 con 0x7fadf415d240 2023-10-06T04:40:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadeb7fe700 1 -- 172.21.15.37:0/3297136920 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf000bb60 con 0x7fadf415d240 2023-10-06T04:40:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.220+0000 7fadeb7fe700 1 -- 172.21.15.37:0/3297136920 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0012430 con 0x7fadf415d240 2023-10-06T04:40:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.224+0000 7fadf9b09700 1 -- 172.21.15.37:0/3297136920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadf415d240 msgr2=0x7fadf40aa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.224+0000 7fadf9b09700 1 --2- 172.21.15.37:0/3297136920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadf415d240 0x7fadf40aa740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009e60 tx=0x7fadf0009780 comp rx=0 tx=0).stop 2023-10-06T04:40:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.224+0000 7fadf9b09700 1 -- 172.21.15.37:0/3297136920 shutdown_connections 2023-10-06T04:40:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.224+0000 7fadf9b09700 1 --2- 172.21.15.37:0/3297136920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadf415d240 0x7fadf40aa740 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.224+0000 7fadf9b09700 1 -- 172.21.15.37:0/3297136920 >> 172.21.15.37:0/3297136920 conn(0x7fadf4068780 msgr2=0x7fadf40cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.224+0000 7fadf9b09700 1 -- 172.21.15.37:0/3297136920 shutdown_connections 2023-10-06T04:40:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.224+0000 7fadf9b09700 1 -- 172.21.15.37:0/3297136920 wait complete. 2023-10-06T04:40:57.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.224+0000 7fadf9b09700 1 Processor -- start 2023-10-06T04:40:57.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.224+0000 7fadf9b09700 1 -- start start 2023-10-06T04:40:57.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf9b09700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf406dbf0 0x7fadf40ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf9b09700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fadf40cc0d0 0x7fadf416dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf9b09700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadf415d240 0x7fadf40c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf9b09700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40aeb20 con 0x7fadf406dbf0 2023-10-06T04:40:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf9b09700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40aee00 con 0x7fadf415d240 2023-10-06T04:40:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf9b09700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40af0e0 con 0x7fadf40cc0d0 2023-10-06T04:40:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf8b07700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf406dbf0 0x7fadf40ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf8b07700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf406dbf0 0x7fadf40ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50678/0 (socket says 172.21.15.37:50678) 2023-10-06T04:40:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf8b07700 1 -- 172.21.15.37:0/529416680 learned_addr learned my addr 172.21.15.37:0/529416680 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf9308700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadf415d240 0x7fadf40c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadebfff700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fadf40cc0d0 0x7fadf416dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf8b07700 1 -- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fadf40cc0d0 msgr2=0x7fadf416dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf8b07700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fadf40cc0d0 0x7fadf416dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf8b07700 1 -- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadf415d240 msgr2=0x7fadf40c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf8b07700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadf415d240 0x7fadf40c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf8b07700 1 -- 172.21.15.37:0/529416680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf0009a20 con 0x7fadf406dbf0 2023-10-06T04:40:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf9308700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadf415d240 0x7fadf40c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf8b07700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf406dbf0 0x7fadf40ae540 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fadf00097c0 tx=0x7fadf0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fade8ff9700 1 -- 172.21.15.37:0/529416680 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0012c90 con 0x7fadf406dbf0 2023-10-06T04:40:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fade8ff9700 1 -- 172.21.15.37:0/529416680 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf0012e10 con 0x7fadf406dbf0 2023-10-06T04:40:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf9b09700 1 -- 172.21.15.37:0/529416680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf40af3c0 con 0x7fadf406dbf0 2023-10-06T04:40:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fade8ff9700 1 -- 172.21.15.37:0/529416680 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf00276c0 con 0x7fadf406dbf0 2023-10-06T04:40:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.228+0000 7fadf9b09700 1 -- 172.21.15.37:0/529416680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf416e110 con 0x7fadf406dbf0 2023-10-06T04:40:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.232+0000 7fade8ff9700 1 -- 172.21.15.37:0/529416680 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fadf0024070 con 0x7fadf406dbf0 2023-10-06T04:40:57.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.232+0000 7fadf9b09700 1 -- 172.21.15.37:0/529416680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf415ce30 con 0x7fadf406dbf0 2023-10-06T04:40:57.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.232+0000 7fade8ff9700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fade0060550 0x7fade0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.232+0000 7fade8ff9700 1 -- 172.21.15.37:0/529416680 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fadf007f060 con 0x7fadf406dbf0 2023-10-06T04:40:57.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.232+0000 7fadebfff700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fade0060550 0x7fade0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.232+0000 7fadebfff700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fade0060550 0x7fade0062a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fadf40a4680 tx=0x7fade4007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:57.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.240+0000 7fade8ff9700 1 -- 172.21.15.37:0/529416680 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fadf00aebe0 con 0x7fadf406dbf0 2023-10-06T04:40:57.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.404+0000 7fadf9b09700 1 -- 172.21.15.37:0/529416680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadf40708a0 con 0x7fadf406dbf0 2023-10-06T04:40:57.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fade8ff9700 1 -- 172.21.15.37:0/529416680 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17023 (secure 0 0 0) 0x7fadf415ce30 con 0x7fadf406dbf0 2023-10-06T04:40:57.413 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:57.413 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":55,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:40:55.683934+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:52.204019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:53.038979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fadf9b09700 1 -- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fade0060550 msgr2=0x7fade0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fadf9b09700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fade0060550 0x7fade0062a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fadf40a4680 tx=0x7fade4007ec0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fadf9b09700 1 -- 172.21.15.37:0/529416680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf406dbf0 msgr2=0x7fadf40ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fadf9b09700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf406dbf0 0x7fadf40ae540 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fadf00097c0 tx=0x7fadf0019000 comp rx=0 tx=0).stop 2023-10-06T04:40:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fadf9b09700 1 -- 172.21.15.37:0/529416680 shutdown_connections 2023-10-06T04:40:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fadf9b09700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fade0060550 0x7fade0062a00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fadf9b09700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fadf415d240 0x7fadf40c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fadf9b09700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fadf40cc0d0 0x7fadf416dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fadf9b09700 1 --2- 172.21.15.37:0/529416680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf406dbf0 0x7fadf40ae540 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fadf9b09700 1 -- 172.21.15.37:0/529416680 >> 172.21.15.37:0/529416680 conn(0x7fadf4068780 msgr2=0x7fadf415ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:57.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fadf9b09700 1 -- 172.21.15.37:0/529416680 shutdown_connections 2023-10-06T04:40:57.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.408+0000 7fadf9b09700 1 -- 172.21.15.37:0/529416680 wait complete. 2023-10-06T04:40:57.427 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:40:57.427 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:57.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.528+0000 7f1badd66700 1 Processor -- start 2023-10-06T04:40:57.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.528+0000 7f1badd66700 1 -- start start 2023-10-06T04:40:57.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.528+0000 7f1badd66700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ba80ad930 0x7f1ba806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.528+0000 7f1badd66700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba80ca810 con 0x7f1ba80cc3f0 2023-10-06T04:40:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.528+0000 7f1badd66700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba81570a0 con 0x7f1ba80ad560 2023-10-06T04:40:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.528+0000 7f1badd66700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba80c9c00 con 0x7f1ba80ad930 2023-10-06T04:40:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.528+0000 7f1ba7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1ba80cc3f0 0x7f1ba80caca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55236/0 (socket says 172.21.15.37:55236) 2023-10-06T04:40:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.528+0000 7f1ba7fff700 1 -- 172.21.15.37:0/1525594908 learned_addr learned my addr 172.21.15.37:0/1525594908 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.528+0000 7f1bad565700 1 --2- 172.21.15.37:0/1525594908 >> v2:172.21.15.37:3300/0 conn(0x7f1ba80ad930 0x7f1ba806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336190106 0 0) 0x7f1ba80ca810 con 0x7f1ba80cc3f0 2023-10-06T04:40:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b94003570 con 0x7f1ba80cc3f0 2023-10-06T04:40:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986578299 0 0) 0x7f1ba81570a0 con 0x7f1ba80ad560 2023-10-06T04:40:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ba80ca810 con 0x7f1ba80ad560 2023-10-06T04:40:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1534929642 0 0) 0x7f1b94003570 con 0x7f1ba80cc3f0 2023-10-06T04:40:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 >> v2:172.21.15.37:3300/0 conn(0x7f1ba80ad930 msgr2=0x7f1ba806d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 --2- 172.21.15.37:0/1525594908 >> v2:172.21.15.37:3300/0 conn(0x7f1ba80ad930 0x7f1ba806d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 >> v1:172.21.15.83:6789/0 conn(0x7f1ba80ad560 legacy=0x7f1ba80c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba80c9ee0 con 0x7f1ba80cc3f0 2023-10-06T04:40:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f1b900017f0 con 0x7f1ba80cc3f0 2023-10-06T04:40:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 >> v1:172.21.15.37:6789/0 conn(0x7f1ba80cc3f0 legacy=0x7f1ba80caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 --2- 172.21.15.37:0/1525594908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b94003bf0 0x7f1b94003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 --2- 172.21.15.37:0/1525594908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b94004810 0x7f1b94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 --2- 172.21.15.37:0/1525594908 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b940051c0 0x7f1b9400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba80c9c00 con 0x7f1b94003bf0 2023-10-06T04:40:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9400c160 con 0x7f1b94004810 2023-10-06T04:40:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9400c320 con 0x7f1b940051c0 2023-10-06T04:40:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1bacd64700 1 --2- 172.21.15.37:0/1525594908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b94003bf0 0x7f1b94003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1bad565700 1 --2- 172.21.15.37:0/1525594908 >> v2:172.21.15.37:3300/0 conn(0x7f1ba80ad930 0x7f1ba806d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1bacd64700 1 -- 172.21.15.37:0/1525594908 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b940051c0 msgr2=0x7f1b9400ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:40:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba7fff700 1 --2- 172.21.15.37:0/1525594908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b94004810 0x7f1b94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1bacd64700 1 --2- 172.21.15.37:0/1525594908 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b940051c0 0x7f1b9400ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1bacd64700 1 -- 172.21.15.37:0/1525594908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b94004810 msgr2=0x7f1b94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1bacd64700 1 --2- 172.21.15.37:0/1525594908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b94004810 0x7f1b94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1bacd64700 1 -- 172.21.15.37:0/1525594908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94003570 con 0x7f1b94003bf0 2023-10-06T04:40:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1bad565700 1 -- 172.21.15.37:0/1525594908 reap_dead start 2023-10-06T04:40:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba7fff700 1 --2- 172.21.15.37:0/1525594908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b94004810 0x7f1b94004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1bacd64700 1 --2- 172.21.15.37:0/1525594908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b94003bf0 0x7f1b94003fe0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1b98001a10 tx=0x7f1b98007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf245f86dda486 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9800c590 con 0x7f1b94003bf0 2023-10-06T04:40:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9800c6f0 con 0x7f1b94003bf0 2023-10-06T04:40:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1ba77fe700 1 -- 172.21.15.37:0/1525594908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9800ca90 con 0x7f1b94003bf0 2023-10-06T04:40:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1badd66700 1 -- 172.21.15.37:0/1525594908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b94003bf0 msgr2=0x7f1b94003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1badd66700 1 --2- 172.21.15.37:0/1525594908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b94003bf0 0x7f1b94003fe0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1b98001a10 tx=0x7f1b98007d10 comp rx=0 tx=0).stop 2023-10-06T04:40:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1badd66700 1 -- 172.21.15.37:0/1525594908 shutdown_connections 2023-10-06T04:40:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1badd66700 1 --2- 172.21.15.37:0/1525594908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b94003bf0 0x7f1b94003fe0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1badd66700 1 -- 172.21.15.37:0/1525594908 >> 172.21.15.37:0/1525594908 conn(0x7f1ba8068780 msgr2=0x7f1ba80cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1badd66700 1 -- 172.21.15.37:0/1525594908 shutdown_connections 2023-10-06T04:40:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.532+0000 7f1badd66700 1 -- 172.21.15.37:0/1525594908 wait complete. 2023-10-06T04:40:57.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1badd66700 1 Processor -- start 2023-10-06T04:40:57.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1badd66700 1 -- start start 2023-10-06T04:40:57.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1badd66700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b94003bf0 0x7f1ba80af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1badd66700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ba80afd50 0x7f1ba8168fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1badd66700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ba8169510 0x7f1ba8169980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1badd66700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8169ec0 con 0x7f1ba8169510 2023-10-06T04:40:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1badd66700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8155210 con 0x7f1ba80afd50 2023-10-06T04:40:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1badd66700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba80b0540 con 0x7f1b94003bf0 2023-10-06T04:40:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1bad565700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ba8169510 0x7f1ba8169980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1bad565700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ba8169510 0x7f1ba8169980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50708/0 (socket says 172.21.15.37:50708) 2023-10-06T04:40:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1bacd64700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b94003bf0 0x7f1ba80af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1bad565700 1 -- 172.21.15.37:0/3049357134 learned_addr learned my addr 172.21.15.37:0/3049357134 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1ba7fff700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ba80afd50 0x7f1ba8168fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1bacd64700 1 -- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ba80afd50 msgr2=0x7f1ba8168fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1bacd64700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ba80afd50 0x7f1ba8168fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1bacd64700 1 -- 172.21.15.37:0/3049357134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ba8169510 msgr2=0x7f1ba8169980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1bacd64700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ba8169510 0x7f1ba8169980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1bacd64700 1 -- 172.21.15.37:0/3049357134 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba80b0820 con 0x7f1b94003bf0 2023-10-06T04:40:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1bad565700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ba8169510 0x7f1ba8169980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1bacd64700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b94003bf0 0x7f1ba80af810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b98014000 tx=0x7f1b98015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1ba4ff9700 1 -- 172.21.15.37:0/3049357134 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9800c590 con 0x7f1b94003bf0 2023-10-06T04:40:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1badd66700 1 -- 172.21.15.37:0/3049357134 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba80b0b00 con 0x7f1b94003bf0 2023-10-06T04:40:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1ba4ff9700 1 -- 172.21.15.37:0/3049357134 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9800ce40 con 0x7f1b94003bf0 2023-10-06T04:40:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1ba4ff9700 1 -- 172.21.15.37:0/3049357134 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9801e630 con 0x7f1b94003bf0 2023-10-06T04:40:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.536+0000 7f1badd66700 1 -- 172.21.15.37:0/3049357134 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba80b01c0 con 0x7f1b94003bf0 2023-10-06T04:40:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.540+0000 7f1badd66700 1 -- 172.21.15.37:0/3049357134 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba80708a0 con 0x7f1b94003bf0 2023-10-06T04:40:57.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.540+0000 7f1ba4ff9700 1 -- 172.21.15.37:0/3049357134 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1b98019030 con 0x7f1b94003bf0 2023-10-06T04:40:57.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.540+0000 7f1ba4ff9700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1b88060550 0x7f1b88062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.540+0000 7f1ba4ff9700 1 -- 172.21.15.37:0/3049357134 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1b9807e150 con 0x7f1b94003bf0 2023-10-06T04:40:57.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.540+0000 7f1ba7fff700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1b88060550 0x7f1b88062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.540+0000 7f1ba7fff700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1b88060550 0x7f1b88062a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1b90001190 tx=0x7f1b900019a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:57.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.552+0000 7f1ba4ff9700 1 -- 172.21.15.37:0/3049357134 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1b9804e4c0 con 0x7f1b94003bf0 2023-10-06T04:40:57.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.712+0000 7f1badd66700 1 -- 172.21.15.37:0/3049357134 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ba80a88c0 con 0x7f1b88060550 2023-10-06T04:40:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.728+0000 7f1ba4ff9700 1 -- 172.21.15.37:0/3049357134 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296116 (secure 0 0 0) 0x7f1ba80a88c0 con 0x7f1b88060550 2023-10-06T04:40:57.736 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:57.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.732+0000 7f1badd66700 1 -- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1b88060550 msgr2=0x7f1b88062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.732+0000 7f1badd66700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1b88060550 0x7f1b88062a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1b90001190 tx=0x7f1b900019a0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.732+0000 7f1badd66700 1 -- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b94003bf0 msgr2=0x7f1ba80af810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.732+0000 7f1badd66700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b94003bf0 0x7f1ba80af810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b98014000 tx=0x7f1b98015000 comp rx=0 tx=0).stop 2023-10-06T04:40:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.732+0000 7f1badd66700 1 -- 172.21.15.37:0/3049357134 shutdown_connections 2023-10-06T04:40:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.732+0000 7f1badd66700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1b88060550 0x7f1b88062a00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.732+0000 7f1badd66700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ba80afd50 0x7f1ba8168fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.732+0000 7f1badd66700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ba8169510 0x7f1ba8169980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.732+0000 7f1badd66700 1 --2- 172.21.15.37:0/3049357134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b94003bf0 0x7f1ba80af810 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.732+0000 7f1badd66700 1 -- 172.21.15.37:0/3049357134 >> 172.21.15.37:0/3049357134 conn(0x7f1ba8068780 msgr2=0x7f1ba815c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.732+0000 7f1badd66700 1 -- 172.21.15.37:0/3049357134 shutdown_connections 2023-10-06T04:40:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.732+0000 7f1badd66700 1 -- 172.21.15.37:0/3049357134 wait complete. 2023-10-06T04:40:57.740 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:40:57.752 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-10-06T04:40:57.067352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2396424,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752578296,"statfs":{"total":773094113280,"available":770640175104,"internally_reserved":0,"allocated":5971968,"data_stored":3346024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.396147"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.679263+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:34.929308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.679021+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:16.332624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.678608+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:05.608883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.680196+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:40.620476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.677549+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:20.783284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.677532+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:50.685590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.680785+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:38.188504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.676315+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:40.620476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455235+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:40:49.455235+0000","last_peered":"2023-10-06T04:40:49.455235+0000","last_clean":"2023-10-06T04:40:49.455235+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:40:49.455235+0000","last_undegraded":"2023-10-06T04:40:49.455235+0000","last_fullsized":"2023-10-06T04:40:49.455235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.678456+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:39.498436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.451712+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:40:49.451712+0000","last_peered":"2023-10-06T04:40:49.451712+0000","last_clean":"2023-10-06T04:40:49.451712+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:40:49.451712+0000","last_undegraded":"2023-10-06T04:40:49.451712+0000","last_fullsized":"2023-10-06T04:40:49.451712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.675948+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:34.929308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455054+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:40:49.455054+0000","last_peered":"2023-10-06T04:40:49.455054+0000","last_clean":"2023-10-06T04:40:49.455054+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:40:49.455054+0000","last_undegraded":"2023-10-06T04:40:49.455054+0000","last_fullsized":"2023-10-06T04:40:49.455054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.681392+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:20.783284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.451645+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:40:49.451645+0000","last_peered":"2023-10-06T04:40:49.451645+0000","last_clean":"2023-10-06T04:40:49.451645+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:40:49.451645+0000","last_undegraded":"2023-10-06T04:40:49.451645+0000","last_fullsized":"2023-10-06T04:40:49.451645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455181+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:40:49.455181+0000","last_peered":"2023-10-06T04:40:49.455181+0000","last_clean":"2023-10-06T04:40:49.455181+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:40:49.455181+0000","last_undegraded":"2023-10-06T04:40:49.455181+0000","last_fullsized":"2023-10-06T04:40:49.455181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.676126+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:46.019138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.213818+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:40:49.213818+0000","last_peered":"2023-10-06T04:40:49.213818+0000","last_clean":"2023-10-06T04:40:49.213818+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:40:49.213818+0000","last_undegraded":"2023-10-06T04:40:49.213818+0000","last_fullsized":"2023-10-06T04:40:49.213818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455049+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:40:49.455049+0000","last_peered":"2023-10-06T04:40:49.455049+0000","last_clean":"2023-10-06T04:40:49.455049+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:40:49.455049+0000","last_undegraded":"2023-10-06T04:40:49.455049+0000","last_fullsized":"2023-10-06T04:40:49.455049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455416+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:40:49.455416+0000","last_peered":"2023-10-06T04:40:49.455416+0000","last_clean":"2023-10-06T04:40:49.455416+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:40:49.455416+0000","last_undegraded":"2023-10-06T04:40:49.455416+0000","last_fullsized":"2023-10-06T04:40:49.455416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455352+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:40:49.455352+0000","last_peered":"2023-10-06T04:40:49.455352+0000","last_clean":"2023-10-06T04:40:49.455352+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:40:49.455352+0000","last_undegraded":"2023-10-06T04:40:49.455352+0000","last_fullsized":"2023-10-06T04:40:49.455352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509468,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.65300000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.89700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.78300000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.86399999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.0049999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.133},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.1899999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.248},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.169}]}]},{"osd":0,"up_from":15,"seq":64424509466,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":861029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.96599999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1759999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.482}]},{"osd":6,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.5900000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.2110000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":861029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":3.347,"5min":3.347,"15min":3.347},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.96399999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.0209999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.0940000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.139},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.1099999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":1.1990000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.224}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.258},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.0620000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.085}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.93700000000000006}]},{"osd":3,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.1319999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.276}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.1639999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.86399999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.97099999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.085},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.052}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.121}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.0209999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.175}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.875},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.004}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.042},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.0980000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.135}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.079}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":1.1990000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3680000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.5069999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.242},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.97499999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.4379999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.337},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.27}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.76300000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.79800000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.5760000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.385}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.3480000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.506},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.4690000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.532},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.4379999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:57.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.864+0000 7ffa9b59e700 1 Processor -- start 2023-10-06T04:40:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.864+0000 7ffa9b59e700 1 -- start start 2023-10-06T04:40:57.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa9c155500 0x7ffa9c0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9b59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffa9c159530 0x7ffa9c0af380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9b59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9c0c8c70 con 0x7ffa9c155130 2023-10-06T04:40:57.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9b59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9c0cbbf0 con 0x7ffa9c159530 2023-10-06T04:40:57.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0b0910 con 0x7ffa9c155500 2023-10-06T04:40:57.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa93fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa9c155500 0x7ffa9c0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9a59c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ffa9c155130 0x7ffa9c158e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:55468/0 (socket says 172.21.15.37:55468) 2023-10-06T04:40:57.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9a59c700 1 -- 172.21.15.37:0/1626917752 learned_addr learned my addr 172.21.15.37:0/1626917752 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:57.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9ad9d700 1 --2- 172.21.15.37:0/1626917752 >> v2:172.21.15.83:3300/0 conn(0x7ffa9c159530 0x7ffa9c0af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9ad9d700 1 -- 172.21.15.37:0/1626917752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa9c155500 msgr2=0x7ffa9c0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:57.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9ad9d700 1 --2- 172.21.15.37:0/1626917752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa9c155500 0x7ffa9c0aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9ad9d700 1 -- 172.21.15.37:0/1626917752 >> v1:172.21.15.83:6789/0 conn(0x7ffa9c155130 legacy=0x7ffa9c158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9ad9d700 1 -- 172.21.15.37:0/1626917752 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c0c8f50 con 0x7ffa9c159530 2023-10-06T04:40:57.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa93fff700 1 --2- 172.21.15.37:0/1626917752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa9c155500 0x7ffa9c0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:57.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa9ad9d700 1 --2- 172.21.15.37:0/1626917752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa9c159530 0x7ffa9c0af380 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009e60 tx=0x7ffa94009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=879d4fd03352d8c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:57.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa99d9b700 1 -- 172.21.15.37:0/1626917752 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400e070 con 0x7ffa9c159530 2023-10-06T04:40:57.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa99d9b700 1 -- 172.21.15.37:0/1626917752 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9400bb60 con 0x7ffa9c159530 2023-10-06T04:40:57.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.868+0000 7ffa99d9b700 1 -- 172.21.15.37:0/1626917752 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94012430 con 0x7ffa9c159530 2023-10-06T04:40:57.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.872+0000 7ffa9b59e700 1 -- 172.21.15.37:0/1626917752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa9c159530 msgr2=0x7ffa9c0af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.872+0000 7ffa9b59e700 1 --2- 172.21.15.37:0/1626917752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa9c159530 0x7ffa9c0af380 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009e60 tx=0x7ffa94009780 comp rx=0 tx=0).stop 2023-10-06T04:40:57.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.872+0000 7ffa9b59e700 1 -- 172.21.15.37:0/1626917752 shutdown_connections 2023-10-06T04:40:57.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.872+0000 7ffa9b59e700 1 --2- 172.21.15.37:0/1626917752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa9c159530 0x7ffa9c0af380 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.872+0000 7ffa9b59e700 1 --2- 172.21.15.37:0/1626917752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa9c155500 0x7ffa9c0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.872+0000 7ffa9b59e700 1 -- 172.21.15.37:0/1626917752 >> 172.21.15.37:0/1626917752 conn(0x7ffa9c0ccb50 msgr2=0x7ffa9c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:57.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.872+0000 7ffa9b59e700 1 -- 172.21.15.37:0/1626917752 shutdown_connections 2023-10-06T04:40:57.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.872+0000 7ffa9b59e700 1 -- 172.21.15.37:0/1626917752 wait complete. 2023-10-06T04:40:57.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.872+0000 7ffa9b59e700 1 Processor -- start 2023-10-06T04:40:57.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.872+0000 7ffa9b59e700 1 -- start start 2023-10-06T04:40:57.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa9c155130 0x7ffa9c14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa9c155500 0x7ffa9c152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9b59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa9c159530 0x7ffa9c153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9b59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c166710 con 0x7ffa9c155130 2023-10-06T04:40:57.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9b59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c1663c0 con 0x7ffa9c159530 2023-10-06T04:40:57.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c1538f0 con 0x7ffa9c155500 2023-10-06T04:40:57.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa9c155130 0x7ffa9c14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa9c155130 0x7ffa9c14f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50722/0 (socket says 172.21.15.37:50722) 2023-10-06T04:40:57.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9a59c700 1 -- 172.21.15.37:0/873494469 learned_addr learned my addr 172.21.15.37:0/873494469 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:57.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa93fff700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa9c155500 0x7ffa9c152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9ad9d700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa9c159530 0x7ffa9c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa93fff700 1 -- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa9c159530 msgr2=0x7ffa9c153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa93fff700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa9c159530 0x7ffa9c153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa93fff700 1 -- 172.21.15.37:0/873494469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa9c155130 msgr2=0x7ffa9c14f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa93fff700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa9c155130 0x7ffa9c14f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa93fff700 1 -- 172.21.15.37:0/873494469 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa84009420 con 0x7ffa9c155500 2023-10-06T04:40:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9a59c700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa9c155130 0x7ffa9c14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa93fff700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa9c155500 0x7ffa9c152b40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400ec80 tx=0x7ffa840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa927fc700 1 -- 172.21.15.37:0/873494469 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa84009700 con 0x7ffa9c155500 2023-10-06T04:40:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa927fc700 1 -- 172.21.15.37:0/873494469 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8400c850 con 0x7ffa9c155500 2023-10-06T04:40:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9b59e700 1 -- 172.21.15.37:0/873494469 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa94009a20 con 0x7ffa9c155500 2023-10-06T04:40:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa927fc700 1 -- 172.21.15.37:0/873494469 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400cc10 con 0x7ffa9c155500 2023-10-06T04:40:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.876+0000 7ffa9b59e700 1 -- 172.21.15.37:0/873494469 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9c153eb0 con 0x7ffa9c155500 2023-10-06T04:40:57.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.880+0000 7ffa9b59e700 1 -- 172.21.15.37:0/873494469 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9c0708a0 con 0x7ffa9c155500 2023-10-06T04:40:57.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.880+0000 7ffa927fc700 1 -- 172.21.15.37:0/873494469 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffa84013470 con 0x7ffa9c155500 2023-10-06T04:40:57.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.880+0000 7ffa927fc700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffa7c060580 0x7ffa7c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.880+0000 7ffa927fc700 1 -- 172.21.15.37:0/873494469 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffa8407cfa0 con 0x7ffa9c155500 2023-10-06T04:40:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.880+0000 7ffa9a59c700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffa7c060580 0x7ffa7c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.884+0000 7ffa9a59c700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffa7c060580 0x7ffa7c062a30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c001eb0 tx=0x7ffa8c001750 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:57.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:57.892+0000 7ffa927fc700 1 -- 172.21.15.37:0/873494469 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffa840acbe0 con 0x7ffa9c155500 2023-10-06T04:40:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.052+0000 7ffa9b59e700 1 -- 172.21.15.37:0/873494469 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa9c069a20 con 0x7ffa7c060580 2023-10-06T04:40:58.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.068+0000 7ffa927fc700 1 -- 172.21.15.37:0/873494469 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296116 (secure 0 0 0) 0x7ffa9c069a20 con 0x7ffa7c060580 2023-10-06T04:40:58.077 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:58.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.072+0000 7ffa9b59e700 1 -- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffa7c060580 msgr2=0x7ffa7c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.072+0000 7ffa9b59e700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffa7c060580 0x7ffa7c062a30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c001eb0 tx=0x7ffa8c001750 comp rx=0 tx=0).stop 2023-10-06T04:40:58.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.072+0000 7ffa9b59e700 1 -- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa9c155500 msgr2=0x7ffa9c152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.072+0000 7ffa9b59e700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa9c155500 0x7ffa9c152b40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400ec80 tx=0x7ffa840091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.072+0000 7ffa9b59e700 1 -- 172.21.15.37:0/873494469 shutdown_connections 2023-10-06T04:40:58.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.072+0000 7ffa9b59e700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffa7c060580 0x7ffa7c062a30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.072+0000 7ffa9b59e700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa9c159530 0x7ffa9c153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.072+0000 7ffa9b59e700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa9c155500 0x7ffa9c152b40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.072+0000 7ffa9b59e700 1 --2- 172.21.15.37:0/873494469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa9c155130 0x7ffa9c14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.072+0000 7ffa9b59e700 1 -- 172.21.15.37:0/873494469 >> 172.21.15.37:0/873494469 conn(0x7ffa9c0ccb50 msgr2=0x7ffa9c0ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:58.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.072+0000 7ffa9b59e700 1 -- 172.21.15.37:0/873494469 shutdown_connections 2023-10-06T04:40:58.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.072+0000 7ffa9b59e700 1 -- 172.21.15.37:0/873494469 wait complete. 2023-10-06T04:40:58.081 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:40:58.096 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-10-06T04:40:57.067352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2396424,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752578296,"statfs":{"total":773094113280,"available":770640175104,"internally_reserved":0,"allocated":5971968,"data_stored":3346024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.396147"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.679263+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:34.929308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.679021+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:16.332624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.678608+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:05.608883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.680196+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:40.620476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.677549+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:20.783284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.677532+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:50.685590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.680785+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:38.188504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.676315+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:40.620476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455235+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:40:49.455235+0000","last_peered":"2023-10-06T04:40:49.455235+0000","last_clean":"2023-10-06T04:40:49.455235+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:40:49.455235+0000","last_undegraded":"2023-10-06T04:40:49.455235+0000","last_fullsized":"2023-10-06T04:40:49.455235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.678456+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:39.498436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.451712+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:40:49.451712+0000","last_peered":"2023-10-06T04:40:49.451712+0000","last_clean":"2023-10-06T04:40:49.451712+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:40:49.451712+0000","last_undegraded":"2023-10-06T04:40:49.451712+0000","last_fullsized":"2023-10-06T04:40:49.451712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.675948+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:34.929308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455054+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:40:49.455054+0000","last_peered":"2023-10-06T04:40:49.455054+0000","last_clean":"2023-10-06T04:40:49.455054+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:40:49.455054+0000","last_undegraded":"2023-10-06T04:40:49.455054+0000","last_fullsized":"2023-10-06T04:40:49.455054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.681392+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:20.783284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.451645+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:40:49.451645+0000","last_peered":"2023-10-06T04:40:49.451645+0000","last_clean":"2023-10-06T04:40:49.451645+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:40:49.451645+0000","last_undegraded":"2023-10-06T04:40:49.451645+0000","last_fullsized":"2023-10-06T04:40:49.451645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455181+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:40:49.455181+0000","last_peered":"2023-10-06T04:40:49.455181+0000","last_clean":"2023-10-06T04:40:49.455181+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:40:49.455181+0000","last_undegraded":"2023-10-06T04:40:49.455181+0000","last_fullsized":"2023-10-06T04:40:49.455181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.676126+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:46.019138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.213818+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:40:49.213818+0000","last_peered":"2023-10-06T04:40:49.213818+0000","last_clean":"2023-10-06T04:40:49.213818+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:40:49.213818+0000","last_undegraded":"2023-10-06T04:40:49.213818+0000","last_fullsized":"2023-10-06T04:40:49.213818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455049+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:40:49.455049+0000","last_peered":"2023-10-06T04:40:49.455049+0000","last_clean":"2023-10-06T04:40:49.455049+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:40:49.455049+0000","last_undegraded":"2023-10-06T04:40:49.455049+0000","last_fullsized":"2023-10-06T04:40:49.455049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455416+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:40:49.455416+0000","last_peered":"2023-10-06T04:40:49.455416+0000","last_clean":"2023-10-06T04:40:49.455416+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:40:49.455416+0000","last_undegraded":"2023-10-06T04:40:49.455416+0000","last_fullsized":"2023-10-06T04:40:49.455416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455352+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:40:49.455352+0000","last_peered":"2023-10-06T04:40:49.455352+0000","last_clean":"2023-10-06T04:40:49.455352+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:40:49.455352+0000","last_undegraded":"2023-10-06T04:40:49.455352+0000","last_fullsized":"2023-10-06T04:40:49.455352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509468,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.65300000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.89700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.78300000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.86399999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.0049999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.133},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.1899999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.248},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.169}]}]},{"osd":0,"up_from":15,"seq":64424509466,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":861029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.96599999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1759999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.482}]},{"osd":6,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.5900000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.2110000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":861029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":3.347,"5min":3.347,"15min":3.347},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.96399999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.0209999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.0940000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.139},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.1099999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":1.1990000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.224}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.258},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.0620000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.085}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.93700000000000006}]},{"osd":3,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.1319999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.276}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.1639999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.86399999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.97099999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.085},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.052}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.121}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.0209999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.175}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.875},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.004}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.042},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.0980000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.135}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.079}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":1.1990000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3680000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.5069999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.242},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.97499999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.4379999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.337},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.27}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.76300000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.79800000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.5760000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.385}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.3480000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.506},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.4690000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.532},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.4379999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:58.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:58.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c4154700 1 Processor -- start 2023-10-06T04:40:58.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c4154700 1 -- start start 2023-10-06T04:40:58.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c4154700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80bc15d020 0x7f80bc0b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c4154700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f80bc0b16c0 0x7f80bc0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c4154700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc15d3f0 0x7f80bc06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c4154700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc0b1230 con 0x7f80bc15d020 2023-10-06T04:40:58.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c4154700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc0b0c00 con 0x7f80bc0b16c0 2023-10-06T04:40:58.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c4154700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0b35a0 con 0x7f80bc15d3f0 2023-10-06T04:40:58.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c1ef0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80bc15d020 0x7f80bc0b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c1ef0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80bc15d020 0x7f80bc0b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50730/0 (socket says 172.21.15.37:50730) 2023-10-06T04:40:58.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c1ef0700 1 -- 172.21.15.37:0/3252418157 learned_addr learned my addr 172.21.15.37:0/3252418157 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:58.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c16ef700 1 --2- 172.21.15.37:0/3252418157 >> v2:172.21.15.83:3300/0 conn(0x7f80bc0b16c0 0x7f80bc0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.208+0000 7f80c26f1700 1 --2- 172.21.15.37:0/3252418157 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc15d3f0 0x7f80bc06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c1ef0700 1 -- 172.21.15.37:0/3252418157 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc15d3f0 msgr2=0x7f80bc06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:58.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c1ef0700 1 --2- 172.21.15.37:0/3252418157 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc15d3f0 0x7f80bc06d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c1ef0700 1 -- 172.21.15.37:0/3252418157 >> v2:172.21.15.83:3300/0 conn(0x7f80bc0b16c0 msgr2=0x7f80bc0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:58.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c1ef0700 1 --2- 172.21.15.37:0/3252418157 >> v2:172.21.15.83:3300/0 conn(0x7f80bc0b16c0 0x7f80bc0b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c1ef0700 1 -- 172.21.15.37:0/3252418157 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc0b3880 con 0x7f80bc15d020 2023-10-06T04:40:58.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c16ef700 1 --2- 172.21.15.37:0/3252418157 >> v2:172.21.15.83:3300/0 conn(0x7f80bc0b16c0 0x7f80bc0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:58.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c1ef0700 1 --2- 172.21.15.37:0/3252418157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc15d020 0x7f80bc0b0060 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f80b80099b0 tx=0x7f80b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c3e13a50e2709a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:58.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c0eee700 1 -- 172.21.15.37:0/3252418157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b800b640 con 0x7f80bc15d020 2023-10-06T04:40:58.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c0eee700 1 -- 172.21.15.37:0/3252418157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b800b7a0 con 0x7f80bc15d020 2023-10-06T04:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c0eee700 1 -- 172.21.15.37:0/3252418157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b800bb40 con 0x7f80bc15d020 2023-10-06T04:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c4154700 1 -- 172.21.15.37:0/3252418157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc15d020 msgr2=0x7f80bc0b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c4154700 1 --2- 172.21.15.37:0/3252418157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc15d020 0x7f80bc0b0060 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f80b80099b0 tx=0x7f80b8009250 comp rx=0 tx=0).stop 2023-10-06T04:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c4154700 1 -- 172.21.15.37:0/3252418157 shutdown_connections 2023-10-06T04:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c4154700 1 --2- 172.21.15.37:0/3252418157 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc15d3f0 0x7f80bc06d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c4154700 1 --2- 172.21.15.37:0/3252418157 >> v2:172.21.15.83:3300/0 conn(0x7f80bc0b16c0 0x7f80bc0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c4154700 1 --2- 172.21.15.37:0/3252418157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc15d020 0x7f80bc0b0060 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c4154700 1 -- 172.21.15.37:0/3252418157 >> 172.21.15.37:0/3252418157 conn(0x7f80bc06c430 msgr2=0x7f80bc0af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c4154700 1 -- 172.21.15.37:0/3252418157 shutdown_connections 2023-10-06T04:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c4154700 1 -- 172.21.15.37:0/3252418157 wait complete. 2023-10-06T04:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c4154700 1 Processor -- start 2023-10-06T04:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.212+0000 7f80c4154700 1 -- start start 2023-10-06T04:40:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c4154700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0b16c0 0x7f80bc15e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c4154700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc15d020 0x7f80bc0af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c4154700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc15d3f0 0x7f80bc15d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c4154700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc15ee80 con 0x7f80bc15d020 2023-10-06T04:40:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c4154700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0af670 con 0x7f80bc15d3f0 2023-10-06T04:40:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c4154700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc170f70 con 0x7f80bc0b16c0 2023-10-06T04:40:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c16ef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc15d020 0x7f80bc0af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c16ef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc15d020 0x7f80bc0af130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50744/0 (socket says 172.21.15.37:50744) 2023-10-06T04:40:58.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c16ef700 1 -- 172.21.15.37:0/356794102 learned_addr learned my addr 172.21.15.37:0/356794102 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c26f1700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc15d3f0 0x7f80bc15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c1ef0700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0b16c0 0x7f80bc15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c16ef700 1 -- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0b16c0 msgr2=0x7f80bc15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c16ef700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0b16c0 0x7f80bc15e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c16ef700 1 -- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc15d3f0 msgr2=0x7f80bc15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c16ef700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc15d3f0 0x7f80bc15d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c16ef700 1 -- 172.21.15.37:0/356794102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac009420 con 0x7f80bc15d020 2023-10-06T04:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c16ef700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc15d020 0x7f80bc0af130 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00ec50 tx=0x7f80ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80b1ffb700 1 -- 172.21.15.37:0/356794102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00c850 con 0x7f80bc15d020 2023-10-06T04:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80b1ffb700 1 -- 172.21.15.37:0/356794102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac00c9b0 con 0x7f80bc15d020 2023-10-06T04:40:58.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c4154700 1 -- 172.21.15.37:0/356794102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b80094f0 con 0x7f80bc15d020 2023-10-06T04:40:58.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80b1ffb700 1 -- 172.21.15.37:0/356794102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00cd50 con 0x7f80bc15d020 2023-10-06T04:40:58.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.216+0000 7f80c4154700 1 -- 172.21.15.37:0/356794102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc171530 con 0x7f80bc15d020 2023-10-06T04:40:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.220+0000 7f80c4154700 1 -- 172.21.15.37:0/356794102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc070ee0 con 0x7f80bc15d020 2023-10-06T04:40:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.220+0000 7f80b1ffb700 1 -- 172.21.15.37:0/356794102 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f80ac013680 con 0x7f80bc15d020 2023-10-06T04:40:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.220+0000 7f80b1ffb700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f80a0060550 0x7f80a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.220+0000 7f80b1ffb700 1 -- 172.21.15.37:0/356794102 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f80ac07ccc0 con 0x7f80bc15d020 2023-10-06T04:40:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.220+0000 7f80c1ef0700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f80a0060550 0x7f80a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.220+0000 7f80c1ef0700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f80a0060550 0x7f80a0062a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f80b80099b0 tx=0x7f80b8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.228+0000 7f80b1ffb700 1 -- 172.21.15.37:0/356794102 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f80ac04d010 con 0x7f80bc15d020 2023-10-06T04:40:58.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.388+0000 7f80c4154700 1 -- 172.21.15.37:0/356794102 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80bc0b0ec0 con 0x7f80a0060550 2023-10-06T04:40:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.404+0000 7f80b1ffb700 1 -- 172.21.15.37:0/356794102 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296116 (secure 0 0 0) 0x7f80bc0b0ec0 con 0x7f80a0060550 2023-10-06T04:40:58.415 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.412+0000 7f80c4154700 1 -- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f80a0060550 msgr2=0x7f80a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.412+0000 7f80c4154700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f80a0060550 0x7f80a0062a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f80b80099b0 tx=0x7f80b8017000 comp rx=0 tx=0).stop 2023-10-06T04:40:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.412+0000 7f80c4154700 1 -- 172.21.15.37:0/356794102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc15d020 msgr2=0x7f80bc0af130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.412+0000 7f80c4154700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc15d020 0x7f80bc0af130 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00ec50 tx=0x7f80ac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.412+0000 7f80c4154700 1 -- 172.21.15.37:0/356794102 shutdown_connections 2023-10-06T04:40:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.412+0000 7f80c4154700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f80a0060550 0x7f80a0062a00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.412+0000 7f80c4154700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc15d3f0 0x7f80bc15d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.412+0000 7f80c4154700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc15d020 0x7f80bc0af130 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.412+0000 7f80c4154700 1 --2- 172.21.15.37:0/356794102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0b16c0 0x7f80bc15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.412+0000 7f80c4154700 1 -- 172.21.15.37:0/356794102 >> 172.21.15.37:0/356794102 conn(0x7f80bc06c430 msgr2=0x7f80bc06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.412+0000 7f80c4154700 1 -- 172.21.15.37:0/356794102 shutdown_connections 2023-10-06T04:40:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.412+0000 7f80c4154700 1 -- 172.21.15.37:0/356794102 wait complete. 2023-10-06T04:40:58.419 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:40:58.431 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-10-06T04:40:57.067352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2396424,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752578296,"statfs":{"total":773094113280,"available":770640175104,"internally_reserved":0,"allocated":5971968,"data_stored":3346024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.396147"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.679263+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:34.929308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.679021+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:16.332624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.678608+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:05.608883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.680196+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:40.620476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.677549+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:20.783284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.677532+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:50.685590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.680785+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:38.188504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.676315+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:40.620476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455235+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:40:49.455235+0000","last_peered":"2023-10-06T04:40:49.455235+0000","last_clean":"2023-10-06T04:40:49.455235+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:40:49.455235+0000","last_undegraded":"2023-10-06T04:40:49.455235+0000","last_fullsized":"2023-10-06T04:40:49.455235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.678456+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:39.498436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.451712+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:40:49.451712+0000","last_peered":"2023-10-06T04:40:49.451712+0000","last_clean":"2023-10-06T04:40:49.451712+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:40:49.451712+0000","last_undegraded":"2023-10-06T04:40:49.451712+0000","last_fullsized":"2023-10-06T04:40:49.451712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.675948+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:34.929308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455054+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:40:49.455054+0000","last_peered":"2023-10-06T04:40:49.455054+0000","last_clean":"2023-10-06T04:40:49.455054+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:40:49.455054+0000","last_undegraded":"2023-10-06T04:40:49.455054+0000","last_fullsized":"2023-10-06T04:40:49.455054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.681392+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:20.783284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.451645+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:40:49.451645+0000","last_peered":"2023-10-06T04:40:49.451645+0000","last_clean":"2023-10-06T04:40:49.451645+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:40:49.451645+0000","last_undegraded":"2023-10-06T04:40:49.451645+0000","last_fullsized":"2023-10-06T04:40:49.451645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455181+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:40:49.455181+0000","last_peered":"2023-10-06T04:40:49.455181+0000","last_clean":"2023-10-06T04:40:49.455181+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:40:49.455181+0000","last_undegraded":"2023-10-06T04:40:49.455181+0000","last_fullsized":"2023-10-06T04:40:49.455181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.676126+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:46.019138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.213818+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:40:49.213818+0000","last_peered":"2023-10-06T04:40:49.213818+0000","last_clean":"2023-10-06T04:40:49.213818+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:40:49.213818+0000","last_undegraded":"2023-10-06T04:40:49.213818+0000","last_fullsized":"2023-10-06T04:40:49.213818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455049+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:40:49.455049+0000","last_peered":"2023-10-06T04:40:49.455049+0000","last_clean":"2023-10-06T04:40:49.455049+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:40:49.455049+0000","last_undegraded":"2023-10-06T04:40:49.455049+0000","last_fullsized":"2023-10-06T04:40:49.455049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:53.669019+0000","last_change":"2023-10-06T04:40:53.669019+0000","last_active":"2023-10-06T04:40:53.669019+0000","last_peered":"2023-10-06T04:40:53.669019+0000","last_clean":"2023-10-06T04:40:53.669019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:53.669019+0000","last_undegraded":"2023-10-06T04:40:53.669019+0000","last_fullsized":"2023-10-06T04:40:53.669019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:40:52.664329+0000","last_change":"2023-10-06T04:40:52.664329+0000","last_active":"2023-10-06T04:40:52.664329+0000","last_peered":"2023-10-06T04:40:52.664329+0000","last_clean":"2023-10-06T04:40:52.664329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:40:52.664329+0000","last_undegraded":"2023-10-06T04:40:52.664329+0000","last_fullsized":"2023-10-06T04:40:52.664329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455416+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:40:49.455416+0000","last_peered":"2023-10-06T04:40:49.455416+0000","last_clean":"2023-10-06T04:40:49.455416+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:40:49.455416+0000","last_undegraded":"2023-10-06T04:40:49.455416+0000","last_fullsized":"2023-10-06T04:40:49.455416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:40:49.455352+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:40:49.455352+0000","last_peered":"2023-10-06T04:40:49.455352+0000","last_clean":"2023-10-06T04:40:49.455352+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:40:49.455352+0000","last_undegraded":"2023-10-06T04:40:49.455352+0000","last_fullsized":"2023-10-06T04:40:49.455352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509468,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.65300000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.89700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.78300000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.86399999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.0049999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.133},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.1899999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.248},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.169}]}]},{"osd":0,"up_from":15,"seq":64424509466,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":861029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.96599999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1759999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.482}]},{"osd":6,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.5900000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.2110000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":861029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":3.347,"5min":3.347,"15min":3.347},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.96399999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.0209999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.0940000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.139},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.1099999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":1.1990000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.224}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.258},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.0620000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.085}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.93700000000000006}]},{"osd":3,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.1319999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.276}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.1639999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.86399999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.97099999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.085},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.052}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.121}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.0209999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.175}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.875},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.004}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.042},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.0980000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.135}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.079}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":1.1990000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3680000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.5069999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.242},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.97499999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.4379999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.337},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.27}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":270661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.76300000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.79800000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.5760000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.385}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.3480000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.506},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.4690000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.532},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.4379999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:58.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-10-06T04:40:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-10-06T04:40:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-10-06T04:40:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-10-06T04:40:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-10-06T04:40:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-10-06T04:40:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-10-06T04:40:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-10-06T04:40:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-10-06T04:40:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-10-06T04:40:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-10-06T04:40:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-10-06T04:40:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-10-06T04:40:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-10-06T04:40:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-10-06T04:40:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-10-06T04:40:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-10-06T04:40:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-10-06T04:40:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-10-06T04:40:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-10-06T04:40:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-10-06T04:40:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-10-06T04:40:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-10-06T04:40:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-10-06T04:40:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-10-06T04:40:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-10-06T04:40:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-10-06T04:40:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-10-06T04:40:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-10-06T04:40:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-10-06T04:40:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-10-06T04:40:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-10-06T04:40:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-10-06T04:40:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-10-06T04:40:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.679263+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:32:34.929308+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:40:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-10-06T04:40:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-10-06T04:40:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.679021+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:00:16.332624+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:40:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-10-06T04:40:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-10-06T04:40:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.678608+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:50:05.608883+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:40:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-10-06T04:40:58.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-10-06T04:40:58.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-10-06T04:40:58.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-10-06T04:40:58.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-10-06T04:40:58.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-10-06T04:40:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.680196+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:34:40.620476+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:40:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-10-06T04:40:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-10-06T04:40:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-10-06T04:40:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-10-06T04:40:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-10-06T04:40:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-10-06T04:40:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-10-06T04:40:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-10-06T04:40:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.677549+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:08:20.783284+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:40:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-10-06T04:40:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-10-06T04:40:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-10-06T04:40:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-10-06T04:40:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-06T04:40:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-10-06T04:40:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.677532+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:53:50.685590+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:40:58.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-10-06T04:40:58.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-10-06T04:40:58.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-06T04:40:58.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-10-06T04:40:58.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-10-06T04:40:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-10-06T04:40:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-06T04:40:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-10-06T04:40:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-06T04:40:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-10-06T04:40:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.680785+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:22:38.188504+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:40:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-10-06T04:40:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-10-06T04:40:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-10-06T04:40:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-10-06T04:40:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-10-06T04:40:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-10-06T04:40:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-10-06T04:40:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-10-06T04:40:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-10-06T04:40:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-10-06T04:40:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-10-06T04:40:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-10-06T04:40:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.676315+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:34:40.620476+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:40:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-10-06T04:40:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-10-06T04:40:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-10-06T04:40:58.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-10-06T04:40:58.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.678456+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:34:39.498436+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:40:58.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-10-06T04:40:58.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-10-06T04:40:58.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.675948+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:32:34.929308+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:40:58.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-06T04:40:58.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-10-06T04:40:58.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.681392+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:08:20.783284+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:40:58.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-10-06T04:40:58.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-10-06T04:40:58.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-06T04:40:58.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-10-06T04:40:58.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.676126+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:55:46.019138+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:40:58.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-10-06T04:40:58.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-10-06T04:40:58.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-10-06T04:40:58.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:53.669019+0000', 'last_change': '2023-10-06T04:40:53.669019+0000', 'last_active': '2023-10-06T04:40:53.669019+0000', 'last_peered': '2023-10-06T04:40:53.669019+0000', 'last_clean': '2023-10-06T04:40:53.669019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:53.669019+0000', 'last_undegraded': '2023-10-06T04:40:53.669019+0000', 'last_fullsized': '2023-10-06T04:40:53.669019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:53.669019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-10-06T04:40:58.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T04:40:52.664329+0000', 'last_change': '2023-10-06T04:40:52.664329+0000', 'last_active': '2023-10-06T04:40:52.664329+0000', 'last_peered': '2023-10-06T04:40:52.664329+0000', 'last_clean': '2023-10-06T04:40:52.664329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:40:52.664329+0000', 'last_undegraded': '2023-10-06T04:40:52.664329+0000', 'last_fullsized': '2023-10-06T04:40:52.664329+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'last_clean_scrub_stamp': '2023-10-06T04:40:52.664329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T04:40:58.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T04:40:58.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5f0aaf700 1 Processor -- start 2023-10-06T04:40:58.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5f0aaf700 1 -- start start 2023-10-06T04:40:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5f0aaf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5ec0c9ae0 0x7fc5ec06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5f0aaf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5ec06da20 0x7fc5ec0c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5f0aaf700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ec0c66d0 con 0x7fc5ec158e10 2023-10-06T04:40:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5f0aaf700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ec1591e0 con 0x7fc5ec06da20 2023-10-06T04:40:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5f0aaf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec0cc360 con 0x7fc5ec0c9ae0 2023-10-06T04:40:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5eb7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc5ec158e10 0x7fc5ec159d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55244/0 (socket says 172.21.15.37:55244) 2023-10-06T04:40:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5eb7fe700 1 -- 172.21.15.37:0/1672468790 learned_addr learned my addr 172.21.15.37:0/1672468790 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:40:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5ebfff700 1 --2- 172.21.15.37:0/1672468790 >> v2:172.21.15.37:3300/0 conn(0x7fc5ec06da20 0x7fc5ec0c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5e2ffd700 1 --2- 172.21.15.37:0/1672468790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5ec0c9ae0 0x7fc5ec06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5eaffd700 1 -- 172.21.15.37:0/1672468790 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005040165 0 0) 0x7fc5ec0c66d0 con 0x7fc5ec158e10 2023-10-06T04:40:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5eaffd700 1 -- 172.21.15.37:0/1672468790 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5d8003570 con 0x7fc5ec158e10 2023-10-06T04:40:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5ebfff700 1 -- 172.21.15.37:0/1672468790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5ec0c9ae0 msgr2=0x7fc5ec06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5ebfff700 1 --2- 172.21.15.37:0/1672468790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5ec0c9ae0 0x7fc5ec06d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5ebfff700 1 -- 172.21.15.37:0/1672468790 >> v1:172.21.15.37:6789/0 conn(0x7fc5ec158e10 legacy=0x7fc5ec159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5ebfff700 1 -- 172.21.15.37:0/1672468790 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec06de70 con 0x7fc5ec06da20 2023-10-06T04:40:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5e2ffd700 1 --2- 172.21.15.37:0/1672468790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5ec0c9ae0 0x7fc5ec06d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5ebfff700 1 --2- 172.21.15.37:0/1672468790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5ec06da20 0x7fc5ec0c6b60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009e90 tx=0x7fc5e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee59667aa54c1588 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5eaffd700 1 -- 172.21.15.37:0/1672468790 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e400e070 con 0x7fc5ec06da20 2023-10-06T04:40:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5eaffd700 1 -- 172.21.15.37:0/1672468790 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e400bb40 con 0x7fc5ec06da20 2023-10-06T04:40:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5eaffd700 1 -- 172.21.15.37:0/1672468790 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4012430 con 0x7fc5ec06da20 2023-10-06T04:40:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/1672468790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5ec06da20 msgr2=0x7fc5ec0c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.584+0000 7fc5f0aaf700 1 --2- 172.21.15.37:0/1672468790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5ec06da20 0x7fc5ec0c6b60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009e90 tx=0x7fc5e4009780 comp rx=0 tx=0).stop 2023-10-06T04:40:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.588+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/1672468790 shutdown_connections 2023-10-06T04:40:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.588+0000 7fc5f0aaf700 1 --2- 172.21.15.37:0/1672468790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5ec06da20 0x7fc5ec0c6b60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.588+0000 7fc5f0aaf700 1 --2- 172.21.15.37:0/1672468790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5ec0c9ae0 0x7fc5ec06d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.588+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/1672468790 >> 172.21.15.37:0/1672468790 conn(0x7fc5ec068780 msgr2=0x7fc5ec0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.588+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/1672468790 shutdown_connections 2023-10-06T04:40:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.588+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/1672468790 wait complete. 2023-10-06T04:40:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.588+0000 7fc5f0aaf700 1 Processor -- start 2023-10-06T04:40:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.588+0000 7fc5f0aaf700 1 -- start start 2023-10-06T04:40:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5f0aaf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec06da20 0x7fc5ec0ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5f0aaf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5ec0c9ae0 0x7fc5ec0ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5f0aaf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5ec158e10 0x7fc5ec16cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5f0aaf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec14ad40 con 0x7fc5ec158e10 2023-10-06T04:40:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5f0aaf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec16c770 con 0x7fc5ec06da20 2023-10-06T04:40:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5f0aaf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec0affb0 con 0x7fc5ec0c9ae0 2023-10-06T04:40:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5ebfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5ec158e10 0x7fc5ec16cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5e2ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5ec0c9ae0 0x7fc5ec0ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5ebfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5ec158e10 0x7fc5ec16cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50758/0 (socket says 172.21.15.37:50758) 2023-10-06T04:40:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5ebfff700 1 -- 172.21.15.37:0/752935385 learned_addr learned my addr 172.21.15.37:0/752935385 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5eb7fe700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec06da20 0x7fc5ec0ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5ebfff700 1 -- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5ec0c9ae0 msgr2=0x7fc5ec0ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5ebfff700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5ec0c9ae0 0x7fc5ec0ac500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5ebfff700 1 -- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec06da20 msgr2=0x7fc5ec0ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5ebfff700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec06da20 0x7fc5ec0ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5ebfff700 1 -- 172.21.15.37:0/752935385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d4009420 con 0x7fc5ec158e10 2023-10-06T04:40:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5e2ffd700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5ec0c9ae0 0x7fc5ec0ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5ebfff700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5ec158e10 0x7fc5ec16cea0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec067c40 tx=0x7fc5e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5e3fff700 1 -- 172.21.15.37:0/752935385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4012c50 con 0x7fc5ec158e10 2023-10-06T04:40:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5e3fff700 1 -- 172.21.15.37:0/752935385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e4021070 con 0x7fc5ec158e10 2023-10-06T04:40:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/752935385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e4009a20 con 0x7fc5ec158e10 2023-10-06T04:40:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5e3fff700 1 -- 172.21.15.37:0/752935385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4026430 con 0x7fc5ec158e10 2023-10-06T04:40:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.592+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/752935385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ec0aebe0 con 0x7fc5ec158e10 2023-10-06T04:40:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.596+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/752935385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ec16cbc0 con 0x7fc5ec158e10 2023-10-06T04:40:58.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.596+0000 7fc5e3fff700 1 -- 172.21.15.37:0/752935385 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc5e4023030 con 0x7fc5ec158e10 2023-10-06T04:40:58.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.596+0000 7fc5e3fff700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc5cc060550 0x7fc5cc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.596+0000 7fc5e3fff700 1 -- 172.21.15.37:0/752935385 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc5e407eb60 con 0x7fc5ec158e10 2023-10-06T04:40:58.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.596+0000 7fc5eb7fe700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc5cc060550 0x7fc5cc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.596+0000 7fc5eb7fe700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc5cc060550 0x7fc5cc062a00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc007fd0 tx=0x7fc5dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:58.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.604+0000 7fc5e3fff700 1 -- 172.21.15.37:0/752935385 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc5ec16cbc0 con 0x7fc5ec158e10 2023-10-06T04:40:58.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.820+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/752935385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc5ec16cbc0 con 0x7fc5ec158e10 2023-10-06T04:40:58.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5e3fff700 1 -- 172.21.15.37:0/752935385 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1273 (secure 0 0 0) 0x7fc5ec16cbc0 con 0x7fc5ec158e10 2023-10-06T04:40:58.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:58.829 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":132,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":55,"num_osds":8,"num_up_osds":8,"osd_up_since":1696567137,"num_in_osds":8,"osd_in_since":1696567128,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":84},{"state_name":"creating+peering","count":12},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2453938176,"bytes_avail":770640175104,"bytes_total":773094113280,"unknown_pgs_ratio":0.80000001192092896,"inactive_pgs_ratio":0.11428571492433548},"fsmap":{"epoch":26,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5249}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-06T04:40:07.050803+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T04:40:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc5cc060550 msgr2=0x7fc5cc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5f0aaf700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc5cc060550 0x7fc5cc062a00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc007fd0 tx=0x7fc5dc009040 comp rx=0 tx=0).stop 2023-10-06T04:40:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/752935385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5ec158e10 msgr2=0x7fc5ec16cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5f0aaf700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5ec158e10 0x7fc5ec16cea0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec067c40 tx=0x7fc5e4019000 comp rx=0 tx=0).stop 2023-10-06T04:40:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/752935385 shutdown_connections 2023-10-06T04:40:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5f0aaf700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc5cc060550 0x7fc5cc062a00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5f0aaf700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5ec158e10 0x7fc5ec16cea0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5f0aaf700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5ec0c9ae0 0x7fc5ec0ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5f0aaf700 1 --2- 172.21.15.37:0/752935385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec06da20 0x7fc5ec0ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/752935385 >> 172.21.15.37:0/752935385 conn(0x7fc5ec068780 msgr2=0x7fc5ec0c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/752935385 shutdown_connections 2023-10-06T04:40:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.824+0000 7fc5f0aaf700 1 -- 172.21.15.37:0/752935385 wait complete. 2023-10-06T04:40:58.843 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T04:40:58.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:58.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.944+0000 7f852ffff700 1 Processor -- start 2023-10-06T04:40:58.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.944+0000 7f852ffff700 1 -- start start 2023-10-06T04:40:58.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.944+0000 7f852ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f853015d240 0x7f85300aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.944+0000 7f852ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85300cc0d0 0x7f853006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.944+0000 7f852ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f853006da20 0x7f8530160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.944+0000 7f852ffff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853015e0e0 con 0x7f85300cc0d0 2023-10-06T04:40:58.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.944+0000 7f852ffff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853006de60 con 0x7f853006da20 2023-10-06T04:40:58.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.944+0000 7f852ffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853015d7b0 con 0x7f853015d240 2023-10-06T04:40:58.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85300cc0d0 0x7f853006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85300cc0d0 0x7f853006d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50764/0 (socket says 172.21.15.37:50764) 2023-10-06T04:40:58.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852e7fc700 1 -- 172.21.15.37:0/1382746151 learned_addr learned my addr 172.21.15.37:0/1382746151 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:58.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852f7fe700 1 --2- 172.21.15.37:0/1382746151 >> v2:172.21.15.83:3300/0 conn(0x7f853006da20 0x7f8530160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852effd700 1 --2- 172.21.15.37:0/1382746151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f853015d240 0x7f85300aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852e7fc700 1 -- 172.21.15.37:0/1382746151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f853015d240 msgr2=0x7f85300aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:58.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852e7fc700 1 --2- 172.21.15.37:0/1382746151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f853015d240 0x7f85300aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852e7fc700 1 -- 172.21.15.37:0/1382746151 >> v2:172.21.15.83:3300/0 conn(0x7f853006da20 msgr2=0x7f8530160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:58.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852e7fc700 1 --2- 172.21.15.37:0/1382746151 >> v2:172.21.15.83:3300/0 conn(0x7f853006da20 0x7f8530160ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852e7fc700 1 -- 172.21.15.37:0/1382746151 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853015da90 con 0x7f85300cc0d0 2023-10-06T04:40:58.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852f7fe700 1 --2- 172.21.15.37:0/1382746151 >> v2:172.21.15.83:3300/0 conn(0x7f853006da20 0x7f8530160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:58.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852e7fc700 1 --2- 172.21.15.37:0/1382746151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85300cc0d0 0x7f853006d4e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f85300c99f0 tx=0x7f8518009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d304984459427a3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:58.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852dffb700 1 -- 172.21.15.37:0/1382746151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851800b860 con 0x7f85300cc0d0 2023-10-06T04:40:58.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852dffb700 1 -- 172.21.15.37:0/1382746151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851800b9c0 con 0x7f85300cc0d0 2023-10-06T04:40:58.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852dffb700 1 -- 172.21.15.37:0/1382746151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851800bd60 con 0x7f85300cc0d0 2023-10-06T04:40:58.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852ffff700 1 -- 172.21.15.37:0/1382746151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85300cc0d0 msgr2=0x7f853006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852ffff700 1 --2- 172.21.15.37:0/1382746151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85300cc0d0 0x7f853006d4e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f85300c99f0 tx=0x7f8518009250 comp rx=0 tx=0).stop 2023-10-06T04:40:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852ffff700 1 -- 172.21.15.37:0/1382746151 shutdown_connections 2023-10-06T04:40:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852ffff700 1 --2- 172.21.15.37:0/1382746151 >> v2:172.21.15.83:3300/0 conn(0x7f853006da20 0x7f8530160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852ffff700 1 --2- 172.21.15.37:0/1382746151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85300cc0d0 0x7f853006d4e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852ffff700 1 --2- 172.21.15.37:0/1382746151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f853015d240 0x7f85300aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852ffff700 1 -- 172.21.15.37:0/1382746151 >> 172.21.15.37:0/1382746151 conn(0x7f8530068780 msgr2=0x7f85300cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852ffff700 1 -- 172.21.15.37:0/1382746151 shutdown_connections 2023-10-06T04:40:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.948+0000 7f852ffff700 1 -- 172.21.15.37:0/1382746151 wait complete. 2023-10-06T04:40:58.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.952+0000 7f852ffff700 1 Processor -- start 2023-10-06T04:40:58.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.952+0000 7f852ffff700 1 -- start start 2023-10-06T04:40:58.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.952+0000 7f852ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f853006da20 0x7f8530159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.952+0000 7f852ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85300cc0d0 0x7f853015be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.952+0000 7f852ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f853015d240 0x7f853015c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.952+0000 7f852ffff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300a78b0 con 0x7f853006da20 2023-10-06T04:40:58.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.952+0000 7f852ffff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853016d210 con 0x7f85300cc0d0 2023-10-06T04:40:58.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.952+0000 7f852ffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853015a150 con 0x7f853015d240 2023-10-06T04:40:58.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.952+0000 7f852effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f853006da20 0x7f8530159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.952+0000 7f852effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f853006da20 0x7f8530159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50776/0 (socket says 172.21.15.37:50776) 2023-10-06T04:40:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.952+0000 7f852effd700 1 -- 172.21.15.37:0/3449325250 learned_addr learned my addr 172.21.15.37:0/3449325250 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:40:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f852e7fc700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85300cc0d0 0x7f853015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f852f7fe700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f853015d240 0x7f853015c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f852effd700 1 -- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f853015d240 msgr2=0x7f853015c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f852effd700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f853015d240 0x7f853015c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f852effd700 1 -- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85300cc0d0 msgr2=0x7f853015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f852effd700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85300cc0d0 0x7f853015be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f852effd700 1 -- 172.21.15.37:0/3449325250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85180094f0 con 0x7f853006da20 2023-10-06T04:40:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f852effd700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f853006da20 0x7f8530159c10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8528009fd0 tx=0x7f8528009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f8526ffd700 1 -- 172.21.15.37:0/3449325250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852800ecf0 con 0x7f853006da20 2023-10-06T04:40:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f8526ffd700 1 -- 172.21.15.37:0/3449325250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852800ee50 con 0x7f853006da20 2023-10-06T04:40:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f8526ffd700 1 -- 172.21.15.37:0/3449325250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528014670 con 0x7f853006da20 2023-10-06T04:40:58.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f852ffff700 1 -- 172.21.15.37:0/3449325250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85300b12d0 con 0x7f853006da20 2023-10-06T04:40:58.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f852ffff700 1 -- 172.21.15.37:0/3449325250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853016d730 con 0x7f853006da20 2023-10-06T04:40:58.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f852ffff700 1 -- 172.21.15.37:0/3449325250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85300708a0 con 0x7f853006da20 2023-10-06T04:40:58.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f8526ffd700 1 -- 172.21.15.37:0/3449325250 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f85280149e0 con 0x7f853006da20 2023-10-06T04:40:58.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f8526ffd700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8514060550 0x7f8514062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:58.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.956+0000 7f8526ffd700 1 -- 172.21.15.37:0/3449325250 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f852807d170 con 0x7f853006da20 2023-10-06T04:40:58.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.960+0000 7f852e7fc700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8514060550 0x7f8514062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:58.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.960+0000 7f852e7fc700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8514060550 0x7f8514062a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f85300c99f0 tx=0x7f8518017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:58.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:58.968+0000 7f8526ffd700 1 -- 172.21.15.37:0/3449325250 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8528050f50 con 0x7f853006da20 2023-10-06T04:40:59.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.120+0000 7f852ffff700 1 -- 172.21.15.37:0/3449325250 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f853015dd70 con 0x7f8514060550 2023-10-06T04:40:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.136+0000 7f8526ffd700 1 -- 172.21.15.37:0/3449325250 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309376 (secure 0 0 0) 0x7f853015dd70 con 0x7f8514060550 2023-10-06T04:40:59.144 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:40:59.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.140+0000 7f852ffff700 1 -- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8514060550 msgr2=0x7f8514062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.140+0000 7f852ffff700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8514060550 0x7f8514062a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f85300c99f0 tx=0x7f8518017000 comp rx=0 tx=0).stop 2023-10-06T04:40:59.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.140+0000 7f852ffff700 1 -- 172.21.15.37:0/3449325250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f853006da20 msgr2=0x7f8530159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.140+0000 7f852ffff700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f853006da20 0x7f8530159c10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8528009fd0 tx=0x7f8528009880 comp rx=0 tx=0).stop 2023-10-06T04:40:59.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.140+0000 7f852ffff700 1 -- 172.21.15.37:0/3449325250 shutdown_connections 2023-10-06T04:40:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.140+0000 7f852ffff700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f8514060550 0x7f8514062a00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.140+0000 7f852ffff700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85300cc0d0 0x7f853015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.140+0000 7f852ffff700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f853015d240 0x7f853015c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.140+0000 7f852ffff700 1 --2- 172.21.15.37:0/3449325250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f853006da20 0x7f8530159c10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.140+0000 7f852ffff700 1 -- 172.21.15.37:0/3449325250 >> 172.21.15.37:0/3449325250 conn(0x7f8530068780 msgr2=0x7f85300c0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.140+0000 7f852ffff700 1 -- 172.21.15.37:0/3449325250 shutdown_connections 2023-10-06T04:40:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:40:59.140+0000 7f852ffff700 1 -- 172.21.15.37:0/3449325250 wait complete. 2023-10-06T04:40:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:40:59.161 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-10-06T04:40:59.067960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396872,"kb_used_data":6280,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577848,"statfs":{"total":773094113280,"available":770639716352,"internally_reserved":0,"allocated":6430720,"data_stored":3573060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001827"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.723754+0000","last_change":"2023-10-06T04:40:54.721349+0000","last_active":"2023-10-06T04:40:54.723754+0000","last_peered":"2023-10-06T04:40:54.723754+0000","last_clean":"2023-10-06T04:40:54.723754+0000","last_became_active":"2023-10-06T04:40:54.721052+0000","last_became_peered":"2023-10-06T04:40:54.721052+0000","last_unstale":"2023-10-06T04:40:54.723754+0000","last_undegraded":"2023-10-06T04:40:54.723754+0000","last_fullsized":"2023-10-06T04:40:54.723754+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.765707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.732733+0000","last_change":"2023-10-06T04:40:54.731643+0000","last_active":"2023-10-06T04:40:54.732733+0000","last_peered":"2023-10-06T04:40:54.732733+0000","last_clean":"2023-10-06T04:40:54.732733+0000","last_became_active":"2023-10-06T04:40:54.731273+0000","last_became_peered":"2023-10-06T04:40:54.731273+0000","last_unstale":"2023-10-06T04:40:54.732733+0000","last_undegraded":"2023-10-06T04:40:54.732733+0000","last_fullsized":"2023-10-06T04:40:54.732733+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:10.510360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.721576+0000","last_change":"2023-10-06T04:40:54.715809+0000","last_active":"2023-10-06T04:40:54.721576+0000","last_peered":"2023-10-06T04:40:54.721576+0000","last_clean":"2023-10-06T04:40:54.721576+0000","last_became_active":"2023-10-06T04:40:54.715475+0000","last_became_peered":"2023-10-06T04:40:54.715475+0000","last_unstale":"2023-10-06T04:40:54.721576+0000","last_undegraded":"2023-10-06T04:40:54.721576+0000","last_fullsized":"2023-10-06T04:40:54.721576+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:33.453549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.712175+0000","last_change":"2023-10-06T04:40:54.710498+0000","last_active":"2023-10-06T04:40:54.712175+0000","last_peered":"2023-10-06T04:40:54.712175+0000","last_clean":"2023-10-06T04:40:54.712175+0000","last_became_active":"2023-10-06T04:40:54.710177+0000","last_became_peered":"2023-10-06T04:40:54.710177+0000","last_unstale":"2023-10-06T04:40:54.712175+0000","last_undegraded":"2023-10-06T04:40:54.712175+0000","last_fullsized":"2023-10-06T04:40:54.712175+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:33.390252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.707168+0000","last_change":"2023-10-06T04:40:54.700535+0000","last_active":"2023-10-06T04:40:54.707168+0000","last_peered":"2023-10-06T04:40:54.707168+0000","last_clean":"2023-10-06T04:40:54.707168+0000","last_became_active":"2023-10-06T04:40:54.699956+0000","last_became_peered":"2023-10-06T04:40:54.699956+0000","last_unstale":"2023-10-06T04:40:54.707168+0000","last_undegraded":"2023-10-06T04:40:54.707168+0000","last_fullsized":"2023-10-06T04:40:54.707168+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:27.125395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726555+0000","last_change":"2023-10-06T04:40:54.720796+0000","last_active":"2023-10-06T04:40:54.726555+0000","last_peered":"2023-10-06T04:40:54.726555+0000","last_clean":"2023-10-06T04:40:54.726555+0000","last_became_active":"2023-10-06T04:40:54.720395+0000","last_became_peered":"2023-10-06T04:40:54.720395+0000","last_unstale":"2023-10-06T04:40:54.726555+0000","last_undegraded":"2023-10-06T04:40:54.726555+0000","last_fullsized":"2023-10-06T04:40:54.726555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:08.260028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.714524+0000","last_change":"2023-10-06T04:40:54.711553+0000","last_active":"2023-10-06T04:40:54.714524+0000","last_peered":"2023-10-06T04:40:54.714524+0000","last_clean":"2023-10-06T04:40:54.714524+0000","last_became_active":"2023-10-06T04:40:54.711210+0000","last_became_peered":"2023-10-06T04:40:54.711210+0000","last_unstale":"2023-10-06T04:40:54.714524+0000","last_undegraded":"2023-10-06T04:40:54.714524+0000","last_fullsized":"2023-10-06T04:40:54.714524+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:18.978760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.724447+0000","last_change":"2023-10-06T04:40:54.720201+0000","last_active":"2023-10-06T04:40:54.724447+0000","last_peered":"2023-10-06T04:40:54.724447+0000","last_clean":"2023-10-06T04:40:54.724447+0000","last_became_active":"2023-10-06T04:40:54.719878+0000","last_became_peered":"2023-10-06T04:40:54.719878+0000","last_unstale":"2023-10-06T04:40:54.724447+0000","last_undegraded":"2023-10-06T04:40:54.724447+0000","last_fullsized":"2023-10-06T04:40:54.724447+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:53.882031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.715385+0000","last_change":"2023-10-06T04:40:54.713880+0000","last_active":"2023-10-06T04:40:54.715385+0000","last_peered":"2023-10-06T04:40:54.715385+0000","last_clean":"2023-10-06T04:40:54.715385+0000","last_became_active":"2023-10-06T04:40:54.713545+0000","last_became_peered":"2023-10-06T04:40:54.713545+0000","last_unstale":"2023-10-06T04:40:54.715385+0000","last_undegraded":"2023-10-06T04:40:54.715385+0000","last_fullsized":"2023-10-06T04:40:54.715385+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:00.032194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731725+0000","last_change":"2023-10-06T04:40:54.723221+0000","last_active":"2023-10-06T04:40:54.731725+0000","last_peered":"2023-10-06T04:40:54.731725+0000","last_clean":"2023-10-06T04:40:54.731725+0000","last_became_active":"2023-10-06T04:40:54.722931+0000","last_became_peered":"2023-10-06T04:40:54.722931+0000","last_unstale":"2023-10-06T04:40:54.731725+0000","last_undegraded":"2023-10-06T04:40:54.731725+0000","last_fullsized":"2023-10-06T04:40:54.731725+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:38.460996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731695+0000","last_change":"2023-10-06T04:40:54.720843+0000","last_active":"2023-10-06T04:40:54.731695+0000","last_peered":"2023-10-06T04:40:54.731695+0000","last_clean":"2023-10-06T04:40:54.731695+0000","last_became_active":"2023-10-06T04:40:54.720551+0000","last_became_peered":"2023-10-06T04:40:54.720551+0000","last_unstale":"2023-10-06T04:40:54.731695+0000","last_undegraded":"2023-10-06T04:40:54.731695+0000","last_fullsized":"2023-10-06T04:40:54.731695+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:33:40.403346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720482+0000","last_change":"2023-10-06T04:40:54.717369+0000","last_active":"2023-10-06T04:40:54.720482+0000","last_peered":"2023-10-06T04:40:54.720482+0000","last_clean":"2023-10-06T04:40:54.720482+0000","last_became_active":"2023-10-06T04:40:54.717031+0000","last_became_peered":"2023-10-06T04:40:54.717031+0000","last_unstale":"2023-10-06T04:40:54.720482+0000","last_undegraded":"2023-10-06T04:40:54.720482+0000","last_fullsized":"2023-10-06T04:40:54.720482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:17.731416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.727042+0000","last_change":"2023-10-06T04:40:54.723784+0000","last_active":"2023-10-06T04:40:54.727042+0000","last_peered":"2023-10-06T04:40:54.727042+0000","last_clean":"2023-10-06T04:40:54.727042+0000","last_became_active":"2023-10-06T04:40:54.723270+0000","last_became_peered":"2023-10-06T04:40:54.723270+0000","last_unstale":"2023-10-06T04:40:54.727042+0000","last_undegraded":"2023-10-06T04:40:54.727042+0000","last_fullsized":"2023-10-06T04:40:54.727042+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:45.494234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.715425+0000","last_change":"2023-10-06T04:40:54.712743+0000","last_active":"2023-10-06T04:40:54.715425+0000","last_peered":"2023-10-06T04:40:54.715425+0000","last_clean":"2023-10-06T04:40:54.715425+0000","last_became_active":"2023-10-06T04:40:54.712422+0000","last_became_peered":"2023-10-06T04:40:54.712422+0000","last_unstale":"2023-10-06T04:40:54.715425+0000","last_undegraded":"2023-10-06T04:40:54.715425+0000","last_fullsized":"2023-10-06T04:40:54.715425+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:59.668534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.732255+0000","last_change":"2023-10-06T04:40:54.731009+0000","last_active":"2023-10-06T04:40:54.732255+0000","last_peered":"2023-10-06T04:40:54.732255+0000","last_clean":"2023-10-06T04:40:54.732255+0000","last_became_active":"2023-10-06T04:40:54.730660+0000","last_became_peered":"2023-10-06T04:40:54.730660+0000","last_unstale":"2023-10-06T04:40:54.732255+0000","last_undegraded":"2023-10-06T04:40:54.732255+0000","last_fullsized":"2023-10-06T04:40:54.732255+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:04.261430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.728762+0000","last_change":"2023-10-06T04:40:54.725857+0000","last_active":"2023-10-06T04:40:54.728762+0000","last_peered":"2023-10-06T04:40:54.728762+0000","last_clean":"2023-10-06T04:40:54.728762+0000","last_became_active":"2023-10-06T04:40:54.725478+0000","last_became_peered":"2023-10-06T04:40:54.725478+0000","last_unstale":"2023-10-06T04:40:54.728762+0000","last_undegraded":"2023-10-06T04:40:54.728762+0000","last_fullsized":"2023-10-06T04:40:54.728762+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:25.995007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.727808+0000","last_change":"2023-10-06T04:40:54.725252+0000","last_active":"2023-10-06T04:40:54.727808+0000","last_peered":"2023-10-06T04:40:54.727808+0000","last_clean":"2023-10-06T04:40:54.727808+0000","last_became_active":"2023-10-06T04:40:54.724963+0000","last_became_peered":"2023-10-06T04:40:54.724963+0000","last_unstale":"2023-10-06T04:40:54.727808+0000","last_undegraded":"2023-10-06T04:40:54.727808+0000","last_fullsized":"2023-10-06T04:40:54.727808+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:46.470206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.721472+0000","last_change":"2023-10-06T04:40:54.716063+0000","last_active":"2023-10-06T04:40:54.721472+0000","last_peered":"2023-10-06T04:40:54.721472+0000","last_clean":"2023-10-06T04:40:54.721472+0000","last_became_active":"2023-10-06T04:40:54.715768+0000","last_became_peered":"2023-10-06T04:40:54.715768+0000","last_unstale":"2023-10-06T04:40:54.721472+0000","last_undegraded":"2023-10-06T04:40:54.721472+0000","last_fullsized":"2023-10-06T04:40:54.721472+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:47.258794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.723720+0000","last_change":"2023-10-06T04:40:54.720573+0000","last_active":"2023-10-06T04:40:54.723720+0000","last_peered":"2023-10-06T04:40:54.723720+0000","last_clean":"2023-10-06T04:40:54.723720+0000","last_became_active":"2023-10-06T04:40:54.720276+0000","last_became_peered":"2023-10-06T04:40:54.720276+0000","last_unstale":"2023-10-06T04:40:54.723720+0000","last_undegraded":"2023-10-06T04:40:54.723720+0000","last_fullsized":"2023-10-06T04:40:54.723720+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:27.104100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.721664+0000","last_change":"2023-10-06T04:40:54.718661+0000","last_active":"2023-10-06T04:40:54.721664+0000","last_peered":"2023-10-06T04:40:54.721664+0000","last_clean":"2023-10-06T04:40:54.721664+0000","last_became_active":"2023-10-06T04:40:54.718357+0000","last_became_peered":"2023-10-06T04:40:54.718357+0000","last_unstale":"2023-10-06T04:40:54.721664+0000","last_undegraded":"2023-10-06T04:40:54.721664+0000","last_fullsized":"2023-10-06T04:40:54.721664+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:10.138500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.719996+0000","last_change":"2023-10-06T04:40:54.715222+0000","last_active":"2023-10-06T04:40:54.719996+0000","last_peered":"2023-10-06T04:40:54.719996+0000","last_clean":"2023-10-06T04:40:54.719996+0000","last_became_active":"2023-10-06T04:40:54.710726+0000","last_became_peered":"2023-10-06T04:40:54.710726+0000","last_unstale":"2023-10-06T04:40:54.719996+0000","last_undegraded":"2023-10-06T04:40:54.719996+0000","last_fullsized":"2023-10-06T04:40:54.719996+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:10.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720796+0000","last_change":"2023-10-06T04:40:54.715635+0000","last_active":"2023-10-06T04:40:54.720796+0000","last_peered":"2023-10-06T04:40:54.720796+0000","last_clean":"2023-10-06T04:40:54.720796+0000","last_became_active":"2023-10-06T04:40:54.715313+0000","last_became_peered":"2023-10-06T04:40:54.715313+0000","last_unstale":"2023-10-06T04:40:54.720796+0000","last_undegraded":"2023-10-06T04:40:54.720796+0000","last_fullsized":"2023-10-06T04:40:54.720796+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:25.995007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.724038+0000","last_change":"2023-10-06T04:40:54.722028+0000","last_active":"2023-10-06T04:40:54.724038+0000","last_peered":"2023-10-06T04:40:54.724038+0000","last_clean":"2023-10-06T04:40:54.724038+0000","last_became_active":"2023-10-06T04:40:54.721364+0000","last_became_peered":"2023-10-06T04:40:54.721364+0000","last_unstale":"2023-10-06T04:40:54.724038+0000","last_undegraded":"2023-10-06T04:40:54.724038+0000","last_fullsized":"2023-10-06T04:40:54.724038+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:35.736228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726275+0000","last_change":"2023-10-06T04:40:54.723814+0000","last_active":"2023-10-06T04:40:54.726275+0000","last_peered":"2023-10-06T04:40:54.726275+0000","last_clean":"2023-10-06T04:40:54.726275+0000","last_became_active":"2023-10-06T04:40:54.723490+0000","last_became_peered":"2023-10-06T04:40:54.723490+0000","last_unstale":"2023-10-06T04:40:54.726275+0000","last_undegraded":"2023-10-06T04:40:54.726275+0000","last_fullsized":"2023-10-06T04:40:54.726275+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:46.645933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.707150+0000","last_change":"2023-10-06T04:40:54.701651+0000","last_active":"2023-10-06T04:40:54.707150+0000","last_peered":"2023-10-06T04:40:54.707150+0000","last_clean":"2023-10-06T04:40:54.707150+0000","last_became_active":"2023-10-06T04:40:54.701358+0000","last_became_peered":"2023-10-06T04:40:54.701358+0000","last_unstale":"2023-10-06T04:40:54.707150+0000","last_undegraded":"2023-10-06T04:40:54.707150+0000","last_fullsized":"2023-10-06T04:40:54.707150+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:35.357203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720273+0000","last_change":"2023-10-06T04:40:54.715059+0000","last_active":"2023-10-06T04:40:54.720273+0000","last_peered":"2023-10-06T04:40:54.720273+0000","last_clean":"2023-10-06T04:40:54.720273+0000","last_became_active":"2023-10-06T04:40:54.714714+0000","last_became_peered":"2023-10-06T04:40:54.714714+0000","last_unstale":"2023-10-06T04:40:54.720273+0000","last_undegraded":"2023-10-06T04:40:54.720273+0000","last_fullsized":"2023-10-06T04:40:54.720273+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:00.430420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.727928+0000","last_change":"2023-10-06T04:40:54.725173+0000","last_active":"2023-10-06T04:40:54.727928+0000","last_peered":"2023-10-06T04:40:54.727928+0000","last_clean":"2023-10-06T04:40:54.727928+0000","last_became_active":"2023-10-06T04:40:54.724838+0000","last_became_peered":"2023-10-06T04:40:54.724838+0000","last_unstale":"2023-10-06T04:40:54.727928+0000","last_undegraded":"2023-10-06T04:40:54.727928+0000","last_fullsized":"2023-10-06T04:40:54.727928+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:08.357836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.707786+0000","last_change":"2023-10-06T04:40:54.700388+0000","last_active":"2023-10-06T04:40:54.707786+0000","last_peered":"2023-10-06T04:40:54.707786+0000","last_clean":"2023-10-06T04:40:54.707786+0000","last_became_active":"2023-10-06T04:40:54.700035+0000","last_became_peered":"2023-10-06T04:40:54.700035+0000","last_unstale":"2023-10-06T04:40:54.707786+0000","last_undegraded":"2023-10-06T04:40:54.707786+0000","last_fullsized":"2023-10-06T04:40:54.707786+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:14.020907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.723570+0000","last_change":"2023-10-06T04:40:54.715106+0000","last_active":"2023-10-06T04:40:54.723570+0000","last_peered":"2023-10-06T04:40:54.723570+0000","last_clean":"2023-10-06T04:40:54.723570+0000","last_became_active":"2023-10-06T04:40:54.714794+0000","last_became_peered":"2023-10-06T04:40:54.714794+0000","last_unstale":"2023-10-06T04:40:54.723570+0000","last_undegraded":"2023-10-06T04:40:54.723570+0000","last_fullsized":"2023-10-06T04:40:54.723570+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:08.357836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.721880+0000","last_change":"2023-10-06T04:40:54.716030+0000","last_active":"2023-10-06T04:40:54.721880+0000","last_peered":"2023-10-06T04:40:54.721880+0000","last_clean":"2023-10-06T04:40:54.721880+0000","last_became_active":"2023-10-06T04:40:54.715674+0000","last_became_peered":"2023-10-06T04:40:54.715674+0000","last_unstale":"2023-10-06T04:40:54.721880+0000","last_undegraded":"2023-10-06T04:40:54.721880+0000","last_fullsized":"2023-10-06T04:40:54.721880+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:17.337314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.707117+0000","last_change":"2023-10-06T04:40:54.701754+0000","last_active":"2023-10-06T04:40:54.707117+0000","last_peered":"2023-10-06T04:40:54.707117+0000","last_clean":"2023-10-06T04:40:54.707117+0000","last_became_active":"2023-10-06T04:40:54.701445+0000","last_became_peered":"2023-10-06T04:40:54.701445+0000","last_unstale":"2023-10-06T04:40:54.707117+0000","last_undegraded":"2023-10-06T04:40:54.707117+0000","last_fullsized":"2023-10-06T04:40:54.707117+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:17.395458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.727640+0000","last_change":"2023-10-06T04:40:54.722789+0000","last_active":"2023-10-06T04:40:54.727640+0000","last_peered":"2023-10-06T04:40:54.727640+0000","last_clean":"2023-10-06T04:40:54.727640+0000","last_became_active":"2023-10-06T04:40:54.722370+0000","last_became_peered":"2023-10-06T04:40:54.722370+0000","last_unstale":"2023-10-06T04:40:54.727640+0000","last_undegraded":"2023-10-06T04:40:54.727640+0000","last_fullsized":"2023-10-06T04:40:54.727640+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:26.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.727899+0000","last_change":"2023-10-06T04:40:54.723125+0000","last_active":"2023-10-06T04:40:54.727899+0000","last_peered":"2023-10-06T04:40:54.727899+0000","last_clean":"2023-10-06T04:40:54.727899+0000","last_became_active":"2023-10-06T04:40:54.722200+0000","last_became_peered":"2023-10-06T04:40:54.722200+0000","last_unstale":"2023-10-06T04:40:54.727899+0000","last_undegraded":"2023-10-06T04:40:54.727899+0000","last_fullsized":"2023-10-06T04:40:54.727899+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:00.032194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.721520+0000","last_change":"2023-10-06T04:40:53.709635+0000","last_active":"2023-10-06T04:40:54.721520+0000","last_peered":"2023-10-06T04:40:54.721520+0000","last_clean":"2023-10-06T04:40:54.721520+0000","last_became_active":"2023-10-06T04:40:53.707439+0000","last_became_peered":"2023-10-06T04:40:53.707439+0000","last_unstale":"2023-10-06T04:40:54.721520+0000","last_undegraded":"2023-10-06T04:40:54.721520+0000","last_fullsized":"2023-10-06T04:40:54.721520+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:50.685590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731743+0000","last_change":"2023-10-06T04:40:54.717631+0000","last_active":"2023-10-06T04:40:54.731743+0000","last_peered":"2023-10-06T04:40:54.731743+0000","last_clean":"2023-10-06T04:40:54.731743+0000","last_became_active":"2023-10-06T04:40:54.716544+0000","last_became_peered":"2023-10-06T04:40:54.716544+0000","last_unstale":"2023-10-06T04:40:54.731743+0000","last_undegraded":"2023-10-06T04:40:54.731743+0000","last_fullsized":"2023-10-06T04:40:54.731743+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:39.410405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.719250+0000","last_change":"2023-10-06T04:40:53.712871+0000","last_active":"2023-10-06T04:40:54.719250+0000","last_peered":"2023-10-06T04:40:54.719250+0000","last_clean":"2023-10-06T04:40:54.719250+0000","last_became_active":"2023-10-06T04:40:53.712575+0000","last_became_peered":"2023-10-06T04:40:53.712575+0000","last_unstale":"2023-10-06T04:40:54.719250+0000","last_undegraded":"2023-10-06T04:40:54.719250+0000","last_fullsized":"2023-10-06T04:40:54.719250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:28.109373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731941+0000","last_change":"2023-10-06T04:40:54.730587+0000","last_active":"2023-10-06T04:40:54.731941+0000","last_peered":"2023-10-06T04:40:54.731941+0000","last_clean":"2023-10-06T04:40:54.731941+0000","last_became_active":"2023-10-06T04:40:54.730225+0000","last_became_peered":"2023-10-06T04:40:54.730225+0000","last_unstale":"2023-10-06T04:40:54.731941+0000","last_undegraded":"2023-10-06T04:40:54.731941+0000","last_fullsized":"2023-10-06T04:40:54.731941+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:22.117172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.732338+0000","last_change":"2023-10-06T04:40:53.710896+0000","last_active":"2023-10-06T04:40:54.732338+0000","last_peered":"2023-10-06T04:40:54.732338+0000","last_clean":"2023-10-06T04:40:54.732338+0000","last_became_active":"2023-10-06T04:40:53.710108+0000","last_became_peered":"2023-10-06T04:40:53.710108+0000","last_unstale":"2023-10-06T04:40:54.732338+0000","last_undegraded":"2023-10-06T04:40:54.732338+0000","last_fullsized":"2023-10-06T04:40:54.732338+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:16.332624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726696+0000","last_change":"2023-10-06T04:40:54.719926+0000","last_active":"2023-10-06T04:40:54.726696+0000","last_peered":"2023-10-06T04:40:54.726696+0000","last_clean":"2023-10-06T04:40:54.726696+0000","last_became_active":"2023-10-06T04:40:54.719385+0000","last_became_peered":"2023-10-06T04:40:54.719385+0000","last_unstale":"2023-10-06T04:40:54.726696+0000","last_undegraded":"2023-10-06T04:40:54.726696+0000","last_fullsized":"2023-10-06T04:40:54.726696+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:23.454893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.701192+0000","last_change":"2023-10-06T04:40:53.702536+0000","last_active":"2023-10-06T04:40:54.701192+0000","last_peered":"2023-10-06T04:40:54.701192+0000","last_clean":"2023-10-06T04:40:54.701192+0000","last_became_active":"2023-10-06T04:40:53.702154+0000","last_became_peered":"2023-10-06T04:40:53.702154+0000","last_unstale":"2023-10-06T04:40:54.701192+0000","last_undegraded":"2023-10-06T04:40:54.701192+0000","last_fullsized":"2023-10-06T04:40:54.701192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:26.883533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720819+0000","last_change":"2023-10-06T04:40:54.715686+0000","last_active":"2023-10-06T04:40:54.720819+0000","last_peered":"2023-10-06T04:40:54.720819+0000","last_clean":"2023-10-06T04:40:54.720819+0000","last_became_active":"2023-10-06T04:40:54.715334+0000","last_became_peered":"2023-10-06T04:40:54.715334+0000","last_unstale":"2023-10-06T04:40:54.720819+0000","last_undegraded":"2023-10-06T04:40:54.720819+0000","last_fullsized":"2023-10-06T04:40:54.720819+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:00.032194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720078+0000","last_change":"2023-10-06T04:40:53.706219+0000","last_active":"2023-10-06T04:40:54.720078+0000","last_peered":"2023-10-06T04:40:54.720078+0000","last_clean":"2023-10-06T04:40:54.720078+0000","last_became_active":"2023-10-06T04:40:53.705941+0000","last_became_peered":"2023-10-06T04:40:53.705941+0000","last_unstale":"2023-10-06T04:40:54.720078+0000","last_undegraded":"2023-10-06T04:40:54.720078+0000","last_fullsized":"2023-10-06T04:40:54.720078+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:09.402032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.723587+0000","last_change":"2023-10-06T04:40:54.718615+0000","last_active":"2023-10-06T04:40:54.723587+0000","last_peered":"2023-10-06T04:40:54.723587+0000","last_clean":"2023-10-06T04:40:54.723587+0000","last_became_active":"2023-10-06T04:40:54.718312+0000","last_became_peered":"2023-10-06T04:40:54.718312+0000","last_unstale":"2023-10-06T04:40:54.723587+0000","last_undegraded":"2023-10-06T04:40:54.723587+0000","last_fullsized":"2023-10-06T04:40:54.723587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:39.529975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.714817+0000","last_change":"2023-10-06T04:40:53.712517+0000","last_active":"2023-10-06T04:40:54.714817+0000","last_peered":"2023-10-06T04:40:54.714817+0000","last_clean":"2023-10-06T04:40:54.714817+0000","last_became_active":"2023-10-06T04:40:53.711693+0000","last_became_peered":"2023-10-06T04:40:53.711693+0000","last_unstale":"2023-10-06T04:40:54.714817+0000","last_undegraded":"2023-10-06T04:40:54.714817+0000","last_fullsized":"2023-10-06T04:40:54.714817+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:28.044622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726402+0000","last_change":"2023-10-06T04:40:54.724731+0000","last_active":"2023-10-06T04:40:54.726402+0000","last_peered":"2023-10-06T04:40:54.726402+0000","last_clean":"2023-10-06T04:40:54.726402+0000","last_became_active":"2023-10-06T04:40:54.724416+0000","last_became_peered":"2023-10-06T04:40:54.724416+0000","last_unstale":"2023-10-06T04:40:54.726402+0000","last_undegraded":"2023-10-06T04:40:54.726402+0000","last_fullsized":"2023-10-06T04:40:54.726402+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:08.449597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.694251+0000","last_change":"2023-10-06T04:40:53.706267+0000","last_active":"2023-10-06T04:40:54.694251+0000","last_peered":"2023-10-06T04:40:54.694251+0000","last_clean":"2023-10-06T04:40:54.694251+0000","last_became_active":"2023-10-06T04:40:53.701664+0000","last_became_peered":"2023-10-06T04:40:53.701664+0000","last_unstale":"2023-10-06T04:40:54.694251+0000","last_undegraded":"2023-10-06T04:40:54.694251+0000","last_fullsized":"2023-10-06T04:40:54.694251+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:02.376723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.728110+0000","last_change":"2023-10-06T04:40:54.725480+0000","last_active":"2023-10-06T04:40:54.728110+0000","last_peered":"2023-10-06T04:40:54.728110+0000","last_clean":"2023-10-06T04:40:54.728110+0000","last_became_active":"2023-10-06T04:40:54.725194+0000","last_became_peered":"2023-10-06T04:40:54.725194+0000","last_unstale":"2023-10-06T04:40:54.728110+0000","last_undegraded":"2023-10-06T04:40:54.728110+0000","last_fullsized":"2023-10-06T04:40:54.728110+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:48.448944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.704588+0000","last_change":"2023-10-06T04:40:53.711239+0000","last_active":"2023-10-06T04:40:54.704588+0000","last_peered":"2023-10-06T04:40:54.704588+0000","last_clean":"2023-10-06T04:40:54.704588+0000","last_became_active":"2023-10-06T04:40:53.710936+0000","last_became_peered":"2023-10-06T04:40:53.710936+0000","last_unstale":"2023-10-06T04:40:54.704588+0000","last_undegraded":"2023-10-06T04:40:54.704588+0000","last_fullsized":"2023-10-06T04:40:54.704588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:20.783284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.732211+0000","last_change":"2023-10-06T04:40:54.730920+0000","last_active":"2023-10-06T04:40:54.732211+0000","last_peered":"2023-10-06T04:40:54.732211+0000","last_clean":"2023-10-06T04:40:54.732211+0000","last_became_active":"2023-10-06T04:40:54.730677+0000","last_became_peered":"2023-10-06T04:40:54.730677+0000","last_unstale":"2023-10-06T04:40:54.732211+0000","last_undegraded":"2023-10-06T04:40:54.732211+0000","last_fullsized":"2023-10-06T04:40:54.732211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:18.401042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.704718+0000","last_change":"2023-10-06T04:40:53.714217+0000","last_active":"2023-10-06T04:40:54.704718+0000","last_peered":"2023-10-06T04:40:54.704718+0000","last_clean":"2023-10-06T04:40:54.704718+0000","last_became_active":"2023-10-06T04:40:53.713925+0000","last_became_peered":"2023-10-06T04:40:53.713925+0000","last_unstale":"2023-10-06T04:40:54.704718+0000","last_undegraded":"2023-10-06T04:40:54.704718+0000","last_fullsized":"2023-10-06T04:40:54.704718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:15.223496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.733502+0000","last_change":"2023-10-06T04:40:54.732036+0000","last_active":"2023-10-06T04:40:54.733502+0000","last_peered":"2023-10-06T04:40:54.733502+0000","last_clean":"2023-10-06T04:40:54.733502+0000","last_became_active":"2023-10-06T04:40:54.731733+0000","last_became_peered":"2023-10-06T04:40:54.731733+0000","last_unstale":"2023-10-06T04:40:54.733502+0000","last_undegraded":"2023-10-06T04:40:54.733502+0000","last_fullsized":"2023-10-06T04:40:54.733502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:21.787974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.704586+0000","last_change":"2023-10-06T04:40:53.705733+0000","last_active":"2023-10-06T04:40:54.704586+0000","last_peered":"2023-10-06T04:40:54.704586+0000","last_clean":"2023-10-06T04:40:54.704586+0000","last_became_active":"2023-10-06T04:40:53.705162+0000","last_became_peered":"2023-10-06T04:40:53.705162+0000","last_unstale":"2023-10-06T04:40:54.704586+0000","last_undegraded":"2023-10-06T04:40:54.704586+0000","last_fullsized":"2023-10-06T04:40:54.704586+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:28.044622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731126+0000","last_change":"2023-10-06T04:40:54.716735+0000","last_active":"2023-10-06T04:40:54.731126+0000","last_peered":"2023-10-06T04:40:54.731126+0000","last_clean":"2023-10-06T04:40:54.731126+0000","last_became_active":"2023-10-06T04:40:54.714250+0000","last_became_peered":"2023-10-06T04:40:54.714250+0000","last_unstale":"2023-10-06T04:40:54.731126+0000","last_undegraded":"2023-10-06T04:40:54.731126+0000","last_fullsized":"2023-10-06T04:40:54.731126+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:21.407040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731612+0000","last_change":"2023-10-06T04:40:53.714273+0000","last_active":"2023-10-06T04:40:54.731612+0000","last_peered":"2023-10-06T04:40:54.731612+0000","last_clean":"2023-10-06T04:40:54.731612+0000","last_became_active":"2023-10-06T04:40:53.713523+0000","last_became_peered":"2023-10-06T04:40:53.713523+0000","last_unstale":"2023-10-06T04:40:54.731612+0000","last_undegraded":"2023-10-06T04:40:54.731612+0000","last_fullsized":"2023-10-06T04:40:54.731612+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:37.946999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.733520+0000","last_change":"2023-10-06T04:40:54.732021+0000","last_active":"2023-10-06T04:40:54.733520+0000","last_peered":"2023-10-06T04:40:54.733520+0000","last_clean":"2023-10-06T04:40:54.733520+0000","last_became_active":"2023-10-06T04:40:54.731609+0000","last_became_peered":"2023-10-06T04:40:54.731609+0000","last_unstale":"2023-10-06T04:40:54.733520+0000","last_undegraded":"2023-10-06T04:40:54.733520+0000","last_fullsized":"2023-10-06T04:40:54.733520+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:18.093420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.732139+0000","last_change":"2023-10-06T04:40:53.708807+0000","last_active":"2023-10-06T04:40:54.732139+0000","last_peered":"2023-10-06T04:40:54.732139+0000","last_clean":"2023-10-06T04:40:54.732139+0000","last_became_active":"2023-10-06T04:40:53.708497+0000","last_became_peered":"2023-10-06T04:40:53.708497+0000","last_unstale":"2023-10-06T04:40:54.732139+0000","last_undegraded":"2023-10-06T04:40:54.732139+0000","last_fullsized":"2023-10-06T04:40:54.732139+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:28.044622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.706933+0000","last_change":"2023-10-06T04:40:54.703846+0000","last_active":"2023-10-06T04:40:54.706933+0000","last_peered":"2023-10-06T04:40:54.706933+0000","last_clean":"2023-10-06T04:40:54.706933+0000","last_became_active":"2023-10-06T04:40:54.703530+0000","last_became_peered":"2023-10-06T04:40:54.703530+0000","last_unstale":"2023-10-06T04:40:54.706933+0000","last_undegraded":"2023-10-06T04:40:54.706933+0000","last_fullsized":"2023-10-06T04:40:54.706933+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:59.955150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.723322+0000","last_change":"2023-10-06T04:40:53.705604+0000","last_active":"2023-10-06T04:40:54.723322+0000","last_peered":"2023-10-06T04:40:54.723322+0000","last_clean":"2023-10-06T04:40:54.723322+0000","last_became_active":"2023-10-06T04:40:53.705173+0000","last_became_peered":"2023-10-06T04:40:53.705173+0000","last_unstale":"2023-10-06T04:40:54.723322+0000","last_undegraded":"2023-10-06T04:40:54.723322+0000","last_fullsized":"2023-10-06T04:40:54.723322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:46.254104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.727748+0000","last_change":"2023-10-06T04:40:54.726036+0000","last_active":"2023-10-06T04:40:54.727748+0000","last_peered":"2023-10-06T04:40:54.727748+0000","last_clean":"2023-10-06T04:40:54.727748+0000","last_became_active":"2023-10-06T04:40:54.725714+0000","last_became_peered":"2023-10-06T04:40:54.725714+0000","last_unstale":"2023-10-06T04:40:54.727748+0000","last_undegraded":"2023-10-06T04:40:54.727748+0000","last_fullsized":"2023-10-06T04:40:54.727748+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:11.803401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.710073+0000","last_change":"2023-10-06T04:40:53.713954+0000","last_active":"2023-10-06T04:40:54.710073+0000","last_peered":"2023-10-06T04:40:54.710073+0000","last_clean":"2023-10-06T04:40:54.710073+0000","last_became_active":"2023-10-06T04:40:53.713576+0000","last_became_peered":"2023-10-06T04:40:53.713576+0000","last_unstale":"2023-10-06T04:40:54.710073+0000","last_undegraded":"2023-10-06T04:40:54.710073+0000","last_fullsized":"2023-10-06T04:40:54.710073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:32.676777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.724005+0000","last_change":"2023-10-06T04:40:54.719778+0000","last_active":"2023-10-06T04:40:54.724005+0000","last_peered":"2023-10-06T04:40:54.724005+0000","last_clean":"2023-10-06T04:40:54.724005+0000","last_became_active":"2023-10-06T04:40:54.719450+0000","last_became_peered":"2023-10-06T04:40:54.719450+0000","last_unstale":"2023-10-06T04:40:54.724005+0000","last_undegraded":"2023-10-06T04:40:54.724005+0000","last_fullsized":"2023-10-06T04:40:54.724005+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:34.478885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.694548+0000","last_change":"2023-10-06T04:40:53.707040+0000","last_active":"2023-10-06T04:40:54.694548+0000","last_peered":"2023-10-06T04:40:54.694548+0000","last_clean":"2023-10-06T04:40:54.694548+0000","last_became_active":"2023-10-06T04:40:53.706027+0000","last_became_peered":"2023-10-06T04:40:53.706027+0000","last_unstale":"2023-10-06T04:40:54.694548+0000","last_undegraded":"2023-10-06T04:40:54.694548+0000","last_fullsized":"2023-10-06T04:40:54.694548+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:07.676781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.724056+0000","last_change":"2023-10-06T04:40:54.722096+0000","last_active":"2023-10-06T04:40:54.724056+0000","last_peered":"2023-10-06T04:40:54.724056+0000","last_clean":"2023-10-06T04:40:54.724056+0000","last_became_active":"2023-10-06T04:40:54.721777+0000","last_became_peered":"2023-10-06T04:40:54.721777+0000","last_unstale":"2023-10-06T04:40:54.724056+0000","last_undegraded":"2023-10-06T04:40:54.724056+0000","last_fullsized":"2023-10-06T04:40:54.724056+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:28.353152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720508+0000","last_change":"2023-10-06T04:40:53.712851+0000","last_active":"2023-10-06T04:40:54.720508+0000","last_peered":"2023-10-06T04:40:54.720508+0000","last_clean":"2023-10-06T04:40:54.720508+0000","last_became_active":"2023-10-06T04:40:53.712485+0000","last_became_peered":"2023-10-06T04:40:53.712485+0000","last_unstale":"2023-10-06T04:40:54.720508+0000","last_undegraded":"2023-10-06T04:40:54.720508+0000","last_fullsized":"2023-10-06T04:40:54.720508+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:36.586486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.712133+0000","last_change":"2023-10-06T04:40:54.709719+0000","last_active":"2023-10-06T04:40:54.712133+0000","last_peered":"2023-10-06T04:40:54.712133+0000","last_clean":"2023-10-06T04:40:54.712133+0000","last_became_active":"2023-10-06T04:40:54.709388+0000","last_became_peered":"2023-10-06T04:40:54.709388+0000","last_unstale":"2023-10-06T04:40:54.712133+0000","last_undegraded":"2023-10-06T04:40:54.712133+0000","last_fullsized":"2023-10-06T04:40:54.712133+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:36.043232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.701749+0000","last_change":"2023-10-06T04:40:53.709267+0000","last_active":"2023-10-06T04:40:54.701749+0000","last_peered":"2023-10-06T04:40:54.701749+0000","last_clean":"2023-10-06T04:40:54.701749+0000","last_became_active":"2023-10-06T04:40:53.708930+0000","last_became_peered":"2023-10-06T04:40:53.708930+0000","last_unstale":"2023-10-06T04:40:54.701749+0000","last_undegraded":"2023-10-06T04:40:54.701749+0000","last_fullsized":"2023-10-06T04:40:54.701749+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:33.326780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720805+0000","last_change":"2023-10-06T04:40:54.717411+0000","last_active":"2023-10-06T04:40:54.720805+0000","last_peered":"2023-10-06T04:40:54.720805+0000","last_clean":"2023-10-06T04:40:54.720805+0000","last_became_active":"2023-10-06T04:40:54.716936+0000","last_became_peered":"2023-10-06T04:40:54.716936+0000","last_unstale":"2023-10-06T04:40:54.720805+0000","last_undegraded":"2023-10-06T04:40:54.720805+0000","last_fullsized":"2023-10-06T04:40:54.720805+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:53.742139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.708649+0000","last_change":"2023-10-06T04:40:53.710911+0000","last_active":"2023-10-06T04:40:54.708649+0000","last_peered":"2023-10-06T04:40:54.708649+0000","last_clean":"2023-10-06T04:40:54.708649+0000","last_became_active":"2023-10-06T04:40:53.710582+0000","last_became_peered":"2023-10-06T04:40:53.710582+0000","last_unstale":"2023-10-06T04:40:54.708649+0000","last_undegraded":"2023-10-06T04:40:54.708649+0000","last_fullsized":"2023-10-06T04:40:54.708649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:46.254104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731105+0000","last_change":"2023-10-06T04:40:54.714123+0000","last_active":"2023-10-06T04:40:54.731105+0000","last_peered":"2023-10-06T04:40:54.731105+0000","last_clean":"2023-10-06T04:40:54.731105+0000","last_became_active":"2023-10-06T04:40:54.713716+0000","last_became_peered":"2023-10-06T04:40:54.713716+0000","last_unstale":"2023-10-06T04:40:54.731105+0000","last_undegraded":"2023-10-06T04:40:54.731105+0000","last_fullsized":"2023-10-06T04:40:54.731105+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:00.795804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.709969+0000","last_change":"2023-10-06T04:40:53.709814+0000","last_active":"2023-10-06T04:40:54.709969+0000","last_peered":"2023-10-06T04:40:54.709969+0000","last_clean":"2023-10-06T04:40:54.709969+0000","last_became_active":"2023-10-06T04:40:53.709580+0000","last_became_peered":"2023-10-06T04:40:53.709580+0000","last_unstale":"2023-10-06T04:40:54.709969+0000","last_undegraded":"2023-10-06T04:40:54.709969+0000","last_fullsized":"2023-10-06T04:40:54.709969+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:47.814601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726662+0000","last_change":"2023-10-06T04:40:54.719695+0000","last_active":"2023-10-06T04:40:54.726662+0000","last_peered":"2023-10-06T04:40:54.726662+0000","last_clean":"2023-10-06T04:40:54.726662+0000","last_became_active":"2023-10-06T04:40:54.717440+0000","last_became_peered":"2023-10-06T04:40:54.717440+0000","last_unstale":"2023-10-06T04:40:54.726662+0000","last_undegraded":"2023-10-06T04:40:54.726662+0000","last_fullsized":"2023-10-06T04:40:54.726662+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:55.094115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.695068+0000","last_change":"2023-10-06T04:40:53.702565+0000","last_active":"2023-10-06T04:40:54.695068+0000","last_peered":"2023-10-06T04:40:54.695068+0000","last_clean":"2023-10-06T04:40:54.695068+0000","last_became_active":"2023-10-06T04:40:53.702285+0000","last_became_peered":"2023-10-06T04:40:53.702285+0000","last_unstale":"2023-10-06T04:40:54.695068+0000","last_undegraded":"2023-10-06T04:40:54.695068+0000","last_fullsized":"2023-10-06T04:40:54.695068+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:01.439365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.733615+0000","last_change":"2023-10-06T04:40:54.732144+0000","last_active":"2023-10-06T04:40:54.733615+0000","last_peered":"2023-10-06T04:40:54.733615+0000","last_clean":"2023-10-06T04:40:54.733615+0000","last_became_active":"2023-10-06T04:40:54.731850+0000","last_became_peered":"2023-10-06T04:40:54.731850+0000","last_unstale":"2023-10-06T04:40:54.733615+0000","last_undegraded":"2023-10-06T04:40:54.733615+0000","last_fullsized":"2023-10-06T04:40:54.733615+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:26.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.690225+0000","last_change":"2023-10-06T04:40:53.697992+0000","last_active":"2023-10-06T04:40:54.690225+0000","last_peered":"2023-10-06T04:40:54.690225+0000","last_clean":"2023-10-06T04:40:54.690225+0000","last_became_active":"2023-10-06T04:40:53.697176+0000","last_became_peered":"2023-10-06T04:40:53.697176+0000","last_unstale":"2023-10-06T04:40:54.690225+0000","last_undegraded":"2023-10-06T04:40:54.690225+0000","last_fullsized":"2023-10-06T04:40:54.690225+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:11.928904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726373+0000","last_change":"2023-10-06T04:40:54.725279+0000","last_active":"2023-10-06T04:40:54.726373+0000","last_peered":"2023-10-06T04:40:54.726373+0000","last_clean":"2023-10-06T04:40:54.726373+0000","last_became_active":"2023-10-06T04:40:54.724979+0000","last_became_peered":"2023-10-06T04:40:54.724979+0000","last_unstale":"2023-10-06T04:40:54.726373+0000","last_undegraded":"2023-10-06T04:40:54.726373+0000","last_fullsized":"2023-10-06T04:40:54.726373+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:29.114064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.701846+0000","last_change":"2023-10-06T04:40:53.708416+0000","last_active":"2023-10-06T04:40:54.701846+0000","last_peered":"2023-10-06T04:40:54.701846+0000","last_clean":"2023-10-06T04:40:54.701846+0000","last_became_active":"2023-10-06T04:40:53.708150+0000","last_became_peered":"2023-10-06T04:40:53.708150+0000","last_unstale":"2023-10-06T04:40:54.701846+0000","last_undegraded":"2023-10-06T04:40:54.701846+0000","last_fullsized":"2023-10-06T04:40:54.701846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:16.332624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731762+0000","last_change":"2023-10-06T04:40:54.726086+0000","last_active":"2023-10-06T04:40:54.731762+0000","last_peered":"2023-10-06T04:40:54.731762+0000","last_clean":"2023-10-06T04:40:54.731762+0000","last_became_active":"2023-10-06T04:40:54.725826+0000","last_became_peered":"2023-10-06T04:40:54.725826+0000","last_unstale":"2023-10-06T04:40:54.731762+0000","last_undegraded":"2023-10-06T04:40:54.731762+0000","last_fullsized":"2023-10-06T04:40:54.731762+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:02.264185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.690418+0000","last_change":"2023-10-06T04:40:53.703323+0000","last_active":"2023-10-06T04:40:54.690418+0000","last_peered":"2023-10-06T04:40:54.690418+0000","last_clean":"2023-10-06T04:40:54.690418+0000","last_became_active":"2023-10-06T04:40:53.703000+0000","last_became_peered":"2023-10-06T04:40:53.703000+0000","last_unstale":"2023-10-06T04:40:54.690418+0000","last_undegraded":"2023-10-06T04:40:54.690418+0000","last_fullsized":"2023-10-06T04:40:54.690418+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:44.489544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.728131+0000","last_change":"2023-10-06T04:40:54.725473+0000","last_active":"2023-10-06T04:40:54.728131+0000","last_peered":"2023-10-06T04:40:54.728131+0000","last_clean":"2023-10-06T04:40:54.728131+0000","last_became_active":"2023-10-06T04:40:54.724788+0000","last_became_peered":"2023-10-06T04:40:54.724788+0000","last_unstale":"2023-10-06T04:40:54.728131+0000","last_undegraded":"2023-10-06T04:40:54.728131+0000","last_fullsized":"2023-10-06T04:40:54.728131+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:11.411040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.709230+0000","last_change":"2023-10-06T04:40:53.707858+0000","last_active":"2023-10-06T04:40:54.709230+0000","last_peered":"2023-10-06T04:40:54.709230+0000","last_clean":"2023-10-06T04:40:54.709230+0000","last_became_active":"2023-10-06T04:40:53.705577+0000","last_became_peered":"2023-10-06T04:40:53.705577+0000","last_unstale":"2023-10-06T04:40:54.709230+0000","last_undegraded":"2023-10-06T04:40:54.709230+0000","last_fullsized":"2023-10-06T04:40:54.709230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:27.348461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.724468+0000","last_change":"2023-10-06T04:40:54.720213+0000","last_active":"2023-10-06T04:40:54.724468+0000","last_peered":"2023-10-06T04:40:54.724468+0000","last_clean":"2023-10-06T04:40:54.724468+0000","last_became_active":"2023-10-06T04:40:54.719896+0000","last_became_peered":"2023-10-06T04:40:54.719896+0000","last_unstale":"2023-10-06T04:40:54.724468+0000","last_undegraded":"2023-10-06T04:40:54.724468+0000","last_fullsized":"2023-10-06T04:40:54.724468+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:23.454893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.700639+0000","last_change":"2023-10-06T04:40:53.706154+0000","last_active":"2023-10-06T04:40:54.700639+0000","last_peered":"2023-10-06T04:40:54.700639+0000","last_clean":"2023-10-06T04:40:54.700639+0000","last_became_active":"2023-10-06T04:40:53.705798+0000","last_became_peered":"2023-10-06T04:40:53.705798+0000","last_unstale":"2023-10-06T04:40:54.700639+0000","last_undegraded":"2023-10-06T04:40:54.700639+0000","last_fullsized":"2023-10-06T04:40:54.700639+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:28.912505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.709965+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:40:54.709965+0000","last_peered":"2023-10-06T04:40:54.709965+0000","last_clean":"2023-10-06T04:40:54.709965+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:40:54.709965+0000","last_undegraded":"2023-10-06T04:40:54.709965+0000","last_fullsized":"2023-10-06T04:40:54.709965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.733823+0000","last_change":"2023-10-06T04:40:54.732283+0000","last_active":"2023-10-06T04:40:54.733823+0000","last_peered":"2023-10-06T04:40:54.733823+0000","last_clean":"2023-10-06T04:40:54.733823+0000","last_became_active":"2023-10-06T04:40:54.731786+0000","last_became_peered":"2023-10-06T04:40:54.731786+0000","last_unstale":"2023-10-06T04:40:54.733823+0000","last_undegraded":"2023-10-06T04:40:54.733823+0000","last_fullsized":"2023-10-06T04:40:54.733823+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:51.690281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.706231+0000","last_change":"2023-10-06T04:40:53.709788+0000","last_active":"2023-10-06T04:40:54.706231+0000","last_peered":"2023-10-06T04:40:54.706231+0000","last_clean":"2023-10-06T04:40:54.706231+0000","last_became_active":"2023-10-06T04:40:53.707204+0000","last_became_peered":"2023-10-06T04:40:53.707204+0000","last_unstale":"2023-10-06T04:40:54.706231+0000","last_undegraded":"2023-10-06T04:40:54.706231+0000","last_fullsized":"2023-10-06T04:40:54.706231+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:46.019138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.690984+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:40:54.690984+0000","last_peered":"2023-10-06T04:40:54.690984+0000","last_clean":"2023-10-06T04:40:54.690984+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:40:54.690984+0000","last_undegraded":"2023-10-06T04:40:54.690984+0000","last_fullsized":"2023-10-06T04:40:54.690984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.721492+0000","last_change":"2023-10-06T04:40:54.717554+0000","last_active":"2023-10-06T04:40:54.721492+0000","last_peered":"2023-10-06T04:40:54.721492+0000","last_clean":"2023-10-06T04:40:54.721492+0000","last_became_active":"2023-10-06T04:40:54.716108+0000","last_became_peered":"2023-10-06T04:40:54.716108+0000","last_unstale":"2023-10-06T04:40:54.721492+0000","last_undegraded":"2023-10-06T04:40:54.721492+0000","last_fullsized":"2023-10-06T04:40:54.721492+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:29.049313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720404+0000","last_change":"2023-10-06T04:40:53.705169+0000","last_active":"2023-10-06T04:40:54.720404+0000","last_peered":"2023-10-06T04:40:54.720404+0000","last_clean":"2023-10-06T04:40:54.720404+0000","last_became_active":"2023-10-06T04:40:53.704751+0000","last_became_peered":"2023-10-06T04:40:53.704751+0000","last_unstale":"2023-10-06T04:40:54.720404+0000","last_undegraded":"2023-10-06T04:40:54.720404+0000","last_fullsized":"2023-10-06T04:40:54.720404+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:09.402032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.708717+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:40:54.708717+0000","last_peered":"2023-10-06T04:40:54.708717+0000","last_clean":"2023-10-06T04:40:54.708717+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:40:54.708717+0000","last_undegraded":"2023-10-06T04:40:54.708717+0000","last_fullsized":"2023-10-06T04:40:54.708717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.705317+0000","last_change":"2023-10-06T04:40:54.703057+0000","last_active":"2023-10-06T04:40:54.705317+0000","last_peered":"2023-10-06T04:40:54.705317+0000","last_clean":"2023-10-06T04:40:54.705317+0000","last_became_active":"2023-10-06T04:40:54.702741+0000","last_became_peered":"2023-10-06T04:40:54.702741+0000","last_unstale":"2023-10-06T04:40:54.705317+0000","last_undegraded":"2023-10-06T04:40:54.705317+0000","last_fullsized":"2023-10-06T04:40:54.705317+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:58:36.704002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720914+0000","last_change":"2023-10-06T04:40:53.710210+0000","last_active":"2023-10-06T04:40:54.720914+0000","last_peered":"2023-10-06T04:40:54.720914+0000","last_clean":"2023-10-06T04:40:54.720914+0000","last_became_active":"2023-10-06T04:40:53.709942+0000","last_became_peered":"2023-10-06T04:40:53.709942+0000","last_unstale":"2023-10-06T04:40:54.720914+0000","last_undegraded":"2023-10-06T04:40:54.720914+0000","last_fullsized":"2023-10-06T04:40:54.720914+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:09.402032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.691411+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:40:54.691411+0000","last_peered":"2023-10-06T04:40:54.691411+0000","last_clean":"2023-10-06T04:40:54.691411+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:40:54.691411+0000","last_undegraded":"2023-10-06T04:40:54.691411+0000","last_fullsized":"2023-10-06T04:40:54.691411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726619+0000","last_change":"2023-10-06T04:40:54.722140+0000","last_active":"2023-10-06T04:40:54.726619+0000","last_peered":"2023-10-06T04:40:54.726619+0000","last_clean":"2023-10-06T04:40:54.726619+0000","last_became_active":"2023-10-06T04:40:54.721798+0000","last_became_peered":"2023-10-06T04:40:54.721798+0000","last_unstale":"2023-10-06T04:40:54.726619+0000","last_undegraded":"2023-10-06T04:40:54.726619+0000","last_fullsized":"2023-10-06T04:40:54.726619+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:04.261430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.695166+0000","last_change":"2023-10-06T04:40:53.709732+0000","last_active":"2023-10-06T04:40:54.695166+0000","last_peered":"2023-10-06T04:40:54.695166+0000","last_clean":"2023-10-06T04:40:54.695166+0000","last_became_active":"2023-10-06T04:40:53.709482+0000","last_became_peered":"2023-10-06T04:40:53.709482+0000","last_unstale":"2023-10-06T04:40:54.695166+0000","last_undegraded":"2023-10-06T04:40:54.695166+0000","last_fullsized":"2023-10-06T04:40:54.695166+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:01.178950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.694790+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:40:54.694790+0000","last_peered":"2023-10-06T04:40:54.694790+0000","last_clean":"2023-10-06T04:40:54.694790+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:40:54.694790+0000","last_undegraded":"2023-10-06T04:40:54.694790+0000","last_fullsized":"2023-10-06T04:40:54.694790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.706913+0000","last_change":"2023-10-06T04:40:54.703711+0000","last_active":"2023-10-06T04:40:54.706913+0000","last_peered":"2023-10-06T04:40:54.706913+0000","last_clean":"2023-10-06T04:40:54.706913+0000","last_became_active":"2023-10-06T04:40:54.703133+0000","last_became_peered":"2023-10-06T04:40:54.703133+0000","last_unstale":"2023-10-06T04:40:54.706913+0000","last_undegraded":"2023-10-06T04:40:54.706913+0000","last_fullsized":"2023-10-06T04:40:54.706913+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:19.292699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.723470+0000","last_change":"2023-10-06T04:40:53.707893+0000","last_active":"2023-10-06T04:40:54.723470+0000","last_peered":"2023-10-06T04:40:54.723470+0000","last_clean":"2023-10-06T04:40:54.723470+0000","last_became_active":"2023-10-06T04:40:53.707559+0000","last_became_peered":"2023-10-06T04:40:53.707559+0000","last_unstale":"2023-10-06T04:40:54.723470+0000","last_undegraded":"2023-10-06T04:40:54.723470+0000","last_fullsized":"2023-10-06T04:40:54.723470+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:38.188504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.693323+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:40:54.693323+0000","last_peered":"2023-10-06T04:40:54.693323+0000","last_clean":"2023-10-06T04:40:54.693323+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:40:54.693323+0000","last_undegraded":"2023-10-06T04:40:54.693323+0000","last_fullsized":"2023-10-06T04:40:54.693323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.728081+0000","last_change":"2023-10-06T04:40:54.725275+0000","last_active":"2023-10-06T04:40:54.728081+0000","last_peered":"2023-10-06T04:40:54.728081+0000","last_clean":"2023-10-06T04:40:54.728081+0000","last_became_active":"2023-10-06T04:40:54.725072+0000","last_became_peered":"2023-10-06T04:40:54.725072+0000","last_unstale":"2023-10-06T04:40:54.728081+0000","last_undegraded":"2023-10-06T04:40:54.728081+0000","last_fullsized":"2023-10-06T04:40:54.728081+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:53.877231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.690966+0000","last_change":"2023-10-06T04:40:53.696702+0000","last_active":"2023-10-06T04:40:54.690966+0000","last_peered":"2023-10-06T04:40:54.690966+0000","last_clean":"2023-10-06T04:40:54.690966+0000","last_became_active":"2023-10-06T04:40:53.696317+0000","last_became_peered":"2023-10-06T04:40:53.696317+0000","last_unstale":"2023-10-06T04:40:54.690966+0000","last_undegraded":"2023-10-06T04:40:54.690966+0000","last_fullsized":"2023-10-06T04:40:54.690966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:07.444907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.705630+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:40:54.705630+0000","last_peered":"2023-10-06T04:40:54.705630+0000","last_clean":"2023-10-06T04:40:54.705630+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:40:54.705630+0000","last_undegraded":"2023-10-06T04:40:54.705630+0000","last_fullsized":"2023-10-06T04:40:54.705630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.724460+0000","last_change":"2023-10-06T04:40:54.720853+0000","last_active":"2023-10-06T04:40:54.724460+0000","last_peered":"2023-10-06T04:40:54.724460+0000","last_clean":"2023-10-06T04:40:54.724460+0000","last_became_active":"2023-10-06T04:40:54.720489+0000","last_became_peered":"2023-10-06T04:40:54.720489+0000","last_unstale":"2023-10-06T04:40:54.724460+0000","last_undegraded":"2023-10-06T04:40:54.724460+0000","last_fullsized":"2023-10-06T04:40:54.724460+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:58:10.619734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.709449+0000","last_change":"2023-10-06T04:40:53.712992+0000","last_active":"2023-10-06T04:40:54.709449+0000","last_peered":"2023-10-06T04:40:54.709449+0000","last_clean":"2023-10-06T04:40:54.709449+0000","last_became_active":"2023-10-06T04:40:53.712773+0000","last_became_peered":"2023-10-06T04:40:53.712773+0000","last_unstale":"2023-10-06T04:40:54.709449+0000","last_undegraded":"2023-10-06T04:40:54.709449+0000","last_fullsized":"2023-10-06T04:40:54.709449+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:28.977388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.694781+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:40:54.694781+0000","last_peered":"2023-10-06T04:40:54.694781+0000","last_clean":"2023-10-06T04:40:54.694781+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:40:54.694781+0000","last_undegraded":"2023-10-06T04:40:54.694781+0000","last_fullsized":"2023-10-06T04:40:54.694781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.705723+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:40:54.705723+0000","last_peered":"2023-10-06T04:40:54.705723+0000","last_clean":"2023-10-06T04:40:54.705723+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:40:54.705723+0000","last_undegraded":"2023-10-06T04:40:54.705723+0000","last_fullsized":"2023-10-06T04:40:54.705723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":655360,"data_stored":298520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.66300000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.91500000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":890922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.92500000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.746},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.0780000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.002}]},{"osd":5,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.329},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.2889999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.391}]},{"osd":7,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.194},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.3560000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1249280,"data_stored":888992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":3.347,"5min":3.347,"15min":3.347},"last":1.196},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.88600000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.98999999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.745},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.1279999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.1099999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.1679999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.244},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.218}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":298464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.92300000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":1.0449999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.131},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.006},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.109}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.86599999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.1990000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.085}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":299088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.77000000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.0309999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.0620000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.296}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.0840000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.171}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":300000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.1339999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.1899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.0389999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.006},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2310000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.258},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.103}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.3080000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":298520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.1759999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.423},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.905}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.758},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.363}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.538}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.653},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.579}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":298554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":1.028},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.2110000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.72099999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.872}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.054}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.091}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.181}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.25},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.28}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:59.539 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-10-06T04:40:59.532+0000 7fcab89ea700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:41:02.168 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:41:02.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9876afb700 1 Processor -- start 2023-10-06T04:41:02.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9876afb700 1 -- start start 2023-10-06T04:41:02.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9876afb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f98700b0f80 0x7f9870155940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9876afb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9870159bc0 0x7f9870155e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9876afb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9870159730 con 0x7f987014f720 2023-10-06T04:41:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9876afb700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9870156980 con 0x7f9870159bc0 2023-10-06T04:41:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9876afb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98701566a0 con 0x7f98700b0f80 2023-10-06T04:41:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9875098700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9870159bc0 0x7f9870155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9875098700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9870159bc0 0x7f9870155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56566/0 (socket says 172.21.15.37:56566) 2023-10-06T04:41:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9875098700 1 -- 172.21.15.37:0/2153226475 learned_addr learned my addr 172.21.15.37:0/2153226475 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f986ffff700 1 --2- 172.21.15.37:0/2153226475 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f98700b0f80 0x7f9870155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9875098700 1 -- 172.21.15.37:0/2153226475 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f98700b0f80 msgr2=0x7f9870155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9875098700 1 --2- 172.21.15.37:0/2153226475 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f98700b0f80 0x7f9870155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9875098700 1 -- 172.21.15.37:0/2153226475 >> v1:172.21.15.83:6789/0 conn(0x7f987014f720 legacy=0x7f98700b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.276+0000 7f9875098700 1 -- 172.21.15.37:0/2153226475 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98701590e0 con 0x7f9870159bc0 2023-10-06T04:41:02.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f9875098700 1 --2- 172.21.15.37:0/2153226475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9870159bc0 0x7f9870155e80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f98600099b0 tx=0x7f9860009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fff439adf6344df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f986f7fe700 1 -- 172.21.15.37:0/2153226475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986000b8f0 con 0x7f9870159bc0 2023-10-06T04:41:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f986f7fe700 1 -- 172.21.15.37:0/2153226475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986000ba50 con 0x7f9870159bc0 2023-10-06T04:41:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f986f7fe700 1 -- 172.21.15.37:0/2153226475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986000bdf0 con 0x7f9870159bc0 2023-10-06T04:41:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f9876afb700 1 -- 172.21.15.37:0/2153226475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9870159bc0 msgr2=0x7f9870155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f9876afb700 1 --2- 172.21.15.37:0/2153226475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9870159bc0 0x7f9870155e80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f98600099b0 tx=0x7f9860009250 comp rx=0 tx=0).stop 2023-10-06T04:41:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f9876afb700 1 -- 172.21.15.37:0/2153226475 shutdown_connections 2023-10-06T04:41:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f9876afb700 1 --2- 172.21.15.37:0/2153226475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9870159bc0 0x7f9870155e80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f9876afb700 1 --2- 172.21.15.37:0/2153226475 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f98700b0f80 0x7f9870155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f9876afb700 1 -- 172.21.15.37:0/2153226475 >> 172.21.15.37:0/2153226475 conn(0x7f98700667b0 msgr2=0x7f9870066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f9876afb700 1 -- 172.21.15.37:0/2153226475 shutdown_connections 2023-10-06T04:41:02.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f9876afb700 1 -- 172.21.15.37:0/2153226475 wait complete. 2023-10-06T04:41:02.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f9876afb700 1 Processor -- start 2023-10-06T04:41:02.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.280+0000 7f9876afb700 1 -- start start 2023-10-06T04:41:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9876afb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f98700b0f80 0x7f987014a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9876afb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f987014f720 0x7f9870148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9876afb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9870159bc0 0x7f9870143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9876afb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9870148f80 con 0x7f9870159bc0 2023-10-06T04:41:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9876afb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987014b700 con 0x7f987014f720 2023-10-06T04:41:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9876afb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987014aaf0 con 0x7f98700b0f80 2023-10-06T04:41:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9875098700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9870159bc0 0x7f9870143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9875098700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9870159bc0 0x7f9870143060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56580/0 (socket says 172.21.15.37:56580) 2023-10-06T04:41:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9875098700 1 -- 172.21.15.37:0/3962531332 learned_addr learned my addr 172.21.15.37:0/3962531332 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f986ffff700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f987014f720 0x7f9870148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9874897700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f98700b0f80 0x7f987014a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9875098700 1 -- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f98700b0f80 msgr2=0x7f987014a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9875098700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f98700b0f80 0x7f987014a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9875098700 1 -- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f987014f720 msgr2=0x7f9870148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9875098700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f987014f720 0x7f9870148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9875098700 1 -- 172.21.15.37:0/3962531332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98600094f0 con 0x7f9870159bc0 2023-10-06T04:41:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f986ffff700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f987014f720 0x7f9870148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9875098700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9870159bc0 0x7f9870143060 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f987006ba00 tx=0x7f9860017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f986cff9700 1 -- 172.21.15.37:0/3962531332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860006bc0 con 0x7f9870159bc0 2023-10-06T04:41:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f986cff9700 1 -- 172.21.15.37:0/3962531332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986001a630 con 0x7f9870159bc0 2023-10-06T04:41:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9876afb700 1 -- 172.21.15.37:0/3962531332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987014add0 con 0x7f9870159bc0 2023-10-06T04:41:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f986cff9700 1 -- 172.21.15.37:0/3962531332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986001a9d0 con 0x7f9870159bc0 2023-10-06T04:41:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9876afb700 1 -- 172.21.15.37:0/3962531332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987014b390 con 0x7f9870159bc0 2023-10-06T04:41:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.284+0000 7f9876afb700 1 -- 172.21.15.37:0/3962531332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987014b8b0 con 0x7f9870159bc0 2023-10-06T04:41:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.288+0000 7f986cff9700 1 -- 172.21.15.37:0/3962531332 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f98600253f0 con 0x7f9870159bc0 2023-10-06T04:41:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.288+0000 7f986cff9700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9850060550 0x7f9850062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.288+0000 7f986cff9700 1 -- 172.21.15.37:0/3962531332 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f986007e640 con 0x7f9870159bc0 2023-10-06T04:41:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.288+0000 7f9874897700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9850060550 0x7f9850062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.288+0000 7f9874897700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9850060550 0x7f9850062a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9868007fd0 tx=0x7f9868009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.296+0000 7f986cff9700 1 -- 172.21.15.37:0/3962531332 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f987014b8b0 con 0x7f9870159bc0 2023-10-06T04:41:02.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.452+0000 7f9876afb700 1 -- 172.21.15.37:0/3962531332 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f987014b8b0 con 0x7f9850060550 2023-10-06T04:41:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.472+0000 7f986cff9700 1 -- 172.21.15.37:0/3962531332 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309376 (secure 0 0 0) 0x7f987014b8b0 con 0x7f9850060550 2023-10-06T04:41:02.480 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:02.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.476+0000 7f9876afb700 1 -- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9850060550 msgr2=0x7f9850062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.476+0000 7f9876afb700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9850060550 0x7f9850062a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9868007fd0 tx=0x7f9868009040 comp rx=0 tx=0).stop 2023-10-06T04:41:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.476+0000 7f9876afb700 1 -- 172.21.15.37:0/3962531332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9870159bc0 msgr2=0x7f9870143060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.476+0000 7f9876afb700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9870159bc0 0x7f9870143060 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f987006ba00 tx=0x7f9860017000 comp rx=0 tx=0).stop 2023-10-06T04:41:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.476+0000 7f9876afb700 1 -- 172.21.15.37:0/3962531332 shutdown_connections 2023-10-06T04:41:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.476+0000 7f9876afb700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9850060550 0x7f9850062a00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.476+0000 7f9876afb700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f987014f720 0x7f9870148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.476+0000 7f9876afb700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9870159bc0 0x7f9870143060 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.476+0000 7f9876afb700 1 --2- 172.21.15.37:0/3962531332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f98700b0f80 0x7f987014a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.476+0000 7f9876afb700 1 -- 172.21.15.37:0/3962531332 >> 172.21.15.37:0/3962531332 conn(0x7f98700667b0 msgr2=0x7f987014c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.476+0000 7f9876afb700 1 -- 172.21.15.37:0/3962531332 shutdown_connections 2023-10-06T04:41:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.476+0000 7f9876afb700 1 -- 172.21.15.37:0/3962531332 wait complete. 2023-10-06T04:41:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:41:02.495 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-10-06T04:41:01.068873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396872,"kb_used_data":6280,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577848,"statfs":{"total":773094113280,"available":770639716352,"internally_reserved":0,"allocated":6430720,"data_stored":3573060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.383051"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.723754+0000","last_change":"2023-10-06T04:40:54.721349+0000","last_active":"2023-10-06T04:40:54.723754+0000","last_peered":"2023-10-06T04:40:54.723754+0000","last_clean":"2023-10-06T04:40:54.723754+0000","last_became_active":"2023-10-06T04:40:54.721052+0000","last_became_peered":"2023-10-06T04:40:54.721052+0000","last_unstale":"2023-10-06T04:40:54.723754+0000","last_undegraded":"2023-10-06T04:40:54.723754+0000","last_fullsized":"2023-10-06T04:40:54.723754+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.765707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.732733+0000","last_change":"2023-10-06T04:40:54.731643+0000","last_active":"2023-10-06T04:40:54.732733+0000","last_peered":"2023-10-06T04:40:54.732733+0000","last_clean":"2023-10-06T04:40:54.732733+0000","last_became_active":"2023-10-06T04:40:54.731273+0000","last_became_peered":"2023-10-06T04:40:54.731273+0000","last_unstale":"2023-10-06T04:40:54.732733+0000","last_undegraded":"2023-10-06T04:40:54.732733+0000","last_fullsized":"2023-10-06T04:40:54.732733+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:10.510360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.721576+0000","last_change":"2023-10-06T04:40:54.715809+0000","last_active":"2023-10-06T04:40:54.721576+0000","last_peered":"2023-10-06T04:40:54.721576+0000","last_clean":"2023-10-06T04:40:54.721576+0000","last_became_active":"2023-10-06T04:40:54.715475+0000","last_became_peered":"2023-10-06T04:40:54.715475+0000","last_unstale":"2023-10-06T04:40:54.721576+0000","last_undegraded":"2023-10-06T04:40:54.721576+0000","last_fullsized":"2023-10-06T04:40:54.721576+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:33.453549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.712175+0000","last_change":"2023-10-06T04:40:54.710498+0000","last_active":"2023-10-06T04:40:54.712175+0000","last_peered":"2023-10-06T04:40:54.712175+0000","last_clean":"2023-10-06T04:40:54.712175+0000","last_became_active":"2023-10-06T04:40:54.710177+0000","last_became_peered":"2023-10-06T04:40:54.710177+0000","last_unstale":"2023-10-06T04:40:54.712175+0000","last_undegraded":"2023-10-06T04:40:54.712175+0000","last_fullsized":"2023-10-06T04:40:54.712175+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:33.390252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.707168+0000","last_change":"2023-10-06T04:40:54.700535+0000","last_active":"2023-10-06T04:40:54.707168+0000","last_peered":"2023-10-06T04:40:54.707168+0000","last_clean":"2023-10-06T04:40:54.707168+0000","last_became_active":"2023-10-06T04:40:54.699956+0000","last_became_peered":"2023-10-06T04:40:54.699956+0000","last_unstale":"2023-10-06T04:40:54.707168+0000","last_undegraded":"2023-10-06T04:40:54.707168+0000","last_fullsized":"2023-10-06T04:40:54.707168+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:27.125395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726555+0000","last_change":"2023-10-06T04:40:54.720796+0000","last_active":"2023-10-06T04:40:54.726555+0000","last_peered":"2023-10-06T04:40:54.726555+0000","last_clean":"2023-10-06T04:40:54.726555+0000","last_became_active":"2023-10-06T04:40:54.720395+0000","last_became_peered":"2023-10-06T04:40:54.720395+0000","last_unstale":"2023-10-06T04:40:54.726555+0000","last_undegraded":"2023-10-06T04:40:54.726555+0000","last_fullsized":"2023-10-06T04:40:54.726555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:08.260028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.714524+0000","last_change":"2023-10-06T04:40:54.711553+0000","last_active":"2023-10-06T04:40:54.714524+0000","last_peered":"2023-10-06T04:40:54.714524+0000","last_clean":"2023-10-06T04:40:54.714524+0000","last_became_active":"2023-10-06T04:40:54.711210+0000","last_became_peered":"2023-10-06T04:40:54.711210+0000","last_unstale":"2023-10-06T04:40:54.714524+0000","last_undegraded":"2023-10-06T04:40:54.714524+0000","last_fullsized":"2023-10-06T04:40:54.714524+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:18.978760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.724447+0000","last_change":"2023-10-06T04:40:54.720201+0000","last_active":"2023-10-06T04:40:54.724447+0000","last_peered":"2023-10-06T04:40:54.724447+0000","last_clean":"2023-10-06T04:40:54.724447+0000","last_became_active":"2023-10-06T04:40:54.719878+0000","last_became_peered":"2023-10-06T04:40:54.719878+0000","last_unstale":"2023-10-06T04:40:54.724447+0000","last_undegraded":"2023-10-06T04:40:54.724447+0000","last_fullsized":"2023-10-06T04:40:54.724447+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:53.882031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.715385+0000","last_change":"2023-10-06T04:40:54.713880+0000","last_active":"2023-10-06T04:40:54.715385+0000","last_peered":"2023-10-06T04:40:54.715385+0000","last_clean":"2023-10-06T04:40:54.715385+0000","last_became_active":"2023-10-06T04:40:54.713545+0000","last_became_peered":"2023-10-06T04:40:54.713545+0000","last_unstale":"2023-10-06T04:40:54.715385+0000","last_undegraded":"2023-10-06T04:40:54.715385+0000","last_fullsized":"2023-10-06T04:40:54.715385+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:00.032194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731725+0000","last_change":"2023-10-06T04:40:54.723221+0000","last_active":"2023-10-06T04:40:54.731725+0000","last_peered":"2023-10-06T04:40:54.731725+0000","last_clean":"2023-10-06T04:40:54.731725+0000","last_became_active":"2023-10-06T04:40:54.722931+0000","last_became_peered":"2023-10-06T04:40:54.722931+0000","last_unstale":"2023-10-06T04:40:54.731725+0000","last_undegraded":"2023-10-06T04:40:54.731725+0000","last_fullsized":"2023-10-06T04:40:54.731725+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:38.460996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731695+0000","last_change":"2023-10-06T04:40:54.720843+0000","last_active":"2023-10-06T04:40:54.731695+0000","last_peered":"2023-10-06T04:40:54.731695+0000","last_clean":"2023-10-06T04:40:54.731695+0000","last_became_active":"2023-10-06T04:40:54.720551+0000","last_became_peered":"2023-10-06T04:40:54.720551+0000","last_unstale":"2023-10-06T04:40:54.731695+0000","last_undegraded":"2023-10-06T04:40:54.731695+0000","last_fullsized":"2023-10-06T04:40:54.731695+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:33:40.403346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720482+0000","last_change":"2023-10-06T04:40:54.717369+0000","last_active":"2023-10-06T04:40:54.720482+0000","last_peered":"2023-10-06T04:40:54.720482+0000","last_clean":"2023-10-06T04:40:54.720482+0000","last_became_active":"2023-10-06T04:40:54.717031+0000","last_became_peered":"2023-10-06T04:40:54.717031+0000","last_unstale":"2023-10-06T04:40:54.720482+0000","last_undegraded":"2023-10-06T04:40:54.720482+0000","last_fullsized":"2023-10-06T04:40:54.720482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:17.731416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.727042+0000","last_change":"2023-10-06T04:40:54.723784+0000","last_active":"2023-10-06T04:40:54.727042+0000","last_peered":"2023-10-06T04:40:54.727042+0000","last_clean":"2023-10-06T04:40:54.727042+0000","last_became_active":"2023-10-06T04:40:54.723270+0000","last_became_peered":"2023-10-06T04:40:54.723270+0000","last_unstale":"2023-10-06T04:40:54.727042+0000","last_undegraded":"2023-10-06T04:40:54.727042+0000","last_fullsized":"2023-10-06T04:40:54.727042+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:45.494234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.715425+0000","last_change":"2023-10-06T04:40:54.712743+0000","last_active":"2023-10-06T04:40:54.715425+0000","last_peered":"2023-10-06T04:40:54.715425+0000","last_clean":"2023-10-06T04:40:54.715425+0000","last_became_active":"2023-10-06T04:40:54.712422+0000","last_became_peered":"2023-10-06T04:40:54.712422+0000","last_unstale":"2023-10-06T04:40:54.715425+0000","last_undegraded":"2023-10-06T04:40:54.715425+0000","last_fullsized":"2023-10-06T04:40:54.715425+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:59.668534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.732255+0000","last_change":"2023-10-06T04:40:54.731009+0000","last_active":"2023-10-06T04:40:54.732255+0000","last_peered":"2023-10-06T04:40:54.732255+0000","last_clean":"2023-10-06T04:40:54.732255+0000","last_became_active":"2023-10-06T04:40:54.730660+0000","last_became_peered":"2023-10-06T04:40:54.730660+0000","last_unstale":"2023-10-06T04:40:54.732255+0000","last_undegraded":"2023-10-06T04:40:54.732255+0000","last_fullsized":"2023-10-06T04:40:54.732255+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:04.261430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.728762+0000","last_change":"2023-10-06T04:40:54.725857+0000","last_active":"2023-10-06T04:40:54.728762+0000","last_peered":"2023-10-06T04:40:54.728762+0000","last_clean":"2023-10-06T04:40:54.728762+0000","last_became_active":"2023-10-06T04:40:54.725478+0000","last_became_peered":"2023-10-06T04:40:54.725478+0000","last_unstale":"2023-10-06T04:40:54.728762+0000","last_undegraded":"2023-10-06T04:40:54.728762+0000","last_fullsized":"2023-10-06T04:40:54.728762+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:25.995007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.727808+0000","last_change":"2023-10-06T04:40:54.725252+0000","last_active":"2023-10-06T04:40:54.727808+0000","last_peered":"2023-10-06T04:40:54.727808+0000","last_clean":"2023-10-06T04:40:54.727808+0000","last_became_active":"2023-10-06T04:40:54.724963+0000","last_became_peered":"2023-10-06T04:40:54.724963+0000","last_unstale":"2023-10-06T04:40:54.727808+0000","last_undegraded":"2023-10-06T04:40:54.727808+0000","last_fullsized":"2023-10-06T04:40:54.727808+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:46.470206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.721472+0000","last_change":"2023-10-06T04:40:54.716063+0000","last_active":"2023-10-06T04:40:54.721472+0000","last_peered":"2023-10-06T04:40:54.721472+0000","last_clean":"2023-10-06T04:40:54.721472+0000","last_became_active":"2023-10-06T04:40:54.715768+0000","last_became_peered":"2023-10-06T04:40:54.715768+0000","last_unstale":"2023-10-06T04:40:54.721472+0000","last_undegraded":"2023-10-06T04:40:54.721472+0000","last_fullsized":"2023-10-06T04:40:54.721472+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:47.258794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.723720+0000","last_change":"2023-10-06T04:40:54.720573+0000","last_active":"2023-10-06T04:40:54.723720+0000","last_peered":"2023-10-06T04:40:54.723720+0000","last_clean":"2023-10-06T04:40:54.723720+0000","last_became_active":"2023-10-06T04:40:54.720276+0000","last_became_peered":"2023-10-06T04:40:54.720276+0000","last_unstale":"2023-10-06T04:40:54.723720+0000","last_undegraded":"2023-10-06T04:40:54.723720+0000","last_fullsized":"2023-10-06T04:40:54.723720+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:27.104100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.721664+0000","last_change":"2023-10-06T04:40:54.718661+0000","last_active":"2023-10-06T04:40:54.721664+0000","last_peered":"2023-10-06T04:40:54.721664+0000","last_clean":"2023-10-06T04:40:54.721664+0000","last_became_active":"2023-10-06T04:40:54.718357+0000","last_became_peered":"2023-10-06T04:40:54.718357+0000","last_unstale":"2023-10-06T04:40:54.721664+0000","last_undegraded":"2023-10-06T04:40:54.721664+0000","last_fullsized":"2023-10-06T04:40:54.721664+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:10.138500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.719996+0000","last_change":"2023-10-06T04:40:54.715222+0000","last_active":"2023-10-06T04:40:54.719996+0000","last_peered":"2023-10-06T04:40:54.719996+0000","last_clean":"2023-10-06T04:40:54.719996+0000","last_became_active":"2023-10-06T04:40:54.710726+0000","last_became_peered":"2023-10-06T04:40:54.710726+0000","last_unstale":"2023-10-06T04:40:54.719996+0000","last_undegraded":"2023-10-06T04:40:54.719996+0000","last_fullsized":"2023-10-06T04:40:54.719996+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:10.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720796+0000","last_change":"2023-10-06T04:40:54.715635+0000","last_active":"2023-10-06T04:40:54.720796+0000","last_peered":"2023-10-06T04:40:54.720796+0000","last_clean":"2023-10-06T04:40:54.720796+0000","last_became_active":"2023-10-06T04:40:54.715313+0000","last_became_peered":"2023-10-06T04:40:54.715313+0000","last_unstale":"2023-10-06T04:40:54.720796+0000","last_undegraded":"2023-10-06T04:40:54.720796+0000","last_fullsized":"2023-10-06T04:40:54.720796+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:25.995007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.724038+0000","last_change":"2023-10-06T04:40:54.722028+0000","last_active":"2023-10-06T04:40:54.724038+0000","last_peered":"2023-10-06T04:40:54.724038+0000","last_clean":"2023-10-06T04:40:54.724038+0000","last_became_active":"2023-10-06T04:40:54.721364+0000","last_became_peered":"2023-10-06T04:40:54.721364+0000","last_unstale":"2023-10-06T04:40:54.724038+0000","last_undegraded":"2023-10-06T04:40:54.724038+0000","last_fullsized":"2023-10-06T04:40:54.724038+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:35.736228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726275+0000","last_change":"2023-10-06T04:40:54.723814+0000","last_active":"2023-10-06T04:40:54.726275+0000","last_peered":"2023-10-06T04:40:54.726275+0000","last_clean":"2023-10-06T04:40:54.726275+0000","last_became_active":"2023-10-06T04:40:54.723490+0000","last_became_peered":"2023-10-06T04:40:54.723490+0000","last_unstale":"2023-10-06T04:40:54.726275+0000","last_undegraded":"2023-10-06T04:40:54.726275+0000","last_fullsized":"2023-10-06T04:40:54.726275+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:46.645933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.707150+0000","last_change":"2023-10-06T04:40:54.701651+0000","last_active":"2023-10-06T04:40:54.707150+0000","last_peered":"2023-10-06T04:40:54.707150+0000","last_clean":"2023-10-06T04:40:54.707150+0000","last_became_active":"2023-10-06T04:40:54.701358+0000","last_became_peered":"2023-10-06T04:40:54.701358+0000","last_unstale":"2023-10-06T04:40:54.707150+0000","last_undegraded":"2023-10-06T04:40:54.707150+0000","last_fullsized":"2023-10-06T04:40:54.707150+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:35.357203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720273+0000","last_change":"2023-10-06T04:40:54.715059+0000","last_active":"2023-10-06T04:40:54.720273+0000","last_peered":"2023-10-06T04:40:54.720273+0000","last_clean":"2023-10-06T04:40:54.720273+0000","last_became_active":"2023-10-06T04:40:54.714714+0000","last_became_peered":"2023-10-06T04:40:54.714714+0000","last_unstale":"2023-10-06T04:40:54.720273+0000","last_undegraded":"2023-10-06T04:40:54.720273+0000","last_fullsized":"2023-10-06T04:40:54.720273+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:00.430420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.727928+0000","last_change":"2023-10-06T04:40:54.725173+0000","last_active":"2023-10-06T04:40:54.727928+0000","last_peered":"2023-10-06T04:40:54.727928+0000","last_clean":"2023-10-06T04:40:54.727928+0000","last_became_active":"2023-10-06T04:40:54.724838+0000","last_became_peered":"2023-10-06T04:40:54.724838+0000","last_unstale":"2023-10-06T04:40:54.727928+0000","last_undegraded":"2023-10-06T04:40:54.727928+0000","last_fullsized":"2023-10-06T04:40:54.727928+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:08.357836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.707786+0000","last_change":"2023-10-06T04:40:54.700388+0000","last_active":"2023-10-06T04:40:54.707786+0000","last_peered":"2023-10-06T04:40:54.707786+0000","last_clean":"2023-10-06T04:40:54.707786+0000","last_became_active":"2023-10-06T04:40:54.700035+0000","last_became_peered":"2023-10-06T04:40:54.700035+0000","last_unstale":"2023-10-06T04:40:54.707786+0000","last_undegraded":"2023-10-06T04:40:54.707786+0000","last_fullsized":"2023-10-06T04:40:54.707786+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:14.020907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.723570+0000","last_change":"2023-10-06T04:40:54.715106+0000","last_active":"2023-10-06T04:40:54.723570+0000","last_peered":"2023-10-06T04:40:54.723570+0000","last_clean":"2023-10-06T04:40:54.723570+0000","last_became_active":"2023-10-06T04:40:54.714794+0000","last_became_peered":"2023-10-06T04:40:54.714794+0000","last_unstale":"2023-10-06T04:40:54.723570+0000","last_undegraded":"2023-10-06T04:40:54.723570+0000","last_fullsized":"2023-10-06T04:40:54.723570+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:08.357836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.721880+0000","last_change":"2023-10-06T04:40:54.716030+0000","last_active":"2023-10-06T04:40:54.721880+0000","last_peered":"2023-10-06T04:40:54.721880+0000","last_clean":"2023-10-06T04:40:54.721880+0000","last_became_active":"2023-10-06T04:40:54.715674+0000","last_became_peered":"2023-10-06T04:40:54.715674+0000","last_unstale":"2023-10-06T04:40:54.721880+0000","last_undegraded":"2023-10-06T04:40:54.721880+0000","last_fullsized":"2023-10-06T04:40:54.721880+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:17.337314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.707117+0000","last_change":"2023-10-06T04:40:54.701754+0000","last_active":"2023-10-06T04:40:54.707117+0000","last_peered":"2023-10-06T04:40:54.707117+0000","last_clean":"2023-10-06T04:40:54.707117+0000","last_became_active":"2023-10-06T04:40:54.701445+0000","last_became_peered":"2023-10-06T04:40:54.701445+0000","last_unstale":"2023-10-06T04:40:54.707117+0000","last_undegraded":"2023-10-06T04:40:54.707117+0000","last_fullsized":"2023-10-06T04:40:54.707117+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:17.395458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.727640+0000","last_change":"2023-10-06T04:40:54.722789+0000","last_active":"2023-10-06T04:40:54.727640+0000","last_peered":"2023-10-06T04:40:54.727640+0000","last_clean":"2023-10-06T04:40:54.727640+0000","last_became_active":"2023-10-06T04:40:54.722370+0000","last_became_peered":"2023-10-06T04:40:54.722370+0000","last_unstale":"2023-10-06T04:40:54.727640+0000","last_undegraded":"2023-10-06T04:40:54.727640+0000","last_fullsized":"2023-10-06T04:40:54.727640+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:26.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.727899+0000","last_change":"2023-10-06T04:40:54.723125+0000","last_active":"2023-10-06T04:40:54.727899+0000","last_peered":"2023-10-06T04:40:54.727899+0000","last_clean":"2023-10-06T04:40:54.727899+0000","last_became_active":"2023-10-06T04:40:54.722200+0000","last_became_peered":"2023-10-06T04:40:54.722200+0000","last_unstale":"2023-10-06T04:40:54.727899+0000","last_undegraded":"2023-10-06T04:40:54.727899+0000","last_fullsized":"2023-10-06T04:40:54.727899+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:00.032194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.721520+0000","last_change":"2023-10-06T04:40:53.709635+0000","last_active":"2023-10-06T04:40:54.721520+0000","last_peered":"2023-10-06T04:40:54.721520+0000","last_clean":"2023-10-06T04:40:54.721520+0000","last_became_active":"2023-10-06T04:40:53.707439+0000","last_became_peered":"2023-10-06T04:40:53.707439+0000","last_unstale":"2023-10-06T04:40:54.721520+0000","last_undegraded":"2023-10-06T04:40:54.721520+0000","last_fullsized":"2023-10-06T04:40:54.721520+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:50.685590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731743+0000","last_change":"2023-10-06T04:40:54.717631+0000","last_active":"2023-10-06T04:40:54.731743+0000","last_peered":"2023-10-06T04:40:54.731743+0000","last_clean":"2023-10-06T04:40:54.731743+0000","last_became_active":"2023-10-06T04:40:54.716544+0000","last_became_peered":"2023-10-06T04:40:54.716544+0000","last_unstale":"2023-10-06T04:40:54.731743+0000","last_undegraded":"2023-10-06T04:40:54.731743+0000","last_fullsized":"2023-10-06T04:40:54.731743+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:39.410405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.719250+0000","last_change":"2023-10-06T04:40:53.712871+0000","last_active":"2023-10-06T04:40:54.719250+0000","last_peered":"2023-10-06T04:40:54.719250+0000","last_clean":"2023-10-06T04:40:54.719250+0000","last_became_active":"2023-10-06T04:40:53.712575+0000","last_became_peered":"2023-10-06T04:40:53.712575+0000","last_unstale":"2023-10-06T04:40:54.719250+0000","last_undegraded":"2023-10-06T04:40:54.719250+0000","last_fullsized":"2023-10-06T04:40:54.719250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:28.109373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731941+0000","last_change":"2023-10-06T04:40:54.730587+0000","last_active":"2023-10-06T04:40:54.731941+0000","last_peered":"2023-10-06T04:40:54.731941+0000","last_clean":"2023-10-06T04:40:54.731941+0000","last_became_active":"2023-10-06T04:40:54.730225+0000","last_became_peered":"2023-10-06T04:40:54.730225+0000","last_unstale":"2023-10-06T04:40:54.731941+0000","last_undegraded":"2023-10-06T04:40:54.731941+0000","last_fullsized":"2023-10-06T04:40:54.731941+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:22.117172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.732338+0000","last_change":"2023-10-06T04:40:53.710896+0000","last_active":"2023-10-06T04:40:54.732338+0000","last_peered":"2023-10-06T04:40:54.732338+0000","last_clean":"2023-10-06T04:40:54.732338+0000","last_became_active":"2023-10-06T04:40:53.710108+0000","last_became_peered":"2023-10-06T04:40:53.710108+0000","last_unstale":"2023-10-06T04:40:54.732338+0000","last_undegraded":"2023-10-06T04:40:54.732338+0000","last_fullsized":"2023-10-06T04:40:54.732338+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:16.332624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726696+0000","last_change":"2023-10-06T04:40:54.719926+0000","last_active":"2023-10-06T04:40:54.726696+0000","last_peered":"2023-10-06T04:40:54.726696+0000","last_clean":"2023-10-06T04:40:54.726696+0000","last_became_active":"2023-10-06T04:40:54.719385+0000","last_became_peered":"2023-10-06T04:40:54.719385+0000","last_unstale":"2023-10-06T04:40:54.726696+0000","last_undegraded":"2023-10-06T04:40:54.726696+0000","last_fullsized":"2023-10-06T04:40:54.726696+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:23.454893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.701192+0000","last_change":"2023-10-06T04:40:53.702536+0000","last_active":"2023-10-06T04:40:54.701192+0000","last_peered":"2023-10-06T04:40:54.701192+0000","last_clean":"2023-10-06T04:40:54.701192+0000","last_became_active":"2023-10-06T04:40:53.702154+0000","last_became_peered":"2023-10-06T04:40:53.702154+0000","last_unstale":"2023-10-06T04:40:54.701192+0000","last_undegraded":"2023-10-06T04:40:54.701192+0000","last_fullsized":"2023-10-06T04:40:54.701192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:26.883533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720819+0000","last_change":"2023-10-06T04:40:54.715686+0000","last_active":"2023-10-06T04:40:54.720819+0000","last_peered":"2023-10-06T04:40:54.720819+0000","last_clean":"2023-10-06T04:40:54.720819+0000","last_became_active":"2023-10-06T04:40:54.715334+0000","last_became_peered":"2023-10-06T04:40:54.715334+0000","last_unstale":"2023-10-06T04:40:54.720819+0000","last_undegraded":"2023-10-06T04:40:54.720819+0000","last_fullsized":"2023-10-06T04:40:54.720819+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:00.032194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720078+0000","last_change":"2023-10-06T04:40:53.706219+0000","last_active":"2023-10-06T04:40:54.720078+0000","last_peered":"2023-10-06T04:40:54.720078+0000","last_clean":"2023-10-06T04:40:54.720078+0000","last_became_active":"2023-10-06T04:40:53.705941+0000","last_became_peered":"2023-10-06T04:40:53.705941+0000","last_unstale":"2023-10-06T04:40:54.720078+0000","last_undegraded":"2023-10-06T04:40:54.720078+0000","last_fullsized":"2023-10-06T04:40:54.720078+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:09.402032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.723587+0000","last_change":"2023-10-06T04:40:54.718615+0000","last_active":"2023-10-06T04:40:54.723587+0000","last_peered":"2023-10-06T04:40:54.723587+0000","last_clean":"2023-10-06T04:40:54.723587+0000","last_became_active":"2023-10-06T04:40:54.718312+0000","last_became_peered":"2023-10-06T04:40:54.718312+0000","last_unstale":"2023-10-06T04:40:54.723587+0000","last_undegraded":"2023-10-06T04:40:54.723587+0000","last_fullsized":"2023-10-06T04:40:54.723587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:39.529975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.714817+0000","last_change":"2023-10-06T04:40:53.712517+0000","last_active":"2023-10-06T04:40:54.714817+0000","last_peered":"2023-10-06T04:40:54.714817+0000","last_clean":"2023-10-06T04:40:54.714817+0000","last_became_active":"2023-10-06T04:40:53.711693+0000","last_became_peered":"2023-10-06T04:40:53.711693+0000","last_unstale":"2023-10-06T04:40:54.714817+0000","last_undegraded":"2023-10-06T04:40:54.714817+0000","last_fullsized":"2023-10-06T04:40:54.714817+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:28.044622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726402+0000","last_change":"2023-10-06T04:40:54.724731+0000","last_active":"2023-10-06T04:40:54.726402+0000","last_peered":"2023-10-06T04:40:54.726402+0000","last_clean":"2023-10-06T04:40:54.726402+0000","last_became_active":"2023-10-06T04:40:54.724416+0000","last_became_peered":"2023-10-06T04:40:54.724416+0000","last_unstale":"2023-10-06T04:40:54.726402+0000","last_undegraded":"2023-10-06T04:40:54.726402+0000","last_fullsized":"2023-10-06T04:40:54.726402+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:08.449597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.694251+0000","last_change":"2023-10-06T04:40:53.706267+0000","last_active":"2023-10-06T04:40:54.694251+0000","last_peered":"2023-10-06T04:40:54.694251+0000","last_clean":"2023-10-06T04:40:54.694251+0000","last_became_active":"2023-10-06T04:40:53.701664+0000","last_became_peered":"2023-10-06T04:40:53.701664+0000","last_unstale":"2023-10-06T04:40:54.694251+0000","last_undegraded":"2023-10-06T04:40:54.694251+0000","last_fullsized":"2023-10-06T04:40:54.694251+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:02.376723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.728110+0000","last_change":"2023-10-06T04:40:54.725480+0000","last_active":"2023-10-06T04:40:54.728110+0000","last_peered":"2023-10-06T04:40:54.728110+0000","last_clean":"2023-10-06T04:40:54.728110+0000","last_became_active":"2023-10-06T04:40:54.725194+0000","last_became_peered":"2023-10-06T04:40:54.725194+0000","last_unstale":"2023-10-06T04:40:54.728110+0000","last_undegraded":"2023-10-06T04:40:54.728110+0000","last_fullsized":"2023-10-06T04:40:54.728110+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:48.448944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.704588+0000","last_change":"2023-10-06T04:40:53.711239+0000","last_active":"2023-10-06T04:40:54.704588+0000","last_peered":"2023-10-06T04:40:54.704588+0000","last_clean":"2023-10-06T04:40:54.704588+0000","last_became_active":"2023-10-06T04:40:53.710936+0000","last_became_peered":"2023-10-06T04:40:53.710936+0000","last_unstale":"2023-10-06T04:40:54.704588+0000","last_undegraded":"2023-10-06T04:40:54.704588+0000","last_fullsized":"2023-10-06T04:40:54.704588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:20.783284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.732211+0000","last_change":"2023-10-06T04:40:54.730920+0000","last_active":"2023-10-06T04:40:54.732211+0000","last_peered":"2023-10-06T04:40:54.732211+0000","last_clean":"2023-10-06T04:40:54.732211+0000","last_became_active":"2023-10-06T04:40:54.730677+0000","last_became_peered":"2023-10-06T04:40:54.730677+0000","last_unstale":"2023-10-06T04:40:54.732211+0000","last_undegraded":"2023-10-06T04:40:54.732211+0000","last_fullsized":"2023-10-06T04:40:54.732211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:18.401042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.704718+0000","last_change":"2023-10-06T04:40:53.714217+0000","last_active":"2023-10-06T04:40:54.704718+0000","last_peered":"2023-10-06T04:40:54.704718+0000","last_clean":"2023-10-06T04:40:54.704718+0000","last_became_active":"2023-10-06T04:40:53.713925+0000","last_became_peered":"2023-10-06T04:40:53.713925+0000","last_unstale":"2023-10-06T04:40:54.704718+0000","last_undegraded":"2023-10-06T04:40:54.704718+0000","last_fullsized":"2023-10-06T04:40:54.704718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:15.223496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.733502+0000","last_change":"2023-10-06T04:40:54.732036+0000","last_active":"2023-10-06T04:40:54.733502+0000","last_peered":"2023-10-06T04:40:54.733502+0000","last_clean":"2023-10-06T04:40:54.733502+0000","last_became_active":"2023-10-06T04:40:54.731733+0000","last_became_peered":"2023-10-06T04:40:54.731733+0000","last_unstale":"2023-10-06T04:40:54.733502+0000","last_undegraded":"2023-10-06T04:40:54.733502+0000","last_fullsized":"2023-10-06T04:40:54.733502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:21.787974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.704586+0000","last_change":"2023-10-06T04:40:53.705733+0000","last_active":"2023-10-06T04:40:54.704586+0000","last_peered":"2023-10-06T04:40:54.704586+0000","last_clean":"2023-10-06T04:40:54.704586+0000","last_became_active":"2023-10-06T04:40:53.705162+0000","last_became_peered":"2023-10-06T04:40:53.705162+0000","last_unstale":"2023-10-06T04:40:54.704586+0000","last_undegraded":"2023-10-06T04:40:54.704586+0000","last_fullsized":"2023-10-06T04:40:54.704586+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:28.044622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731126+0000","last_change":"2023-10-06T04:40:54.716735+0000","last_active":"2023-10-06T04:40:54.731126+0000","last_peered":"2023-10-06T04:40:54.731126+0000","last_clean":"2023-10-06T04:40:54.731126+0000","last_became_active":"2023-10-06T04:40:54.714250+0000","last_became_peered":"2023-10-06T04:40:54.714250+0000","last_unstale":"2023-10-06T04:40:54.731126+0000","last_undegraded":"2023-10-06T04:40:54.731126+0000","last_fullsized":"2023-10-06T04:40:54.731126+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:21.407040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731612+0000","last_change":"2023-10-06T04:40:53.714273+0000","last_active":"2023-10-06T04:40:54.731612+0000","last_peered":"2023-10-06T04:40:54.731612+0000","last_clean":"2023-10-06T04:40:54.731612+0000","last_became_active":"2023-10-06T04:40:53.713523+0000","last_became_peered":"2023-10-06T04:40:53.713523+0000","last_unstale":"2023-10-06T04:40:54.731612+0000","last_undegraded":"2023-10-06T04:40:54.731612+0000","last_fullsized":"2023-10-06T04:40:54.731612+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:37.946999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.733520+0000","last_change":"2023-10-06T04:40:54.732021+0000","last_active":"2023-10-06T04:40:54.733520+0000","last_peered":"2023-10-06T04:40:54.733520+0000","last_clean":"2023-10-06T04:40:54.733520+0000","last_became_active":"2023-10-06T04:40:54.731609+0000","last_became_peered":"2023-10-06T04:40:54.731609+0000","last_unstale":"2023-10-06T04:40:54.733520+0000","last_undegraded":"2023-10-06T04:40:54.733520+0000","last_fullsized":"2023-10-06T04:40:54.733520+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:18.093420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.732139+0000","last_change":"2023-10-06T04:40:53.708807+0000","last_active":"2023-10-06T04:40:54.732139+0000","last_peered":"2023-10-06T04:40:54.732139+0000","last_clean":"2023-10-06T04:40:54.732139+0000","last_became_active":"2023-10-06T04:40:53.708497+0000","last_became_peered":"2023-10-06T04:40:53.708497+0000","last_unstale":"2023-10-06T04:40:54.732139+0000","last_undegraded":"2023-10-06T04:40:54.732139+0000","last_fullsized":"2023-10-06T04:40:54.732139+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:28.044622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.706933+0000","last_change":"2023-10-06T04:40:54.703846+0000","last_active":"2023-10-06T04:40:54.706933+0000","last_peered":"2023-10-06T04:40:54.706933+0000","last_clean":"2023-10-06T04:40:54.706933+0000","last_became_active":"2023-10-06T04:40:54.703530+0000","last_became_peered":"2023-10-06T04:40:54.703530+0000","last_unstale":"2023-10-06T04:40:54.706933+0000","last_undegraded":"2023-10-06T04:40:54.706933+0000","last_fullsized":"2023-10-06T04:40:54.706933+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:59.955150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.723322+0000","last_change":"2023-10-06T04:40:53.705604+0000","last_active":"2023-10-06T04:40:54.723322+0000","last_peered":"2023-10-06T04:40:54.723322+0000","last_clean":"2023-10-06T04:40:54.723322+0000","last_became_active":"2023-10-06T04:40:53.705173+0000","last_became_peered":"2023-10-06T04:40:53.705173+0000","last_unstale":"2023-10-06T04:40:54.723322+0000","last_undegraded":"2023-10-06T04:40:54.723322+0000","last_fullsized":"2023-10-06T04:40:54.723322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:46.254104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.727748+0000","last_change":"2023-10-06T04:40:54.726036+0000","last_active":"2023-10-06T04:40:54.727748+0000","last_peered":"2023-10-06T04:40:54.727748+0000","last_clean":"2023-10-06T04:40:54.727748+0000","last_became_active":"2023-10-06T04:40:54.725714+0000","last_became_peered":"2023-10-06T04:40:54.725714+0000","last_unstale":"2023-10-06T04:40:54.727748+0000","last_undegraded":"2023-10-06T04:40:54.727748+0000","last_fullsized":"2023-10-06T04:40:54.727748+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:11.803401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.710073+0000","last_change":"2023-10-06T04:40:53.713954+0000","last_active":"2023-10-06T04:40:54.710073+0000","last_peered":"2023-10-06T04:40:54.710073+0000","last_clean":"2023-10-06T04:40:54.710073+0000","last_became_active":"2023-10-06T04:40:53.713576+0000","last_became_peered":"2023-10-06T04:40:53.713576+0000","last_unstale":"2023-10-06T04:40:54.710073+0000","last_undegraded":"2023-10-06T04:40:54.710073+0000","last_fullsized":"2023-10-06T04:40:54.710073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:32.676777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.724005+0000","last_change":"2023-10-06T04:40:54.719778+0000","last_active":"2023-10-06T04:40:54.724005+0000","last_peered":"2023-10-06T04:40:54.724005+0000","last_clean":"2023-10-06T04:40:54.724005+0000","last_became_active":"2023-10-06T04:40:54.719450+0000","last_became_peered":"2023-10-06T04:40:54.719450+0000","last_unstale":"2023-10-06T04:40:54.724005+0000","last_undegraded":"2023-10-06T04:40:54.724005+0000","last_fullsized":"2023-10-06T04:40:54.724005+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:34.478885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.694548+0000","last_change":"2023-10-06T04:40:53.707040+0000","last_active":"2023-10-06T04:40:54.694548+0000","last_peered":"2023-10-06T04:40:54.694548+0000","last_clean":"2023-10-06T04:40:54.694548+0000","last_became_active":"2023-10-06T04:40:53.706027+0000","last_became_peered":"2023-10-06T04:40:53.706027+0000","last_unstale":"2023-10-06T04:40:54.694548+0000","last_undegraded":"2023-10-06T04:40:54.694548+0000","last_fullsized":"2023-10-06T04:40:54.694548+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:07.676781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.724056+0000","last_change":"2023-10-06T04:40:54.722096+0000","last_active":"2023-10-06T04:40:54.724056+0000","last_peered":"2023-10-06T04:40:54.724056+0000","last_clean":"2023-10-06T04:40:54.724056+0000","last_became_active":"2023-10-06T04:40:54.721777+0000","last_became_peered":"2023-10-06T04:40:54.721777+0000","last_unstale":"2023-10-06T04:40:54.724056+0000","last_undegraded":"2023-10-06T04:40:54.724056+0000","last_fullsized":"2023-10-06T04:40:54.724056+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:28.353152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720508+0000","last_change":"2023-10-06T04:40:53.712851+0000","last_active":"2023-10-06T04:40:54.720508+0000","last_peered":"2023-10-06T04:40:54.720508+0000","last_clean":"2023-10-06T04:40:54.720508+0000","last_became_active":"2023-10-06T04:40:53.712485+0000","last_became_peered":"2023-10-06T04:40:53.712485+0000","last_unstale":"2023-10-06T04:40:54.720508+0000","last_undegraded":"2023-10-06T04:40:54.720508+0000","last_fullsized":"2023-10-06T04:40:54.720508+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:36.586486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.712133+0000","last_change":"2023-10-06T04:40:54.709719+0000","last_active":"2023-10-06T04:40:54.712133+0000","last_peered":"2023-10-06T04:40:54.712133+0000","last_clean":"2023-10-06T04:40:54.712133+0000","last_became_active":"2023-10-06T04:40:54.709388+0000","last_became_peered":"2023-10-06T04:40:54.709388+0000","last_unstale":"2023-10-06T04:40:54.712133+0000","last_undegraded":"2023-10-06T04:40:54.712133+0000","last_fullsized":"2023-10-06T04:40:54.712133+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:36.043232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.701749+0000","last_change":"2023-10-06T04:40:53.709267+0000","last_active":"2023-10-06T04:40:54.701749+0000","last_peered":"2023-10-06T04:40:54.701749+0000","last_clean":"2023-10-06T04:40:54.701749+0000","last_became_active":"2023-10-06T04:40:53.708930+0000","last_became_peered":"2023-10-06T04:40:53.708930+0000","last_unstale":"2023-10-06T04:40:54.701749+0000","last_undegraded":"2023-10-06T04:40:54.701749+0000","last_fullsized":"2023-10-06T04:40:54.701749+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:33.326780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720805+0000","last_change":"2023-10-06T04:40:54.717411+0000","last_active":"2023-10-06T04:40:54.720805+0000","last_peered":"2023-10-06T04:40:54.720805+0000","last_clean":"2023-10-06T04:40:54.720805+0000","last_became_active":"2023-10-06T04:40:54.716936+0000","last_became_peered":"2023-10-06T04:40:54.716936+0000","last_unstale":"2023-10-06T04:40:54.720805+0000","last_undegraded":"2023-10-06T04:40:54.720805+0000","last_fullsized":"2023-10-06T04:40:54.720805+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:53.742139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.708649+0000","last_change":"2023-10-06T04:40:53.710911+0000","last_active":"2023-10-06T04:40:54.708649+0000","last_peered":"2023-10-06T04:40:54.708649+0000","last_clean":"2023-10-06T04:40:54.708649+0000","last_became_active":"2023-10-06T04:40:53.710582+0000","last_became_peered":"2023-10-06T04:40:53.710582+0000","last_unstale":"2023-10-06T04:40:54.708649+0000","last_undegraded":"2023-10-06T04:40:54.708649+0000","last_fullsized":"2023-10-06T04:40:54.708649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:46.254104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731105+0000","last_change":"2023-10-06T04:40:54.714123+0000","last_active":"2023-10-06T04:40:54.731105+0000","last_peered":"2023-10-06T04:40:54.731105+0000","last_clean":"2023-10-06T04:40:54.731105+0000","last_became_active":"2023-10-06T04:40:54.713716+0000","last_became_peered":"2023-10-06T04:40:54.713716+0000","last_unstale":"2023-10-06T04:40:54.731105+0000","last_undegraded":"2023-10-06T04:40:54.731105+0000","last_fullsized":"2023-10-06T04:40:54.731105+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:00.795804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.709969+0000","last_change":"2023-10-06T04:40:53.709814+0000","last_active":"2023-10-06T04:40:54.709969+0000","last_peered":"2023-10-06T04:40:54.709969+0000","last_clean":"2023-10-06T04:40:54.709969+0000","last_became_active":"2023-10-06T04:40:53.709580+0000","last_became_peered":"2023-10-06T04:40:53.709580+0000","last_unstale":"2023-10-06T04:40:54.709969+0000","last_undegraded":"2023-10-06T04:40:54.709969+0000","last_fullsized":"2023-10-06T04:40:54.709969+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:47.814601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726662+0000","last_change":"2023-10-06T04:40:54.719695+0000","last_active":"2023-10-06T04:40:54.726662+0000","last_peered":"2023-10-06T04:40:54.726662+0000","last_clean":"2023-10-06T04:40:54.726662+0000","last_became_active":"2023-10-06T04:40:54.717440+0000","last_became_peered":"2023-10-06T04:40:54.717440+0000","last_unstale":"2023-10-06T04:40:54.726662+0000","last_undegraded":"2023-10-06T04:40:54.726662+0000","last_fullsized":"2023-10-06T04:40:54.726662+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:55.094115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.695068+0000","last_change":"2023-10-06T04:40:53.702565+0000","last_active":"2023-10-06T04:40:54.695068+0000","last_peered":"2023-10-06T04:40:54.695068+0000","last_clean":"2023-10-06T04:40:54.695068+0000","last_became_active":"2023-10-06T04:40:53.702285+0000","last_became_peered":"2023-10-06T04:40:53.702285+0000","last_unstale":"2023-10-06T04:40:54.695068+0000","last_undegraded":"2023-10-06T04:40:54.695068+0000","last_fullsized":"2023-10-06T04:40:54.695068+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:01.439365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.733615+0000","last_change":"2023-10-06T04:40:54.732144+0000","last_active":"2023-10-06T04:40:54.733615+0000","last_peered":"2023-10-06T04:40:54.733615+0000","last_clean":"2023-10-06T04:40:54.733615+0000","last_became_active":"2023-10-06T04:40:54.731850+0000","last_became_peered":"2023-10-06T04:40:54.731850+0000","last_unstale":"2023-10-06T04:40:54.733615+0000","last_undegraded":"2023-10-06T04:40:54.733615+0000","last_fullsized":"2023-10-06T04:40:54.733615+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:26.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.690225+0000","last_change":"2023-10-06T04:40:53.697992+0000","last_active":"2023-10-06T04:40:54.690225+0000","last_peered":"2023-10-06T04:40:54.690225+0000","last_clean":"2023-10-06T04:40:54.690225+0000","last_became_active":"2023-10-06T04:40:53.697176+0000","last_became_peered":"2023-10-06T04:40:53.697176+0000","last_unstale":"2023-10-06T04:40:54.690225+0000","last_undegraded":"2023-10-06T04:40:54.690225+0000","last_fullsized":"2023-10-06T04:40:54.690225+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:11.928904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726373+0000","last_change":"2023-10-06T04:40:54.725279+0000","last_active":"2023-10-06T04:40:54.726373+0000","last_peered":"2023-10-06T04:40:54.726373+0000","last_clean":"2023-10-06T04:40:54.726373+0000","last_became_active":"2023-10-06T04:40:54.724979+0000","last_became_peered":"2023-10-06T04:40:54.724979+0000","last_unstale":"2023-10-06T04:40:54.726373+0000","last_undegraded":"2023-10-06T04:40:54.726373+0000","last_fullsized":"2023-10-06T04:40:54.726373+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:29.114064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.701846+0000","last_change":"2023-10-06T04:40:53.708416+0000","last_active":"2023-10-06T04:40:54.701846+0000","last_peered":"2023-10-06T04:40:54.701846+0000","last_clean":"2023-10-06T04:40:54.701846+0000","last_became_active":"2023-10-06T04:40:53.708150+0000","last_became_peered":"2023-10-06T04:40:53.708150+0000","last_unstale":"2023-10-06T04:40:54.701846+0000","last_undegraded":"2023-10-06T04:40:54.701846+0000","last_fullsized":"2023-10-06T04:40:54.701846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:16.332624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.731762+0000","last_change":"2023-10-06T04:40:54.726086+0000","last_active":"2023-10-06T04:40:54.731762+0000","last_peered":"2023-10-06T04:40:54.731762+0000","last_clean":"2023-10-06T04:40:54.731762+0000","last_became_active":"2023-10-06T04:40:54.725826+0000","last_became_peered":"2023-10-06T04:40:54.725826+0000","last_unstale":"2023-10-06T04:40:54.731762+0000","last_undegraded":"2023-10-06T04:40:54.731762+0000","last_fullsized":"2023-10-06T04:40:54.731762+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:02.264185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.690418+0000","last_change":"2023-10-06T04:40:53.703323+0000","last_active":"2023-10-06T04:40:54.690418+0000","last_peered":"2023-10-06T04:40:54.690418+0000","last_clean":"2023-10-06T04:40:54.690418+0000","last_became_active":"2023-10-06T04:40:53.703000+0000","last_became_peered":"2023-10-06T04:40:53.703000+0000","last_unstale":"2023-10-06T04:40:54.690418+0000","last_undegraded":"2023-10-06T04:40:54.690418+0000","last_fullsized":"2023-10-06T04:40:54.690418+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:44.489544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.728131+0000","last_change":"2023-10-06T04:40:54.725473+0000","last_active":"2023-10-06T04:40:54.728131+0000","last_peered":"2023-10-06T04:40:54.728131+0000","last_clean":"2023-10-06T04:40:54.728131+0000","last_became_active":"2023-10-06T04:40:54.724788+0000","last_became_peered":"2023-10-06T04:40:54.724788+0000","last_unstale":"2023-10-06T04:40:54.728131+0000","last_undegraded":"2023-10-06T04:40:54.728131+0000","last_fullsized":"2023-10-06T04:40:54.728131+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:11.411040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.709230+0000","last_change":"2023-10-06T04:40:53.707858+0000","last_active":"2023-10-06T04:40:54.709230+0000","last_peered":"2023-10-06T04:40:54.709230+0000","last_clean":"2023-10-06T04:40:54.709230+0000","last_became_active":"2023-10-06T04:40:53.705577+0000","last_became_peered":"2023-10-06T04:40:53.705577+0000","last_unstale":"2023-10-06T04:40:54.709230+0000","last_undegraded":"2023-10-06T04:40:54.709230+0000","last_fullsized":"2023-10-06T04:40:54.709230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:27.348461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.724468+0000","last_change":"2023-10-06T04:40:54.720213+0000","last_active":"2023-10-06T04:40:54.724468+0000","last_peered":"2023-10-06T04:40:54.724468+0000","last_clean":"2023-10-06T04:40:54.724468+0000","last_became_active":"2023-10-06T04:40:54.719896+0000","last_became_peered":"2023-10-06T04:40:54.719896+0000","last_unstale":"2023-10-06T04:40:54.724468+0000","last_undegraded":"2023-10-06T04:40:54.724468+0000","last_fullsized":"2023-10-06T04:40:54.724468+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:23.454893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.700639+0000","last_change":"2023-10-06T04:40:53.706154+0000","last_active":"2023-10-06T04:40:54.700639+0000","last_peered":"2023-10-06T04:40:54.700639+0000","last_clean":"2023-10-06T04:40:54.700639+0000","last_became_active":"2023-10-06T04:40:53.705798+0000","last_became_peered":"2023-10-06T04:40:53.705798+0000","last_unstale":"2023-10-06T04:40:54.700639+0000","last_undegraded":"2023-10-06T04:40:54.700639+0000","last_fullsized":"2023-10-06T04:40:54.700639+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:28.912505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.709965+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:40:54.709965+0000","last_peered":"2023-10-06T04:40:54.709965+0000","last_clean":"2023-10-06T04:40:54.709965+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:40:54.709965+0000","last_undegraded":"2023-10-06T04:40:54.709965+0000","last_fullsized":"2023-10-06T04:40:54.709965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.733823+0000","last_change":"2023-10-06T04:40:54.732283+0000","last_active":"2023-10-06T04:40:54.733823+0000","last_peered":"2023-10-06T04:40:54.733823+0000","last_clean":"2023-10-06T04:40:54.733823+0000","last_became_active":"2023-10-06T04:40:54.731786+0000","last_became_peered":"2023-10-06T04:40:54.731786+0000","last_unstale":"2023-10-06T04:40:54.733823+0000","last_undegraded":"2023-10-06T04:40:54.733823+0000","last_fullsized":"2023-10-06T04:40:54.733823+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:51.690281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.706231+0000","last_change":"2023-10-06T04:40:53.709788+0000","last_active":"2023-10-06T04:40:54.706231+0000","last_peered":"2023-10-06T04:40:54.706231+0000","last_clean":"2023-10-06T04:40:54.706231+0000","last_became_active":"2023-10-06T04:40:53.707204+0000","last_became_peered":"2023-10-06T04:40:53.707204+0000","last_unstale":"2023-10-06T04:40:54.706231+0000","last_undegraded":"2023-10-06T04:40:54.706231+0000","last_fullsized":"2023-10-06T04:40:54.706231+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:46.019138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.690984+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:40:54.690984+0000","last_peered":"2023-10-06T04:40:54.690984+0000","last_clean":"2023-10-06T04:40:54.690984+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:40:54.690984+0000","last_undegraded":"2023-10-06T04:40:54.690984+0000","last_fullsized":"2023-10-06T04:40:54.690984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.721492+0000","last_change":"2023-10-06T04:40:54.717554+0000","last_active":"2023-10-06T04:40:54.721492+0000","last_peered":"2023-10-06T04:40:54.721492+0000","last_clean":"2023-10-06T04:40:54.721492+0000","last_became_active":"2023-10-06T04:40:54.716108+0000","last_became_peered":"2023-10-06T04:40:54.716108+0000","last_unstale":"2023-10-06T04:40:54.721492+0000","last_undegraded":"2023-10-06T04:40:54.721492+0000","last_fullsized":"2023-10-06T04:40:54.721492+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:29.049313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720404+0000","last_change":"2023-10-06T04:40:53.705169+0000","last_active":"2023-10-06T04:40:54.720404+0000","last_peered":"2023-10-06T04:40:54.720404+0000","last_clean":"2023-10-06T04:40:54.720404+0000","last_became_active":"2023-10-06T04:40:53.704751+0000","last_became_peered":"2023-10-06T04:40:53.704751+0000","last_unstale":"2023-10-06T04:40:54.720404+0000","last_undegraded":"2023-10-06T04:40:54.720404+0000","last_fullsized":"2023-10-06T04:40:54.720404+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:09.402032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.708717+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:40:54.708717+0000","last_peered":"2023-10-06T04:40:54.708717+0000","last_clean":"2023-10-06T04:40:54.708717+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:40:54.708717+0000","last_undegraded":"2023-10-06T04:40:54.708717+0000","last_fullsized":"2023-10-06T04:40:54.708717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.705317+0000","last_change":"2023-10-06T04:40:54.703057+0000","last_active":"2023-10-06T04:40:54.705317+0000","last_peered":"2023-10-06T04:40:54.705317+0000","last_clean":"2023-10-06T04:40:54.705317+0000","last_became_active":"2023-10-06T04:40:54.702741+0000","last_became_peered":"2023-10-06T04:40:54.702741+0000","last_unstale":"2023-10-06T04:40:54.705317+0000","last_undegraded":"2023-10-06T04:40:54.705317+0000","last_fullsized":"2023-10-06T04:40:54.705317+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:58:36.704002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.720914+0000","last_change":"2023-10-06T04:40:53.710210+0000","last_active":"2023-10-06T04:40:54.720914+0000","last_peered":"2023-10-06T04:40:54.720914+0000","last_clean":"2023-10-06T04:40:54.720914+0000","last_became_active":"2023-10-06T04:40:53.709942+0000","last_became_peered":"2023-10-06T04:40:53.709942+0000","last_unstale":"2023-10-06T04:40:54.720914+0000","last_undegraded":"2023-10-06T04:40:54.720914+0000","last_fullsized":"2023-10-06T04:40:54.720914+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:09.402032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.691411+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:40:54.691411+0000","last_peered":"2023-10-06T04:40:54.691411+0000","last_clean":"2023-10-06T04:40:54.691411+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:40:54.691411+0000","last_undegraded":"2023-10-06T04:40:54.691411+0000","last_fullsized":"2023-10-06T04:40:54.691411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.726619+0000","last_change":"2023-10-06T04:40:54.722140+0000","last_active":"2023-10-06T04:40:54.726619+0000","last_peered":"2023-10-06T04:40:54.726619+0000","last_clean":"2023-10-06T04:40:54.726619+0000","last_became_active":"2023-10-06T04:40:54.721798+0000","last_became_peered":"2023-10-06T04:40:54.721798+0000","last_unstale":"2023-10-06T04:40:54.726619+0000","last_undegraded":"2023-10-06T04:40:54.726619+0000","last_fullsized":"2023-10-06T04:40:54.726619+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:04.261430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.695166+0000","last_change":"2023-10-06T04:40:53.709732+0000","last_active":"2023-10-06T04:40:54.695166+0000","last_peered":"2023-10-06T04:40:54.695166+0000","last_clean":"2023-10-06T04:40:54.695166+0000","last_became_active":"2023-10-06T04:40:53.709482+0000","last_became_peered":"2023-10-06T04:40:53.709482+0000","last_unstale":"2023-10-06T04:40:54.695166+0000","last_undegraded":"2023-10-06T04:40:54.695166+0000","last_fullsized":"2023-10-06T04:40:54.695166+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:01.178950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.694790+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:40:54.694790+0000","last_peered":"2023-10-06T04:40:54.694790+0000","last_clean":"2023-10-06T04:40:54.694790+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:40:54.694790+0000","last_undegraded":"2023-10-06T04:40:54.694790+0000","last_fullsized":"2023-10-06T04:40:54.694790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.706913+0000","last_change":"2023-10-06T04:40:54.703711+0000","last_active":"2023-10-06T04:40:54.706913+0000","last_peered":"2023-10-06T04:40:54.706913+0000","last_clean":"2023-10-06T04:40:54.706913+0000","last_became_active":"2023-10-06T04:40:54.703133+0000","last_became_peered":"2023-10-06T04:40:54.703133+0000","last_unstale":"2023-10-06T04:40:54.706913+0000","last_undegraded":"2023-10-06T04:40:54.706913+0000","last_fullsized":"2023-10-06T04:40:54.706913+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:19.292699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.723470+0000","last_change":"2023-10-06T04:40:53.707893+0000","last_active":"2023-10-06T04:40:54.723470+0000","last_peered":"2023-10-06T04:40:54.723470+0000","last_clean":"2023-10-06T04:40:54.723470+0000","last_became_active":"2023-10-06T04:40:53.707559+0000","last_became_peered":"2023-10-06T04:40:53.707559+0000","last_unstale":"2023-10-06T04:40:54.723470+0000","last_undegraded":"2023-10-06T04:40:54.723470+0000","last_fullsized":"2023-10-06T04:40:54.723470+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:38.188504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.693323+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:40:54.693323+0000","last_peered":"2023-10-06T04:40:54.693323+0000","last_clean":"2023-10-06T04:40:54.693323+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:40:54.693323+0000","last_undegraded":"2023-10-06T04:40:54.693323+0000","last_fullsized":"2023-10-06T04:40:54.693323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.728081+0000","last_change":"2023-10-06T04:40:54.725275+0000","last_active":"2023-10-06T04:40:54.728081+0000","last_peered":"2023-10-06T04:40:54.728081+0000","last_clean":"2023-10-06T04:40:54.728081+0000","last_became_active":"2023-10-06T04:40:54.725072+0000","last_became_peered":"2023-10-06T04:40:54.725072+0000","last_unstale":"2023-10-06T04:40:54.728081+0000","last_undegraded":"2023-10-06T04:40:54.728081+0000","last_fullsized":"2023-10-06T04:40:54.728081+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:53.877231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.690966+0000","last_change":"2023-10-06T04:40:53.696702+0000","last_active":"2023-10-06T04:40:54.690966+0000","last_peered":"2023-10-06T04:40:54.690966+0000","last_clean":"2023-10-06T04:40:54.690966+0000","last_became_active":"2023-10-06T04:40:53.696317+0000","last_became_peered":"2023-10-06T04:40:53.696317+0000","last_unstale":"2023-10-06T04:40:54.690966+0000","last_undegraded":"2023-10-06T04:40:54.690966+0000","last_fullsized":"2023-10-06T04:40:54.690966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:07.444907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.705630+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:40:54.705630+0000","last_peered":"2023-10-06T04:40:54.705630+0000","last_clean":"2023-10-06T04:40:54.705630+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:40:54.705630+0000","last_undegraded":"2023-10-06T04:40:54.705630+0000","last_fullsized":"2023-10-06T04:40:54.705630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.724460+0000","last_change":"2023-10-06T04:40:54.720853+0000","last_active":"2023-10-06T04:40:54.724460+0000","last_peered":"2023-10-06T04:40:54.724460+0000","last_clean":"2023-10-06T04:40:54.724460+0000","last_became_active":"2023-10-06T04:40:54.720489+0000","last_became_peered":"2023-10-06T04:40:54.720489+0000","last_unstale":"2023-10-06T04:40:54.724460+0000","last_undegraded":"2023-10-06T04:40:54.724460+0000","last_fullsized":"2023-10-06T04:40:54.724460+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:53.669019+0000","last_clean_scrub_stamp":"2023-10-06T04:40:53.669019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:58:10.619734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.709449+0000","last_change":"2023-10-06T04:40:53.712992+0000","last_active":"2023-10-06T04:40:54.709449+0000","last_peered":"2023-10-06T04:40:54.709449+0000","last_clean":"2023-10-06T04:40:54.709449+0000","last_became_active":"2023-10-06T04:40:53.712773+0000","last_became_peered":"2023-10-06T04:40:53.712773+0000","last_unstale":"2023-10-06T04:40:54.709449+0000","last_undegraded":"2023-10-06T04:40:54.709449+0000","last_fullsized":"2023-10-06T04:40:54.709449+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:52.664329+0000","last_clean_scrub_stamp":"2023-10-06T04:40:52.664329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:28.977388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.694781+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:40:54.694781+0000","last_peered":"2023-10-06T04:40:54.694781+0000","last_clean":"2023-10-06T04:40:54.694781+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:40:54.694781+0000","last_undegraded":"2023-10-06T04:40:54.694781+0000","last_fullsized":"2023-10-06T04:40:54.694781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T04:40:54.705723+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:40:54.705723+0000","last_peered":"2023-10-06T04:40:54.705723+0000","last_clean":"2023-10-06T04:40:54.705723+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:40:54.705723+0000","last_undegraded":"2023-10-06T04:40:54.705723+0000","last_fullsized":"2023-10-06T04:40:54.705723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":655360,"data_stored":298520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.66300000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.91500000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":890922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.92500000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.746},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.0780000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.002}]},{"osd":5,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.329},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.2889999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.391}]},{"osd":7,"last update":"Fri Oct 6 04:40:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.194},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.3560000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1249280,"data_stored":888992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":3.347,"5min":3.347,"15min":3.347},"last":1.196},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.88600000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.98999999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.745},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.1279999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.1099999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.1679999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.244},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.218}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":298464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.92300000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":1.0449999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.131},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:40:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.006},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.109}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.86599999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.1990000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.085}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":299088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.77000000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.0309999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.0620000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.296}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.0840000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.171}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":300000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.1339999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.1899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.0389999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.006},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2310000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.258},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.103}]},{"osd":7,"last update":"Fri Oct 6 04:39:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.3080000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":298520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.1759999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.423},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.905}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.758},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.363}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.538}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.653},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.579}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":298554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":1.028},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.2110000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.72099999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.872}]},{"osd":4,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.054}]},{"osd":5,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.091}]},{"osd":6,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.181}]},{"osd":7,"last update":"Fri Oct 6 04:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.25},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.28}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:41:02.506 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:41:02.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T04:41:02.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.624+0000 7fbc8f59e700 1 Processor -- start 2023-10-06T04:41:02.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.624+0000 7fbc8f59e700 1 -- start start 2023-10-06T04:41:02.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc90158f70 0x7fbc90159340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc9006e0f0 0x7fbc900adde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbc9014f1e0 0x7fbc9014f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9006a620 con 0x7fbc9006e0f0 2023-10-06T04:41:02.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9006d670 con 0x7fbc9014f1e0 2023-10-06T04:41:02.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc900ae320 con 0x7fbc90158f70 2023-10-06T04:41:02.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8dd9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc9006e0f0 0x7fbc900adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8dd9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc9006e0f0 0x7fbc900adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56588/0 (socket says 172.21.15.37:56588) 2023-10-06T04:41:02.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8dd9b700 1 -- 172.21.15.37:0/4015035521 learned_addr learned my addr 172.21.15.37:0/4015035521 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:02.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8ed9d700 1 --2- 172.21.15.37:0/4015035521 >> v2:172.21.15.83:3300/0 conn(0x7fbc9014f1e0 0x7fbc9014f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8e59c700 1 --2- 172.21.15.37:0/4015035521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc90158f70 0x7fbc90159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8ed9d700 1 -- 172.21.15.37:0/4015035521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc90158f70 msgr2=0x7fbc90159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:02.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8ed9d700 1 --2- 172.21.15.37:0/4015035521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc90158f70 0x7fbc90159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8ed9d700 1 -- 172.21.15.37:0/4015035521 >> v2:172.21.15.37:3300/0 conn(0x7fbc9006e0f0 msgr2=0x7fbc900adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:02.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8ed9d700 1 --2- 172.21.15.37:0/4015035521 >> v2:172.21.15.37:3300/0 conn(0x7fbc9006e0f0 0x7fbc900adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8ed9d700 1 -- 172.21.15.37:0/4015035521 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9006a340 con 0x7fbc9014f1e0 2023-10-06T04:41:02.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8dd9b700 1 --2- 172.21.15.37:0/4015035521 >> v2:172.21.15.37:3300/0 conn(0x7fbc9006e0f0 0x7fbc900adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:02.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8ed9d700 1 --2- 172.21.15.37:0/4015035521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc9014f1e0 0x7fbc9014f620 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbc900cc860 tx=0x7fbc88009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4255a192fe9ddd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:02.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8d59a700 1 -- 172.21.15.37:0/4015035521 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800e070 con 0x7fbc9014f1e0 2023-10-06T04:41:02.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8d59a700 1 -- 172.21.15.37:0/4015035521 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800ba70 con 0x7fbc9014f1e0 2023-10-06T04:41:02.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8d59a700 1 -- 172.21.15.37:0/4015035521 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800be30 con 0x7fbc9014f1e0 2023-10-06T04:41:02.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 -- 172.21.15.37:0/4015035521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc9014f1e0 msgr2=0x7fbc9014f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:02.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 --2- 172.21.15.37:0/4015035521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc9014f1e0 0x7fbc9014f620 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbc900cc860 tx=0x7fbc88009780 comp rx=0 tx=0).stop 2023-10-06T04:41:02.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 -- 172.21.15.37:0/4015035521 shutdown_connections 2023-10-06T04:41:02.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 --2- 172.21.15.37:0/4015035521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc9014f1e0 0x7fbc9014f620 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 --2- 172.21.15.37:0/4015035521 >> v2:172.21.15.37:3300/0 conn(0x7fbc9006e0f0 0x7fbc900adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 --2- 172.21.15.37:0/4015035521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc90158f70 0x7fbc90159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 -- 172.21.15.37:0/4015035521 >> 172.21.15.37:0/4015035521 conn(0x7fbc90067cf0 msgr2=0x7fbc900680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:02.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 -- 172.21.15.37:0/4015035521 shutdown_connections 2023-10-06T04:41:02.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.628+0000 7fbc8f59e700 1 -- 172.21.15.37:0/4015035521 wait complete. 2023-10-06T04:41:02.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8f59e700 1 Processor -- start 2023-10-06T04:41:02.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8f59e700 1 -- start start 2023-10-06T04:41:02.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9006e0f0 0x7fbc90150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc9014f1e0 0x7fbc900c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc90158f70 0x7fbc901693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8f59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9014cdc0 con 0x7fbc9006e0f0 2023-10-06T04:41:02.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8f59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc901502f0 con 0x7fbc9014f1e0 2023-10-06T04:41:02.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc90169930 con 0x7fbc90158f70 2023-10-06T04:41:02.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9006e0f0 0x7fbc90150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9006e0f0 0x7fbc90150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56602/0 (socket says 172.21.15.37:56602) 2023-10-06T04:41:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8e59c700 1 -- 172.21.15.37:0/2583191182 learned_addr learned my addr 172.21.15.37:0/2583191182 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8dd9b700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc9014f1e0 0x7fbc900c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8ed9d700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc90158f70 0x7fbc901693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8e59c700 1 -- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc90158f70 msgr2=0x7fbc901693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:02.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8e59c700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc90158f70 0x7fbc901693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8e59c700 1 -- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc9014f1e0 msgr2=0x7fbc900c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:02.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8e59c700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc9014f1e0 0x7fbc900c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.632+0000 7fbc8e59c700 1 -- 172.21.15.37:0/2583191182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc800094f0 con 0x7fbc9006e0f0 2023-10-06T04:41:02.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.636+0000 7fbc8e59c700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9006e0f0 0x7fbc90150780 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800e960 tx=0x7fbc780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:02.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.636+0000 7fbc867fc700 1 -- 172.21.15.37:0/2583191182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc78013680 con 0x7fbc9006e0f0 2023-10-06T04:41:02.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.636+0000 7fbc867fc700 1 -- 172.21.15.37:0/2583191182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc780137e0 con 0x7fbc9006e0f0 2023-10-06T04:41:02.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.636+0000 7fbc8f59e700 1 -- 172.21.15.37:0/2583191182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc88009a20 con 0x7fbc9006e0f0 2023-10-06T04:41:02.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.636+0000 7fbc8f59e700 1 -- 172.21.15.37:0/2583191182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9014f9c0 con 0x7fbc9006e0f0 2023-10-06T04:41:02.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.636+0000 7fbc867fc700 1 -- 172.21.15.37:0/2583191182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc78013b80 con 0x7fbc9006e0f0 2023-10-06T04:41:02.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.636+0000 7fbc8f59e700 1 -- 172.21.15.37:0/2583191182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9004be00 con 0x7fbc9006e0f0 2023-10-06T04:41:02.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.636+0000 7fbc867fc700 1 -- 172.21.15.37:0/2583191182 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbc780123d0 con 0x7fbc9006e0f0 2023-10-06T04:41:02.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.640+0000 7fbc867fc700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbc70060550 0x7fbc70062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:02.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.640+0000 7fbc867fc700 1 -- 172.21.15.37:0/2583191182 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbc7807cb00 con 0x7fbc9006e0f0 2023-10-06T04:41:02.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.640+0000 7fbc8dd9b700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbc70060550 0x7fbc70062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:02.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.640+0000 7fbc8dd9b700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbc70060550 0x7fbc70062a00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbc90158570 tx=0x7fbc80009250 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:02.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.644+0000 7fbc867fc700 1 -- 172.21.15.37:0/2583191182 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbc7804ce50 con 0x7fbc9006e0f0 2023-10-06T04:41:02.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.868+0000 7fbc8f59e700 1 -- 172.21.15.37:0/2583191182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbc9006d910 con 0x7fbc9006e0f0 2023-10-06T04:41:02.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.876+0000 7fbc867fc700 1 -- 172.21.15.37:0/2583191182 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbc780210e0 con 0x7fbc9006e0f0 2023-10-06T04:41:02.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.880+0000 7fbc8f59e700 1 -- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbc70060550 msgr2=0x7fbc70062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:02.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.880+0000 7fbc8f59e700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbc70060550 0x7fbc70062a00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbc90158570 tx=0x7fbc80009250 comp rx=0 tx=0).stop 2023-10-06T04:41:02.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.880+0000 7fbc8f59e700 1 -- 172.21.15.37:0/2583191182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9006e0f0 msgr2=0x7fbc90150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:02.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.880+0000 7fbc8f59e700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9006e0f0 0x7fbc90150780 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800e960 tx=0x7fbc780091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.880+0000 7fbc8f59e700 1 -- 172.21.15.37:0/2583191182 shutdown_connections 2023-10-06T04:41:02.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.880+0000 7fbc8f59e700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fbc70060550 0x7fbc70062a00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.880+0000 7fbc8f59e700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc9014f1e0 0x7fbc900c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.880+0000 7fbc8f59e700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc90158f70 0x7fbc901693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.880+0000 7fbc8f59e700 1 --2- 172.21.15.37:0/2583191182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9006e0f0 0x7fbc90150780 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:02.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.880+0000 7fbc8f59e700 1 -- 172.21.15.37:0/2583191182 >> 172.21.15.37:0/2583191182 conn(0x7fbc90067cf0 msgr2=0x7fbc90157060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:02.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.880+0000 7fbc8f59e700 1 -- 172.21.15.37:0/2583191182 shutdown_connections 2023-10-06T04:41:02.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:02.880+0000 7fbc8f59e700 1 -- 172.21.15.37:0/2583191182 wait complete. 2023-10-06T04:41:02.886 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-10-06T04:41:02.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:41:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 Processor -- start 2023-10-06T04:41:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 -- start start 2023-10-06T04:41:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64f41587d0 0x7f64f415d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f4068400 0x7f64f40ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f4159040 con 0x7f64f4158ba0 2023-10-06T04:41:03.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f415d6d0 con 0x7f64f41587d0 2023-10-06T04:41:03.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40af7f0 con 0x7f64f4068400 2023-10-06T04:41:03.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f2d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64f41587d0 0x7f64f415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f2d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64f41587d0 0x7f64f415d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56604/0 (socket says 172.21.15.37:56604) 2023-10-06T04:41:03.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f2d9d700 1 -- 172.21.15.37:0/3813512126 learned_addr learned my addr 172.21.15.37:0/3813512126 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:03.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f2d9d700 1 -- 172.21.15.37:0/3813512126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f4068400 msgr2=0x7f64f40ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f359e700 1 --2- 172.21.15.37:0/3813512126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f4068400 0x7f64f40ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f2d9d700 1 --2- 172.21.15.37:0/3813512126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f4068400 0x7f64f40ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f2d9d700 1 -- 172.21.15.37:0/3813512126 >> v1:172.21.15.83:6789/0 conn(0x7f64f4158ba0 legacy=0x7f64f4067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f2d9d700 1 -- 172.21.15.37:0/3813512126 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f40afad0 con 0x7f64f41587d0 2023-10-06T04:41:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f359e700 1 --2- 172.21.15.37:0/3813512126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f4068400 0x7f64f40ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:41:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f2d9d700 1 --2- 172.21.15.37:0/3813512126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f41587d0 0x7f64f415d190 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0099b0 tx=0x7f64dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb3c9331615a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f1d9b700 1 -- 172.21.15.37:0/3813512126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc00b820 con 0x7f64f41587d0 2023-10-06T04:41:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f1d9b700 1 -- 172.21.15.37:0/3813512126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc00b980 con 0x7f64f41587d0 2023-10-06T04:41:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f1d9b700 1 -- 172.21.15.37:0/3813512126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc00bd20 con 0x7f64f41587d0 2023-10-06T04:41:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 -- 172.21.15.37:0/3813512126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f41587d0 msgr2=0x7f64f415d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 --2- 172.21.15.37:0/3813512126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f41587d0 0x7f64f415d190 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0099b0 tx=0x7f64dc009250 comp rx=0 tx=0).stop 2023-10-06T04:41:03.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 -- 172.21.15.37:0/3813512126 shutdown_connections 2023-10-06T04:41:03.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 --2- 172.21.15.37:0/3813512126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f4068400 0x7f64f40ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 --2- 172.21.15.37:0/3813512126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f41587d0 0x7f64f415d190 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 -- 172.21.15.37:0/3813512126 >> 172.21.15.37:0/3813512126 conn(0x7f64f40cc5f0 msgr2=0x7f64f40cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:03.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 -- 172.21.15.37:0/3813512126 shutdown_connections 2023-10-06T04:41:03.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.000+0000 7f64f88b9700 1 -- 172.21.15.37:0/3813512126 wait complete. 2023-10-06T04:41:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f88b9700 1 Processor -- start 2023-10-06T04:41:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f88b9700 1 -- start start 2023-10-06T04:41:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f88b9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f4068400 0x7f64f4169c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f88b9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64f4158ba0 0x7f64f40c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f88b9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f41551f0 0x7f64f40caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f88b9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40c94c0 con 0x7f64f4068400 2023-10-06T04:41:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f88b9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40c4930 con 0x7f64f4158ba0 2023-10-06T04:41:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f88b9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40c62b0 con 0x7f64f41551f0 2023-10-06T04:41:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f4068400 0x7f64f4169c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f4068400 0x7f64f4169c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56620/0 (socket says 172.21.15.37:56620) 2023-10-06T04:41:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f2d9d700 1 -- 172.21.15.37:0/2897465708 learned_addr learned my addr 172.21.15.37:0/2897465708 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f359e700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f41551f0 0x7f64f40caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f259c700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64f4158ba0 0x7f64f40c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f2d9d700 1 -- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f41551f0 msgr2=0x7f64f40caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f2d9d700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f41551f0 0x7f64f40caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f2d9d700 1 -- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64f4158ba0 msgr2=0x7f64f40c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f2d9d700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64f4158ba0 0x7f64f40c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f2d9d700 1 -- 172.21.15.37:0/2897465708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc0094f0 con 0x7f64f4068400 2023-10-06T04:41:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f359e700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f41551f0 0x7f64f40caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f2d9d700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f4068400 0x7f64f4169c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009290 tx=0x7f64dc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64eaffd700 1 -- 172.21.15.37:0/2897465708 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc011b40 con 0x7f64f4068400 2023-10-06T04:41:03.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64eaffd700 1 -- 172.21.15.37:0/2897465708 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc020070 con 0x7f64f4068400 2023-10-06T04:41:03.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f88b9700 1 -- 172.21.15.37:0/2897465708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f40c9220 con 0x7f64f4068400 2023-10-06T04:41:03.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64eaffd700 1 -- 172.21.15.37:0/2897465708 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc01b450 con 0x7f64f4068400 2023-10-06T04:41:03.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.004+0000 7f64f88b9700 1 -- 172.21.15.37:0/2897465708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f40c6830 con 0x7f64f4068400 2023-10-06T04:41:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.008+0000 7f64f88b9700 1 -- 172.21.15.37:0/2897465708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f40708a0 con 0x7f64f4068400 2023-10-06T04:41:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.008+0000 7f64eaffd700 1 -- 172.21.15.37:0/2897465708 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f64dc022030 con 0x7f64f4068400 2023-10-06T04:41:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.008+0000 7f64eaffd700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f64d8060550 0x7f64d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.008+0000 7f64eaffd700 1 -- 172.21.15.37:0/2897465708 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f64dc07e0f0 con 0x7f64f4068400 2023-10-06T04:41:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.008+0000 7f64f259c700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f64d8060550 0x7f64d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.008+0000 7f64f259c700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f64d8060550 0x7f64d8062a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f64ec007fd0 tx=0x7f64ec0026a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.016+0000 7f64eaffd700 1 -- 172.21.15.37:0/2897465708 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f64dc04e3a0 con 0x7f64f4068400 2023-10-06T04:41:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.208+0000 7f64f88b9700 1 -- 172.21.15.37:0/2897465708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64f40c4700 con 0x7f64f4068400 2023-10-06T04:41:03.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64eaffd700 1 -- 172.21.15.37:0/2897465708 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f64dc0519c0 con 0x7f64f4068400 2023-10-06T04:41:03.216 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:03.216 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3641721079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":3641721079},{"type":"v1","addr":"172.21.15.83:6836","nonce":3641721079}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/204975667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":204975667},{"type":"v1","addr":"172.21.15.83:6837","nonce":204975667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4106618910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4106618910},{"type":"v1","addr":"172.21.15.37:6833","nonce":4106618910}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:54.053558+0000","modified":"2023-10-06T04:40:56.731365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5249":{"gid":5249,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3410822358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3410822358},{"type":"v1","addr":"172.21.15.37:6835","nonce":3410822358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:41:03.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64f88b9700 1 -- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f64d8060550 msgr2=0x7f64d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64f88b9700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f64d8060550 0x7f64d8062a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f64ec007fd0 tx=0x7f64ec0026a0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64f88b9700 1 -- 172.21.15.37:0/2897465708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f4068400 msgr2=0x7f64f4169c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64f88b9700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f4068400 0x7f64f4169c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009290 tx=0x7f64dc016000 comp rx=0 tx=0).stop 2023-10-06T04:41:03.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64f88b9700 1 -- 172.21.15.37:0/2897465708 shutdown_connections 2023-10-06T04:41:03.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64f88b9700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f64d8060550 0x7f64d8062a00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64f88b9700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64f4158ba0 0x7f64f40c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64f88b9700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f41551f0 0x7f64f40caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64f88b9700 1 --2- 172.21.15.37:0/2897465708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f4068400 0x7f64f4169c40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64f88b9700 1 -- 172.21.15.37:0/2897465708 >> 172.21.15.37:0/2897465708 conn(0x7f64f40cc5f0 msgr2=0x7f64f4155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:03.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64f88b9700 1 -- 172.21.15.37:0/2897465708 shutdown_connections 2023-10-06T04:41:03.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.212+0000 7f64f88b9700 1 -- 172.21.15.37:0/2897465708 wait complete. 2023-10-06T04:41:03.220 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2023-10-06T04:41:03.635 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:40:54.053558+0000', 'modified': '2023-10-06T04:40:56.731365+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5249}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5249': {'gid': 5249, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/3410822358', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 3410822358}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 3410822358}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:41:03.635 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:41:03.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T04:41:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.748+0000 7f3c69bbf700 1 Processor -- start 2023-10-06T04:41:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.748+0000 7f3c69bbf700 1 -- start start 2023-10-06T04:41:03.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3c640cc2e0 0x7f3c6406e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c641550a0 0x7f3c64155520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c64156a00 con 0x7f3c64154cd0 2023-10-06T04:41:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c64155df0 con 0x7f3c641550a0 2023-10-06T04:41:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c641560d0 con 0x7f3c640cc2e0 2023-10-06T04:41:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c63fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c641550a0 0x7f3c64155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c63fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c641550a0 0x7f3c64155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56632/0 (socket says 172.21.15.37:56632) 2023-10-06T04:41:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c63fff700 1 -- 172.21.15.37:0/2287217761 learned_addr learned my addr 172.21.15.37:0/2287217761 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c62ffd700 1 --2- 172.21.15.37:0/2287217761 >> v2:172.21.15.83:3300/0 conn(0x7f3c640cc2e0 0x7f3c6406e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c63fff700 1 -- 172.21.15.37:0/2287217761 >> v2:172.21.15.83:3300/0 conn(0x7f3c640cc2e0 msgr2=0x7f3c6406e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c63fff700 1 --2- 172.21.15.37:0/2287217761 >> v2:172.21.15.83:3300/0 conn(0x7f3c640cc2e0 0x7f3c6406e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c63fff700 1 -- 172.21.15.37:0/2287217761 >> v1:172.21.15.83:6789/0 conn(0x7f3c64154cd0 legacy=0x7f3c640cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c63fff700 1 -- 172.21.15.37:0/2287217761 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c641563b0 con 0x7f3c641550a0 2023-10-06T04:41:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c63fff700 1 --2- 172.21.15.37:0/2287217761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c641550a0 0x7f3c64155520 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3c6406dd40 tx=0x7f3c5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59a0f01d439240c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c627fc700 1 -- 172.21.15.37:0/2287217761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c009e70 con 0x7f3c641550a0 2023-10-06T04:41:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c627fc700 1 -- 172.21.15.37:0/2287217761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c00b860 con 0x7f3c641550a0 2023-10-06T04:41:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c627fc700 1 -- 172.21.15.37:0/2287217761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c00bc00 con 0x7f3c641550a0 2023-10-06T04:41:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2287217761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c641550a0 msgr2=0x7f3c64155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 --2- 172.21.15.37:0/2287217761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c641550a0 0x7f3c64155520 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3c6406dd40 tx=0x7f3c5c009250 comp rx=0 tx=0).stop 2023-10-06T04:41:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2287217761 shutdown_connections 2023-10-06T04:41:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 --2- 172.21.15.37:0/2287217761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c641550a0 0x7f3c64155520 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 --2- 172.21.15.37:0/2287217761 >> v2:172.21.15.83:3300/0 conn(0x7f3c640cc2e0 0x7f3c6406e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2287217761 >> 172.21.15.37:0/2287217761 conn(0x7f3c640667b0 msgr2=0x7f3c64066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2287217761 shutdown_connections 2023-10-06T04:41:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.752+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2287217761 wait complete. 2023-10-06T04:41:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c69bbf700 1 Processor -- start 2023-10-06T04:41:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c69bbf700 1 -- start start 2023-10-06T04:41:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c69bbf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c640cc2e0 0x7f3c64141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c69bbf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c64154cd0 0x7f3c6414d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c69bbf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c641550a0 0x7f3c64145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c69bbf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6414da50 con 0x7f3c641550a0 2023-10-06T04:41:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c69bbf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c64142520 con 0x7f3c64154cd0 2023-10-06T04:41:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c69bbf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c64142800 con 0x7f3c640cc2e0 2023-10-06T04:41:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c641550a0 0x7f3c64145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c641550a0 0x7f3c64145d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56634/0 (socket says 172.21.15.37:56634) 2023-10-06T04:41:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c63fff700 1 -- 172.21.15.37:0/2069726575 learned_addr learned my addr 172.21.15.37:0/2069726575 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c62ffd700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c64154cd0 0x7f3c6414d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c637fe700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c640cc2e0 0x7f3c64141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c63fff700 1 -- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c640cc2e0 msgr2=0x7f3c64141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c63fff700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c640cc2e0 0x7f3c64141e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c63fff700 1 -- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c64154cd0 msgr2=0x7f3c6414d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c63fff700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c64154cd0 0x7f3c6414d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.756+0000 7f3c63fff700 1 -- 172.21.15.37:0/2069726575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c0094f0 con 0x7f3c641550a0 2023-10-06T04:41:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.760+0000 7f3c62ffd700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c64154cd0 0x7f3c6414d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.760+0000 7f3c637fe700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c640cc2e0 0x7f3c64141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.760+0000 7f3c63fff700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c641550a0 0x7f3c64145d90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009290 tx=0x7f3c5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.760+0000 7f3c5b7fe700 1 -- 172.21.15.37:0/2069726575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c020070 con 0x7f3c641550a0 2023-10-06T04:41:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.760+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2069726575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c64142ae0 con 0x7f3c641550a0 2023-10-06T04:41:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.760+0000 7f3c5b7fe700 1 -- 172.21.15.37:0/2069726575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c011630 con 0x7f3c641550a0 2023-10-06T04:41:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.760+0000 7f3c5b7fe700 1 -- 172.21.15.37:0/2069726575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c0119f0 con 0x7f3c641550a0 2023-10-06T04:41:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.760+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2069726575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c641430a0 con 0x7f3c641550a0 2023-10-06T04:41:03.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.760+0000 7f3c5b7fe700 1 -- 172.21.15.37:0/2069726575 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3c5c02d3b0 con 0x7f3c641550a0 2023-10-06T04:41:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c5b7fe700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3c44060550 0x7f3c44062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c5b7fe700 1 -- 172.21.15.37:0/2069726575 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3c5c07fee0 con 0x7f3c641550a0 2023-10-06T04:41:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c637fe700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3c44060550 0x7f3c44062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c637fe700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3c44060550 0x7f3c44062a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c007fd0 tx=0x7f3c4c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c6be68740 1 Processor -- start 2023-10-06T04:41:03.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c6be68740 1 -- start start 2023-10-06T04:41:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c6be68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c6be68740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931710 0x1baeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c6be68740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x197c790 0x1baf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c6be68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x1adcf30 con 0x1931ae0 2023-10-06T04:41:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c6be68740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ad8ed0 con 0x197c790 2023-10-06T04:41:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c6be68740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a9f0b0 con 0x1931710 2023-10-06T04:41:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c637fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c637fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56640/0 (socket says 172.21.15.37:56640) 2023-10-06T04:41:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c637fe700 1 -- 172.21.15.37:0/3976844824 learned_addr learned my addr 172.21.15.37:0/3976844824 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c63fff700 1 --2- 172.21.15.37:0/3976844824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x197c790 0x1baf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c62ffd700 1 --2- 172.21.15.37:0/3976844824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931710 0x1baeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c637fe700 1 -- 172.21.15.37:0/3976844824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931710 msgr2=0x1baeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c637fe700 1 --2- 172.21.15.37:0/3976844824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931710 0x1baeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c637fe700 1 -- 172.21.15.37:0/3976844824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x197c790 msgr2=0x1baf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c637fe700 1 --2- 172.21.15.37:0/3976844824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x197c790 0x1baf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c637fe700 1 -- 172.21.15.37:0/3976844824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x197d9e0 con 0x1931ae0 2023-10-06T04:41:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.764+0000 7f3c62ffd700 1 --2- 172.21.15.37:0/3976844824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931710 0x1baeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c637fe700 1 --2- 172.21.15.37:0/3976844824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bae630 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00e980 tx=0x7f3c4c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700037ec7cafeafe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c58ff9700 1 -- 172.21.15.37:0/3976844824 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0155f0 con 0x1931ae0 2023-10-06T04:41:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c58ff9700 1 -- 172.21.15.37:0/3976844824 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c015750 con 0x1931ae0 2023-10-06T04:41:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c58ff9700 1 -- 172.21.15.37:0/3976844824 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c015ad0 con 0x1931ae0 2023-10-06T04:41:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 -- 172.21.15.37:0/3976844824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 msgr2=0x1bae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 --2- 172.21.15.37:0/3976844824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bae630 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00e980 tx=0x7f3c4c013000 comp rx=0 tx=0).stop 2023-10-06T04:41:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 -- 172.21.15.37:0/3976844824 shutdown_connections 2023-10-06T04:41:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 --2- 172.21.15.37:0/3976844824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x197c790 0x1baf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 --2- 172.21.15.37:0/3976844824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931710 0x1baeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 --2- 172.21.15.37:0/3976844824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bae630 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 -- 172.21.15.37:0/3976844824 >> 172.21.15.37:0/3976844824 conn(0x1931eb0 msgr2=0x1b6b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 -- 172.21.15.37:0/3976844824 shutdown_connections 2023-10-06T04:41:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 -- 172.21.15.37:0/3976844824 wait complete. 2023-10-06T04:41:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 -- start start 2023-10-06T04:41:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 Processor -- start 2023-10-06T04:41:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931710 0x1bb2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bb3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x197c790 0x1b68c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a9ed50 con 0x1931ae0 2023-10-06T04:41:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.768+0000 7f3c6be68740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a77970 con 0x197c790 2023-10-06T04:41:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c6be68740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a15430 con 0x1931710 2023-10-06T04:41:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c6be68740 10 client.0 _ll_register_callbacks cb 0x1a7bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:41:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c62ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bb3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c637fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931710 0x1bb2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x197c790 0x1b68c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c637fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931710 0x1bb2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:42576/0 (socket says 172.21.15.37:42576) 2023-10-06T04:41:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c637fe700 1 -- 172.21.15.37:0/1102362703 learned_addr learned my addr 172.21.15.37:0/1102362703 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c62ffd700 1 -- 172.21.15.37:0/1102362703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931710 msgr2=0x1bb2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c62ffd700 1 --2- 172.21.15.37:0/1102362703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931710 0x1bb2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c62ffd700 1 -- 172.21.15.37:0/1102362703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x197c790 msgr2=0x1b68c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c62ffd700 1 --2- 172.21.15.37:0/1102362703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x197c790 0x1b68c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c62ffd700 1 -- 172.21.15.37:0/1102362703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c00f040 con 0x1931ae0 2023-10-06T04:41:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c63fff700 1 --2- 172.21.15.37:0/1102362703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x197c790 0x1b68c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:03.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c62ffd700 1 --2- 172.21.15.37:0/1102362703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bb3180 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3c64143b90 tx=0x7f3c5400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacec26bcd444407 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:41:03.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c41ffb700 1 -- 172.21.15.37:0/1102362703 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400e040 con 0x1931ae0 2023-10-06T04:41:03.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c6be68740 1 -- 172.21.15.37:0/1102362703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a77cc0 con 0x1931ae0 2023-10-06T04:41:03.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c41ffb700 1 -- 172.21.15.37:0/1102362703 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3c54013ba0 con 0x1931ae0 2023-10-06T04:41:03.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c41ffb700 1 -- 172.21.15.37:0/1102362703 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c54017430 con 0x1931ae0 2023-10-06T04:41:03.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c6be68740 10 client.5757 fetch_fsmap learned FSMap version 26 2023-10-06T04:41:03.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c6be68740 1 -- 172.21.15.37:0/1102362703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x1aa7370 con 0x1931ae0 2023-10-06T04:41:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c41ffb700 1 -- 172.21.15.37:0/1102362703 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a77cc0 con 0x1931ae0 2023-10-06T04:41:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c41ffb700 1 -- 172.21.15.37:0/1102362703 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 26) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3c54017590 con 0x1931ae0 2023-10-06T04:41:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c6be68740 10 client.5757 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T04:41:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c6be68740 10 client.5757 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:41:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c6be68740 20 client.5757 populate_metadata read hostname 'smithi037' 2023-10-06T04:41:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c6be68740 1 --2- 172.21.15.37:0/1102362703 >> [v2:172.21.15.37:6834/3410822358,v1:172.21.15.37:6835/3410822358] conn(0x1b6a1f0 0x1bbdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c6be68740 4 client.5757 mds_command: new command op to 5249 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:41:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c6be68740 1 -- 172.21.15.37:0/1102362703 --> [v2:172.21.15.37:6834/3410822358,v1:172.21.15.37:6835/3410822358] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a7b3e0 con 0x1b6a1f0 2023-10-06T04:41:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.772+0000 7f3c637fe700 1 --2- 172.21.15.37:0/1102362703 >> [v2:172.21.15.37:6834/3410822358,v1:172.21.15.37:6835/3410822358] conn(0x1b6a1f0 0x1bbdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c41ffb700 10 client.5757 ms_handle_connect on v2:172.21.15.37:6834/3410822358 2023-10-06T04:41:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c637fe700 1 --2- 172.21.15.37:0/1102362703 >> [v2:172.21.15.37:6834/3410822358,v1:172.21.15.37:6835/3410822358] conn(0x1b6a1f0 0x1bbdde0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=410274d70c81146e server_cookie=f95135a01fee73c5 in_seq=0 out_seq=0 2023-10-06T04:41:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c41ffb700 1 -- 172.21.15.37:0/1102362703 <== mds.0 v2:172.21.15.37:6834/3410822358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1a7b3e0 con 0x1b6a1f0 2023-10-06T04:41:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c41ffb700 10 client.5757 handle_command_reply: tid=0 2023-10-06T04:41:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c6be68740 1 client.5757 shutdown 2023-10-06T04:41:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c6be68740 1 -- 172.21.15.37:0/1102362703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 msgr2=0x1bb3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c6be68740 1 --2- 172.21.15.37:0/1102362703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bb3180 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3c64143b90 tx=0x7f3c5400b040 comp rx=0 tx=0).stop 2023-10-06T04:41:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c6be68740 1 -- 172.21.15.37:0/1102362703 shutdown_connections 2023-10-06T04:41:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c6be68740 1 --2- 172.21.15.37:0/1102362703 >> [v2:172.21.15.37:6834/3410822358,v1:172.21.15.37:6835/3410822358] conn(0x1b6a1f0 0x1bbdde0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c6be68740 1 --2- 172.21.15.37:0/1102362703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x197c790 0x1b68c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c41ffb700 0 client.5757 ms_handle_reset on v2:172.21.15.37:6834/3410822358 2023-10-06T04:41:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c6be68740 1 --2- 172.21.15.37:0/1102362703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bb3180 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c6be68740 1 --2- 172.21.15.37:0/1102362703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931710 0x1bb2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c6be68740 1 -- 172.21.15.37:0/1102362703 >> 172.21.15.37:0/1102362703 conn(0x1931eb0 msgr2=0x1b921e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c6be68740 1 -- 172.21.15.37:0/1102362703 shutdown_connections 2023-10-06T04:41:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c6be68740 1 -- 172.21.15.37:0/1102362703 wait complete. 2023-10-06T04:41:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.776+0000 7f3c6be68740 20 client.5757 trim_cache size 0 max 16384 2023-10-06T04:41:03.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.796+0000 7f3c6be68740 1 Processor -- start 2023-10-06T04:41:03.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.796+0000 7f3c6be68740 1 -- start start 2023-10-06T04:41:03.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.796+0000 7f3c6be68740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1931710 0x1bb1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bb1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x197c790 0x1b6a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ad4b50 con 0x1931ae0 2023-10-06T04:41:03.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x1adb590 con 0x1931710 2023-10-06T04:41:03.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x1aac040 con 0x197c790 2023-10-06T04:41:03.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c62ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bb1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c62ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bb1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56656/0 (socket says 172.21.15.37:56656) 2023-10-06T04:41:03.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c62ffd700 1 -- 172.21.15.37:0/2240001487 learned_addr learned my addr 172.21.15.37:0/2240001487 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:03.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c637fe700 1 --2- 172.21.15.37:0/2240001487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1931710 0x1bb1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c63fff700 1 --2- 172.21.15.37:0/2240001487 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x197c790 0x1b6a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c637fe700 1 -- 172.21.15.37:0/2240001487 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x197c790 msgr2=0x1b6a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:03.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c637fe700 1 --2- 172.21.15.37:0/2240001487 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x197c790 0x1b6a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c637fe700 1 -- 172.21.15.37:0/2240001487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 msgr2=0x1bb1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:03.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c637fe700 1 --2- 172.21.15.37:0/2240001487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bb1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c637fe700 1 -- 172.21.15.37:0/2240001487 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6406e3b0 con 0x1931710 2023-10-06T04:41:03.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c62ffd700 1 --2- 172.21.15.37:0/2240001487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bb1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:03.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c637fe700 1 --2- 172.21.15.37:0/2240001487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1931710 0x1bb1650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c001da0 tx=0x7f3c4c01d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8be184b8d656932 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c597fa700 1 -- 172.21.15.37:0/2240001487 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c001630 con 0x1931710 2023-10-06T04:41:03.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c597fa700 1 -- 172.21.15.37:0/2240001487 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c019070 con 0x1931710 2023-10-06T04:41:03.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c597fa700 1 -- 172.21.15.37:0/2240001487 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0158c0 con 0x1931710 2023-10-06T04:41:03.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 -- 172.21.15.37:0/2240001487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1931710 msgr2=0x1bb1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 --2- 172.21.15.37:0/2240001487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1931710 0x1bb1650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c001da0 tx=0x7f3c4c01d000 comp rx=0 tx=0).stop 2023-10-06T04:41:03.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 -- 172.21.15.37:0/2240001487 shutdown_connections 2023-10-06T04:41:03.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 --2- 172.21.15.37:0/2240001487 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x197c790 0x1b6a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 --2- 172.21.15.37:0/2240001487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1931ae0 0x1bb1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 --2- 172.21.15.37:0/2240001487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1931710 0x1bb1650 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 -- 172.21.15.37:0/2240001487 >> 172.21.15.37:0/2240001487 conn(0x1931eb0 msgr2=0x1b8f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:03.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 -- 172.21.15.37:0/2240001487 shutdown_connections 2023-10-06T04:41:03.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 -- 172.21.15.37:0/2240001487 wait complete. 2023-10-06T04:41:03.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 -- start start 2023-10-06T04:41:03.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.800+0000 7f3c6be68740 1 Processor -- start 2023-10-06T04:41:03.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c6be68740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1931710 0x1c04b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c6be68740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931ae0 0x1bef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c6be68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x197c790 0x1befe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c6be68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aae010 con 0x197c790 2023-10-06T04:41:03.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c6be68740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x19ae650 con 0x1931710 2023-10-06T04:41:03.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c6be68740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a43d40 con 0x1931ae0 2023-10-06T04:41:03.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c6be68740 10 client.0 _ll_register_callbacks cb 0x1aa4110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:41:03.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x197c790 0x1befe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x197c790 0x1befe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56668/0 (socket says 172.21.15.37:56668) 2023-10-06T04:41:03.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c63fff700 1 -- 172.21.15.37:0/1698182597 learned_addr learned my addr 172.21.15.37:0/1698182597 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:03.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c62ffd700 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931ae0 0x1bef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c637fe700 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1931710 0x1c04b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c63fff700 1 -- 172.21.15.37:0/1698182597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931ae0 msgr2=0x1bef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:03.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c63fff700 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931ae0 0x1bef8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c63fff700 1 -- 172.21.15.37:0/1698182597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1931710 msgr2=0x1c04b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:03.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c63fff700 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1931710 0x1c04b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c63fff700 1 -- 172.21.15.37:0/1698182597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1aa7370 con 0x197c790 2023-10-06T04:41:03.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:41:03.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c63fff700 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x197c790 0x1befe10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c014040 tx=0x7f3c5c057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e91bed8aaefe6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c41ffb700 1 -- 172.21.15.37:0/1698182597 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c069070 con 0x197c790 2023-10-06T04:41:03.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c6be68740 1 -- 172.21.15.37:0/1698182597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c4c015750 con 0x197c790 2023-10-06T04:41:03.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c41ffb700 1 -- 172.21.15.37:0/1698182597 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3c5c05aed0 con 0x197c790 2023-10-06T04:41:03.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c41ffb700 1 -- 172.21.15.37:0/1698182597 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c5c06e120 con 0x197c790 2023-10-06T04:41:03.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c6be68740 10 client.5763 fetch_fsmap learned FSMap version 26 2023-10-06T04:41:03.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c6be68740 1 -- 172.21.15.37:0/1698182597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x197d9e0 con 0x197c790 2023-10-06T04:41:03.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.804+0000 7f3c41ffb700 1 -- 172.21.15.37:0/1698182597 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c015750 con 0x197c790 2023-10-06T04:41:03.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c41ffb700 1 -- 172.21.15.37:0/1698182597 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 26) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3c5c0691d0 con 0x197c790 2023-10-06T04:41:03.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 10 client.5763 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T04:41:03.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 10 client.5763 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:41:03.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 20 client.5763 populate_metadata read hostname 'smithi037' 2023-10-06T04:41:03.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.37:6834/3410822358,v1:172.21.15.37:6835/3410822358] conn(0x1bf0350 0x1c146c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 4 client.5763 mds_command: new command op to 5249 tid=0[{"prefix": "status"}] 2023-10-06T04:41:03.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 -- 172.21.15.37:0/1698182597 --> [v2:172.21.15.37:6834/3410822358,v1:172.21.15.37:6835/3410822358] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1aad410 con 0x1bf0350 2023-10-06T04:41:03.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c637fe700 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.37:6834/3410822358,v1:172.21.15.37:6835/3410822358] conn(0x1bf0350 0x1c146c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c41ffb700 10 client.5763 ms_handle_connect on v2:172.21.15.37:6834/3410822358 2023-10-06T04:41:03.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c637fe700 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.37:6834/3410822358,v1:172.21.15.37:6835/3410822358] conn(0x1bf0350 0x1c146c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36f0f94931396767 server_cookie=ca30e34c76753980 in_seq=0 out_seq=0 2023-10-06T04:41:03.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c41ffb700 1 -- 172.21.15.37:0/1698182597 <== mds.0 v2:172.21.15.37:6834/3410822358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1aad410 con 0x1bf0350 2023-10-06T04:41:03.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c41ffb700 10 client.5763 handle_command_reply: tid=0 2023-10-06T04:41:03.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 client.5763 shutdown 2023-10-06T04:41:03.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 -- 172.21.15.37:0/1698182597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x197c790 msgr2=0x1befe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x197c790 0x1befe10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c014040 tx=0x7f3c5c057040 comp rx=0 tx=0).stop 2023-10-06T04:41:03.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 -- 172.21.15.37:0/1698182597 shutdown_connections 2023-10-06T04:41:03.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.37:6834/3410822358,v1:172.21.15.37:6835/3410822358] conn(0x1bf0350 0x1c146c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x197c790 0x1befe10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c41ffb700 0 client.5763 ms_handle_reset on v2:172.21.15.37:6834/3410822358 2023-10-06T04:41:03.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x1931ae0 0x1bef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 --2- 172.21.15.37:0/1698182597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x1931710 0x1c04b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 -- 172.21.15.37:0/1698182597 >> 172.21.15.37:0/1698182597 conn(0x1931eb0 msgr2=0x1b6ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:03.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 -- 172.21.15.37:0/1698182597 shutdown_connections 2023-10-06T04:41:03.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 1 -- 172.21.15.37:0/1698182597 wait complete. 2023-10-06T04:41:03.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c6be68740 20 client.5763 trim_cache size 0 max 16384 2023-10-06T04:41:03.817 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:41:03.817 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "77bb67cc-15eb-432c-9ac1-b724f40102d2", 2023-10-06T04:41:03.817 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T04:41:03.817 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5249, 2023-10-06T04:41:03.817 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T04:41:03.817 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T04:41:03.818 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T04:41:03.818 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 9.1254138870000006, 2023-10-06T04:41:03.818 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 26, 2023-10-06T04:41:03.818 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 55, 2023-10-06T04:41:03.818 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 55, 2023-10-06T04:41:03.818 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 14.747296930999999 2023-10-06T04:41:03.818 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:41:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3c44060550 msgr2=0x7f3c44062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c69bbf700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3c44060550 0x7f3c44062a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c007fd0 tx=0x7f3c4c009040 comp rx=0 tx=0).stop 2023-10-06T04:41:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2069726575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c641550a0 msgr2=0x7f3c64145d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c69bbf700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c641550a0 0x7f3c64145d90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009290 tx=0x7f3c5c017000 comp rx=0 tx=0).stop 2023-10-06T04:41:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2069726575 shutdown_connections 2023-10-06T04:41:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c69bbf700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3c44060550 0x7f3c44062a00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c69bbf700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c64154cd0 0x7f3c6414d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c69bbf700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c641550a0 0x7f3c64145d90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c69bbf700 1 --2- 172.21.15.37:0/2069726575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c640cc2e0 0x7f3c64141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2069726575 >> 172.21.15.37:0/2069726575 conn(0x7f3c640667b0 msgr2=0x7f3c640aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:03.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2069726575 shutdown_connections 2023-10-06T04:41:03.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.808+0000 7f3c69bbf700 1 -- 172.21.15.37:0/2069726575 wait complete. 2023-10-06T04:41:03.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:41:03.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f288759e700 1 Processor -- start 2023-10-06T04:41:03.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f288759e700 1 -- start start 2023-10-06T04:41:03.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f288759e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2888068400 0x7f288815d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f288759e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2888158ba0 0x7f28880ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f288759e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2888159040 con 0x7f28881587d0 2023-10-06T04:41:03.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f288759e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288815d6d0 con 0x7f2888068400 2023-10-06T04:41:03.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f288759e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28880af7f0 con 0x7f2888158ba0 2023-10-06T04:41:03.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f2885d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2888068400 0x7f288815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f2885d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2888068400 0x7f288815d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56672/0 (socket says 172.21.15.37:56672) 2023-10-06T04:41:03.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f2885d9b700 1 -- 172.21.15.37:0/422496090 learned_addr learned my addr 172.21.15.37:0/422496090 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:03.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f288659c700 1 --1- 172.21.15.37:0/422496090 >> v1:172.21.15.37:6789/0 conn(0x7f28881587d0 0x7f2888067cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55614/0 (socket says 172.21.15.37:55614) 2023-10-06T04:41:03.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f2886d9d700 1 --2- 172.21.15.37:0/422496090 >> v2:172.21.15.83:3300/0 conn(0x7f2888158ba0 0x7f28880ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f2885d9b700 1 -- 172.21.15.37:0/422496090 >> v2:172.21.15.83:3300/0 conn(0x7f2888158ba0 msgr2=0x7f28880ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:03.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f2885d9b700 1 --2- 172.21.15.37:0/422496090 >> v2:172.21.15.83:3300/0 conn(0x7f2888158ba0 0x7f28880ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f2885d9b700 1 -- 172.21.15.37:0/422496090 >> v1:172.21.15.37:6789/0 conn(0x7f28881587d0 legacy=0x7f2888067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f2885d9b700 1 -- 172.21.15.37:0/422496090 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880afad0 con 0x7f2888068400 2023-10-06T04:41:03.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f2885d9b700 1 --2- 172.21.15.37:0/422496090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2888068400 0x7f288815d190 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f28880b12e0 tx=0x7f2878009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85a0a97bd75502b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f288559a700 1 -- 172.21.15.37:0/422496090 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800b860 con 0x7f2888068400 2023-10-06T04:41:03.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f288559a700 1 -- 172.21.15.37:0/422496090 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287800b9c0 con 0x7f2888068400 2023-10-06T04:41:03.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.940+0000 7f288559a700 1 -- 172.21.15.37:0/422496090 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800bd60 con 0x7f2888068400 2023-10-06T04:41:03.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.944+0000 7f288759e700 1 -- 172.21.15.37:0/422496090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2888068400 msgr2=0x7f288815d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.944+0000 7f288759e700 1 --2- 172.21.15.37:0/422496090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2888068400 0x7f288815d190 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f28880b12e0 tx=0x7f2878009250 comp rx=0 tx=0).stop 2023-10-06T04:41:03.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.944+0000 7f288759e700 1 -- 172.21.15.37:0/422496090 shutdown_connections 2023-10-06T04:41:03.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.944+0000 7f288759e700 1 --2- 172.21.15.37:0/422496090 >> v2:172.21.15.83:3300/0 conn(0x7f2888158ba0 0x7f28880ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.944+0000 7f288759e700 1 --2- 172.21.15.37:0/422496090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2888068400 0x7f288815d190 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.944+0000 7f288759e700 1 -- 172.21.15.37:0/422496090 >> 172.21.15.37:0/422496090 conn(0x7f28880cc5f0 msgr2=0x7f28880cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:03.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.944+0000 7f288759e700 1 -- 172.21.15.37:0/422496090 shutdown_connections 2023-10-06T04:41:03.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.944+0000 7f288759e700 1 -- 172.21.15.37:0/422496090 wait complete. 2023-10-06T04:41:03.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.944+0000 7f288759e700 1 Processor -- start 2023-10-06T04:41:03.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.944+0000 7f288759e700 1 -- start start 2023-10-06T04:41:03.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2888068400 0x7f28880c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28881587d0 0x7f28880c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2888158ba0 0x7f28881550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28880c49d0 con 0x7f2888068400 2023-10-06T04:41:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288815abb0 con 0x7f28881587d0 2023-10-06T04:41:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28880c83b0 con 0x7f2888158ba0 2023-10-06T04:41:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2888068400 0x7f28880c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2888068400 0x7f28880c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56684/0 (socket says 172.21.15.37:56684) 2023-10-06T04:41:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288659c700 1 -- 172.21.15.37:0/3553094447 learned_addr learned my addr 172.21.15.37:0/3553094447 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f2886d9d700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2888158ba0 0x7f28881550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f2885d9b700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28881587d0 0x7f28880c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288659c700 1 -- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2888158ba0 msgr2=0x7f28881550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288659c700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2888158ba0 0x7f28881550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288659c700 1 -- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28881587d0 msgr2=0x7f28880c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:03.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288659c700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28881587d0 0x7f28880c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:03.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288659c700 1 -- 172.21.15.37:0/3553094447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28780094f0 con 0x7f2888068400 2023-10-06T04:41:03.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288659c700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2888068400 0x7f28880c4490 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f287c00c590 tx=0x7f287c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f28767fc700 1 -- 172.21.15.37:0/3553094447 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c005a70 con 0x7f2888068400 2023-10-06T04:41:03.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f28767fc700 1 -- 172.21.15.37:0/3553094447 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c005bd0 con 0x7f2888068400 2023-10-06T04:41:03.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f28767fc700 1 -- 172.21.15.37:0/3553094447 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0070d0 con 0x7f2888068400 2023-10-06T04:41:03.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288759e700 1 -- 172.21.15.37:0/3553094447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28880c8690 con 0x7f2888068400 2023-10-06T04:41:03.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288759e700 1 -- 172.21.15.37:0/3553094447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28880c80a0 con 0x7f2888068400 2023-10-06T04:41:03.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.948+0000 7f288759e700 1 -- 172.21.15.37:0/3553094447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28880c8b70 con 0x7f2888068400 2023-10-06T04:41:03.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.952+0000 7f28767fc700 1 -- 172.21.15.37:0/3553094447 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f287c007440 con 0x7f2888068400 2023-10-06T04:41:03.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.952+0000 7f28767fc700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2868060550 0x7f2868062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:03.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.952+0000 7f28767fc700 1 -- 172.21.15.37:0/3553094447 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f287c07bd80 con 0x7f2888068400 2023-10-06T04:41:03.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.952+0000 7f2885d9b700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2868060550 0x7f2868062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:03.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.952+0000 7f2885d9b700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2868060550 0x7f2868062a00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f28880b12e0 tx=0x7f2878017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:03.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:03.956+0000 7f28767fc700 1 -- 172.21.15.37:0/3553094447 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f287c04c0d0 con 0x7f2888068400 2023-10-06T04:41:04.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 -- 172.21.15.37:0/3553094447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f28880708a0 con 0x7f2888068400 2023-10-06T04:41:04.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f28767fc700 1 -- 172.21.15.37:0/3553094447 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f287c017070 con 0x7f2888068400 2023-10-06T04:41:04.165 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:41:04.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 -- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2868060550 msgr2=0x7f2868062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2868060550 0x7f2868062a00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f28880b12e0 tx=0x7f2878017000 comp rx=0 tx=0).stop 2023-10-06T04:41:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 -- 172.21.15.37:0/3553094447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2888068400 msgr2=0x7f28880c4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2888068400 0x7f28880c4490 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f287c00c590 tx=0x7f287c007f90 comp rx=0 tx=0).stop 2023-10-06T04:41:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 -- 172.21.15.37:0/3553094447 shutdown_connections 2023-10-06T04:41:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2868060550 0x7f2868062a00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28881587d0 0x7f28880c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2888158ba0 0x7f28881550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 --2- 172.21.15.37:0/3553094447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2888068400 0x7f28880c4490 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 -- 172.21.15.37:0/3553094447 >> 172.21.15.37:0/3553094447 conn(0x7f28880cc5f0 msgr2=0x7f28880b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 -- 172.21.15.37:0/3553094447 shutdown_connections 2023-10-06T04:41:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:04.160+0000 7f288759e700 1 -- 172.21.15.37:0/3553094447 wait complete. 2023-10-06T04:41:04.179 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:41:04.179 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:41:04.179 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T04:41:04.179 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:41:04.179 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:41:04.179 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:41:04.180 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:41:04.180 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:41:04.180 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:41:04.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:04.180 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T04:41:04.188 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:41:04.188 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:41:04.188 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:41:04.188 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:41:04.188 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:41:04.188 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:41:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:41:04.189 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:41:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:41:04.189 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:41:04.189 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T04:41:04.189 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42483sec preferred_lft 42483sec 2023-10-06T04:41:04.189 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T04:41:04.189 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:41:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:41:04.189 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:41:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T04:41:04.189 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:41:04.190 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T04:41:04.190 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:e0:81:f4:d2 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:41:04.190 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T04:41:04.190 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:41:04.191 INFO:teuthology.orchestra.run.smithi037.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:41:04.191 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:7a:01:84:5a:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T04:41:04.191 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:41:04.191 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:41:04.191 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::f0f6:45ff:fe62:bcd0/64 scope link 2023-10-06T04:41:04.192 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:41:04.192 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:41:04.192 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:7a:01:84:5a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:41:04.192 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a47a:1ff:fe84:5afc/64 scope link 2023-10-06T04:41:04.192 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:41:04.192 INFO:teuthology.orchestra.run.smithi037.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:41:04.192 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether fa:90:64:f2:f5:58 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:41:04.192 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::f890:64ff:fef2:f558/64 scope link 2023-10-06T04:41:04.193 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:41:04.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:04.193 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:41:04.207 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T04:41:04.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:04.209 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T04:41:04.260 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T04:41:04.260 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:41:04.260 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T04:41:04.260 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T04:41:04.260 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T04:41:04.261 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:41:04.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:04.261 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:41:04.261 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:41:04.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:41:04.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:41:04.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:41:04.261 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:41:04.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:04.300 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:41:04.351 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:41:04.351 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:41:04.352 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:41:04.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:04.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T04:41:04.369 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T04:41:04.369 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:41:04.369 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:41:04.375 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:41:04.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:41:04.376 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:41:04.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:41:04.439 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:41:04.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:41:04.451 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:41:04.452 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:41:04.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:41:04.453 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:41:04.461 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T04:41:04.462 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T04:41:04.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:41:04.479 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:41:04.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:41:04.538 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:41:04.539 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:41:04.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:41:04.540 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:41:04.548 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T04:41:04.540+0000 7f8034bca380 -1 init, newargv = 0x5598e5a5e7e0 newargc=15 2023-10-06T04:41:04.548 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[44588]: starting ceph client 2023-10-06T04:41:04.556 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[44588]: starting fuse 2023-10-06T04:41:05.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T04:41:05.662 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:41:05.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:41:05.723 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:41:05.724 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:41:05.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:41:05.725 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T04:41:05.730 INFO:teuthology.orchestra.run.smithi037.stdout:52 2023-10-06T04:41:05.730 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T04:41:05.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:41:05.730 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T04:41:05.731 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T04:41:05.732 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:41:05.732 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T04:41:05.732 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T04:41:05.732 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T04:41:05.732 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T04:41:05.732 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T04:41:05.732 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T04:41:05.732 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T04:41:05.732 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T04:41:05.732 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:41:05.732 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T04:41:05.732 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T04:41:05.815 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.44588.asok 2023-10-06T04:41:05.999 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44588.asok 2023-10-06T04:41:05.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:41:05.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44588.asok status 2023-10-06T04:41:06.100 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:41:06.100 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T04:41:06.100 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T04:41:06.100 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T04:41:06.100 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T04:41:06.101 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T04:41:06.101 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T04:41:06.101 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "44588", 2023-10-06T04:41:06.101 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T04:41:06.101 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:41:06.101 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T04:41:06.101 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T04:41:06.101 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5781, 2023-10-06T04:41:06.101 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T04:41:06.102 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T04:41:06.102 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T04:41:06.102 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 5781 2023-10-06T04:41:06.102 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:41:06.102 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T04:41:06.102 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T04:41:06.102 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:41:06.102 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 173111146 2023-10-06T04:41:06.102 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:41:06.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:41:06.103 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T04:41:06.103 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T04:41:06.103 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:41:06.103 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 173111146 2023-10-06T04:41:06.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:41:06.103 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.5781 192.168.0.1:0/173111146", 2023-10-06T04:41:06.103 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/173111146", 2023-10-06T04:41:06.103 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T04:41:06.103 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 26, 2023-10-06T04:41:06.103 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 55, 2023-10-06T04:41:06.103 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T04:41:06.104 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T04:41:06.104 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T04:41:06.104 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:41:06.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:41:06.110 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T04:41:06.110 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T04:41:06.118 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T04:41:06.118 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T04:41:06.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:41:06.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:41:06.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:41:06.136 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file1) 2023-10-06T04:41:06.154 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:41:06.155 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T04:41:06.155 DEBUG:teuthology.orchestra.run.smithi037:> import time 2023-10-06T04:41:06.155 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T04:41:06.155 DEBUG:teuthology.orchestra.run.smithi037:> fd = os.open("/home/ubuntu/cephtest/mnt.0/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2023-10-06T04:41:06.156 DEBUG:teuthology.orchestra.run.smithi037:> try: 2023-10-06T04:41:06.156 DEBUG:teuthology.orchestra.run.smithi037:> while True: 2023-10-06T04:41:06.156 DEBUG:teuthology.orchestra.run.smithi037:> os.write(fd, b'"'"'content'"'"') 2023-10-06T04:41:06.157 DEBUG:teuthology.orchestra.run.smithi037:> time.sleep(1) 2023-10-06T04:41:06.157 DEBUG:teuthology.orchestra.run.smithi037:> if not True: 2023-10-06T04:41:06.157 DEBUG:teuthology.orchestra.run.smithi037:> break 2023-10-06T04:41:06.157 DEBUG:teuthology.orchestra.run.smithi037:> except IOError as e: 2023-10-06T04:41:06.157 DEBUG:teuthology.orchestra.run.smithi037:> pass 2023-10-06T04:41:06.158 DEBUG:teuthology.orchestra.run.smithi037:> os.close(fd) 2023-10-06T04:41:06.158 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T04:41:13.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:41:13.098 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:41:16.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:41:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 Processor -- start 2023-10-06T04:41:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 -- start start 2023-10-06T04:41:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c01550a0 0x7fb5c00ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb5c0155470 0x7fb5c00afce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c00adff0 con 0x7fb5c00b0220 2023-10-06T04:41:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c00b06a0 con 0x7fb5c0155470 2023-10-06T04:41:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0066ec0 con 0x7fb5c01550a0 2023-10-06T04:41:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c4ad7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb5c0155470 0x7fb5c00afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c4ad7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb5c0155470 0x7fb5c00afce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51770/0 (socket says 172.21.15.37:51770) 2023-10-06T04:41:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c4ad7700 1 -- 172.21.15.37:0/1601401291 learned_addr learned my addr 172.21.15.37:0/1601401291 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c52d8700 1 --2- 172.21.15.37:0/1601401291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c01550a0 0x7fb5c00ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c4ad7700 1 -- 172.21.15.37:0/1601401291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c01550a0 msgr2=0x7fb5c00ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c4ad7700 1 --2- 172.21.15.37:0/1601401291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c01550a0 0x7fb5c00ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c4ad7700 1 -- 172.21.15.37:0/1601401291 >> v1:172.21.15.83:6789/0 conn(0x7fb5c00b0220 legacy=0x7fb5c00667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c4ad7700 1 -- 172.21.15.37:0/1601401291 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00ab500 con 0x7fb5c0155470 2023-10-06T04:41:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c52d8700 1 --2- 172.21.15.37:0/1601401291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c01550a0 0x7fb5c00ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c4ad7700 1 --2- 172.21.15.37:0/1601401291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c0155470 0x7fb5c00afce0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00099e0 tx=0x7fb5b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7076e6695a48529a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5b7fff700 1 -- 172.21.15.37:0/1601401291 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b000b820 con 0x7fb5c0155470 2023-10-06T04:41:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5b7fff700 1 -- 172.21.15.37:0/1601401291 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b000b980 con 0x7fb5c0155470 2023-10-06T04:41:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5b7fff700 1 -- 172.21.15.37:0/1601401291 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b000bd20 con 0x7fb5c0155470 2023-10-06T04:41:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 -- 172.21.15.37:0/1601401291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c0155470 msgr2=0x7fb5c00afce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 --2- 172.21.15.37:0/1601401291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c0155470 0x7fb5c00afce0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00099e0 tx=0x7fb5b0009250 comp rx=0 tx=0).stop 2023-10-06T04:41:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 -- 172.21.15.37:0/1601401291 shutdown_connections 2023-10-06T04:41:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 --2- 172.21.15.37:0/1601401291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c0155470 0x7fb5c00afce0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 --2- 172.21.15.37:0/1601401291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c01550a0 0x7fb5c00ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 -- 172.21.15.37:0/1601401291 >> 172.21.15.37:0/1601401291 conn(0x7fb5c00ccb50 msgr2=0x7fb5c006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 -- 172.21.15.37:0/1601401291 shutdown_connections 2023-10-06T04:41:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.376+0000 7fb5c62da700 1 -- 172.21.15.37:0/1601401291 wait complete. 2023-10-06T04:41:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c62da700 1 Processor -- start 2023-10-06T04:41:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c62da700 1 -- start start 2023-10-06T04:41:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c62da700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c00b0220 0x7fb5c00cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c62da700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c01550a0 0x7fb5c0148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c62da700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c0155470 0x7fb5c0169360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c62da700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00ca380 con 0x7fb5c01550a0 2023-10-06T04:41:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c62da700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0149380 con 0x7fb5c0155470 2023-10-06T04:41:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c62da700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00c9490 con 0x7fb5c00b0220 2023-10-06T04:41:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c4ad7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c01550a0 0x7fb5c0148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c4ad7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c01550a0 0x7fb5c0148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51786/0 (socket says 172.21.15.37:51786) 2023-10-06T04:41:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c4ad7700 1 -- 172.21.15.37:0/296220939 learned_addr learned my addr 172.21.15.37:0/296220939 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c52d8700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c00b0220 0x7fb5c00cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c5ad9700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c0155470 0x7fb5c0169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c4ad7700 1 -- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c00b0220 msgr2=0x7fb5c00cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c4ad7700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c00b0220 0x7fb5c00cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c4ad7700 1 -- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c0155470 msgr2=0x7fb5c0169360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c4ad7700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c0155470 0x7fb5c0169360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c4ad7700 1 -- 172.21.15.37:0/296220939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00094f0 con 0x7fb5c01550a0 2023-10-06T04:41:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c4ad7700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c01550a0 0x7fb5c0148e40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00090b0 tx=0x7fb5b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5b57fa700 1 -- 172.21.15.37:0/296220939 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b001a450 con 0x7fb5c01550a0 2023-10-06T04:41:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5b57fa700 1 -- 172.21.15.37:0/296220939 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b001a5b0 con 0x7fb5c01550a0 2023-10-06T04:41:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c62da700 1 -- 172.21.15.37:0/296220939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c00c9770 con 0x7fb5c01550a0 2023-10-06T04:41:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5b57fa700 1 -- 172.21.15.37:0/296220939 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b001a970 con 0x7fb5c01550a0 2023-10-06T04:41:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.380+0000 7fb5c62da700 1 -- 172.21.15.37:0/296220939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c00c9d30 con 0x7fb5c01550a0 2023-10-06T04:41:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.384+0000 7fb5c62da700 1 -- 172.21.15.37:0/296220939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c00708a0 con 0x7fb5c01550a0 2023-10-06T04:41:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.384+0000 7fb5b57fa700 1 -- 172.21.15.37:0/296220939 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb5b001ace0 con 0x7fb5c01550a0 2023-10-06T04:41:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.384+0000 7fb5b57fa700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb5a4060550 0x7fb5a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.384+0000 7fb5b57fa700 1 -- 172.21.15.37:0/296220939 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb5b007e020 con 0x7fb5c01550a0 2023-10-06T04:41:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.384+0000 7fb5c52d8700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb5a4060550 0x7fb5a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.384+0000 7fb5c52d8700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb5a4060550 0x7fb5a4062a00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb5c00ca640 tx=0x7fb5bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:16.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.396+0000 7fb5b57fa700 1 -- 172.21.15.37:0/296220939 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb5b004e350 con 0x7fb5c01550a0 2023-10-06T04:41:16.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.592+0000 7fb5c62da700 1 -- 172.21.15.37:0/296220939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5c006ee90 con 0x7fb5c01550a0 2023-10-06T04:41:16.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.592+0000 7fb5b57fa700 1 -- 172.21.15.37:0/296220939 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fb5b0051970 con 0x7fb5c01550a0 2023-10-06T04:41:16.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:16.598 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3641721079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":3641721079},{"type":"v1","addr":"172.21.15.83:6836","nonce":3641721079}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/204975667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":204975667},{"type":"v1","addr":"172.21.15.83:6837","nonce":204975667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4106618910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4106618910},{"type":"v1","addr":"172.21.15.37:6833","nonce":4106618910}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:54.053558+0000","modified":"2023-10-06T04:40:56.731365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5249":{"gid":5249,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3410822358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3410822358},{"type":"v1","addr":"172.21.15.37:6835","nonce":3410822358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:41:16.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.596+0000 7fb5c62da700 1 -- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb5a4060550 msgr2=0x7fb5a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:16.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.596+0000 7fb5c62da700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb5a4060550 0x7fb5a4062a00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb5c00ca640 tx=0x7fb5bc008040 comp rx=0 tx=0).stop 2023-10-06T04:41:16.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.596+0000 7fb5c62da700 1 -- 172.21.15.37:0/296220939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c01550a0 msgr2=0x7fb5c0148e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:16.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.596+0000 7fb5c62da700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c01550a0 0x7fb5c0148e40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00090b0 tx=0x7fb5b0017000 comp rx=0 tx=0).stop 2023-10-06T04:41:16.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.596+0000 7fb5c62da700 1 -- 172.21.15.37:0/296220939 shutdown_connections 2023-10-06T04:41:16.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.596+0000 7fb5c62da700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb5a4060550 0x7fb5a4062a00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:16.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.596+0000 7fb5c62da700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c0155470 0x7fb5c0169360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:16.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.596+0000 7fb5c62da700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c01550a0 0x7fb5c0148e40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:16.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.596+0000 7fb5c62da700 1 --2- 172.21.15.37:0/296220939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c00b0220 0x7fb5c00cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:16.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.596+0000 7fb5c62da700 1 -- 172.21.15.37:0/296220939 >> 172.21.15.37:0/296220939 conn(0x7fb5c00ccb50 msgr2=0x7fb5c006a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:16.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.596+0000 7fb5c62da700 1 -- 172.21.15.37:0/296220939 shutdown_connections 2023-10-06T04:41:16.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:16.596+0000 7fb5c62da700 1 -- 172.21.15.37:0/296220939 wait complete. 2023-10-06T04:41:16.602 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2023-10-06T04:41:16.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json force_readonly 2023-10-06T04:41:16.724 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-06T04:41:26.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:41:26.725 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file1) 2023-10-06T04:41:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:touch: cannot touch 'test_file1': Read-only file system 2023-10-06T04:41:26.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:41:26.736 INFO:tasks.ceph_test_case:waiting 30s for health warning matching MDS_READ_ONLY 2023-10-06T04:41:26.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T04:41:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.884+0000 7f129e372700 1 Processor -- start 2023-10-06T04:41:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.884+0000 7f129e372700 1 -- start start 2023-10-06T04:41:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1298068400 0x7f129815d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1298158ba0 0x7f12980ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1298159040 con 0x7f12981587d0 2023-10-06T04:41:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129815d6d0 con 0x7f1298068400 2023-10-06T04:41:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12980af7f0 con 0x7f1298158ba0 2023-10-06T04:41:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129cb6f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1298068400 0x7f129815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129cb6f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1298068400 0x7f129815d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45854/0 (socket says 172.21.15.37:45854) 2023-10-06T04:41:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129cb6f700 1 -- 172.21.15.37:0/3357692061 learned_addr learned my addr 172.21.15.37:0/3357692061 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129db71700 1 --2- 172.21.15.37:0/3357692061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1298158ba0 0x7f12980ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129cb6f700 1 -- 172.21.15.37:0/3357692061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1298158ba0 msgr2=0x7f12980ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129cb6f700 1 --2- 172.21.15.37:0/3357692061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1298158ba0 0x7f12980ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129cb6f700 1 -- 172.21.15.37:0/3357692061 >> v1:172.21.15.83:6789/0 conn(0x7f12981587d0 legacy=0x7f1298067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129cb6f700 1 -- 172.21.15.37:0/3357692061 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12980afad0 con 0x7f1298068400 2023-10-06T04:41:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129cb6f700 1 --2- 172.21.15.37:0/3357692061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1298068400 0x7f129815d190 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f12940099b0 tx=0x7f1294009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e76a960e6faf01f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f128bfff700 1 -- 172.21.15.37:0/3357692061 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129400b860 con 0x7f1298068400 2023-10-06T04:41:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f128bfff700 1 -- 172.21.15.37:0/3357692061 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129400b9c0 con 0x7f1298068400 2023-10-06T04:41:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f128bfff700 1 -- 172.21.15.37:0/3357692061 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129400bd60 con 0x7f1298068400 2023-10-06T04:41:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 -- 172.21.15.37:0/3357692061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1298068400 msgr2=0x7f129815d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 --2- 172.21.15.37:0/3357692061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1298068400 0x7f129815d190 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f12940099b0 tx=0x7f1294009250 comp rx=0 tx=0).stop 2023-10-06T04:41:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 -- 172.21.15.37:0/3357692061 shutdown_connections 2023-10-06T04:41:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 --2- 172.21.15.37:0/3357692061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1298158ba0 0x7f12980ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 --2- 172.21.15.37:0/3357692061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1298068400 0x7f129815d190 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 -- 172.21.15.37:0/3357692061 >> 172.21.15.37:0/3357692061 conn(0x7f12980cc5f0 msgr2=0x7f12980cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 -- 172.21.15.37:0/3357692061 shutdown_connections 2023-10-06T04:41:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.888+0000 7f129e372700 1 -- 172.21.15.37:0/3357692061 wait complete. 2023-10-06T04:41:26.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.892+0000 7f129e372700 1 Processor -- start 2023-10-06T04:41:26.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.892+0000 7f129e372700 1 -- start start 2023-10-06T04:41:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129e372700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1298068400 0x7f12980c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129e372700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12981587d0 0x7f12980d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129e372700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1298158ba0 0x7f12980d0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129e372700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12981565e0 con 0x7f12981587d0 2023-10-06T04:41:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129e372700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12980cfd60 con 0x7f1298068400 2023-10-06T04:41:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129e372700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12980cf4b0 con 0x7f1298158ba0 2023-10-06T04:41:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129cb6f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12981587d0 0x7f12980d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129cb6f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12981587d0 0x7f12980d01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45868/0 (socket says 172.21.15.37:45868) 2023-10-06T04:41:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129cb6f700 1 -- 172.21.15.37:0/2485937551 learned_addr learned my addr 172.21.15.37:0/2485937551 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129d370700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1298068400 0x7f12980c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129db71700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1298158ba0 0x7f12980d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129cb6f700 1 -- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1298158ba0 msgr2=0x7f12980d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129cb6f700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1298158ba0 0x7f12980d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129cb6f700 1 -- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1298068400 msgr2=0x7f12980c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129cb6f700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1298068400 0x7f12980c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129cb6f700 1 -- 172.21.15.37:0/2485937551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940094f0 con 0x7f12981587d0 2023-10-06T04:41:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129d370700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1298068400 0x7f12980c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129cb6f700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12981587d0 0x7f12980d01f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1294009fd0 tx=0x7f1294017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f12897fa700 1 -- 172.21.15.37:0/2485937551 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294011e40 con 0x7f12981587d0 2023-10-06T04:41:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f12897fa700 1 -- 172.21.15.37:0/2485937551 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1294024440 con 0x7f12981587d0 2023-10-06T04:41:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129e372700 1 -- 172.21.15.37:0/2485937551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12980cf730 con 0x7f12981587d0 2023-10-06T04:41:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f12897fa700 1 -- 172.21.15.37:0/2485937551 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12940247e0 con 0x7f12981587d0 2023-10-06T04:41:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.896+0000 7f129e372700 1 -- 172.21.15.37:0/2485937551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12980cf9f0 con 0x7f12981587d0 2023-10-06T04:41:26.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.900+0000 7f129e372700 1 -- 172.21.15.37:0/2485937551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12980cfef0 con 0x7f12981587d0 2023-10-06T04:41:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.900+0000 7f12897fa700 1 -- 172.21.15.37:0/2485937551 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f129401a420 con 0x7f12981587d0 2023-10-06T04:41:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.900+0000 7f12897fa700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f127c060580 0x7f127c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.900+0000 7f12897fa700 1 -- 172.21.15.37:0/2485937551 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f129407e820 con 0x7f12981587d0 2023-10-06T04:41:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.900+0000 7f129d370700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f127c060580 0x7f127c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.900+0000 7f129d370700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f127c060580 0x7f127c062a30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f12980c34d0 tx=0x7f128c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:26.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:26.904+0000 7f12897fa700 1 -- 172.21.15.37:0/2485937551 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f129404ead0 con 0x7f12981587d0 2023-10-06T04:41:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 -- 172.21.15.37:0/2485937551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f12980708a0 con 0x7f12981587d0 2023-10-06T04:41:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f12897fa700 1 -- 172.21.15.37:0/2485937551 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+159 (secure 0 0 0) 0x7f12940520f0 con 0x7f12981587d0 2023-10-06T04:41:27.109 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:27.109 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_WARN","checks":{"MDS_READ_ONLY":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs are read only","count":1},"muted":false}},"mutes":[]} 2023-10-06T04:41:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 -- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f127c060580 msgr2=0x7f127c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f127c060580 0x7f127c062a30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f12980c34d0 tx=0x7f128c009040 comp rx=0 tx=0).stop 2023-10-06T04:41:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 -- 172.21.15.37:0/2485937551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12981587d0 msgr2=0x7f12980d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12981587d0 0x7f12980d01f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1294009fd0 tx=0x7f1294017000 comp rx=0 tx=0).stop 2023-10-06T04:41:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 -- 172.21.15.37:0/2485937551 shutdown_connections 2023-10-06T04:41:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f127c060580 0x7f127c062a30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1298158ba0 0x7f12980d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12981587d0 0x7f12980d01f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 --2- 172.21.15.37:0/2485937551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1298068400 0x7f12980c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 -- 172.21.15.37:0/2485937551 >> 172.21.15.37:0/2485937551 conn(0x7f12980cc5f0 msgr2=0x7f12980b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 -- 172.21.15.37:0/2485937551 shutdown_connections 2023-10-06T04:41:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.104+0000 7f129e372700 1 -- 172.21.15.37:0/2485937551 wait complete. 2023-10-06T04:41:27.123 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T04:41:27.124 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:41:27.124 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:27.124 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:41:27.124 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:27.125 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:41:27.125 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:27.125 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:41:27.125 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:27.134 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:41:27.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2023-10-06T04:41:27.137 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:41:27.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2023-10-06T04:41:27.141 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:41:27.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2023-10-06T04:41:27.143 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:41:27.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2023-10-06T04:41:27.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b3284700 1 Processor -- start 2023-10-06T04:41:27.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b3284700 1 -- start start 2023-10-06T04:41:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b3284700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6ac158d10 0x7fe6ac0c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b3284700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6ac1590e0 0x7fe6ac0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b3284700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe6ac0ae0a0 0x7fe6ac0ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b3284700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ac0b1dd0 con 0x7fe6ac158d10 2023-10-06T04:41:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b3284700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ac0aea80 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b3284700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac0adc10 con 0x7fe6ac1590e0 2023-10-06T04:41:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b2282700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6ac158d10 0x7fe6ac0c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b2282700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6ac158d10 0x7fe6ac0c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45876/0 (socket says 172.21.15.37:45876) 2023-10-06T04:41:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b2282700 1 -- 172.21.15.37:0/1963608660 learned_addr learned my addr 172.21.15.37:0/1963608660 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b2a83700 1 --2- 172.21.15.37:0/1963608660 >> v2:172.21.15.83:3300/0 conn(0x7fe6ac0ae0a0 0x7fe6ac0ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.224+0000 7fe6b1a81700 1 --2- 172.21.15.37:0/1963608660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6ac1590e0 0x7fe6ac0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b2282700 1 -- 172.21.15.37:0/1963608660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6ac1590e0 msgr2=0x7fe6ac0c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:27.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b2282700 1 --2- 172.21.15.37:0/1963608660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6ac1590e0 0x7fe6ac0c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b2282700 1 -- 172.21.15.37:0/1963608660 >> v2:172.21.15.83:3300/0 conn(0x7fe6ac0ae0a0 msgr2=0x7fe6ac0ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:27.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b2282700 1 --2- 172.21.15.37:0/1963608660 >> v2:172.21.15.83:3300/0 conn(0x7fe6ac0ae0a0 0x7fe6ac0ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b2282700 1 -- 172.21.15.37:0/1963608660 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac0ad600 con 0x7fe6ac158d10 2023-10-06T04:41:27.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b2282700 1 --2- 172.21.15.37:0/1963608660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac158d10 0x7fe6ac0c8f90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac066ff0 tx=0x7fe6a800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a52b3e92df93d1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:27.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b1280700 1 -- 172.21.15.37:0/1963608660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800dc50 con 0x7fe6ac158d10 2023-10-06T04:41:27.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b1280700 1 -- 172.21.15.37:0/1963608660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a800ddb0 con 0x7fe6ac158d10 2023-10-06T04:41:27.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b1280700 1 -- 172.21.15.37:0/1963608660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a80196d0 con 0x7fe6ac158d10 2023-10-06T04:41:27.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b3284700 1 -- 172.21.15.37:0/1963608660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac158d10 msgr2=0x7fe6ac0c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b3284700 1 --2- 172.21.15.37:0/1963608660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac158d10 0x7fe6ac0c8f90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac066ff0 tx=0x7fe6a800b4f0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b3284700 1 -- 172.21.15.37:0/1963608660 shutdown_connections 2023-10-06T04:41:27.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b3284700 1 --2- 172.21.15.37:0/1963608660 >> v2:172.21.15.83:3300/0 conn(0x7fe6ac0ae0a0 0x7fe6ac0ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b3284700 1 --2- 172.21.15.37:0/1963608660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6ac1590e0 0x7fe6ac0c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b3284700 1 --2- 172.21.15.37:0/1963608660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac158d10 0x7fe6ac0c8f90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b3284700 1 -- 172.21.15.37:0/1963608660 >> 172.21.15.37:0/1963608660 conn(0x7fe6ac0ccb50 msgr2=0x7fe6ac06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:27.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b3284700 1 -- 172.21.15.37:0/1963608660 shutdown_connections 2023-10-06T04:41:27.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b3284700 1 -- 172.21.15.37:0/1963608660 wait complete. 2023-10-06T04:41:27.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b3284700 1 Processor -- start 2023-10-06T04:41:27.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.228+0000 7fe6b3284700 1 -- start start 2023-10-06T04:41:27.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b3284700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac0ae0a0 0x7fe6ac096a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b3284700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6ac158d10 0x7fe6ac098a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b3284700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6ac1590e0 0x7fe6ac157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b3284700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac098fa0 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b3284700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac0a71b0 con 0x7fe6ac158d10 2023-10-06T04:41:27.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b3284700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac097930 con 0x7fe6ac1590e0 2023-10-06T04:41:27.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b2282700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac0ae0a0 0x7fe6ac096a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b2282700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac0ae0a0 0x7fe6ac096a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45888/0 (socket says 172.21.15.37:45888) 2023-10-06T04:41:27.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b2282700 1 -- 172.21.15.37:0/4016175861 learned_addr learned my addr 172.21.15.37:0/4016175861 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:27.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b1a81700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6ac158d10 0x7fe6ac098a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b2a83700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6ac1590e0 0x7fe6ac157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b2282700 1 -- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6ac1590e0 msgr2=0x7fe6ac157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b2282700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6ac1590e0 0x7fe6ac157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b2282700 1 -- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6ac158d10 msgr2=0x7fe6ac098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b2282700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6ac158d10 0x7fe6ac098a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b2282700 1 -- 172.21.15.37:0/4016175861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a800b790 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b2282700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac0ae0a0 0x7fe6ac096a20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac06cea0 tx=0x7fe6a801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:27.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6a27fc700 1 -- 172.21.15.37:0/4016175861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800dc50 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6a27fc700 1 -- 172.21.15.37:0/4016175861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a8010470 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b3284700 1 -- 172.21.15.37:0/4016175861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ac097090 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6a27fc700 1 -- 172.21.15.37:0/4016175861 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8010810 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b3284700 1 -- 172.21.15.37:0/4016175861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ac097650 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.232+0000 7fe6b3284700 1 -- 172.21.15.37:0/4016175861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ac0708a0 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.236+0000 7fe6a27fc700 1 -- 172.21.15.37:0/4016175861 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe6a8022030 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.236+0000 7fe6a27fc700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe690060550 0x7fe690062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.236+0000 7fe6a27fc700 1 -- 172.21.15.37:0/4016175861 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe6a8014070 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.236+0000 7fe6b1a81700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe690060550 0x7fe690062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.236+0000 7fe6b1a81700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe690060550 0x7fe690062a00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0c72a0 tx=0x7fe69c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:27.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.244+0000 7fe6a27fc700 1 -- 172.21.15.37:0/4016175861 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe6a8051090 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.268+0000 7f94f3fff700 1 Processor -- start 2023-10-06T04:41:27.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.268+0000 7f94f3fff700 1 -- start start 2023-10-06T04:41:27.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.268+0000 7f94f3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40ad4c0 0x7f94f40ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.268+0000 7f94f3fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f41570b0 con 0x7f94f4152970 2023-10-06T04:41:27.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.268+0000 7f94f3fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f40ac6b0 con 0x7f94f4152d40 2023-10-06T04:41:27.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.268+0000 7f94f3fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4156780 con 0x7f94f40ad4c0 2023-10-06T04:41:27.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.268+0000 7f94f2ffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f94f4152970 0x7f94f40acdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43964/0 (socket says 172.21.15.37:43964) 2023-10-06T04:41:27.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.268+0000 7f94f2ffd700 1 -- 172.21.15.37:0/2727979541 learned_addr learned my addr 172.21.15.37:0/2727979541 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:27.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f37fe700 1 --2- 172.21.15.37:0/2727979541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40ad4c0 0x7f94f40ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990837270 0 0) 0x7f94f41570b0 con 0x7f94f4152970 2023-10-06T04:41:27.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e0003570 con 0x7f94f4152970 2023-10-06T04:41:27.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1940030636 0 0) 0x7f94e0003570 con 0x7f94f4152970 2023-10-06T04:41:27.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40ad4c0 msgr2=0x7f94f40ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:27.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 --2- 172.21.15.37:0/2727979541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40ad4c0 0x7f94f40ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 >> v1:172.21.15.83:6789/0 conn(0x7f94f4152d40 legacy=0x7f94f40ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f4156a60 con 0x7f94f4152970 2023-10-06T04:41:27.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f94dc001470 con 0x7f94f4152970 2023-10-06T04:41:27.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 >> v1:172.21.15.37:6789/0 conn(0x7f94f4152970 legacy=0x7f94f40acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 --2- 172.21.15.37:0/2727979541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0003a90 0x7f94e0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 --2- 172.21.15.37:0/2727979541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94e0004810 0x7f94e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 --2- 172.21.15.37:0/2727979541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40ad4c0 0x7f94e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4156780 con 0x7f94e0003a90 2023-10-06T04:41:27.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e000bb40 con 0x7f94e0004810 2023-10-06T04:41:27.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e000bd00 con 0x7f94f40ad4c0 2023-10-06T04:41:27.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff39ae700 1 Processor -- start 2023-10-06T04:41:27.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f2ffd700 1 --2- 172.21.15.37:0/2727979541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0003a90 0x7f94e0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff39ae700 1 -- start start 2023-10-06T04:41:27.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f37fe700 1 --2- 172.21.15.37:0/2727979541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40ad4c0 0x7f94e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f27fc700 1 --2- 172.21.15.37:0/2727979541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94e0004810 0x7f94e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f2ffd700 1 -- 172.21.15.37:0/2727979541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40ad4c0 msgr2=0x7f94e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:27.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f2ffd700 1 --2- 172.21.15.37:0/2727979541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40ad4c0 0x7f94e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f2ffd700 1 -- 172.21.15.37:0/2727979541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94e0004810 msgr2=0x7f94e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:27.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f2ffd700 1 --2- 172.21.15.37:0/2727979541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94e0004810 0x7f94e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f2ffd700 1 -- 172.21.15.37:0/2727979541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0003570 con 0x7f94e0003a90 2023-10-06T04:41:27.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f2ffd700 1 --2- 172.21.15.37:0/2727979541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0003a90 0x7f94e0003e60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00c390 tx=0x7f94f4157020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4198616ff0a36e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:27.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc00cc60 con 0x7f94e0003a90 2023-10-06T04:41:27.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc00cde0 con 0x7f94e0003a90 2023-10-06T04:41:27.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f1ffb700 1 -- 172.21.15.37:0/2727979541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc005b70 con 0x7f94e0003a90 2023-10-06T04:41:27.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff39ae700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fefec0acc10 0x7fefec0667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff39ae700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec158f10 0x7fefec0b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff39ae700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefec0b0950 con 0x7fefec0ac840 2023-10-06T04:41:27.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff39ae700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefec066cf0 con 0x7fefec0acc10 2023-10-06T04:41:27.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff39ae700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefec0afd40 con 0x7fefec158f10 2023-10-06T04:41:27.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff174a700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fefec0ac840 0x7fefec158800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:41782/0 (socket says 172.21.15.37:41782) 2023-10-06T04:41:27.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff174a700 1 -- 172.21.15.37:0/2157180876 learned_addr learned my addr 172.21.15.37:0/2157180876 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:27.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff1f4b700 1 --2- 172.21.15.37:0/2157180876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec158f10 0x7fefec0b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f3fff700 1 -- 172.21.15.37:0/2727979541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0003a90 msgr2=0x7f94e0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f3fff700 1 --2- 172.21.15.37:0/2727979541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0003a90 0x7f94e0003e60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00c390 tx=0x7f94f4157020 comp rx=0 tx=0).stop 2023-10-06T04:41:27.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f37fe700 1 -- 172.21.15.37:0/2727979541 reap_dead start 2023-10-06T04:41:27.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f3fff700 1 -- 172.21.15.37:0/2727979541 shutdown_connections 2023-10-06T04:41:27.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f3fff700 1 -- 172.21.15.37:0/2727979541 >> 172.21.15.37:0/2727979541 conn(0x7f94f40cca70 msgr2=0x7f94f40a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:27.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff0f49700 1 --2- 172.21.15.37:0/2157180876 >> v2:172.21.15.37:3300/0 conn(0x7fefec0acc10 0x7fefec0667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f3fff700 1 -- 172.21.15.37:0/2727979541 shutdown_connections 2023-10-06T04:41:27.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7f94f3fff700 1 -- 172.21.15.37:0/2727979541 wait complete. 2023-10-06T04:41:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7fefe3fff700 1 -- 172.21.15.37:0/2157180876 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991415189 0 0) 0x7fefec0b0950 con 0x7fefec0ac840 2023-10-06T04:41:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7fefe3fff700 1 -- 172.21.15.37:0/2157180876 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd8003570 con 0x7fefec0ac840 2023-10-06T04:41:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff1f4b700 1 -- 172.21.15.37:0/2157180876 >> v2:172.21.15.37:3300/0 conn(0x7fefec0acc10 msgr2=0x7fefec0667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff1f4b700 1 --2- 172.21.15.37:0/2157180876 >> v2:172.21.15.37:3300/0 conn(0x7fefec0acc10 0x7fefec0667b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff1f4b700 1 -- 172.21.15.37:0/2157180876 >> v1:172.21.15.83:6789/0 conn(0x7fefec0ac840 legacy=0x7fefec158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff1f4b700 1 -- 172.21.15.37:0/2157180876 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec0b0020 con 0x7fefec158f10 2023-10-06T04:41:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.272+0000 7feff1f4b700 1 --2- 172.21.15.37:0/2157180876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec158f10 0x7fefec0b0de0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fefe80098e0 tx=0x7fefe80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2f37b3732727dd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7fefe3fff700 1 -- 172.21.15.37:0/2157180876 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8011630 con 0x7fefec158f10 2023-10-06T04:41:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7fefe3fff700 1 -- 172.21.15.37:0/2157180876 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe8011790 con 0x7fefec158f10 2023-10-06T04:41:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7fefe3fff700 1 -- 172.21.15.37:0/2157180876 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8011b30 con 0x7fefec158f10 2023-10-06T04:41:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021bd25700 1 Processor -- start 2023-10-06T04:41:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021bd25700 1 -- start start 2023-10-06T04:41:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 -- 172.21.15.37:0/2157180876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec158f10 msgr2=0x7fefec0b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 --2- 172.21.15.37:0/2157180876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec158f10 0x7fefec0b0de0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fefe80098e0 tx=0x7fefe80091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 -- 172.21.15.37:0/2157180876 shutdown_connections 2023-10-06T04:41:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 --2- 172.21.15.37:0/2157180876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec158f10 0x7fefec0b0de0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 --2- 172.21.15.37:0/2157180876 >> v2:172.21.15.37:3300/0 conn(0x7fefec0acc10 0x7fefec0667b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 -- 172.21.15.37:0/2157180876 >> 172.21.15.37:0/2157180876 conn(0x7fefec0ccc60 msgr2=0x7fefec06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:27.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 -- 172.21.15.37:0/2157180876 shutdown_connections 2023-10-06T04:41:27.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 -- 172.21.15.37:0/2157180876 wait complete. 2023-10-06T04:41:27.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f3fff700 1 Processor -- start 2023-10-06T04:41:27.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f3fff700 1 -- start start 2023-10-06T04:41:27.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021bd25700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f021415c680 0x7f02140ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021bd25700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021415b1e0 con 0x7f02141531e0 2023-10-06T04:41:27.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021bd25700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02140cd5e0 con 0x7f021415d2e0 2023-10-06T04:41:27.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021bd25700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021415a8b0 con 0x7f021415c680 2023-10-06T04:41:27.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 Processor -- start 2023-10-06T04:41:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021a2c2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f021415c680 0x7f02140ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021a2c2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f021415c680 0x7f02140ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45918/0 (socket says 172.21.15.37:45918) 2023-10-06T04:41:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021a2c2700 1 -- 172.21.15.37:0/3295892028 learned_addr learned my addr 172.21.15.37:0/3295892028 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f02192c0700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f021415d2e0 0x7f02140cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:41784/0 (socket says 172.21.15.37:41784) 2023-10-06T04:41:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f0219ac1700 1 --1- 172.21.15.37:0/3295892028 >> v1:172.21.15.37:6789/0 conn(0x7f02141531e0 0x7f021415cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43966/0 (socket says 172.21.15.37:43966) 2023-10-06T04:41:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94e0003a90 0x7f94f40ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40a78e0 0x7f94f416a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94f40a7d30 0x7f94f416a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f3fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40aad50 con 0x7f94f40a7d30 2023-10-06T04:41:27.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f3fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40a9ee0 con 0x7f94e0003a90 2023-10-06T04:41:27.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f3fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40ca7f0 con 0x7f94f40a78e0 2023-10-06T04:41:27.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 -- start start 2023-10-06T04:41:27.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f2ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94e0003a90 0x7f94f40ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f0218abf700 1 -- 172.21.15.37:0/3295892028 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181532141 0 0) 0x7f02140cd5e0 con 0x7f021415d2e0 2023-10-06T04:41:27.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f0218abf700 1 -- 172.21.15.37:0/3295892028 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0200003570 con 0x7f021415d2e0 2023-10-06T04:41:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f27fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40a78e0 0x7f94f416a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f2ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94e0003a90 0x7f94f40ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:40770/0 (socket says 172.21.15.37:40770) 2023-10-06T04:41:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f2ffd700 1 -- 172.21.15.37:0/945514174 learned_addr learned my addr 172.21.15.37:0/945514174 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f37fe700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94f40a7d30 0x7f94f416a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f0218abf700 1 -- 172.21.15.37:0/3295892028 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059541356 0 0) 0x7f021415b1e0 con 0x7f02141531e0 2023-10-06T04:41:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021a2c2700 1 -- 172.21.15.37:0/3295892028 >> v1:172.21.15.83:6789/0 conn(0x7f021415d2e0 legacy=0x7f02140cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021a2c2700 1 -- 172.21.15.37:0/3295892028 >> v1:172.21.15.37:6789/0 conn(0x7f02141531e0 legacy=0x7f021415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021a2c2700 1 -- 172.21.15.37:0/3295892028 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021415ab90 con 0x7f021415c680 2023-10-06T04:41:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f37fe700 1 -- 172.21.15.37:0/945514174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40a78e0 msgr2=0x7f94f416a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f37fe700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40a78e0 0x7f94f416a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f37fe700 1 -- 172.21.15.37:0/945514174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94e0003a90 msgr2=0x7f94f40ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f37fe700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94e0003a90 0x7f94f40ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f94f37fe700 1 -- 172.21.15.37:0/945514174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f40aa140 con 0x7f94f40a7d30 2023-10-06T04:41:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7f021a2c2700 1 --2- 172.21.15.37:0/3295892028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021415c680 0x7f02140ccf80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f020c009f20 tx=0x7f020c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2fd99ff6328b56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec0ac840 0x7fefec06b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefec0acc10 0x7fefec13d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefec158f10 0x7fefec13dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefec16d0a0 con 0x7fefec0acc10 2023-10-06T04:41:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefec150060 con 0x7fefec158f10 2023-10-06T04:41:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.276+0000 7feff39ae700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefec14f730 con 0x7fefec0ac840 2023-10-06T04:41:27.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f94f37fe700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94f40a7d30 0x7f94f416a550 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f94f406d170 tx=0x7f94ec00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:27.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff0f49700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefec0acc10 0x7fefec13d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff174a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec0ac840 0x7fefec06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff174a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec0ac840 0x7fefec06b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:32872/0 (socket says 172.21.15.37:32872) 2023-10-06T04:41:27.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff174a700 1 -- 172.21.15.37:0/3240261182 learned_addr learned my addr 172.21.15.37:0/3240261182 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:27.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff1f4b700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefec158f10 0x7fefec13dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f0218abf700 1 -- 172.21.15.37:0/3295892028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c00e070 con 0x7f021415c680 2023-10-06T04:41:27.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f0218abf700 1 -- 172.21.15.37:0/3295892028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c00b9d0 con 0x7f021415c680 2023-10-06T04:41:27.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f0218abf700 1 -- 172.21.15.37:0/3295892028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c0092e0 con 0x7f021415c680 2023-10-06T04:41:27.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f94eaffd700 1 -- 172.21.15.37:0/945514174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00f070 con 0x7f94f40a7d30 2023-10-06T04:41:27.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f94eaffd700 1 -- 172.21.15.37:0/945514174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec010040 con 0x7f94f40a7d30 2023-10-06T04:41:27.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f94f3fff700 1 -- 172.21.15.37:0/945514174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f40aa420 con 0x7f94f40a7d30 2023-10-06T04:41:27.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f94eaffd700 1 -- 172.21.15.37:0/945514174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec007c10 con 0x7f94f40a7d30 2023-10-06T04:41:27.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f94f3fff700 1 -- 172.21.15.37:0/945514174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f40aa9e0 con 0x7f94f40a7d30 2023-10-06T04:41:27.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff0f49700 1 -- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec0ac840 msgr2=0x7fefec06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff0f49700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec0ac840 0x7fefec06b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff0f49700 1 -- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefec158f10 msgr2=0x7fefec13dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff0f49700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefec158f10 0x7fefec13dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff0f49700 1 -- 172.21.15.37:0/3240261182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe8009420 con 0x7fefec0acc10 2023-10-06T04:41:27.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff174a700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec0ac840 0x7fefec06b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:27.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff0f49700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefec0acc10 0x7fefec13d7d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00ea80 tx=0x7fefdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:27.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7fefe17fa700 1 -- 172.21.15.37:0/3240261182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc00eec0 con 0x7fefec0acc10 2023-10-06T04:41:27.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7fefe17fa700 1 -- 172.21.15.37:0/3240261182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc00c7f0 con 0x7fefec0acc10 2023-10-06T04:41:27.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff39ae700 1 -- 172.21.15.37:0/3240261182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefec14fa10 con 0x7fefec0acc10 2023-10-06T04:41:27.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f94f3fff700 1 -- 172.21.15.37:0/945514174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f406ad70 con 0x7f94f40a7d30 2023-10-06T04:41:27.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f94eaffd700 1 -- 172.21.15.37:0/945514174 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f94ec016480 con 0x7f94f40a7d30 2023-10-06T04:41:27.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff39ae700 1 -- 172.21.15.37:0/3240261182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefec1504f0 con 0x7fefec0acc10 2023-10-06T04:41:27.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7fefe17fa700 1 -- 172.21.15.37:0/3240261182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc00cb70 con 0x7fefec0acc10 2023-10-06T04:41:27.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f021bd25700 1 -- 172.21.15.37:0/3295892028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021415c680 msgr2=0x7f02140ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f021bd25700 1 --2- 172.21.15.37:0/3295892028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021415c680 0x7f02140ccf80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f020c009f20 tx=0x7f020c009840 comp rx=0 tx=0).stop 2023-10-06T04:41:27.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f021bd25700 1 -- 172.21.15.37:0/3295892028 shutdown_connections 2023-10-06T04:41:27.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f021bd25700 1 --2- 172.21.15.37:0/3295892028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021415c680 0x7f02140ccf80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f021bd25700 1 -- 172.21.15.37:0/3295892028 >> 172.21.15.37:0/3295892028 conn(0x7f0214087ab0 msgr2=0x7f0214067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:27.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7feff39ae700 1 -- 172.21.15.37:0/3240261182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefcc0052b0 con 0x7fefec0acc10 2023-10-06T04:41:27.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7fefe17fa700 1 -- 172.21.15.37:0/3240261182 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fefdc013470 con 0x7fefec0acc10 2023-10-06T04:41:27.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f021bd25700 1 -- 172.21.15.37:0/3295892028 shutdown_connections 2023-10-06T04:41:27.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.280+0000 7f021bd25700 1 -- 172.21.15.37:0/3295892028 wait complete. 2023-10-06T04:41:27.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f94eaffd700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f94d4060580 0x7f94d4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f94eaffd700 1 -- 172.21.15.37:0/945514174 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f94ec07d2a0 con 0x7f94f40a7d30 2023-10-06T04:41:27.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7fefe17fa700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fefd0060550 0x7fefd0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f94f2ffd700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f94d4060580 0x7f94d4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7fefe17fa700 1 -- 172.21.15.37:0/3240261182 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fefdc07cb90 con 0x7fefec0acc10 2023-10-06T04:41:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7feff174a700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fefd0060550 0x7fefd0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f94f2ffd700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f94d4060580 0x7f94d4062a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f94dc007d10 tx=0x7f94dc015000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7feff174a700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fefd0060550 0x7fefd0062a00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fefe4002250 tx=0x7fefe4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021bd25700 1 Processor -- start 2023-10-06T04:41:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021bd25700 1 -- start start 2023-10-06T04:41:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021bd25700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f021415c680 0x7f02140c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021bd25700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f021415d2e0 0x7f021416c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021bd25700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214169280 0x7f02140b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021bd25700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02140b3c90 con 0x7f0214169280 2023-10-06T04:41:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021bd25700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02140c8b50 con 0x7f021415c680 2023-10-06T04:41:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021bd25700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02140b39f0 con 0x7f021415d2e0 2023-10-06T04:41:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021a2c2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214169280 0x7f02140b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021a2c2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214169280 0x7f02140b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45946/0 (socket says 172.21.15.37:45946) 2023-10-06T04:41:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021a2c2700 1 -- 172.21.15.37:0/3942726557 learned_addr learned my addr 172.21.15.37:0/3942726557 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f0219ac1700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f021415c680 0x7f02140c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f02192c0700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f021415d2e0 0x7f021416c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021a2c2700 1 -- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f021415d2e0 msgr2=0x7f021416c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021a2c2700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f021415d2e0 0x7f021416c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.284+0000 7f021a2c2700 1 -- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f021415c680 msgr2=0x7f02140c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.288+0000 7f021a2c2700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f021415c680 0x7f02140c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.288+0000 7f021a2c2700 1 -- 172.21.15.37:0/3942726557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c009ae0 con 0x7f0214169280 2023-10-06T04:41:27.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.288+0000 7f021a2c2700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214169280 0x7f02140b34b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f020c00b610 tx=0x7f020c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:27.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.288+0000 7f94eaffd700 1 -- 172.21.15.37:0/945514174 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f94f406ad70 con 0x7f94f40a7d30 2023-10-06T04:41:27.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.292+0000 7f0209ffb700 1 -- 172.21.15.37:0/3942726557 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c008b00 con 0x7f0214169280 2023-10-06T04:41:27.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.292+0000 7f0209ffb700 1 -- 172.21.15.37:0/3942726557 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c008c60 con 0x7f0214169280 2023-10-06T04:41:27.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.292+0000 7f021bd25700 1 -- 172.21.15.37:0/3942726557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0214169720 con 0x7f0214169280 2023-10-06T04:41:27.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.292+0000 7f0209ffb700 1 -- 172.21.15.37:0/3942726557 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c026460 con 0x7f0214169280 2023-10-06T04:41:27.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.292+0000 7f021bd25700 1 -- 172.21.15.37:0/3942726557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02140c8500 con 0x7f0214169280 2023-10-06T04:41:27.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.292+0000 7fefe17fa700 1 -- 172.21.15.37:0/3240261182 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fefdc04cf20 con 0x7fefec0acc10 2023-10-06T04:41:27.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.292+0000 7f021bd25700 1 -- 172.21.15.37:0/3942726557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0214070ee0 con 0x7f0214169280 2023-10-06T04:41:27.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.296+0000 7f0209ffb700 1 -- 172.21.15.37:0/3942726557 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f020c003040 con 0x7f0214169280 2023-10-06T04:41:27.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.296+0000 7f0209ffb700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f01f8060580 0x7f01f8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:27.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.296+0000 7f0209ffb700 1 -- 172.21.15.37:0/3942726557 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f020c07ed50 con 0x7f0214169280 2023-10-06T04:41:27.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.296+0000 7f0219ac1700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f01f8060580 0x7f01f8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:27.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.296+0000 7f0219ac1700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f01f8060580 0x7f01f8062a30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0210007180 tx=0x7f0210007ef0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:27.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.304+0000 7f0209ffb700 1 -- 172.21.15.37:0/3942726557 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f020c04f080 con 0x7f0214169280 2023-10-06T04:41:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.468+0000 7fe6b3284700 1 -- 172.21.15.37:0/4016175861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7fe6ac0cbb40 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.516+0000 7feff39ae700 1 -- 172.21.15.37:0/3240261182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fefcc005830 con 0x7fefec0acc10 2023-10-06T04:41:27.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.560+0000 7f94f3fff700 1 -- 172.21.15.37:0/945514174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f94f406ad70 con 0x7f94f40a7d30 2023-10-06T04:41:27.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.568+0000 7f021bd25700 1 -- 172.21.15.37:0/3942726557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7f02140b1ba0 con 0x7f0214169280 2023-10-06T04:41:27.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.864+0000 7fe6a27fc700 1 -- 172.21.15.37:0/4016175861 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5246 v28) v1 ==== 95+0+0 (secure 0 0 0) 0x7fe6a80546b0 con 0x7fe6ac0ae0a0 2023-10-06T04:41:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.868+0000 7fe6b3284700 1 -- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe690060550 msgr2=0x7fe690062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.868+0000 7fe6b3284700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe690060550 0x7fe690062a00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0c72a0 tx=0x7fe69c008040 comp rx=0 tx=0).stop 2023-10-06T04:41:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.868+0000 7fe6b3284700 1 -- 172.21.15.37:0/4016175861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac0ae0a0 msgr2=0x7fe6ac096a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.868+0000 7fe6b3284700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac0ae0a0 0x7fe6ac096a20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac06cea0 tx=0x7fe6a801b000 comp rx=0 tx=0).stop 2023-10-06T04:41:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.868+0000 7fe6b3284700 1 -- 172.21.15.37:0/4016175861 shutdown_connections 2023-10-06T04:41:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.868+0000 7fe6b3284700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe690060550 0x7fe690062a00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.868+0000 7fe6b3284700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6ac158d10 0x7fe6ac098a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.868+0000 7fe6b3284700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6ac1590e0 0x7fe6ac157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.868+0000 7fe6b3284700 1 --2- 172.21.15.37:0/4016175861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac0ae0a0 0x7fe6ac096a20 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.868+0000 7fe6b3284700 1 -- 172.21.15.37:0/4016175861 >> 172.21.15.37:0/4016175861 conn(0x7fe6ac0ccb50 msgr2=0x7fe6ac0af6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.868+0000 7fe6b3284700 1 -- 172.21.15.37:0/4016175861 shutdown_connections 2023-10-06T04:41:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.868+0000 7fe6b3284700 1 -- 172.21.15.37:0/4016175861 wait complete. 2023-10-06T04:41:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:failed mds gid 5246 2023-10-06T04:41:27.880 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T04:41:27.876+0000 7f2a8352f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:41:27.889 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:41:27.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:41:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.884+0000 7fefe17fa700 1 -- 172.21.15.37:0/3240261182 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5240 v29) v1 ==== 95+0+0 (secure 0 0 0) 0x7fefdc050540 con 0x7fefec0acc10 2023-10-06T04:41:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.884+0000 7f94eaffd700 1 -- 172.21.15.37:0/945514174 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5249 v29) v1 ==== 95+0+0 (secure 0 0 0) 0x7f94f406ad70 con 0x7f94f40a7d30 2023-10-06T04:41:27.892 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:41:27.892 DEBUG:teuthology.parallel:result is None 2023-10-06T04:41:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7f94f3fff700 1 -- 172.21.15.37:0/945514174 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f94d4060580 msgr2=0x7f94d4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7f94f3fff700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f94d4060580 0x7f94d4062a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f94dc007d10 tx=0x7f94dc015000 comp rx=0 tx=0).stop 2023-10-06T04:41:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7f94f3fff700 1 -- 172.21.15.37:0/945514174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94f40a7d30 msgr2=0x7f94f416a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7f94f3fff700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94f40a7d30 0x7f94f416a550 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f94f406d170 tx=0x7f94ec00c040 comp rx=0 tx=0).stop 2023-10-06T04:41:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7f94f3fff700 1 -- 172.21.15.37:0/945514174 shutdown_connections 2023-10-06T04:41:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7f94f3fff700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f94d4060580 0x7f94d4062a30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7f94f3fff700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94f40a7d30 0x7f94f416a550 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7f94f3fff700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94f40a78e0 0x7f94f416a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7f94f3fff700 1 --2- 172.21.15.37:0/945514174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94e0003a90 0x7f94f40ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7f94f3fff700 1 -- 172.21.15.37:0/945514174 >> 172.21.15.37:0/945514174 conn(0x7f94f40cca70 msgr2=0x7f94f40a5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7f94f3fff700 1 -- 172.21.15.37:0/945514174 shutdown_connections 2023-10-06T04:41:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7f94f3fff700 1 -- 172.21.15.37:0/945514174 wait complete. 2023-10-06T04:41:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7feff39ae700 1 -- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fefd0060550 msgr2=0x7fefd0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7feff39ae700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fefd0060550 0x7fefd0062a00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fefe4002250 tx=0x7fefe4009040 comp rx=0 tx=0).stop 2023-10-06T04:41:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7feff39ae700 1 -- 172.21.15.37:0/3240261182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefec0acc10 msgr2=0x7fefec13d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7feff39ae700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefec0acc10 0x7fefec13d7d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00ea80 tx=0x7fefdc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7feff39ae700 1 -- 172.21.15.37:0/3240261182 shutdown_connections 2023-10-06T04:41:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7feff39ae700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fefd0060550 0x7fefd0062a00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7feff39ae700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefec158f10 0x7fefec13dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7feff39ae700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefec0acc10 0x7fefec13d7d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7feff39ae700 1 --2- 172.21.15.37:0/3240261182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefec0ac840 0x7fefec06b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:27.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.888+0000 7feff39ae700 1 -- 172.21.15.37:0/3240261182 >> 172.21.15.37:0/3240261182 conn(0x7fefec0ccc60 msgr2=0x7fefec155a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:27.896 INFO:teuthology.orchestra.run.smithi037.stderr:failed mds gid 5249 2023-10-06T04:41:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.892+0000 7feff39ae700 1 -- 172.21.15.37:0/3240261182 shutdown_connections 2023-10-06T04:41:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:27.892+0000 7feff39ae700 1 -- 172.21.15.37:0/3240261182 wait complete. 2023-10-06T04:41:27.899 INFO:teuthology.orchestra.run.smithi037.stderr:failed mds gid 5240 2023-10-06T04:41:27.911 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:41:27.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:41:27.913 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:41:27.913 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:41:27.914 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:41:27.914 DEBUG:teuthology.parallel:result is None 2023-10-06T04:41:27.915 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:41:27.916 DEBUG:teuthology.parallel:result is None 2023-10-06T04:41:27.963 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T04:41:27.975 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T04:41:27.991 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T04:41:28.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.888+0000 7f0209ffb700 1 -- 172.21.15.37:0/3942726557 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5237 v30) v1 ==== 95+0+0 (secure 0 0 0) 0x7f020c0526a0 con 0x7f0214169280 2023-10-06T04:41:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.892+0000 7f021bd25700 1 -- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f01f8060580 msgr2=0x7f01f8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.892+0000 7f021bd25700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f01f8060580 0x7f01f8062a30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0210007180 tx=0x7f0210007ef0 comp rx=0 tx=0).stop 2023-10-06T04:41:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.892+0000 7f021bd25700 1 -- 172.21.15.37:0/3942726557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214169280 msgr2=0x7f02140b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.892+0000 7f021bd25700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214169280 0x7f02140b34b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f020c00b610 tx=0x7f020c018000 comp rx=0 tx=0).stop 2023-10-06T04:41:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.892+0000 7f021bd25700 1 -- 172.21.15.37:0/3942726557 shutdown_connections 2023-10-06T04:41:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.892+0000 7f021bd25700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f01f8060580 0x7f01f8062a30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.892+0000 7f021bd25700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214169280 0x7f02140b34b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.892+0000 7f021bd25700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f021415d2e0 0x7f021416c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.892+0000 7f021bd25700 1 --2- 172.21.15.37:0/3942726557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f021415c680 0x7f02140c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.892+0000 7f021bd25700 1 -- 172.21.15.37:0/3942726557 >> 172.21.15.37:0/3942726557 conn(0x7f02141531e0 msgr2=0x7f02140ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:28.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.892+0000 7f021bd25700 1 -- 172.21.15.37:0/3942726557 shutdown_connections 2023-10-06T04:41:28.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:28.892+0000 7f021bd25700 1 -- 172.21.15.37:0/3942726557 wait complete. 2023-10-06T04:41:28.900 INFO:teuthology.orchestra.run.smithi037.stderr:failed mds gid 5237 2023-10-06T04:41:28.918 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:41:28.918 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:41:28.920 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:41:28.920 DEBUG:teuthology.parallel:result is None 2023-10-06T04:41:28.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:41:28.993 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T04:41:29.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.024+0000 7f041cfba700 1 Processor -- start 2023-10-06T04:41:29.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.024+0000 7f041cfba700 1 -- start start 2023-10-06T04:41:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041cfba700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f041815c680 0x7f04180ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041cfba700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041815b1e0 con 0x7f041815d2e0 2023-10-06T04:41:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041cfba700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04180cd5e0 con 0x7f04181531e0 2023-10-06T04:41:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041cfba700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041815a8b0 con 0x7f041815c680 2023-10-06T04:41:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f0416d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f041815c680 0x7f04180ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:29.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041659c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f04181531e0 0x7f041815cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:45770/0 (socket says 172.21.15.37:45770) 2023-10-06T04:41:29.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f0415d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f041815d2e0 0x7f04180cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42072/0 (socket says 172.21.15.37:42072) 2023-10-06T04:41:29.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041659c700 1 -- 172.21.15.37:0/1235045820 learned_addr learned my addr 172.21.15.37:0/1235045820 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041559a700 1 -- 172.21.15.37:0/1235045820 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912448328 0 0) 0x7f04180cd5e0 con 0x7f04181531e0 2023-10-06T04:41:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041559a700 1 -- 172.21.15.37:0/1235045820 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0400003570 con 0x7f04181531e0 2023-10-06T04:41:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f0416d9d700 1 -- 172.21.15.37:0/1235045820 >> v1:172.21.15.83:6789/0 conn(0x7f04181531e0 legacy=0x7f041815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f0416d9d700 1 -- 172.21.15.37:0/1235045820 >> v1:172.21.15.37:6789/0 conn(0x7f041815d2e0 legacy=0x7f04180cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041559a700 1 -- 172.21.15.37:0/1235045820 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246549447 0 0) 0x7f041815b1e0 con 0x7f041815d2e0 2023-10-06T04:41:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f0416d9d700 1 -- 172.21.15.37:0/1235045820 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041815ab90 con 0x7f041815c680 2023-10-06T04:41:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f0416d9d700 1 --2- 172.21.15.37:0/1235045820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f041815c680 0x7f04180ccf80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0410009e60 tx=0x7f0410009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c0deb27db7022b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041559a700 1 -- 172.21.15.37:0/1235045820 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041000e070 con 0x7f041815c680 2023-10-06T04:41:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041559a700 1 -- 172.21.15.37:0/1235045820 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041000bb60 con 0x7f041815c680 2023-10-06T04:41:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041559a700 1 -- 172.21.15.37:0/1235045820 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041000bee0 con 0x7f041815c680 2023-10-06T04:41:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041cfba700 1 -- 172.21.15.37:0/1235045820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f041815c680 msgr2=0x7f04180ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041cfba700 1 --2- 172.21.15.37:0/1235045820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f041815c680 0x7f04180ccf80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0410009e60 tx=0x7f0410009780 comp rx=0 tx=0).stop 2023-10-06T04:41:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041cfba700 1 -- 172.21.15.37:0/1235045820 shutdown_connections 2023-10-06T04:41:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041cfba700 1 --2- 172.21.15.37:0/1235045820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f041815c680 0x7f04180ccf80 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041cfba700 1 -- 172.21.15.37:0/1235045820 >> 172.21.15.37:0/1235045820 conn(0x7f0418087ab0 msgr2=0x7f0418067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041cfba700 1 -- 172.21.15.37:0/1235045820 shutdown_connections 2023-10-06T04:41:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.028+0000 7f041cfba700 1 -- 172.21.15.37:0/1235045820 wait complete. 2023-10-06T04:41:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.032+0000 7f041cfba700 1 Processor -- start 2023-10-06T04:41:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.032+0000 7f041cfba700 1 -- start start 2023-10-06T04:41:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f041cfba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f041815c680 0x7f04180c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f041cfba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f041815d2e0 0x7f04180b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f041cfba700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0418151420 0x7f0418152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f041cfba700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04180c7dd0 con 0x7f041815d2e0 2023-10-06T04:41:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f041cfba700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04180c80b0 con 0x7f0418151420 2023-10-06T04:41:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f041cfba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04180c8390 con 0x7f041815c680 2023-10-06T04:41:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f0415d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f041815d2e0 0x7f04180b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f0415d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f041815d2e0 0x7f04180b0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46978/0 (socket says 172.21.15.37:46978) 2023-10-06T04:41:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f0415d9b700 1 -- 172.21.15.37:0/1867186682 learned_addr learned my addr 172.21.15.37:0/1867186682 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f0416d9d700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0418151420 0x7f0418152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f041659c700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f041815c680 0x7f04180c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f0415d9b700 1 -- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f041815c680 msgr2=0x7f04180c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f0415d9b700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f041815c680 0x7f04180c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f0415d9b700 1 -- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0418151420 msgr2=0x7f0418152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:29.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f0415d9b700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0418151420 0x7f0418152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:29.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f0415d9b700 1 -- 172.21.15.37:0/1867186682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0410009a20 con 0x7f041815d2e0 2023-10-06T04:41:29.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f0416d9d700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0418151420 0x7f0418152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:29.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f0415d9b700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f041815d2e0 0x7f04180b0a30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f040c0011e0 tx=0x7f040c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:29.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f04067fc700 1 -- 172.21.15.37:0/1867186682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c005a70 con 0x7f041815d2e0 2023-10-06T04:41:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f04067fc700 1 -- 172.21.15.37:0/1867186682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c005bd0 con 0x7f041815d2e0 2023-10-06T04:41:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f041cfba700 1 -- 172.21.15.37:0/1867186682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04180c8670 con 0x7f041815d2e0 2023-10-06T04:41:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f04067fc700 1 -- 172.21.15.37:0/1867186682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0070d0 con 0x7f041815d2e0 2023-10-06T04:41:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f041cfba700 1 -- 172.21.15.37:0/1867186682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04180c89e0 con 0x7f041815d2e0 2023-10-06T04:41:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.036+0000 7f041cfba700 1 -- 172.21.15.37:0/1867186682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0418070ee0 con 0x7f041815d2e0 2023-10-06T04:41:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.040+0000 7f04067fc700 1 -- 172.21.15.37:0/1867186682 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f040c007480 con 0x7f041815d2e0 2023-10-06T04:41:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.040+0000 7f04067fc700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f03f8060550 0x7f03f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.040+0000 7f04067fc700 1 -- 172.21.15.37:0/1867186682 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f040c07c790 con 0x7f041815d2e0 2023-10-06T04:41:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.040+0000 7f041659c700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f03f8060550 0x7f03f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:29.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.040+0000 7f041659c700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f03f8060550 0x7f03f8062a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0408007fd0 tx=0x7f0408009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:29.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.044+0000 7f04067fc700 1 -- 172.21.15.37:0/1867186682 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f040c04cb40 con 0x7f041815d2e0 2023-10-06T04:41:29.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.236+0000 7f041cfba700 1 -- 172.21.15.37:0/1867186682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04180d08f0 con 0x7f041815d2e0 2023-10-06T04:41:29.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f04067fc700 1 -- 172.21.15.37:0/1867186682 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+3838 (secure 0 0 0) 0x7f040c017090 con 0x7f041815d2e0 2023-10-06T04:41:29.245 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:29.245 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3716256971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3716256971},{"type":"v1","addr":"172.21.15.37:6833","nonce":3716256971}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/893255287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":893255287},{"type":"v1","addr":"172.21.15.37:6835","nonce":893255287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:54.053558+0000","modified":"2023-10-06T04:41:28.891315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":58,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"b","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.83:6835/1381995756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1381995756},{"type":"v1","addr":"172.21.15.83:6835","nonce":1381995756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:41:29.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f041cfba700 1 -- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f03f8060550 msgr2=0x7f03f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:29.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f041cfba700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f03f8060550 0x7f03f8062a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0408007fd0 tx=0x7f0408009040 comp rx=0 tx=0).stop 2023-10-06T04:41:29.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f041cfba700 1 -- 172.21.15.37:0/1867186682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f041815d2e0 msgr2=0x7f04180b0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:29.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f041cfba700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f041815d2e0 0x7f04180b0a30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f040c0011e0 tx=0x7f040c007e10 comp rx=0 tx=0).stop 2023-10-06T04:41:29.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f041cfba700 1 -- 172.21.15.37:0/1867186682 shutdown_connections 2023-10-06T04:41:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f041cfba700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f03f8060550 0x7f03f8062a00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f041cfba700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0418151420 0x7f0418152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f041cfba700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f041815d2e0 0x7f04180b0a30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f041cfba700 1 --2- 172.21.15.37:0/1867186682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f041815c680 0x7f04180c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f041cfba700 1 -- 172.21.15.37:0/1867186682 >> 172.21.15.37:0/1867186682 conn(0x7f04181531e0 msgr2=0x7f04180c5160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f041cfba700 1 -- 172.21.15.37:0/1867186682 shutdown_connections 2023-10-06T04:41:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:29.240+0000 7f041cfba700 1 -- 172.21.15.37:0/1867186682 wait complete. 2023-10-06T04:41:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2023-10-06T04:41:29.662 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:40:54.053558+0000', 'modified': '2023-10-06T04:41:28.891315+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 58, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5836}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5836': {'gid': 5836, 'name': 'b', 'rank': 0, 'incarnation': 31, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.83:6835/1381995756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6834', 'nonce': 1381995756}, {'type': 'v1', 'addr': '172.21.15.83:6835', 'nonce': 1381995756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:41:29.662 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5836:up:replay 2023-10-06T04:41:30.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:41:30.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.772+0000 7f0ceed02700 1 Processor -- start 2023-10-06T04:41:30.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.772+0000 7f0ceed02700 1 -- start start 2023-10-06T04:41:30.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceed02700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce81562d0 0x7f0ce80caf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:30.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceed02700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce814d270 con 0x7f0ce814cea0 2023-10-06T04:41:30.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceed02700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce8156770 con 0x7f0ce80c8490 2023-10-06T04:41:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceed02700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8156a50 con 0x7f0ce81562d0 2023-10-06T04:41:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceca9e700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0ce814cea0 0x7f0ce80c7d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42082/0 (socket says 172.21.15.37:42082) 2023-10-06T04:41:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceca9e700 1 -- 172.21.15.37:0/2257786729 learned_addr learned my addr 172.21.15.37:0/2257786729 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ce7fff700 1 --2- 172.21.15.37:0/2257786729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce81562d0 0x7f0ce80caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ce77fe700 1 -- 172.21.15.37:0/2257786729 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142696611 0 0) 0x7f0ce814d270 con 0x7f0ce814cea0 2023-10-06T04:41:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ce77fe700 1 -- 172.21.15.37:0/2257786729 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd8003570 con 0x7f0ce814cea0 2023-10-06T04:41:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ce77fe700 1 -- 172.21.15.37:0/2257786729 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809192645 0 0) 0x7f0ce8156770 con 0x7f0ce80c8490 2023-10-06T04:41:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ce7fff700 1 -- 172.21.15.37:0/2257786729 >> v1:172.21.15.83:6789/0 conn(0x7f0ce80c8490 legacy=0x7f0ce806a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ce7fff700 1 -- 172.21.15.37:0/2257786729 >> v1:172.21.15.37:6789/0 conn(0x7f0ce814cea0 legacy=0x7f0ce80c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ce7fff700 1 -- 172.21.15.37:0/2257786729 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce8156d30 con 0x7f0ce81562d0 2023-10-06T04:41:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ce7fff700 1 --2- 172.21.15.37:0/2257786729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce81562d0 0x7f0ce80caf70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009910 tx=0x7f0cd40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9584ffe3c76608d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ce77fe700 1 -- 172.21.15.37:0/2257786729 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400b680 con 0x7f0ce81562d0 2023-10-06T04:41:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ce77fe700 1 -- 172.21.15.37:0/2257786729 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd400b7e0 con 0x7f0ce81562d0 2023-10-06T04:41:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ce77fe700 1 -- 172.21.15.37:0/2257786729 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400bba0 con 0x7f0ce81562d0 2023-10-06T04:41:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceed02700 1 -- 172.21.15.37:0/2257786729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce81562d0 msgr2=0x7f0ce80caf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceed02700 1 --2- 172.21.15.37:0/2257786729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce81562d0 0x7f0ce80caf70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009910 tx=0x7f0cd40091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceed02700 1 -- 172.21.15.37:0/2257786729 shutdown_connections 2023-10-06T04:41:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceed02700 1 --2- 172.21.15.37:0/2257786729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce81562d0 0x7f0ce80caf70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceed02700 1 -- 172.21.15.37:0/2257786729 >> 172.21.15.37:0/2257786729 conn(0x7f0ce80cc180 msgr2=0x7f0ce80cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceed02700 1 -- 172.21.15.37:0/2257786729 shutdown_connections 2023-10-06T04:41:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.776+0000 7f0ceed02700 1 -- 172.21.15.37:0/2257786729 wait complete. 2023-10-06T04:41:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.780+0000 7f0ceed02700 1 Processor -- start 2023-10-06T04:41:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.780+0000 7f0ceed02700 1 -- start start 2023-10-06T04:41:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.780+0000 7f0ceed02700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce80c8490 0x7f0ce8169840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.780+0000 7f0ceed02700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce814cea0 0x7f0ce80c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceed02700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ce81562d0 0x7f0ce8144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceed02700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8168e30 con 0x7f0ce80c8490 2023-10-06T04:41:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceed02700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce81693b0 con 0x7f0ce81562d0 2023-10-06T04:41:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceed02700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8169d80 con 0x7f0ce814cea0 2023-10-06T04:41:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceca9e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce80c8490 0x7f0ce8169840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceca9e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce80c8490 0x7f0ce8169840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46988/0 (socket says 172.21.15.37:46988) 2023-10-06T04:41:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceca9e700 1 -- 172.21.15.37:0/1753305835 learned_addr learned my addr 172.21.15.37:0/1753305835 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ce7fff700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce814cea0 0x7f0ce80c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ced29f700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ce81562d0 0x7f0ce8144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceca9e700 1 -- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce814cea0 msgr2=0x7f0ce80c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceca9e700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce814cea0 0x7f0ce80c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceca9e700 1 -- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ce81562d0 msgr2=0x7f0ce8144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceca9e700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ce81562d0 0x7f0ce8144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceca9e700 1 -- 172.21.15.37:0/1753305835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd4009420 con 0x7f0ce80c8490 2023-10-06T04:41:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ce7fff700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce814cea0 0x7f0ce80c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ced29f700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ce81562d0 0x7f0ce8144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceca9e700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce80c8490 0x7f0ce8169840 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0011e0 tx=0x7f0cdc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ce4ff9700 1 -- 172.21.15.37:0/1753305835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc005b30 con 0x7f0ce80c8490 2023-10-06T04:41:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ce4ff9700 1 -- 172.21.15.37:0/1753305835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc005c90 con 0x7f0ce80c8490 2023-10-06T04:41:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceed02700 1 -- 172.21.15.37:0/1753305835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce80c2010 con 0x7f0ce80c8490 2023-10-06T04:41:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ce4ff9700 1 -- 172.21.15.37:0/1753305835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc007340 con 0x7f0ce80c8490 2023-10-06T04:41:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceed02700 1 -- 172.21.15.37:0/1753305835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce8169040 con 0x7f0ce80c8490 2023-10-06T04:41:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ceed02700 1 -- 172.21.15.37:0/1753305835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce804be00 con 0x7f0ce80c8490 2023-10-06T04:41:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.784+0000 7f0ce4ff9700 1 -- 172.21.15.37:0/1753305835 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0cdc0076b0 con 0x7f0ce80c8490 2023-10-06T04:41:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.788+0000 7f0ce4ff9700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0ccc060550 0x7f0ccc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.788+0000 7f0ce4ff9700 1 -- 172.21.15.37:0/1753305835 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f0cdc07e7a0 con 0x7f0ce80c8490 2023-10-06T04:41:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.788+0000 7f0ce7fff700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0ccc060550 0x7f0ccc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.788+0000 7f0ce7fff700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0ccc060550 0x7f0ccc062a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0ce81566a0 tx=0x7f0cd4017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.796+0000 7f0ce4ff9700 1 -- 172.21.15.37:0/1753305835 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0cdc04eaa0 con 0x7f0ce80c8490 2023-10-06T04:41:30.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.988+0000 7f0ceed02700 1 -- 172.21.15.37:0/1753305835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ce8069ed0 con 0x7f0ce80c8490 2023-10-06T04:41:30.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.988+0000 7f0ce4ff9700 1 -- 172.21.15.37:0/1753305835 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f0cdc0520c0 con 0x7f0ce80c8490 2023-10-06T04:41:30.995 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:30.995 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3716256971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3716256971},{"type":"v1","addr":"172.21.15.37:6833","nonce":3716256971}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/893255287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":893255287},{"type":"v1","addr":"172.21.15.37:6835","nonce":893255287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3794492713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3794492713},{"type":"v1","addr":"172.21.15.83:6837","nonce":3794492713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:54.053558+0000","modified":"2023-10-06T04:41:30.906661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":58,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"b","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.83:6835/1381995756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1381995756},{"type":"v1","addr":"172.21.15.83:6835","nonce":1381995756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:41:30.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.992+0000 7f0ceed02700 1 -- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0ccc060550 msgr2=0x7f0ccc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.992+0000 7f0ceed02700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0ccc060550 0x7f0ccc062a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0ce81566a0 tx=0x7f0cd4017000 comp rx=0 tx=0).stop 2023-10-06T04:41:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.992+0000 7f0ceed02700 1 -- 172.21.15.37:0/1753305835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce80c8490 msgr2=0x7f0ce8169840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.992+0000 7f0ceed02700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce80c8490 0x7f0ce8169840 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0011e0 tx=0x7f0cdc007df0 comp rx=0 tx=0).stop 2023-10-06T04:41:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.992+0000 7f0ceed02700 1 -- 172.21.15.37:0/1753305835 shutdown_connections 2023-10-06T04:41:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.992+0000 7f0ceed02700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0ccc060550 0x7f0ccc062a00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.992+0000 7f0ceed02700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ce81562d0 0x7f0ce8144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.992+0000 7f0ceed02700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce814cea0 0x7f0ce80c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.992+0000 7f0ceed02700 1 --2- 172.21.15.37:0/1753305835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce80c8490 0x7f0ce8169840 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.992+0000 7f0ceed02700 1 -- 172.21.15.37:0/1753305835 >> 172.21.15.37:0/1753305835 conn(0x7f0ce80cc180 msgr2=0x7f0ce8147150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.992+0000 7f0ceed02700 1 -- 172.21.15.37:0/1753305835 shutdown_connections 2023-10-06T04:41:30.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:30.992+0000 7f0ceed02700 1 -- 172.21.15.37:0/1753305835 wait complete. 2023-10-06T04:41:30.999 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 33 2023-10-06T04:41:31.411 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:40:54.053558+0000', 'modified': '2023-10-06T04:41:30.906661+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 58, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5836}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5836': {'gid': 5836, 'name': 'b', 'rank': 0, 'incarnation': 31, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.83:6835/1381995756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6834', 'nonce': 1381995756}, {'type': 'v1', 'addr': '172.21.15.83:6835', 'nonce': 1381995756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:41:31.412 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5836:up:rejoin 2023-10-06T04:41:32.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:41:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6b23a700 1 Processor -- start 2023-10-06T04:41:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6b23a700 1 -- start start 2023-10-06T04:41:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6b23a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed640ad560 0x7fed640ad930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6b23a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640cc3f0 0x7fed640c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6b23a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed640ca810 con 0x7fed640caca0 2023-10-06T04:41:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6b23a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed641570a0 con 0x7fed640ad560 2023-10-06T04:41:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6b23a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed640c9c00 con 0x7fed640cc3f0 2023-10-06T04:41:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6a238700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed640ad560 0x7fed640ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6aa39700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed640caca0 0x7fed6406d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42096/0 (socket says 172.21.15.37:42096) 2023-10-06T04:41:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6aa39700 1 -- 172.21.15.37:0/1577828156 learned_addr learned my addr 172.21.15.37:0/1577828156 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed69a37700 1 --2- 172.21.15.37:0/1577828156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640cc3f0 0x7fed640c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6a238700 1 -- 172.21.15.37:0/1577828156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640cc3f0 msgr2=0x7fed640c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6a238700 1 --2- 172.21.15.37:0/1577828156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640cc3f0 0x7fed640c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6a238700 1 -- 172.21.15.37:0/1577828156 >> v1:172.21.15.37:6789/0 conn(0x7fed640caca0 legacy=0x7fed6406d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed6a238700 1 -- 172.21.15.37:0/1577828156 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed640c9ee0 con 0x7fed640ad560 2023-10-06T04:41:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.524+0000 7fed69236700 1 -- 172.21.15.37:0/1577828156 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269746961 0 0) 0x7fed640ca810 con 0x7fed640caca0 2023-10-06T04:41:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.528+0000 7fed6a238700 1 --2- 172.21.15.37:0/1577828156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed640ad560 0x7fed640ad930 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fed540098e0 tx=0x7fed540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497ec20f9bf358f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.528+0000 7fed69236700 1 -- 172.21.15.37:0/1577828156 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400b640 con 0x7fed640ad560 2023-10-06T04:41:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.528+0000 7fed69236700 1 -- 172.21.15.37:0/1577828156 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5400b7a0 con 0x7fed640ad560 2023-10-06T04:41:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.528+0000 7fed69236700 1 -- 172.21.15.37:0/1577828156 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400bb40 con 0x7fed640ad560 2023-10-06T04:41:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.528+0000 7fed6b23a700 1 -- 172.21.15.37:0/1577828156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed640ad560 msgr2=0x7fed640ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.528+0000 7fed6b23a700 1 --2- 172.21.15.37:0/1577828156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed640ad560 0x7fed640ad930 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fed540098e0 tx=0x7fed540091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.528+0000 7fed6b23a700 1 -- 172.21.15.37:0/1577828156 shutdown_connections 2023-10-06T04:41:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.528+0000 7fed6b23a700 1 --2- 172.21.15.37:0/1577828156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640cc3f0 0x7fed640c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.528+0000 7fed6b23a700 1 --2- 172.21.15.37:0/1577828156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed640ad560 0x7fed640ad930 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.528+0000 7fed6b23a700 1 -- 172.21.15.37:0/1577828156 >> 172.21.15.37:0/1577828156 conn(0x7fed64068780 msgr2=0x7fed640cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.528+0000 7fed6b23a700 1 -- 172.21.15.37:0/1577828156 shutdown_connections 2023-10-06T04:41:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.528+0000 7fed6b23a700 1 -- 172.21.15.37:0/1577828156 wait complete. 2023-10-06T04:41:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6b23a700 1 Processor -- start 2023-10-06T04:41:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6b23a700 1 -- start start 2023-10-06T04:41:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6b23a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640ad560 0x7fed641667e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6b23a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed640caca0 0x7fed640c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6b23a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed640cc3f0 0x7fed640c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6b23a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed640c3a50 con 0x7fed640cc3f0 2023-10-06T04:41:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6b23a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed64167010 con 0x7fed640caca0 2023-10-06T04:41:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6b23a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed641672f0 con 0x7fed640ad560 2023-10-06T04:41:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6aa39700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed640cc3f0 0x7fed640c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6aa39700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed640cc3f0 0x7fed640c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47012/0 (socket says 172.21.15.37:47012) 2023-10-06T04:41:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6aa39700 1 -- 172.21.15.37:0/4018192327 learned_addr learned my addr 172.21.15.37:0/4018192327 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed69a37700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed640caca0 0x7fed640c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6a238700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640ad560 0x7fed641667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6aa39700 1 -- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640ad560 msgr2=0x7fed641667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6aa39700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640ad560 0x7fed641667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6aa39700 1 -- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed640caca0 msgr2=0x7fed640c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6aa39700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed640caca0 0x7fed640c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6aa39700 1 -- 172.21.15.37:0/4018192327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed54009420 con 0x7fed640cc3f0 2023-10-06T04:41:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6aa39700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed640cc3f0 0x7fed640c3ee0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00c7e0 tx=0x7fed5c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed627fc700 1 -- 172.21.15.37:0/4018192327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c005c00 con 0x7fed640cc3f0 2023-10-06T04:41:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed627fc700 1 -- 172.21.15.37:0/4018192327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c005d80 con 0x7fed640cc3f0 2023-10-06T04:41:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.532+0000 7fed6b23a700 1 -- 172.21.15.37:0/4018192327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed641675d0 con 0x7fed640cc3f0 2023-10-06T04:41:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.536+0000 7fed627fc700 1 -- 172.21.15.37:0/4018192327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c007320 con 0x7fed640cc3f0 2023-10-06T04:41:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.536+0000 7fed6b23a700 1 -- 172.21.15.37:0/4018192327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed641598b0 con 0x7fed640cc3f0 2023-10-06T04:41:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.536+0000 7fed6b23a700 1 -- 172.21.15.37:0/4018192327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed640c3820 con 0x7fed640cc3f0 2023-10-06T04:41:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.536+0000 7fed627fc700 1 -- 172.21.15.37:0/4018192327 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fed5c01b3b0 con 0x7fed640cc3f0 2023-10-06T04:41:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.536+0000 7fed627fc700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fed50060550 0x7fed50062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.536+0000 7fed627fc700 1 -- 172.21.15.37:0/4018192327 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fed5c07bf00 con 0x7fed640cc3f0 2023-10-06T04:41:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.536+0000 7fed6a238700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fed50060550 0x7fed50062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.540+0000 7fed6a238700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fed50060550 0x7fed50062a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fed540091e0 tx=0x7fed54017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:32.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.544+0000 7fed627fc700 1 -- 172.21.15.37:0/4018192327 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fed640c3820 con 0x7fed640cc3f0 2023-10-06T04:41:32.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.748+0000 7fed6b23a700 1 -- 172.21.15.37:0/4018192327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed640c3820 con 0x7fed640cc3f0 2023-10-06T04:41:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.748+0000 7fed627fc700 1 -- 172.21.15.37:0/4018192327 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fed640c3820 con 0x7fed640cc3f0 2023-10-06T04:41:32.754 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:32.754 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3716256971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3716256971},{"type":"v1","addr":"172.21.15.37:6833","nonce":3716256971}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/893255287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":893255287},{"type":"v1","addr":"172.21.15.37:6835","nonce":893255287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3794492713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3794492713},{"type":"v1","addr":"172.21.15.83:6837","nonce":3794492713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:54.053558+0000","modified":"2023-10-06T04:41:31.918744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":58,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6835/1381995756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1381995756},{"type":"v1","addr":"172.21.15.83:6835","nonce":1381995756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:41:32.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.752+0000 7fed6b23a700 1 -- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fed50060550 msgr2=0x7fed50062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.752+0000 7fed6b23a700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fed50060550 0x7fed50062a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fed540091e0 tx=0x7fed54017000 comp rx=0 tx=0).stop 2023-10-06T04:41:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.752+0000 7fed6b23a700 1 -- 172.21.15.37:0/4018192327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed640cc3f0 msgr2=0x7fed640c3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.752+0000 7fed6b23a700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed640cc3f0 0x7fed640c3ee0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00c7e0 tx=0x7fed5c007d90 comp rx=0 tx=0).stop 2023-10-06T04:41:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.752+0000 7fed6b23a700 1 -- 172.21.15.37:0/4018192327 shutdown_connections 2023-10-06T04:41:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.752+0000 7fed6b23a700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fed50060550 0x7fed50062a00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.752+0000 7fed6b23a700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed640caca0 0x7fed640c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.752+0000 7fed6b23a700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed640cc3f0 0x7fed640c3ee0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.752+0000 7fed6b23a700 1 --2- 172.21.15.37:0/4018192327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640ad560 0x7fed641667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.752+0000 7fed6b23a700 1 -- 172.21.15.37:0/4018192327 >> 172.21.15.37:0/4018192327 conn(0x7fed64068780 msgr2=0x7fed64155380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.752+0000 7fed6b23a700 1 -- 172.21.15.37:0/4018192327 shutdown_connections 2023-10-06T04:41:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:32.752+0000 7fed6b23a700 1 -- 172.21.15.37:0/4018192327 wait complete. 2023-10-06T04:41:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2023-10-06T04:41:33.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:40:54.053558+0000', 'modified': '2023-10-06T04:41:31.918744+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 58, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5836}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5836': {'gid': 5836, 'name': 'b', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.83:6835/1381995756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6834', 'nonce': 1381995756}, {'type': 'v1', 'addr': '172.21.15.83:6835', 'nonce': 1381995756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:41:33.172 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:41:33.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T04:41:33.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.284+0000 7ff55a130700 1 Processor -- start 2023-10-06T04:41:33.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.284+0000 7ff55a130700 1 -- start start 2023-10-06T04:41:33.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55a130700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff55415c240 0x7ff5540ab940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55a130700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff5540667b0 0x7ff5540b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55a130700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5540acd30 con 0x7ff5540b1860 2023-10-06T04:41:33.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55a130700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5540abe80 con 0x7ff55415c240 2023-10-06T04:41:33.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55a130700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5540b1cc0 con 0x7ff5540667b0 2023-10-06T04:41:33.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55912e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff55415c240 0x7ff5540ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55912e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff55415c240 0x7ff5540ab940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47028/0 (socket says 172.21.15.37:47028) 2023-10-06T04:41:33.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55912e700 1 -- 172.21.15.37:0/2388528127 learned_addr learned my addr 172.21.15.37:0/2388528127 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:33.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55892d700 1 --2- 172.21.15.37:0/2388528127 >> v2:172.21.15.83:3300/0 conn(0x7ff5540667b0 0x7ff5540b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55912e700 1 -- 172.21.15.37:0/2388528127 >> v2:172.21.15.83:3300/0 conn(0x7ff5540667b0 msgr2=0x7ff5540b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:33.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55912e700 1 --2- 172.21.15.37:0/2388528127 >> v2:172.21.15.83:3300/0 conn(0x7ff5540667b0 0x7ff5540b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55912e700 1 -- 172.21.15.37:0/2388528127 >> v1:172.21.15.83:6789/0 conn(0x7ff5540b1860 legacy=0x7ff55415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55912e700 1 -- 172.21.15.37:0/2388528127 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5540ac120 con 0x7ff55415c240 2023-10-06T04:41:33.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff55912e700 1 --2- 172.21.15.37:0/2388528127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff55415c240 0x7ff5540ab940 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff554067b00 tx=0x7ff550009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24922fc560b446c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:33.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff54bfff700 1 -- 172.21.15.37:0/2388528127 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550009e70 con 0x7ff55415c240 2023-10-06T04:41:33.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff54bfff700 1 -- 172.21.15.37:0/2388528127 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55000b860 con 0x7ff55415c240 2023-10-06T04:41:33.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.288+0000 7ff54bfff700 1 -- 172.21.15.37:0/2388528127 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55000bc20 con 0x7ff55415c240 2023-10-06T04:41:33.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.292+0000 7ff55a130700 1 -- 172.21.15.37:0/2388528127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff55415c240 msgr2=0x7ff5540ab940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.292+0000 7ff55a130700 1 --2- 172.21.15.37:0/2388528127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff55415c240 0x7ff5540ab940 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff554067b00 tx=0x7ff550009250 comp rx=0 tx=0).stop 2023-10-06T04:41:33.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.292+0000 7ff55a130700 1 -- 172.21.15.37:0/2388528127 shutdown_connections 2023-10-06T04:41:33.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.292+0000 7ff55a130700 1 --2- 172.21.15.37:0/2388528127 >> v2:172.21.15.83:3300/0 conn(0x7ff5540667b0 0x7ff5540b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.292+0000 7ff55a130700 1 --2- 172.21.15.37:0/2388528127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff55415c240 0x7ff5540ab940 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.292+0000 7ff55a130700 1 -- 172.21.15.37:0/2388528127 >> 172.21.15.37:0/2388528127 conn(0x7ff5540ccb50 msgr2=0x7ff55406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:33.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.292+0000 7ff55a130700 1 -- 172.21.15.37:0/2388528127 shutdown_connections 2023-10-06T04:41:33.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.292+0000 7ff55a130700 1 -- 172.21.15.37:0/2388528127 wait complete. 2023-10-06T04:41:33.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.292+0000 7ff55a130700 1 Processor -- start 2023-10-06T04:41:33.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.292+0000 7ff55a130700 1 -- start start 2023-10-06T04:41:33.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55a130700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5540667b0 0x7ff5540c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55a130700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5540b1860 0x7ff554098ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55a130700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff55415c240 0x7ff5540ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55a130700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540c31f0 con 0x7ff5540667b0 2023-10-06T04:41:33.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55a130700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540c25e0 con 0x7ff55415c240 2023-10-06T04:41:33.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55a130700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540c28c0 con 0x7ff5540b1860 2023-10-06T04:41:33.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55912e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5540667b0 0x7ff5540c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55912e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5540667b0 0x7ff5540c1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47042/0 (socket says 172.21.15.37:47042) 2023-10-06T04:41:33.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55912e700 1 -- 172.21.15.37:0/3516544003 learned_addr learned my addr 172.21.15.37:0/3516544003 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:33.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55992f700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff55415c240 0x7ff5540ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55892d700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5540b1860 0x7ff554098ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55912e700 1 -- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5540b1860 msgr2=0x7ff554098ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55912e700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5540b1860 0x7ff554098ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55912e700 1 -- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff55415c240 msgr2=0x7ff5540ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55912e700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff55415c240 0x7ff5540ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55912e700 1 -- 172.21.15.37:0/3516544003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5500094f0 con 0x7ff5540667b0 2023-10-06T04:41:33.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55892d700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5540b1860 0x7ff554098ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:41:33.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55912e700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5540667b0 0x7ff5540c1fb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff5540b2150 tx=0x7ff550017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:33.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff5497fa700 1 -- 172.21.15.37:0/3516544003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55001f070 con 0x7ff5540667b0 2023-10-06T04:41:33.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff5497fa700 1 -- 172.21.15.37:0/3516544003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff550000bc0 con 0x7ff5540667b0 2023-10-06T04:41:33.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff5497fa700 1 -- 172.21.15.37:0/3516544003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55000bc20 con 0x7ff5540667b0 2023-10-06T04:41:33.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55a130700 1 -- 172.21.15.37:0/3516544003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5540c2ba0 con 0x7ff5540667b0 2023-10-06T04:41:33.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff55a130700 1 -- 172.21.15.37:0/3516544003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff554099420 con 0x7ff5540667b0 2023-10-06T04:41:33.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.296+0000 7ff5497fa700 1 -- 172.21.15.37:0/3516544003 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff550023070 con 0x7ff5540667b0 2023-10-06T04:41:33.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.300+0000 7ff5497fa700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff538060580 0x7ff538062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.300+0000 7ff5497fa700 1 -- 172.21.15.37:0/3516544003 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff55007dd10 con 0x7ff5540667b0 2023-10-06T04:41:33.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.300+0000 7ff55892d700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff538060580 0x7ff538062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.300+0000 7ff55892d700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff538060580 0x7ff538062a30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff544006f00 tx=0x7ff544008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:33.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 Processor -- start 2023-10-06T04:41:33.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 -- start start 2023-10-06T04:41:33.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 0xcbb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3e710 0xcbbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa89790 0xcbc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0xbe9f30 con 0xa3eae0 2023-10-06T04:41:33.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0xbe5ed0 con 0xa3e710 2023-10-06T04:41:33.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0xbac0b0 con 0xa89790 2023-10-06T04:41:33.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55912e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 0xcbb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55912e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 0xcbb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47044/0 (socket says 172.21.15.37:47044) 2023-10-06T04:41:33.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55912e700 1 -- 172.21.15.37:0/1220686208 learned_addr learned my addr 172.21.15.37:0/1220686208 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:33.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55892d700 1 --2- 172.21.15.37:0/1220686208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3e710 0xcbbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55992f700 1 --2- 172.21.15.37:0/1220686208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa89790 0xcbc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55912e700 1 -- 172.21.15.37:0/1220686208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa89790 msgr2=0xcbc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:33.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55912e700 1 --2- 172.21.15.37:0/1220686208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa89790 0xcbc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55912e700 1 -- 172.21.15.37:0/1220686208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3e710 msgr2=0xcbbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:33.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55912e700 1 --2- 172.21.15.37:0/1220686208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3e710 0xcbbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55912e700 1 -- 172.21.15.37:0/1220686208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xa8a9e0 con 0xa3eae0 2023-10-06T04:41:33.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55912e700 1 --2- 172.21.15.37:0/1220686208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 0xcbb630 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff550014040 tx=0x7ff550057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed18df1a4363f38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:33.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff53e7fc700 1 -- 172.21.15.37:0/1220686208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550009300 con 0xa3eae0 2023-10-06T04:41:33.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff53e7fc700 1 -- 172.21.15.37:0/1220686208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff550052410 con 0xa3eae0 2023-10-06T04:41:33.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff53e7fc700 1 -- 172.21.15.37:0/1220686208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550054f60 con 0xa3eae0 2023-10-06T04:41:33.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 -- 172.21.15.37:0/1220686208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 msgr2=0xcbb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 --2- 172.21.15.37:0/1220686208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 0xcbb630 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff550014040 tx=0x7ff550057040 comp rx=0 tx=0).stop 2023-10-06T04:41:33.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 -- 172.21.15.37:0/1220686208 shutdown_connections 2023-10-06T04:41:33.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 --2- 172.21.15.37:0/1220686208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3e710 0xcbbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 --2- 172.21.15.37:0/1220686208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa89790 0xcbc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 --2- 172.21.15.37:0/1220686208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 0xcbb630 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 -- 172.21.15.37:0/1220686208 >> 172.21.15.37:0/1220686208 conn(0xa3eeb0 msgr2=0xc78060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:33.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 -- 172.21.15.37:0/1220686208 shutdown_connections 2023-10-06T04:41:33.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.304+0000 7ff55d63b740 1 -- 172.21.15.37:0/1220686208 wait complete. 2023-10-06T04:41:33.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55d63b740 1 -- start start 2023-10-06T04:41:33.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55d63b740 1 Processor -- start 2023-10-06T04:41:33.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55d63b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3e710 0xcbfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55d63b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 0xcc0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55d63b740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa89790 0xc75c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55d63b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0xbabd50 con 0xa3eae0 2023-10-06T04:41:33.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55d63b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0xb84970 con 0xa3e710 2023-10-06T04:41:33.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55d63b740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0xa15060 con 0xa89790 2023-10-06T04:41:33.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55d63b740 10 client.0 _ll_register_callbacks cb 0xb88b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:41:33.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55892d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 0xcc0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55892d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 0xcc0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47058/0 (socket says 172.21.15.37:47058) 2023-10-06T04:41:33.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55892d700 1 -- 172.21.15.37:0/4115435169 learned_addr learned my addr 172.21.15.37:0/4115435169 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:33.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55912e700 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3e710 0xcbfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55992f700 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa89790 0xc75c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55892d700 1 -- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa89790 msgr2=0xc75c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:33.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55892d700 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa89790 0xc75c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55892d700 1 -- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3e710 msgr2=0xcbfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:33.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55892d700 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3e710 0xcbfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55892d700 1 -- 172.21.15.37:0/4115435169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff554099420 con 0xa3eae0 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55912e700 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3e710 0xcbfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55892d700 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 0xcc0180 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff544017b60 tx=0x7ff544015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e828173f9fa2541 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff5337fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff5337fe700 1 -- 172.21.15.37:0/4115435169 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff544017e70 con 0xa3eae0 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff5337fe700 1 -- 172.21.15.37:0/4115435169 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff544014ab0 con 0xa3eae0 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.308+0000 7ff55d63b740 1 -- 172.21.15.37:0/4115435169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xb84cc0 con 0xa3eae0 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff5337fe700 1 -- 172.21.15.37:0/4115435169 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff544014e80 con 0xa3eae0 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55d63b740 10 client.5880 fetch_fsmap learned FSMap version 34 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55d63b740 1 -- 172.21.15.37:0/4115435169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0xbb4370 con 0xa3eae0 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff5337fe700 1 -- 172.21.15.37:0/4115435169 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xb84cc0 con 0xa3eae0 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff5337fe700 1 -- 172.21.15.37:0/4115435169 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff544022070 con 0xa3eae0 2023-10-06T04:41:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55d63b740 10 client.5880 fetch_fsmap finished waiting for FSMap version 34 2023-10-06T04:41:33.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55d63b740 10 client.5880 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T04:41:33.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55d63b740 20 client.5880 populate_metadata read hostname 'smithi037' 2023-10-06T04:41:33.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55d63b740 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:6834/1381995756,v1:172.21.15.83:6835/1381995756] conn(0xcc8dd0 0xccb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55d63b740 4 client.5880 mds_command: new command op to 5836 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:41:33.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55d63b740 1 -- 172.21.15.37:0/4115435169 --> [v2:172.21.15.83:6834/1381995756,v1:172.21.15.83:6835/1381995756] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xb883e0 con 0xcc8dd0 2023-10-06T04:41:33.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55912e700 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:6834/1381995756,v1:172.21.15.83:6835/1381995756] conn(0xcc8dd0 0xccb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff5337fe700 10 client.5880 ms_handle_connect on v2:172.21.15.83:6834/1381995756 2023-10-06T04:41:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55912e700 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:6834/1381995756,v1:172.21.15.83:6835/1381995756] conn(0xcc8dd0 0xccb1b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6705e3fdcb6051b2 server_cookie=a254faf068fe1a5 in_seq=0 out_seq=0 2023-10-06T04:41:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff5337fe700 1 -- 172.21.15.37:0/4115435169 <== mds.0 v2:172.21.15.83:6834/1381995756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0xb883e0 con 0xcc8dd0 2023-10-06T04:41:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff5337fe700 10 client.5880 handle_command_reply: tid=0 2023-10-06T04:41:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55d63b740 1 client.5880 shutdown 2023-10-06T04:41:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55d63b740 1 -- 172.21.15.37:0/4115435169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 msgr2=0xcc0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.312+0000 7ff55d63b740 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 0xcc0180 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff544017b60 tx=0x7ff544015000 comp rx=0 tx=0).stop 2023-10-06T04:41:33.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.316+0000 7ff55d63b740 1 -- 172.21.15.37:0/4115435169 shutdown_connections 2023-10-06T04:41:33.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.316+0000 7ff55d63b740 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:6834/1381995756,v1:172.21.15.83:6835/1381995756] conn(0xcc8dd0 0xccb1b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.316+0000 7ff55d63b740 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa89790 0xc75c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.316+0000 7ff55d63b740 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3eae0 0xcc0180 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.316+0000 7ff55d63b740 1 --2- 172.21.15.37:0/4115435169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3e710 0xcbfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.316+0000 7ff55d63b740 1 -- 172.21.15.37:0/4115435169 >> 172.21.15.37:0/4115435169 conn(0xa3eeb0 msgr2=0xc9f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:33.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.316+0000 7ff5337fe700 0 client.5880 ms_handle_reset on v2:172.21.15.83:6834/1381995756 2023-10-06T04:41:33.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.316+0000 7ff55d63b740 1 -- 172.21.15.37:0/4115435169 shutdown_connections 2023-10-06T04:41:33.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.316+0000 7ff55d63b740 1 -- 172.21.15.37:0/4115435169 wait complete. 2023-10-06T04:41:33.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.316+0000 7ff55d63b740 20 client.5880 trim_cache size 0 max 16384 2023-10-06T04:41:33.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.332+0000 7ff55d63b740 1 Processor -- start 2023-10-06T04:41:33.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.332+0000 7ff55d63b740 1 -- start start 2023-10-06T04:41:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa3e710 0xc77500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3eae0 0xc77a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa89790 0xc706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0xbae920 con 0xa89790 2023-10-06T04:41:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0xb91ec0 con 0xa3eae0 2023-10-06T04:41:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0xbe2150 con 0xa3e710 2023-10-06T04:41:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55992f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa89790 0xc706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55992f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa89790 0xc706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47068/0 (socket says 172.21.15.37:47068) 2023-10-06T04:41:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55912e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa3e710 0xc77500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55992f700 1 -- 172.21.15.37:0/3865843046 learned_addr learned my addr 172.21.15.37:0/3865843046 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55892d700 1 --2- 172.21.15.37:0/3865843046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3eae0 0xc77a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55992f700 1 -- 172.21.15.37:0/3865843046 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa3e710 msgr2=0xc77500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55992f700 1 --2- 172.21.15.37:0/3865843046 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa3e710 0xc77500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55992f700 1 -- 172.21.15.37:0/3865843046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3eae0 msgr2=0xc77a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55992f700 1 --2- 172.21.15.37:0/3865843046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3eae0 0xc77a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55992f700 1 -- 172.21.15.37:0/3865843046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55406a620 con 0xa89790 2023-10-06T04:41:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55892d700 1 --2- 172.21.15.37:0/3865843046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3eae0 0xc77a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55912e700 1 --2- 172.21.15.37:0/3865843046 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa3e710 0xc77500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55992f700 1 --2- 172.21.15.37:0/3865843046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa89790 0xc706b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff54c003dc0 tx=0x7ff54c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1406c2e8bfb1e88c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff53effd700 1 -- 172.21.15.37:0/3865843046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c001b40 con 0xa89790 2023-10-06T04:41:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff53effd700 1 -- 172.21.15.37:0/3865843046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c001ca0 con 0xa89790 2023-10-06T04:41:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff53effd700 1 -- 172.21.15.37:0/3865843046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0149c0 con 0xa89790 2023-10-06T04:41:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 -- 172.21.15.37:0/3865843046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa89790 msgr2=0xc706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 --2- 172.21.15.37:0/3865843046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa89790 0xc706b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff54c003dc0 tx=0x7ff54c009040 comp rx=0 tx=0).stop 2023-10-06T04:41:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 -- 172.21.15.37:0/3865843046 shutdown_connections 2023-10-06T04:41:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 --2- 172.21.15.37:0/3865843046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa3eae0 0xc77a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 --2- 172.21.15.37:0/3865843046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa89790 0xc706b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 --2- 172.21.15.37:0/3865843046 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa3e710 0xc77500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 -- 172.21.15.37:0/3865843046 >> 172.21.15.37:0/3865843046 conn(0xa3eeb0 msgr2=0xc9fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 -- 172.21.15.37:0/3865843046 shutdown_connections 2023-10-06T04:41:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.336+0000 7ff55d63b740 1 -- 172.21.15.37:0/3865843046 wait complete. 2023-10-06T04:41:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55d63b740 1 -- start start 2023-10-06T04:41:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55d63b740 1 Processor -- start 2023-10-06T04:41:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55d63b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3e710 0xccc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55d63b740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa3eae0 0xc99e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55d63b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa89790 0xc9a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55d63b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0xbec400 con 0xa3e710 2023-10-06T04:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55d63b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0xbacb00 con 0xa89790 2023-10-06T04:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55d63b740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0xc3c270 con 0xa3eae0 2023-10-06T04:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55d63b740 10 client.0 _ll_register_callbacks cb 0xbb1110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55912e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3e710 0xccc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55912e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3e710 0xccc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47080/0 (socket says 172.21.15.37:47080) 2023-10-06T04:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55912e700 1 -- 172.21.15.37:0/512332708 learned_addr learned my addr 172.21.15.37:0/512332708 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55892d700 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa3eae0 0xc99e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55992f700 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa89790 0xc9a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55912e700 1 -- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa3eae0 msgr2=0xc99e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55912e700 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa3eae0 0xc99e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55912e700 1 -- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa89790 msgr2=0xc9a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55912e700 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa89790 0xc9a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55912e700 1 -- 172.21.15.37:0/512332708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xa8a9e0 con 0xa3e710 2023-10-06T04:41:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55892d700 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa3eae0 0xc99e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.340+0000 7ff55992f700 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa89790 0xc9a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff5337fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:41:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55912e700 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3e710 0xccc420 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff550052370 tx=0x7ff55006b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a61d11bce483338 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff5337fe700 1 -- 172.21.15.37:0/512332708 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550058cb0 con 0xa3e710 2023-10-06T04:41:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff5337fe700 1 -- 172.21.15.37:0/512332708 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff550054f60 con 0xa3e710 2023-10-06T04:41:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 -- 172.21.15.37:0/512332708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff550052410 con 0xa3e710 2023-10-06T04:41:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff5337fe700 1 -- 172.21.15.37:0/512332708 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5500511c0 con 0xa3e710 2023-10-06T04:41:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 10 client.5886 fetch_fsmap learned FSMap version 34 2023-10-06T04:41:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 -- 172.21.15.37:0/512332708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0xbb4370 con 0xa3e710 2023-10-06T04:41:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff5337fe700 1 -- 172.21.15.37:0/512332708 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff550052410 con 0xa3e710 2023-10-06T04:41:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff5337fe700 1 -- 172.21.15.37:0/512332708 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff550052d20 con 0xa3e710 2023-10-06T04:41:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 10 client.5886 fetch_fsmap finished waiting for FSMap version 34 2023-10-06T04:41:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 10 client.5886 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T04:41:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 20 client.5886 populate_metadata read hostname 'smithi037' 2023-10-06T04:41:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:6834/1381995756,v1:172.21.15.83:6835/1381995756] conn(0xc9a8d0 0xd145e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 4 client.5886 mds_command: new command op to 5836 tid=0[{"prefix": "status"}] 2023-10-06T04:41:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 -- 172.21.15.37:0/512332708 --> [v2:172.21.15.83:6834/1381995756,v1:172.21.15.83:6835/1381995756] -- command(tid 0: {"prefix": "status"}) v1 -- 0xbba410 con 0xc9a8d0 2023-10-06T04:41:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55892d700 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:6834/1381995756,v1:172.21.15.83:6835/1381995756] conn(0xc9a8d0 0xd145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff5337fe700 10 client.5886 ms_handle_connect on v2:172.21.15.83:6834/1381995756 2023-10-06T04:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55892d700 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:6834/1381995756,v1:172.21.15.83:6835/1381995756] conn(0xc9a8d0 0xd145e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dfe734d208fc663 server_cookie=7949808eac0a1afe in_seq=0 out_seq=0 2023-10-06T04:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff5337fe700 1 -- 172.21.15.37:0/512332708 <== mds.0 v2:172.21.15.83:6834/1381995756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0xbba410 con 0xc9a8d0 2023-10-06T04:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff5337fe700 10 client.5886 handle_command_reply: tid=0 2023-10-06T04:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 client.5886 shutdown 2023-10-06T04:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 -- 172.21.15.37:0/512332708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3e710 msgr2=0xccc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3e710 0xccc420 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff550052370 tx=0x7ff55006b040 comp rx=0 tx=0).stop 2023-10-06T04:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 -- 172.21.15.37:0/512332708 shutdown_connections 2023-10-06T04:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0xa89790 0xc9a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:6834/1381995756,v1:172.21.15.83:6835/1381995756] conn(0xc9a8d0 0xd145e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0xa3eae0 0xc99e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff5337fe700 0 client.5886 ms_handle_reset on v2:172.21.15.83:6834/1381995756 2023-10-06T04:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 --2- 172.21.15.37:0/512332708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa3e710 0xccc420 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 -- 172.21.15.37:0/512332708 >> 172.21.15.37:0/512332708 conn(0xa3eeb0 msgr2=0xc77e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 -- 172.21.15.37:0/512332708 shutdown_connections 2023-10-06T04:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.344+0000 7ff55d63b740 1 -- 172.21.15.37:0/512332708 wait complete. 2023-10-06T04:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55d63b740 20 client.5886 trim_cache size 0 max 16384 2023-10-06T04:41:33.354 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:41:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "77bb67cc-15eb-432c-9ac1-b724f40102d2", 2023-10-06T04:41:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T04:41:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5836, 2023-10-06T04:41:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T04:41:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T04:41:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T04:41:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 4.4464081179999999, 2023-10-06T04:41:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 34, 2023-10-06T04:41:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 59, 2023-10-06T04:41:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 59, 2023-10-06T04:41:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 5.3579485919999996 2023-10-06T04:41:33.355 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:41:33.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55a130700 1 -- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff538060580 msgr2=0x7ff538062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55a130700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff538060580 0x7ff538062a30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff544006f00 tx=0x7ff544008040 comp rx=0 tx=0).stop 2023-10-06T04:41:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55a130700 1 -- 172.21.15.37:0/3516544003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5540667b0 msgr2=0x7ff5540c1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55a130700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5540667b0 0x7ff5540c1fb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff5540b2150 tx=0x7ff550017000 comp rx=0 tx=0).stop 2023-10-06T04:41:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55a130700 1 -- 172.21.15.37:0/3516544003 shutdown_connections 2023-10-06T04:41:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55a130700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff538060580 0x7ff538062a30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55a130700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff55415c240 0x7ff5540ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55a130700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5540b1860 0x7ff554098ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55a130700 1 --2- 172.21.15.37:0/3516544003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5540667b0 0x7ff5540c1fb0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55a130700 1 -- 172.21.15.37:0/3516544003 >> 172.21.15.37:0/3516544003 conn(0x7ff5540ccb50 msgr2=0x7ff55415b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55a130700 1 -- 172.21.15.37:0/3516544003 shutdown_connections 2023-10-06T04:41:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.348+0000 7ff55a130700 1 -- 172.21.15.37:0/3516544003 wait complete. 2023-10-06T04:41:33.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T04:41:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ea68700 1 Processor -- start 2023-10-06T04:41:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ea68700 1 -- start start 2023-10-06T04:41:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ea68700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7f780ad930 0x7f7f7806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ea68700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f780ca810 con 0x7f7f780cc3f0 2023-10-06T04:41:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ea68700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f781570a0 con 0x7f7f780ad560 2023-10-06T04:41:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ea68700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f780c9c00 con 0x7f7f780ad930 2023-10-06T04:41:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7d265700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7f780cc3f0 0x7f7f780caca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42100/0 (socket says 172.21.15.37:42100) 2023-10-06T04:41:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7d265700 1 -- 172.21.15.37:0/2852306035 learned_addr learned my addr 172.21.15.37:0/2852306035 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7e267700 1 --2- 172.21.15.37:0/2852306035 >> v2:172.21.15.83:3300/0 conn(0x7f7f780ad930 0x7f7f7806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ca64700 1 -- 172.21.15.37:0/2852306035 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543191001 0 0) 0x7f7f780ca810 con 0x7f7f780cc3f0 2023-10-06T04:41:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ca64700 1 -- 172.21.15.37:0/2852306035 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f64003570 con 0x7f7f780cc3f0 2023-10-06T04:41:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ca64700 1 -- 172.21.15.37:0/2852306035 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412553079 0 0) 0x7f7f781570a0 con 0x7f7f780ad560 2023-10-06T04:41:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ca64700 1 -- 172.21.15.37:0/2852306035 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f780ca810 con 0x7f7f780ad560 2023-10-06T04:41:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7e267700 1 -- 172.21.15.37:0/2852306035 >> v1:172.21.15.83:6789/0 conn(0x7f7f780ad560 legacy=0x7f7f780c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ca64700 1 -- 172.21.15.37:0/2852306035 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2497563440 0 0) 0x7f7f64003570 con 0x7f7f780cc3f0 2023-10-06T04:41:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7e267700 1 -- 172.21.15.37:0/2852306035 >> v1:172.21.15.37:6789/0 conn(0x7f7f780cc3f0 legacy=0x7f7f780caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7e267700 1 -- 172.21.15.37:0/2852306035 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780c9ee0 con 0x7f7f780ad930 2023-10-06T04:41:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7e267700 1 --2- 172.21.15.37:0/2852306035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f780ad930 0x7f7f7806d4e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009e60 tx=0x7f7f70009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fad4249b9011fadf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ca64700 1 -- 172.21.15.37:0/2852306035 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000e070 con 0x7f7f780ad930 2023-10-06T04:41:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ca64700 1 -- 172.21.15.37:0/2852306035 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7000b7a0 con 0x7f7f780ad930 2023-10-06T04:41:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ca64700 1 -- 172.21.15.37:0/2852306035 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68001470 con 0x7f7f780ad930 2023-10-06T04:41:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ea68700 1 -- 172.21.15.37:0/2852306035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f780ad930 msgr2=0x7f7f7806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ea68700 1 --2- 172.21.15.37:0/2852306035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f780ad930 0x7f7f7806d4e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009e60 tx=0x7f7f70009780 comp rx=0 tx=0).stop 2023-10-06T04:41:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ea68700 1 -- 172.21.15.37:0/2852306035 shutdown_connections 2023-10-06T04:41:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ea68700 1 --2- 172.21.15.37:0/2852306035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f780ad930 0x7f7f7806d4e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.480+0000 7f7f7ea68700 1 -- 172.21.15.37:0/2852306035 >> 172.21.15.37:0/2852306035 conn(0x7f7f78068780 msgr2=0x7f7f780cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7ea68700 1 -- 172.21.15.37:0/2852306035 shutdown_connections 2023-10-06T04:41:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7ea68700 1 -- 172.21.15.37:0/2852306035 wait complete. 2023-10-06T04:41:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7ea68700 1 Processor -- start 2023-10-06T04:41:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7ea68700 1 -- start start 2023-10-06T04:41:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7ea68700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f780ad560 0x7f7f781562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7ea68700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f780ad930 0x7f7f781589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7ea68700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f780cc3f0 0x7f7f780c1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7ea68700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7816ff60 con 0x7f7f780cc3f0 2023-10-06T04:41:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7ea68700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78170800 con 0x7f7f780ad930 2023-10-06T04:41:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7ea68700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78159330 con 0x7f7f780ad560 2023-10-06T04:41:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7e267700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f780cc3f0 0x7f7f780c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7d265700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f780ad930 0x7f7f781589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7d265700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f780ad930 0x7f7f781589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:33002/0 (socket says 172.21.15.37:33002) 2023-10-06T04:41:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7d265700 1 -- 172.21.15.37:0/3334164727 learned_addr learned my addr 172.21.15.37:0/3334164727 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7da66700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f780ad560 0x7f7f781562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7e267700 1 -- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f780ad560 msgr2=0x7f7f781562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7e267700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f780ad560 0x7f7f781562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7e267700 1 -- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f780ad930 msgr2=0x7f7f781589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7e267700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f780ad930 0x7f7f781589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7e267700 1 -- 172.21.15.37:0/3334164727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70009a20 con 0x7f7f780cc3f0 2023-10-06T04:41:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7da66700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f780ad560 0x7f7f781562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f7e267700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f780cc3f0 0x7f7f780c1820 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7f780ab130 tx=0x7f7f70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.484+0000 7f7f6dffb700 1 -- 172.21.15.37:0/3334164727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70012c90 con 0x7f7f780cc3f0 2023-10-06T04:41:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.488+0000 7f7f6dffb700 1 -- 172.21.15.37:0/3334164727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f70012df0 con 0x7f7f780cc3f0 2023-10-06T04:41:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.488+0000 7f7f7ea68700 1 -- 172.21.15.37:0/3334164727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f781701b0 con 0x7f7f780cc3f0 2023-10-06T04:41:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.488+0000 7f7f6dffb700 1 -- 172.21.15.37:0/3334164727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7001e660 con 0x7f7f780cc3f0 2023-10-06T04:41:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.488+0000 7f7f7ea68700 1 -- 172.21.15.37:0/3334164727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f78156810 con 0x7f7f780cc3f0 2023-10-06T04:41:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.488+0000 7f7f7ea68700 1 -- 172.21.15.37:0/3334164727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f780708a0 con 0x7f7f780cc3f0 2023-10-06T04:41:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.488+0000 7f7f6dffb700 1 -- 172.21.15.37:0/3334164727 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7f7001e9d0 con 0x7f7f780cc3f0 2023-10-06T04:41:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.488+0000 7f7f6dffb700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7f5c060550 0x7f7f5c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.488+0000 7f7f6dffb700 1 -- 172.21.15.37:0/3334164727 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7f7007ec30 con 0x7f7f780cc3f0 2023-10-06T04:41:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.488+0000 7f7f7da66700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7f5c060550 0x7f7f5c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.492+0000 7f7f7da66700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7f5c060550 0x7f7f5c062a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7f74003990 tx=0x7f7f74009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.496+0000 7f7f6dffb700 1 -- 172.21.15.37:0/3334164727 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7f7004eff0 con 0x7f7f780cc3f0 2023-10-06T04:41:33.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.692+0000 7f7f7ea68700 1 -- 172.21.15.37:0/3334164727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7f78170940 con 0x7f7f780cc3f0 2023-10-06T04:41:33.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.692+0000 7f7f6dffb700 1 -- 172.21.15.37:0/3334164727 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7f70052610 con 0x7f7f780cc3f0 2023-10-06T04:41:33.698 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:33.698 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T04:41:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.696+0000 7f7f7ea68700 1 -- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7f5c060550 msgr2=0x7f7f5c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.696+0000 7f7f7ea68700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7f5c060550 0x7f7f5c062a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7f74003990 tx=0x7f7f74009040 comp rx=0 tx=0).stop 2023-10-06T04:41:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.696+0000 7f7f7ea68700 1 -- 172.21.15.37:0/3334164727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f780cc3f0 msgr2=0x7f7f780c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.696+0000 7f7f7ea68700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f780cc3f0 0x7f7f780c1820 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7f780ab130 tx=0x7f7f70017000 comp rx=0 tx=0).stop 2023-10-06T04:41:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.696+0000 7f7f7ea68700 1 -- 172.21.15.37:0/3334164727 shutdown_connections 2023-10-06T04:41:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.696+0000 7f7f7ea68700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7f5c060550 0x7f7f5c062a00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.696+0000 7f7f7ea68700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f780ad930 0x7f7f781589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.696+0000 7f7f7ea68700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f780cc3f0 0x7f7f780c1820 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.696+0000 7f7f7ea68700 1 --2- 172.21.15.37:0/3334164727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f780ad560 0x7f7f781562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.696+0000 7f7f7ea68700 1 -- 172.21.15.37:0/3334164727 >> 172.21.15.37:0/3334164727 conn(0x7f7f78068780 msgr2=0x7f7f7806a420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:33.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.696+0000 7f7f7ea68700 1 -- 172.21.15.37:0/3334164727 shutdown_connections 2023-10-06T04:41:33.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:33.696+0000 7f7f7ea68700 1 -- 172.21.15.37:0/3334164727 wait complete. 2023-10-06T04:41:33.713 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T04:41:33.713 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:41:33.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:41:33.727 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:41:33.747 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:41:33.747 INFO:tasks.cephfs.mount:Terminating background process 2023-10-06T04:41:33.747 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T04:41:33.747 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:41:33.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T04:41:33.760 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[44588]: fuse finished with error 0 and tester_r 0 2023-10-06T04:41:33.762 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:41:33.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:33.762 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:41:33.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:41:33.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:33.929 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T04:41:33.937 INFO:teuthology.orchestra.run.smithi083.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T04:41:33.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:41:33.938 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:41:33.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:33.939 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T04:41:33.945 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T04:41:33.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:41:33.946 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:41:33.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:33.946 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T04:41:33.951 INFO:teuthology.orchestra.run.smithi083.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T04:41:33.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:41:33.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:41:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f73373b4700 1 Processor -- start 2023-10-06T04:41:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f73373b4700 1 -- start start 2023-10-06T04:41:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f73373b4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73301531e0 0x7f73301535b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f73373b4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f73300ccf80 0x7f733015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f73373b4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7330153af0 con 0x7f733015cbd0 2023-10-06T04:41:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f73373b4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73300cd400 con 0x7f73300ccf80 2023-10-06T04:41:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f73373b4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733015b1e0 con 0x7f73301531e0 2023-10-06T04:41:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7335951700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f73300ccf80 0x7f733015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f733494f700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f733015cbd0 0x7f73300cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:45816/0 (socket says 172.21.15.37:45816) 2023-10-06T04:41:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f733494f700 1 -- 172.21.15.37:0/3497779750 learned_addr learned my addr 172.21.15.37:0/3497779750 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7335150700 1 --2- 172.21.15.37:0/3497779750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73301531e0 0x7f73301535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7327fff700 1 -- 172.21.15.37:0/3497779750 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578947441 0 0) 0x7f7330153af0 con 0x7f733015cbd0 2023-10-06T04:41:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7327fff700 1 -- 172.21.15.37:0/3497779750 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7318003570 con 0x7f733015cbd0 2023-10-06T04:41:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7335150700 1 -- 172.21.15.37:0/3497779750 >> v2:172.21.15.83:3300/0 conn(0x7f73300ccf80 msgr2=0x7f733015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7335150700 1 --2- 172.21.15.37:0/3497779750 >> v2:172.21.15.83:3300/0 conn(0x7f73300ccf80 0x7f733015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7335150700 1 -- 172.21.15.37:0/3497779750 >> v1:172.21.15.83:6789/0 conn(0x7f733015cbd0 legacy=0x7f73300cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7335150700 1 -- 172.21.15.37:0/3497779750 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733015d580 con 0x7f73301531e0 2023-10-06T04:41:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7335951700 1 --2- 172.21.15.37:0/3497779750 >> v2:172.21.15.83:3300/0 conn(0x7f73300ccf80 0x7f733015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7335150700 1 --2- 172.21.15.37:0/3497779750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73301531e0 0x7f73301535b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f732c0098e0 tx=0x7f732c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c85ff725075dab2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7327fff700 1 -- 172.21.15.37:0/3497779750 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c011630 con 0x7f73301531e0 2023-10-06T04:41:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7327fff700 1 -- 172.21.15.37:0/3497779750 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c011790 con 0x7f73301531e0 2023-10-06T04:41:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.100+0000 7f7327fff700 1 -- 172.21.15.37:0/3497779750 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c011b30 con 0x7f73301531e0 2023-10-06T04:41:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 -- 172.21.15.37:0/3497779750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73301531e0 msgr2=0x7f73301535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 --2- 172.21.15.37:0/3497779750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73301531e0 0x7f73301535b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f732c0098e0 tx=0x7f732c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 -- 172.21.15.37:0/3497779750 shutdown_connections 2023-10-06T04:41:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 --2- 172.21.15.37:0/3497779750 >> v2:172.21.15.83:3300/0 conn(0x7f73300ccf80 0x7f733015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 --2- 172.21.15.37:0/3497779750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73301531e0 0x7f73301535b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 -- 172.21.15.37:0/3497779750 >> 172.21.15.37:0/3497779750 conn(0x7f7330087ab0 msgr2=0x7f7330067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 -- 172.21.15.37:0/3497779750 shutdown_connections 2023-10-06T04:41:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 -- 172.21.15.37:0/3497779750 wait complete. 2023-10-06T04:41:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 Processor -- start 2023-10-06T04:41:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 -- start start 2023-10-06T04:41:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73301531e0 0x7f73300c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f733015cbd0 0x7f7330168560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7330168aa0 0x7f73300b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7330168ff0 con 0x7f7330168aa0 2023-10-06T04:41:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73300c80f0 con 0x7f733015cbd0 2023-10-06T04:41:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.104+0000 7f73373b4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73300c83d0 con 0x7f73301531e0 2023-10-06T04:41:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f7335951700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7330168aa0 0x7f73300b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f7335951700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7330168aa0 0x7f73300b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47102/0 (socket says 172.21.15.37:47102) 2023-10-06T04:41:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f7335951700 1 -- 172.21.15.37:0/3600848015 learned_addr learned my addr 172.21.15.37:0/3600848015 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f7335150700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73301531e0 0x7f73300c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f733494f700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f733015cbd0 0x7f7330168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f7335951700 1 -- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73301531e0 msgr2=0x7f73300c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f7335951700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73301531e0 0x7f73300c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f7335951700 1 -- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f733015cbd0 msgr2=0x7f7330168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f7335951700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f733015cbd0 0x7f7330168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f7335951700 1 -- 172.21.15.37:0/3600848015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320009420 con 0x7f7330168aa0 2023-10-06T04:41:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f7335951700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7330168aa0 0x7f73300b2b10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f732000ea20 tx=0x7f73200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f73257fa700 1 -- 172.21.15.37:0/3600848015 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000ee60 con 0x7f7330168aa0 2023-10-06T04:41:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f73257fa700 1 -- 172.21.15.37:0/3600848015 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732000c850 con 0x7f7330168aa0 2023-10-06T04:41:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f73373b4700 1 -- 172.21.15.37:0/3600848015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732c009420 con 0x7f7330168aa0 2023-10-06T04:41:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f73257fa700 1 -- 172.21.15.37:0/3600848015 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000cc10 con 0x7f7330168aa0 2023-10-06T04:41:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f73373b4700 1 -- 172.21.15.37:0/3600848015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73300c7d00 con 0x7f7330168aa0 2023-10-06T04:41:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.108+0000 7f73373b4700 1 -- 172.21.15.37:0/3600848015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7330169160 con 0x7f7330168aa0 2023-10-06T04:41:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.112+0000 7f73257fa700 1 -- 172.21.15.37:0/3600848015 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7320013470 con 0x7f7330168aa0 2023-10-06T04:41:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.112+0000 7f73257fa700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f731c060550 0x7f731c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.112+0000 7f73257fa700 1 -- 172.21.15.37:0/3600848015 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f732007c9f0 con 0x7f7330168aa0 2023-10-06T04:41:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.112+0000 7f7335150700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f731c060550 0x7f731c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.112+0000 7f7335150700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f731c060550 0x7f731c062a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f732c0091e0 tx=0x7f732c017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:34.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.120+0000 7f73257fa700 1 -- 172.21.15.37:0/3600848015 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f732004ccf0 con 0x7f7330168aa0 2023-10-06T04:41:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.312+0000 7f73373b4700 1 -- 172.21.15.37:0/3600848015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7330070ee0 con 0x7f7330168aa0 2023-10-06T04:41:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.312+0000 7f73257fa700 1 -- 172.21.15.37:0/3600848015 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f7320017090 con 0x7f7330168aa0 2023-10-06T04:41:34.320 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:34.320 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3716256971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3716256971},{"type":"v1","addr":"172.21.15.37:6833","nonce":3716256971}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/893255287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":893255287},{"type":"v1","addr":"172.21.15.37:6835","nonce":893255287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3794492713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3794492713},{"type":"v1","addr":"172.21.15.83:6837","nonce":3794492713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:54.053558+0000","modified":"2023-10-06T04:41:31.918744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":58,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6835/1381995756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1381995756},{"type":"v1","addr":"172.21.15.83:6835","nonce":1381995756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:41:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.316+0000 7f73373b4700 1 -- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f731c060550 msgr2=0x7f731c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.316+0000 7f73373b4700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f731c060550 0x7f731c062a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f732c0091e0 tx=0x7f732c017000 comp rx=0 tx=0).stop 2023-10-06T04:41:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.316+0000 7f73373b4700 1 -- 172.21.15.37:0/3600848015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7330168aa0 msgr2=0x7f73300b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.316+0000 7f73373b4700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7330168aa0 0x7f73300b2b10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f732000ea20 tx=0x7f73200091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.316+0000 7f73373b4700 1 -- 172.21.15.37:0/3600848015 shutdown_connections 2023-10-06T04:41:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.316+0000 7f73373b4700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f731c060550 0x7f731c062a00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.316+0000 7f73373b4700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f733015cbd0 0x7f7330168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.316+0000 7f73373b4700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7330168aa0 0x7f73300b2b10 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.316+0000 7f73373b4700 1 --2- 172.21.15.37:0/3600848015 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73301531e0 0x7f73300c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.316+0000 7f73373b4700 1 -- 172.21.15.37:0/3600848015 >> 172.21.15.37:0/3600848015 conn(0x7f73300ccf80 msgr2=0x7f73300cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.320+0000 7f73373b4700 1 -- 172.21.15.37:0/3600848015 shutdown_connections 2023-10-06T04:41:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.320+0000 7f73373b4700 1 -- 172.21.15.37:0/3600848015 wait complete. 2023-10-06T04:41:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2023-10-06T04:41:34.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:41:34.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 Processor -- start 2023-10-06T04:41:34.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 -- start start 2023-10-06T04:41:34.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff8e015d240 0x7ff8e00aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8e00cc0d0 0x7ff8e006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e015e0e0 con 0x7ff8e006da20 2023-10-06T04:41:34.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e006de20 con 0x7ff8e00cc0d0 2023-10-06T04:41:34.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e015d7b0 con 0x7ff8e015d240 2023-10-06T04:41:34.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8d6ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8e00cc0d0 0x7ff8e006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8d6ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8e00cc0d0 0x7ff8e006d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47118/0 (socket says 172.21.15.37:47118) 2023-10-06T04:41:34.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8d6ffd700 1 -- 172.21.15.37:0/3306129602 learned_addr learned my addr 172.21.15.37:0/3306129602 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:34.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8df7fe700 1 --2- 172.21.15.37:0/3306129602 >> v2:172.21.15.83:3300/0 conn(0x7ff8e015d240 0x7ff8e00aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8d6ffd700 1 -- 172.21.15.37:0/3306129602 >> v2:172.21.15.83:3300/0 conn(0x7ff8e015d240 msgr2=0x7ff8e00aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8d6ffd700 1 --2- 172.21.15.37:0/3306129602 >> v2:172.21.15.83:3300/0 conn(0x7ff8e015d240 0x7ff8e00aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8d6ffd700 1 -- 172.21.15.37:0/3306129602 >> v1:172.21.15.83:6789/0 conn(0x7ff8e006da20 legacy=0x7ff8e0160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8d6ffd700 1 -- 172.21.15.37:0/3306129602 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e015da90 con 0x7ff8e00cc0d0 2023-10-06T04:41:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8d6ffd700 1 --2- 172.21.15.37:0/3306129602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e00cc0d0 0x7ff8e006d4e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff8e006d2e0 tx=0x7ff8c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fbf52a554c1189 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8deffd700 1 -- 172.21.15.37:0/3306129602 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8009e70 con 0x7ff8e00cc0d0 2023-10-06T04:41:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8deffd700 1 -- 172.21.15.37:0/3306129602 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c800b860 con 0x7ff8e00cc0d0 2023-10-06T04:41:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8deffd700 1 -- 172.21.15.37:0/3306129602 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c800bc00 con 0x7ff8e00cc0d0 2023-10-06T04:41:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3306129602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e00cc0d0 msgr2=0x7ff8e006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 --2- 172.21.15.37:0/3306129602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e00cc0d0 0x7ff8e006d4e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff8e006d2e0 tx=0x7ff8c8009250 comp rx=0 tx=0).stop 2023-10-06T04:41:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3306129602 shutdown_connections 2023-10-06T04:41:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 --2- 172.21.15.37:0/3306129602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e00cc0d0 0x7ff8e006d4e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 --2- 172.21.15.37:0/3306129602 >> v2:172.21.15.83:3300/0 conn(0x7ff8e015d240 0x7ff8e00aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3306129602 >> 172.21.15.37:0/3306129602 conn(0x7ff8e0068780 msgr2=0x7ff8e00cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3306129602 shutdown_connections 2023-10-06T04:41:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.444+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3306129602 wait complete. 2023-10-06T04:41:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8e4fd2700 1 Processor -- start 2023-10-06T04:41:34.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8e4fd2700 1 -- start start 2023-10-06T04:41:34.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8e4fd2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e006da20 0x7ff8e0170b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8e4fd2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8e00cc0d0 0x7ff8e016c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8e4fd2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e015d240 0x7ff8e016ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8e4fd2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00b0ef0 con 0x7ff8e015d240 2023-10-06T04:41:34.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8e4fd2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e016d200 con 0x7ff8e00cc0d0 2023-10-06T04:41:34.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8e4fd2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0157910 con 0x7ff8e006da20 2023-10-06T04:41:34.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8dffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e015d240 0x7ff8e016ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8dffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e015d240 0x7ff8e016ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47134/0 (socket says 172.21.15.37:47134) 2023-10-06T04:41:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8df7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e006da20 0x7ff8e0170b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8dffff700 1 -- 172.21.15.37:0/3420138251 learned_addr learned my addr 172.21.15.37:0/3420138251 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8d6ffd700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8e00cc0d0 0x7ff8e016c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8dffff700 1 -- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e006da20 msgr2=0x7ff8e0170b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8dffff700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e006da20 0x7ff8e0170b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8dffff700 1 -- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8e00cc0d0 msgr2=0x7ff8e016c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8dffff700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8e00cc0d0 0x7ff8e016c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.448+0000 7ff8dffff700 1 -- 172.21.15.37:0/3420138251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c80094f0 con 0x7ff8e015d240 2023-10-06T04:41:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.452+0000 7ff8dffff700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e015d240 0x7ff8e016ccc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800c910 tx=0x7ff8d80016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.452+0000 7ff8d7fff700 1 -- 172.21.15.37:0/3420138251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8012630 con 0x7ff8e015d240 2023-10-06T04:41:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.452+0000 7ff8d7fff700 1 -- 172.21.15.37:0/3420138251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d80127b0 con 0x7ff8e015d240 2023-10-06T04:41:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.452+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3420138251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e0157bf0 con 0x7ff8e015d240 2023-10-06T04:41:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.452+0000 7ff8d7fff700 1 -- 172.21.15.37:0/3420138251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8012b70 con 0x7ff8e015d240 2023-10-06T04:41:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.452+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3420138251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e0158490 con 0x7ff8e015d240 2023-10-06T04:41:34.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.452+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3420138251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e0157de0 con 0x7ff8e015d240 2023-10-06T04:41:34.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.452+0000 7ff8d7fff700 1 -- 172.21.15.37:0/3420138251 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff8d8003030 con 0x7ff8e015d240 2023-10-06T04:41:34.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.452+0000 7ff8d7fff700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8c0060550 0x7ff8c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.452+0000 7ff8d7fff700 1 -- 172.21.15.37:0/3420138251 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff8d807c970 con 0x7ff8e015d240 2023-10-06T04:41:34.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.452+0000 7ff8df7fe700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8c0060550 0x7ff8c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.456+0000 7ff8df7fe700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8c0060550 0x7ff8c0062a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009d10 tx=0x7ff8d00091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:34.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.460+0000 7ff8d7fff700 1 -- 172.21.15.37:0/3420138251 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff8d804cc70 con 0x7ff8e015d240 2023-10-06T04:41:34.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.624+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3420138251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8e00708a0 con 0x7ff8e015d240 2023-10-06T04:41:34.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8d7fff700 1 -- 172.21.15.37:0/3420138251 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+17152 (secure 0 0 0) 0x7ff8d8050290 con 0x7ff8e015d240 2023-10-06T04:41:34.632 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:34.632 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":59,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:41:27.888956+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:52.204019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:53.038979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/3410822358":"2023-10-07T04:41:27.878627+0000","172.21.15.37:6834/3410822358":"2023-10-07T04:41:27.878627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:41:34.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8c0060550 msgr2=0x7ff8c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8e4fd2700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8c0060550 0x7ff8c0062a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009d10 tx=0x7ff8d00091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3420138251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e015d240 msgr2=0x7ff8e016ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8e4fd2700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e015d240 0x7ff8e016ccc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800c910 tx=0x7ff8d80016d0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3420138251 shutdown_connections 2023-10-06T04:41:34.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8e4fd2700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff8c0060550 0x7ff8c0062a00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8e4fd2700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8e00cc0d0 0x7ff8e016c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8e4fd2700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8e015d240 0x7ff8e016ccc0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8e4fd2700 1 --2- 172.21.15.37:0/3420138251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8e006da20 0x7ff8e0170b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3420138251 >> 172.21.15.37:0/3420138251 conn(0x7ff8e0068780 msgr2=0x7ff8e015bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:34.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3420138251 shutdown_connections 2023-10-06T04:41:34.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.628+0000 7ff8e4fd2700 1 -- 172.21.15.37:0/3420138251 wait complete. 2023-10-06T04:41:34.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:38:57.083952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:04.547586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:40:52.204019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:40:53.038979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:41:34.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:41:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.756+0000 7fa2d88c0700 1 Processor -- start 2023-10-06T04:41:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.756+0000 7fa2d88c0700 1 -- start start 2023-10-06T04:41:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.756+0000 7fa2d88c0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d415bfe0 0x7fa2d40ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.756+0000 7fa2d88c0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2d415c3b0 0x7fa2d4067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.756+0000 7fa2d88c0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa2d40aeac0 0x7fa2d4068230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.756+0000 7fa2d88c0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d40ad1c0 con 0x7fa2d415c3b0 2023-10-06T04:41:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.756+0000 7fa2d88c0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d40ac490 con 0x7fa2d40aeac0 2023-10-06T04:41:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.756+0000 7fa2d88c0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40acd30 con 0x7fa2d415bfe0 2023-10-06T04:41:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.756+0000 7fa2cbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2d415c3b0 0x7fa2d4067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.756+0000 7fa2cbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2d415c3b0 0x7fa2d4067cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47148/0 (socket says 172.21.15.37:47148) 2023-10-06T04:41:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.756+0000 7fa2cbfff700 1 -- 172.21.15.37:0/1746800992 learned_addr learned my addr 172.21.15.37:0/1746800992 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d359e700 1 --2- 172.21.15.37:0/1746800992 >> v2:172.21.15.83:3300/0 conn(0x7fa2d40aeac0 0x7fa2d4068230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d2d9d700 1 --2- 172.21.15.37:0/1746800992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d415bfe0 0x7fa2d40ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2cbfff700 1 -- 172.21.15.37:0/1746800992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d415bfe0 msgr2=0x7fa2d40ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2cbfff700 1 --2- 172.21.15.37:0/1746800992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d415bfe0 0x7fa2d40ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2cbfff700 1 -- 172.21.15.37:0/1746800992 >> v2:172.21.15.83:3300/0 conn(0x7fa2d40aeac0 msgr2=0x7fa2d4068230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2cbfff700 1 --2- 172.21.15.37:0/1746800992 >> v2:172.21.15.83:3300/0 conn(0x7fa2d40aeac0 0x7fa2d4068230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2cbfff700 1 -- 172.21.15.37:0/1746800992 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40af090 con 0x7fa2d415c3b0 2023-10-06T04:41:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d359e700 1 --2- 172.21.15.37:0/1746800992 >> v2:172.21.15.83:3300/0 conn(0x7fa2d40aeac0 0x7fa2d4068230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2cbfff700 1 --2- 172.21.15.37:0/1746800992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d415c3b0 0x7fa2d4067cf0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa2d406f500 tx=0x7fa2bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19f4eda1d69c086 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d259c700 1 -- 172.21.15.37:0/1746800992 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00b640 con 0x7fa2d415c3b0 2023-10-06T04:41:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d259c700 1 -- 172.21.15.37:0/1746800992 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc00b7a0 con 0x7fa2d415c3b0 2023-10-06T04:41:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d259c700 1 -- 172.21.15.37:0/1746800992 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00bb60 con 0x7fa2d415c3b0 2023-10-06T04:41:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d88c0700 1 -- 172.21.15.37:0/1746800992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d415c3b0 msgr2=0x7fa2d4067cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d88c0700 1 --2- 172.21.15.37:0/1746800992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d415c3b0 0x7fa2d4067cf0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa2d406f500 tx=0x7fa2bc009250 comp rx=0 tx=0).stop 2023-10-06T04:41:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d88c0700 1 -- 172.21.15.37:0/1746800992 shutdown_connections 2023-10-06T04:41:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d88c0700 1 --2- 172.21.15.37:0/1746800992 >> v2:172.21.15.83:3300/0 conn(0x7fa2d40aeac0 0x7fa2d4068230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d88c0700 1 --2- 172.21.15.37:0/1746800992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d415c3b0 0x7fa2d4067cf0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d88c0700 1 --2- 172.21.15.37:0/1746800992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d415bfe0 0x7fa2d40ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d88c0700 1 -- 172.21.15.37:0/1746800992 >> 172.21.15.37:0/1746800992 conn(0x7fa2d406e7c0 msgr2=0x7fa2d406ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d88c0700 1 -- 172.21.15.37:0/1746800992 shutdown_connections 2023-10-06T04:41:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.760+0000 7fa2d88c0700 1 -- 172.21.15.37:0/1746800992 wait complete. 2023-10-06T04:41:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d88c0700 1 Processor -- start 2023-10-06T04:41:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d88c0700 1 -- start start 2023-10-06T04:41:34.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d88c0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d40aeac0 0x7fa2d4154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d88c0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d415bfe0 0x7fa2d415a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d88c0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2d415c3b0 0x7fa2d4098e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d88c0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d415a570 con 0x7fa2d40aeac0 2023-10-06T04:41:34.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d88c0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41550c0 con 0x7fa2d415c3b0 2023-10-06T04:41:34.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d88c0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41553a0 con 0x7fa2d415bfe0 2023-10-06T04:41:34.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d40aeac0 0x7fa2d4154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d40aeac0 0x7fa2d4154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47154/0 (socket says 172.21.15.37:47154) 2023-10-06T04:41:34.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d2d9d700 1 -- 172.21.15.37:0/3945210353 learned_addr learned my addr 172.21.15.37:0/3945210353 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:34.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d359e700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2d415c3b0 0x7fa2d4098e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2cbfff700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d415bfe0 0x7fa2d415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d2d9d700 1 -- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d415bfe0 msgr2=0x7fa2d415a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d2d9d700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d415bfe0 0x7fa2d415a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d2d9d700 1 -- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2d415c3b0 msgr2=0x7fa2d4098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d2d9d700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2d415c3b0 0x7fa2d4098e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.764+0000 7fa2d2d9d700 1 -- 172.21.15.37:0/3945210353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc009a20 con 0x7fa2d40aeac0 2023-10-06T04:41:34.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.768+0000 7fa2d2d9d700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d40aeac0 0x7fa2d4154ab0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400ec80 tx=0x7fa2c4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.768+0000 7fa2caffd700 1 -- 172.21.15.37:0/3945210353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c400c850 con 0x7fa2d40aeac0 2023-10-06T04:41:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.768+0000 7fa2caffd700 1 -- 172.21.15.37:0/3945210353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c400c9b0 con 0x7fa2d40aeac0 2023-10-06T04:41:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.768+0000 7fa2d88c0700 1 -- 172.21.15.37:0/3945210353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc0094f0 con 0x7fa2d40aeac0 2023-10-06T04:41:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.768+0000 7fa2caffd700 1 -- 172.21.15.37:0/3945210353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c400cd30 con 0x7fa2d40aeac0 2023-10-06T04:41:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.768+0000 7fa2d88c0700 1 -- 172.21.15.37:0/3945210353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d4155960 con 0x7fa2d40aeac0 2023-10-06T04:41:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.768+0000 7fa2d88c0700 1 -- 172.21.15.37:0/3945210353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d4095a50 con 0x7fa2d40aeac0 2023-10-06T04:41:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.768+0000 7fa2caffd700 1 -- 172.21.15.37:0/3945210353 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa2c4013680 con 0x7fa2d40aeac0 2023-10-06T04:41:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.768+0000 7fa2caffd700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2b4060550 0x7fa2b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.768+0000 7fa2caffd700 1 -- 172.21.15.37:0/3945210353 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa2c407d020 con 0x7fa2d40aeac0 2023-10-06T04:41:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.772+0000 7fa2cbfff700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2b4060550 0x7fa2b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.772+0000 7fa2cbfff700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2b4060550 0x7fa2b4062a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa2d406f500 tx=0x7fa2bc017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.776+0000 7fa2caffd700 1 -- 172.21.15.37:0/3945210353 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa2c404d3e0 con 0x7fa2d40aeac0 2023-10-06T04:41:34.904 INFO:tasks.ceph.mds.b.smithi083.stderr:2023-10-06T04:41:34.899+0000 7f81af539700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:41:34.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.940+0000 7fa2d88c0700 1 -- 172.21.15.37:0/3945210353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2d40708a0 con 0x7fa2d40aeac0 2023-10-06T04:41:34.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.940+0000 7fa2caffd700 1 -- 172.21.15.37:0/3945210353 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2c4021020 con 0x7fa2d40aeac0 2023-10-06T04:41:34.946 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:41:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.940+0000 7fa2d88c0700 1 -- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2b4060550 msgr2=0x7fa2b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.940+0000 7fa2d88c0700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2b4060550 0x7fa2b4062a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa2d406f500 tx=0x7fa2bc017000 comp rx=0 tx=0).stop 2023-10-06T04:41:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.940+0000 7fa2d88c0700 1 -- 172.21.15.37:0/3945210353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d40aeac0 msgr2=0x7fa2d4154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.940+0000 7fa2d88c0700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d40aeac0 0x7fa2d4154ab0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400ec80 tx=0x7fa2c4009120 comp rx=0 tx=0).stop 2023-10-06T04:41:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.940+0000 7fa2d88c0700 1 -- 172.21.15.37:0/3945210353 shutdown_connections 2023-10-06T04:41:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.940+0000 7fa2d88c0700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fa2b4060550 0x7fa2b4062a00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.940+0000 7fa2d88c0700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2d415c3b0 0x7fa2d4098e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.940+0000 7fa2d88c0700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2d415bfe0 0x7fa2d415a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.940+0000 7fa2d88c0700 1 --2- 172.21.15.37:0/3945210353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d40aeac0 0x7fa2d4154ab0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.944+0000 7fa2d88c0700 1 -- 172.21.15.37:0/3945210353 >> 172.21.15.37:0/3945210353 conn(0x7fa2d406e7c0 msgr2=0x7fa2d406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.944+0000 7fa2d88c0700 1 -- 172.21.15.37:0/3945210353 shutdown_connections 2023-10-06T04:41:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:34.944+0000 7fa2d88c0700 1 -- 172.21.15.37:0/3945210353 wait complete. 2023-10-06T04:41:34.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:41:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30ffff700 1 Processor -- start 2023-10-06T04:41:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30ffff700 1 -- start start 2023-10-06T04:41:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3100ca7a0 0x7fc31009a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc31009b2b0 0x7fc310068e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc3100cab70 0x7fc310069340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30ffff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3101592a0 con 0x7fc31009b2b0 2023-10-06T04:41:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30ffff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31006b8d0 con 0x7fc3100cab70 2023-10-06T04:41:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30ffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31009adb0 con 0x7fc3100ca7a0 2023-10-06T04:41:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc31009b2b0 0x7fc310068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc31009b2b0 0x7fc310068e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47158/0 (socket says 172.21.15.37:47158) 2023-10-06T04:41:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30e7fc700 1 -- 172.21.15.37:0/2857110009 learned_addr learned my addr 172.21.15.37:0/2857110009 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30effd700 1 --2- 172.21.15.37:0/2857110009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3100ca7a0 0x7fc31009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30f7fe700 1 --2- 172.21.15.37:0/2857110009 >> v2:172.21.15.83:3300/0 conn(0x7fc3100cab70 0x7fc310069340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30e7fc700 1 -- 172.21.15.37:0/2857110009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3100ca7a0 msgr2=0x7fc31009a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30e7fc700 1 --2- 172.21.15.37:0/2857110009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3100ca7a0 0x7fc31009a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30e7fc700 1 -- 172.21.15.37:0/2857110009 >> v2:172.21.15.83:3300/0 conn(0x7fc3100cab70 msgr2=0x7fc310069340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30e7fc700 1 --2- 172.21.15.37:0/2857110009 >> v2:172.21.15.83:3300/0 conn(0x7fc3100cab70 0x7fc310069340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30e7fc700 1 -- 172.21.15.37:0/2857110009 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31006bae0 con 0x7fc31009b2b0 2023-10-06T04:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.060+0000 7fc30effd700 1 --2- 172.21.15.37:0/2857110009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3100ca7a0 0x7fc31009a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30e7fc700 1 --2- 172.21.15.37:0/2857110009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc31009b2b0 0x7fc310068e00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80099b0 tx=0x7fc2f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a247d64aab6ec4af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30dffb700 1 -- 172.21.15.37:0/2857110009 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f800b820 con 0x7fc31009b2b0 2023-10-06T04:41:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30dffb700 1 -- 172.21.15.37:0/2857110009 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f800b980 con 0x7fc31009b2b0 2023-10-06T04:41:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30dffb700 1 -- 172.21.15.37:0/2857110009 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f800bd20 con 0x7fc31009b2b0 2023-10-06T04:41:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30ffff700 1 -- 172.21.15.37:0/2857110009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc31009b2b0 msgr2=0x7fc310068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30ffff700 1 --2- 172.21.15.37:0/2857110009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc31009b2b0 0x7fc310068e00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80099b0 tx=0x7fc2f8009250 comp rx=0 tx=0).stop 2023-10-06T04:41:35.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30ffff700 1 -- 172.21.15.37:0/2857110009 shutdown_connections 2023-10-06T04:41:35.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30ffff700 1 --2- 172.21.15.37:0/2857110009 >> v2:172.21.15.83:3300/0 conn(0x7fc3100cab70 0x7fc310069340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30ffff700 1 --2- 172.21.15.37:0/2857110009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc31009b2b0 0x7fc310068e00 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30ffff700 1 --2- 172.21.15.37:0/2857110009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3100ca7a0 0x7fc31009a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30ffff700 1 -- 172.21.15.37:0/2857110009 >> 172.21.15.37:0/2857110009 conn(0x7fc3100667b0 msgr2=0x7fc310066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:35.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30ffff700 1 -- 172.21.15.37:0/2857110009 shutdown_connections 2023-10-06T04:41:35.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30ffff700 1 -- 172.21.15.37:0/2857110009 wait complete. 2023-10-06T04:41:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30ffff700 1 Processor -- start 2023-10-06T04:41:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.064+0000 7fc30ffff700 1 -- start start 2023-10-06T04:41:35.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc31009b2b0 0x7fc3100afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3100ca7a0 0x7fc31015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3100cab70 0x7fc31016ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30ffff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31015a070 con 0x7fc31009b2b0 2023-10-06T04:41:35.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30ffff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3101594a0 con 0x7fc3100ca7a0 2023-10-06T04:41:35.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30ffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc310159740 con 0x7fc3100cab70 2023-10-06T04:41:35.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc31009b2b0 0x7fc3100afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc31009b2b0 0x7fc3100afb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47166/0 (socket says 172.21.15.37:47166) 2023-10-06T04:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30effd700 1 -- 172.21.15.37:0/1305373774 learned_addr learned my addr 172.21.15.37:0/1305373774 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30e7fc700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3100ca7a0 0x7fc31015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30f7fe700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3100cab70 0x7fc31016ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30effd700 1 -- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3100cab70 msgr2=0x7fc31016ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30effd700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3100cab70 0x7fc31016ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30effd700 1 -- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3100ca7a0 msgr2=0x7fc31015bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30effd700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3100ca7a0 0x7fc31015bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30effd700 1 -- 172.21.15.37:0/1305373774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80094f0 con 0x7fc31009b2b0 2023-10-06T04:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30f7fe700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3100cab70 0x7fc31016ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30e7fc700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3100ca7a0 0x7fc31015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30effd700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc31009b2b0 0x7fc3100afb50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc30000d220 tx=0x7fc300009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc306ffd700 1 -- 172.21.15.37:0/1305373774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300015440 con 0x7fc31009b2b0 2023-10-06T04:41:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc306ffd700 1 -- 172.21.15.37:0/1305373774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30000f040 con 0x7fc31009b2b0 2023-10-06T04:41:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30ffff700 1 -- 172.21.15.37:0/1305373774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc310159a20 con 0x7fc31009b2b0 2023-10-06T04:41:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc306ffd700 1 -- 172.21.15.37:0/1305373774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3000157d0 con 0x7fc31009b2b0 2023-10-06T04:41:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.068+0000 7fc30ffff700 1 -- 172.21.15.37:0/1305373774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3100b0090 con 0x7fc31009b2b0 2023-10-06T04:41:35.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.072+0000 7fc30ffff700 1 -- 172.21.15.37:0/1305373774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3100708a0 con 0x7fc31009b2b0 2023-10-06T04:41:35.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.072+0000 7fc306ffd700 1 -- 172.21.15.37:0/1305373774 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc300015bc0 con 0x7fc31009b2b0 2023-10-06T04:41:35.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.072+0000 7fc306ffd700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc2f0060550 0x7fc2f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.072+0000 7fc306ffd700 1 -- 172.21.15.37:0/1305373774 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fc30007d140 con 0x7fc31009b2b0 2023-10-06T04:41:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.072+0000 7fc30e7fc700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc2f0060550 0x7fc2f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.072+0000 7fc30e7fc700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc2f0060550 0x7fc2f0062a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80099b0 tx=0x7fc2f8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:35.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.080+0000 7fc306ffd700 1 -- 172.21.15.37:0/1305373774 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc30004cbe0 con 0x7fc31009b2b0 2023-10-06T04:41:35.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.240+0000 7fc30ffff700 1 -- 172.21.15.37:0/1305373774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc31006bdc0 con 0x7fc31009b2b0 2023-10-06T04:41:35.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.240+0000 7fc306ffd700 1 -- 172.21.15.37:0/1305373774 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v59) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc30001a020 con 0x7fc31009b2b0 2023-10-06T04:41:35.246 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:41:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.240+0000 7fc30ffff700 1 -- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc2f0060550 msgr2=0x7fc2f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.240+0000 7fc30ffff700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc2f0060550 0x7fc2f0062a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80099b0 tx=0x7fc2f8017000 comp rx=0 tx=0).stop 2023-10-06T04:41:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.240+0000 7fc30ffff700 1 -- 172.21.15.37:0/1305373774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc31009b2b0 msgr2=0x7fc3100afb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.240+0000 7fc30ffff700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc31009b2b0 0x7fc3100afb50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc30000d220 tx=0x7fc300009ae0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.244+0000 7fc30ffff700 1 -- 172.21.15.37:0/1305373774 shutdown_connections 2023-10-06T04:41:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.244+0000 7fc30ffff700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc2f0060550 0x7fc2f0062a00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.244+0000 7fc30ffff700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3100ca7a0 0x7fc31015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.244+0000 7fc30ffff700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3100cab70 0x7fc31016ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.244+0000 7fc30ffff700 1 --2- 172.21.15.37:0/1305373774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc31009b2b0 0x7fc3100afb50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.244+0000 7fc30ffff700 1 -- 172.21.15.37:0/1305373774 >> 172.21.15.37:0/1305373774 conn(0x7fc3100667b0 msgr2=0x7fc3100cc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.244+0000 7fc30ffff700 1 -- 172.21.15.37:0/1305373774 shutdown_connections 2023-10-06T04:41:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.244+0000 7fc30ffff700 1 -- 172.21.15.37:0/1305373774 wait complete. 2023-10-06T04:41:35.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:41:35.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.376+0000 7f97cbfff700 1 Processor -- start 2023-10-06T04:41:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.376+0000 7f97cbfff700 1 -- start start 2023-10-06T04:41:35.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97cc156960 0x7f97cc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f97cc156d30 0x7f97cc06ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97cc06cf50 con 0x7f97cc0cca30 2023-10-06T04:41:35.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97cc06c390 con 0x7f97cc156960 2023-10-06T04:41:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97cc0c28f0 con 0x7f97cc156d30 2023-10-06T04:41:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97caffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97cc156960 0x7f97cc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97caffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97cc156960 0x7f97cc06bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47172/0 (socket says 172.21.15.37:47172) 2023-10-06T04:41:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97caffd700 1 -- 172.21.15.37:0/1949636664 learned_addr learned my addr 172.21.15.37:0/1949636664 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cb7fe700 1 --1- 172.21.15.37:0/1949636664 >> v1:172.21.15.37:6789/0 conn(0x7f97cc0cca30 0x7f97cc0cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42112/0 (socket says 172.21.15.37:42112) 2023-10-06T04:41:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97ca7fc700 1 --2- 172.21.15.37:0/1949636664 >> v2:172.21.15.83:3300/0 conn(0x7f97cc156d30 0x7f97cc06ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97c9ffb700 1 -- 172.21.15.37:0/1949636664 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308044976 0 0) 0x7f97cc06cf50 con 0x7f97cc0cca30 2023-10-06T04:41:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97c9ffb700 1 -- 172.21.15.37:0/1949636664 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b4003570 con 0x7f97cc0cca30 2023-10-06T04:41:35.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97caffd700 1 -- 172.21.15.37:0/1949636664 >> v2:172.21.15.83:3300/0 conn(0x7f97cc156d30 msgr2=0x7f97cc06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:35.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97caffd700 1 --2- 172.21.15.37:0/1949636664 >> v2:172.21.15.83:3300/0 conn(0x7f97cc156d30 0x7f97cc06ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97caffd700 1 -- 172.21.15.37:0/1949636664 >> v1:172.21.15.37:6789/0 conn(0x7f97cc0cca30 legacy=0x7f97cc0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97caffd700 1 -- 172.21.15.37:0/1949636664 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc0c2b90 con 0x7f97cc156960 2023-10-06T04:41:35.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97caffd700 1 --2- 172.21.15.37:0/1949636664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97cc156960 0x7f97cc06bd80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f97cc09b690 tx=0x7f97c0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72fc2f75c930d84d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:35.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97c9ffb700 1 -- 172.21.15.37:0/1949636664 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c0005c10 con 0x7f97cc156960 2023-10-06T04:41:35.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97c9ffb700 1 -- 172.21.15.37:0/1949636664 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c0005d70 con 0x7f97cc156960 2023-10-06T04:41:35.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97c9ffb700 1 -- 172.21.15.37:0/1949636664 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c0006260 con 0x7f97cc156960 2023-10-06T04:41:35.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 -- 172.21.15.37:0/1949636664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97cc156960 msgr2=0x7f97cc06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 --2- 172.21.15.37:0/1949636664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97cc156960 0x7f97cc06bd80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f97cc09b690 tx=0x7f97c0009220 comp rx=0 tx=0).stop 2023-10-06T04:41:35.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 -- 172.21.15.37:0/1949636664 shutdown_connections 2023-10-06T04:41:35.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 --2- 172.21.15.37:0/1949636664 >> v2:172.21.15.83:3300/0 conn(0x7f97cc156d30 0x7f97cc06ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 --2- 172.21.15.37:0/1949636664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97cc156960 0x7f97cc06bd80 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 -- 172.21.15.37:0/1949636664 >> 172.21.15.37:0/1949636664 conn(0x7f97cc0667b0 msgr2=0x7f97cc066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:35.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 -- 172.21.15.37:0/1949636664 shutdown_connections 2023-10-06T04:41:35.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.380+0000 7f97cbfff700 1 -- 172.21.15.37:0/1949636664 wait complete. 2023-10-06T04:41:35.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cbfff700 1 Processor -- start 2023-10-06T04:41:35.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cbfff700 1 -- start start 2023-10-06T04:41:35.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97cc0cca30 0x7f97cc153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97cc156960 0x7f97cc0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97cc156d30 0x7f97cc0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cbfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc154260 con 0x7f97cc156d30 2023-10-06T04:41:35.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cbfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc15b6d0 con 0x7f97cc0cca30 2023-10-06T04:41:35.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc15aac0 con 0x7f97cc156960 2023-10-06T04:41:35.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97cc156d30 0x7f97cc0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97cc156d30 0x7f97cc0c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47188/0 (socket says 172.21.15.37:47188) 2023-10-06T04:41:35.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cb7fe700 1 -- 172.21.15.37:0/797195579 learned_addr learned my addr 172.21.15.37:0/797195579 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:35.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97caffd700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97cc0cca30 0x7f97cc153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97ca7fc700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97cc156960 0x7f97cc0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cb7fe700 1 -- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97cc156960 msgr2=0x7f97cc0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cb7fe700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97cc156960 0x7f97cc0b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cb7fe700 1 -- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97cc0cca30 msgr2=0x7f97cc153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cb7fe700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97cc0cca30 0x7f97cc153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cb7fe700 1 -- 172.21.15.37:0/797195579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c0009480 con 0x7f97cc156d30 2023-10-06T04:41:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97caffd700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97cc0cca30 0x7f97cc153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97ca7fc700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97cc156960 0x7f97cc0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:35.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cb7fe700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97cc156d30 0x7f97cc0c57c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f97c400cd30 tx=0x7f97c4001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:35.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97b2ffd700 1 -- 172.21.15.37:0/797195579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4005df0 con 0x7f97cc156d30 2023-10-06T04:41:35.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97b2ffd700 1 -- 172.21.15.37:0/797195579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c400a960 con 0x7f97cc156d30 2023-10-06T04:41:35.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.384+0000 7f97cbfff700 1 -- 172.21.15.37:0/797195579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97cc15ada0 con 0x7f97cc156d30 2023-10-06T04:41:35.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.388+0000 7f97b2ffd700 1 -- 172.21.15.37:0/797195579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c400ace0 con 0x7f97cc156d30 2023-10-06T04:41:35.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.388+0000 7f97cbfff700 1 -- 172.21.15.37:0/797195579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97cc15b360 con 0x7f97cc156d30 2023-10-06T04:41:35.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.388+0000 7f97cbfff700 1 -- 172.21.15.37:0/797195579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97cc15b840 con 0x7f97cc156d30 2023-10-06T04:41:35.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.388+0000 7f97b2ffd700 1 -- 172.21.15.37:0/797195579 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f97c4007300 con 0x7f97cc156d30 2023-10-06T04:41:35.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.388+0000 7f97b2ffd700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f97b8060550 0x7f97b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.388+0000 7f97b2ffd700 1 -- 172.21.15.37:0/797195579 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f97c407cbf0 con 0x7f97cc156d30 2023-10-06T04:41:35.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.388+0000 7f97caffd700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f97b8060550 0x7f97b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.392+0000 7f97caffd700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f97b8060550 0x7f97b8062a00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009260 tx=0x7f97c0016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:35.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.392+0000 7f97b2ffd700 1 -- 172.21.15.37:0/797195579 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f97c404cf70 con 0x7f97cc156d30 2023-10-06T04:41:35.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 -- 172.21.15.37:0/797195579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97cc0708a0 con 0x7f97cc156d30 2023-10-06T04:41:35.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97b2ffd700 1 -- 172.21.15.37:0/797195579 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97c4050590 con 0x7f97cc156d30 2023-10-06T04:41:35.561 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:41:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 -- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f97b8060550 msgr2=0x7f97b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f97b8060550 0x7f97b8062a00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009260 tx=0x7f97c0016000 comp rx=0 tx=0).stop 2023-10-06T04:41:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 -- 172.21.15.37:0/797195579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97cc156d30 msgr2=0x7f97cc0c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97cc156d30 0x7f97cc0c57c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f97c400cd30 tx=0x7f97c4001b60 comp rx=0 tx=0).stop 2023-10-06T04:41:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 -- 172.21.15.37:0/797195579 shutdown_connections 2023-10-06T04:41:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f97b8060550 0x7f97b8062a00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97cc156d30 0x7f97cc0c57c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97cc156960 0x7f97cc0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 --2- 172.21.15.37:0/797195579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97cc0cca30 0x7f97cc153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 -- 172.21.15.37:0/797195579 >> 172.21.15.37:0/797195579 conn(0x7f97cc0667b0 msgr2=0x7f97cc0c8160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 -- 172.21.15.37:0/797195579 shutdown_connections 2023-10-06T04:41:35.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.556+0000 7f97cbfff700 1 -- 172.21.15.37:0/797195579 wait complete. 2023-10-06T04:41:35.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:41:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.680+0000 7f4c919f8700 1 Processor -- start 2023-10-06T04:41:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.680+0000 7f4c919f8700 1 -- start start 2023-10-06T04:41:35.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.680+0000 7f4c919f8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4c8c069b40 0x7f4c8c0b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.680+0000 7f4c919f8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c8c1537d0 0x7f4c8c0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.680+0000 7f4c919f8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8c0b5a60 con 0x7f4c8c153400 2023-10-06T04:41:35.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.680+0000 7f4c919f8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8c0b4c60 con 0x7f4c8c069b40 2023-10-06T04:41:35.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.680+0000 7f4c919f8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c15a680 con 0x7f4c8c1537d0 2023-10-06T04:41:35.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.680+0000 7f4c8b7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c8c1537d0 0x7f4c8c0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.680+0000 7f4c8a7fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4c8c069b40 0x7f4c8c0b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.680+0000 7f4c8b7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c8c1537d0 0x7f4c8c0b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:56774/0 (socket says 172.21.15.37:56774) 2023-10-06T04:41:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.680+0000 7f4c8b7fe700 1 -- 172.21.15.37:0/21152570 learned_addr learned my addr 172.21.15.37:0/21152570 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c8b7fe700 1 -- 172.21.15.37:0/21152570 >> v2:172.21.15.83:3300/0 conn(0x7f4c8c069b40 msgr2=0x7f4c8c0b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c8b7fe700 1 --2- 172.21.15.37:0/21152570 >> v2:172.21.15.83:3300/0 conn(0x7f4c8c069b40 0x7f4c8c0b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c8b7fe700 1 -- 172.21.15.37:0/21152570 >> v1:172.21.15.83:6789/0 conn(0x7f4c8c153400 legacy=0x7f4c8c069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c8b7fe700 1 -- 172.21.15.37:0/21152570 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c159950 con 0x7f4c8c1537d0 2023-10-06T04:41:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c8b7fe700 1 --2- 172.21.15.37:0/21152570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c8c1537d0 0x7f4c8c0b4720 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009f20 tx=0x7f4c84009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aee5c53a227c4b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c89ffb700 1 -- 172.21.15.37:0/21152570 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400e070 con 0x7f4c8c1537d0 2023-10-06T04:41:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c89ffb700 1 -- 172.21.15.37:0/21152570 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8400b9d0 con 0x7f4c8c1537d0 2023-10-06T04:41:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c89ffb700 1 -- 172.21.15.37:0/21152570 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c840092e0 con 0x7f4c8c1537d0 2023-10-06T04:41:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c919f8700 1 -- 172.21.15.37:0/21152570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c8c1537d0 msgr2=0x7f4c8c0b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c919f8700 1 --2- 172.21.15.37:0/21152570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c8c1537d0 0x7f4c8c0b4720 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009f20 tx=0x7f4c84009840 comp rx=0 tx=0).stop 2023-10-06T04:41:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c919f8700 1 -- 172.21.15.37:0/21152570 shutdown_connections 2023-10-06T04:41:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c919f8700 1 --2- 172.21.15.37:0/21152570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c8c1537d0 0x7f4c8c0b4720 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c919f8700 1 --2- 172.21.15.37:0/21152570 >> v2:172.21.15.83:3300/0 conn(0x7f4c8c069b40 0x7f4c8c0b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c919f8700 1 -- 172.21.15.37:0/21152570 >> 172.21.15.37:0/21152570 conn(0x7f4c8c067cf0 msgr2=0x7f4c8c0680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c919f8700 1 -- 172.21.15.37:0/21152570 shutdown_connections 2023-10-06T04:41:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.684+0000 7f4c919f8700 1 -- 172.21.15.37:0/21152570 wait complete. 2023-10-06T04:41:35.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c919f8700 1 Processor -- start 2023-10-06T04:41:35.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c919f8700 1 -- start start 2023-10-06T04:41:35.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c919f8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c069b40 0x7f4c8c14ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c919f8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c8c153400 0x7f4c8c15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c919f8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c8c1537d0 0x7f4c8c15e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c919f8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c14cc10 con 0x7f4c8c069b40 2023-10-06T04:41:35.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c919f8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c14d3e0 con 0x7f4c8c153400 2023-10-06T04:41:35.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c919f8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c169200 con 0x7f4c8c1537d0 2023-10-06T04:41:35.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c8affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c069b40 0x7f4c8c14ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c8affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c069b40 0x7f4c8c14ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47202/0 (socket says 172.21.15.37:47202) 2023-10-06T04:41:35.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c8affd700 1 -- 172.21.15.37:0/2011056292 learned_addr learned my addr 172.21.15.37:0/2011056292 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:35.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c8b7fe700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c8c1537d0 0x7f4c8c15e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.688+0000 7f4c8a7fc700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c8c153400 0x7f4c8c15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c8affd700 1 -- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c8c1537d0 msgr2=0x7f4c8c15e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c8affd700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c8c1537d0 0x7f4c8c15e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c8affd700 1 -- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c8c153400 msgr2=0x7f4c8c15e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c8affd700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c8c153400 0x7f4c8c15e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c8affd700 1 -- 172.21.15.37:0/2011056292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c84009ae0 con 0x7f4c8c069b40 2023-10-06T04:41:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c8affd700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c069b40 0x7f4c8c14ba00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00c590 tx=0x7f4c7c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c82ffd700 1 -- 172.21.15.37:0/2011056292 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c011590 con 0x7f4c8c069b40 2023-10-06T04:41:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c82ffd700 1 -- 172.21.15.37:0/2011056292 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c011710 con 0x7f4c8c069b40 2023-10-06T04:41:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c919f8700 1 -- 172.21.15.37:0/2011056292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c150de0 con 0x7f4c8c069b40 2023-10-06T04:41:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c82ffd700 1 -- 172.21.15.37:0/2011056292 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c011ad0 con 0x7f4c8c069b40 2023-10-06T04:41:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c919f8700 1 -- 172.21.15.37:0/2011056292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c14d100 con 0x7f4c8c069b40 2023-10-06T04:41:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c919f8700 1 -- 172.21.15.37:0/2011056292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8c070ee0 con 0x7f4c8c069b40 2023-10-06T04:41:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.692+0000 7f4c82ffd700 1 -- 172.21.15.37:0/2011056292 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4c7c01b3b0 con 0x7f4c8c069b40 2023-10-06T04:41:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.696+0000 7f4c82ffd700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4c6c060550 0x7f4c6c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.696+0000 7f4c82ffd700 1 -- 172.21.15.37:0/2011056292 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4c7c07be50 con 0x7f4c8c069b40 2023-10-06T04:41:35.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.696+0000 7f4c8a7fc700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4c6c060550 0x7f4c6c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:35.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.696+0000 7f4c8a7fc700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4c6c060550 0x7f4c6c062a00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c16c730 tx=0x7f4c740091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.700+0000 7f4c82ffd700 1 -- 172.21.15.37:0/2011056292 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4c7c04c150 con 0x7f4c8c069b40 2023-10-06T04:41:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.864+0000 7f4c919f8700 1 -- 172.21.15.37:0/2011056292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4c8c068870 con 0x7f4c8c069b40 2023-10-06T04:41:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.864+0000 7f4c82ffd700 1 -- 172.21.15.37:0/2011056292 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4c7c017020 con 0x7f4c8c069b40 2023-10-06T04:41:35.871 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:41:35.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.868+0000 7f4c919f8700 1 -- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4c6c060550 msgr2=0x7f4c6c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.868+0000 7f4c919f8700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4c6c060550 0x7f4c6c062a00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c16c730 tx=0x7f4c740091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.868+0000 7f4c919f8700 1 -- 172.21.15.37:0/2011056292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c069b40 msgr2=0x7f4c8c14ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:35.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.868+0000 7f4c919f8700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c069b40 0x7f4c8c14ba00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00c590 tx=0x7f4c7c00c8a0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.868+0000 7f4c919f8700 1 -- 172.21.15.37:0/2011056292 shutdown_connections 2023-10-06T04:41:35.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.868+0000 7f4c919f8700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4c6c060550 0x7f4c6c062a00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.868+0000 7f4c919f8700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c8c153400 0x7f4c8c15e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.868+0000 7f4c919f8700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c8c1537d0 0x7f4c8c15e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.868+0000 7f4c919f8700 1 --2- 172.21.15.37:0/2011056292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c069b40 0x7f4c8c14ba00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.868+0000 7f4c919f8700 1 -- 172.21.15.37:0/2011056292 >> 172.21.15.37:0/2011056292 conn(0x7f4c8c067cf0 msgr2=0x7f4c8c0b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.868+0000 7f4c919f8700 1 -- 172.21.15.37:0/2011056292 shutdown_connections 2023-10-06T04:41:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.868+0000 7f4c919f8700 1 -- 172.21.15.37:0/2011056292 wait complete. 2023-10-06T04:41:35.886 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:41:35.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79c6717700 1 Processor -- start 2023-10-06T04:41:35.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79c6717700 1 -- start start 2023-10-06T04:41:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79c6717700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79c00c6e70 0x7f79c006f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79c6717700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c00c82a0 con 0x7f79c006ef10 2023-10-06T04:41:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79c6717700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c00c7380 con 0x7f79c00c9440 2023-10-06T04:41:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79c6717700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00ad650 con 0x7f79c00c6e70 2023-10-06T04:41:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79c5715700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f79c006ef10 0x7f79c015a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42122/0 (socket says 172.21.15.37:42122) 2023-10-06T04:41:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79c5715700 1 -- 172.21.15.37:0/3186327959 learned_addr learned my addr 172.21.15.37:0/3186327959 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79c4f14700 1 --2- 172.21.15.37:0/3186327959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79c00c6e70 0x7f79c006f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283737534 0 0) 0x7f79c00c82a0 con 0x7f79c006ef10 2023-10-06T04:41:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79ac003570 con 0x7f79c006ef10 2023-10-06T04:41:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217408886 0 0) 0x7f79c00c7380 con 0x7f79c00c9440 2023-10-06T04:41:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.984+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c00c82a0 con 0x7f79c00c9440 2023-10-06T04:41:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4252404400 0 0) 0x7f79ac003570 con 0x7f79c006ef10 2023-10-06T04:41:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79c00c6e70 msgr2=0x7f79c006f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 --2- 172.21.15.37:0/3186327959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79c00c6e70 0x7f79c006f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 >> v1:172.21.15.83:6789/0 conn(0x7f79c00c9440 legacy=0x7f79c00c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00c7620 con 0x7f79c006ef10 2023-10-06T04:41:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f79bc001470 con 0x7f79c006ef10 2023-10-06T04:41:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 >> v1:172.21.15.37:6789/0 conn(0x7f79c006ef10 legacy=0x7f79c015a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 --2- 172.21.15.37:0/3186327959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac003c50 0x7f79ac004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 --2- 172.21.15.37:0/3186327959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79ac004810 0x7f79ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 --2- 172.21.15.37:0/3186327959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79c00c6e70 0x7f79ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80015b0 con 0x7f79ac003c50 2023-10-06T04:41:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00ad650 con 0x7f79ac004810 2023-10-06T04:41:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac00bb90 con 0x7f79c00c6e70 2023-10-06T04:41:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c5715700 1 --2- 172.21.15.37:0/3186327959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac003c50 0x7f79ac004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c4f14700 1 --2- 172.21.15.37:0/3186327959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79ac004810 0x7f79ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c5f16700 1 --2- 172.21.15.37:0/3186327959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79c00c6e70 0x7f79ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c5715700 1 -- 172.21.15.37:0/3186327959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79c00c6e70 msgr2=0x7f79ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c5715700 1 --2- 172.21.15.37:0/3186327959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79c00c6e70 0x7f79ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c5715700 1 -- 172.21.15.37:0/3186327959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79ac004810 msgr2=0x7f79ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c5715700 1 --2- 172.21.15.37:0/3186327959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79ac004810 0x7f79ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c5715700 1 -- 172.21.15.37:0/3186327959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac003570 con 0x7f79ac003c50 2023-10-06T04:41:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c5715700 1 --2- 172.21.15.37:0/3186327959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac003c50 0x7f79ac004020 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f79bc007c80 tx=0x7f79c00c7f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f195f1128fb7f0ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00cca0 con 0x7f79ac003c50 2023-10-06T04:41:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc00ce00 con 0x7f79ac003c50 2023-10-06T04:41:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79b7fff700 1 -- 172.21.15.37:0/3186327959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc005b50 con 0x7f79ac003c50 2023-10-06T04:41:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c6717700 1 -- 172.21.15.37:0/3186327959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac003c50 msgr2=0x7f79ac004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c6717700 1 --2- 172.21.15.37:0/3186327959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac003c50 0x7f79ac004020 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f79bc007c80 tx=0x7f79c00c7f50 comp rx=0 tx=0).stop 2023-10-06T04:41:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c5f16700 1 -- 172.21.15.37:0/3186327959 reap_dead start 2023-10-06T04:41:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c6717700 1 -- 172.21.15.37:0/3186327959 shutdown_connections 2023-10-06T04:41:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c6717700 1 -- 172.21.15.37:0/3186327959 >> 172.21.15.37:0/3186327959 conn(0x7f79c0068e00 msgr2=0x7f79c0069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c6717700 1 -- 172.21.15.37:0/3186327959 shutdown_connections 2023-10-06T04:41:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.988+0000 7f79c6717700 1 -- 172.21.15.37:0/3186327959 wait complete. 2023-10-06T04:41:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c6717700 1 Processor -- start 2023-10-06T04:41:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c6717700 1 -- start start 2023-10-06T04:41:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c6717700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79ac003c50 0x7f79c015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c6717700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79c00b0650 0x7f79c00b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c6717700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79c00b1000 0x7f79c015dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c6717700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0155cf0 con 0x7f79c00b0650 2023-10-06T04:41:36.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c6717700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c015cf60 con 0x7f79c00b1000 2023-10-06T04:41:36.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c6717700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c015d800 con 0x7f79ac003c50 2023-10-06T04:41:36.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c4f14700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79c00b0650 0x7f79c00b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c4f14700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79c00b0650 0x7f79c00b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47224/0 (socket says 172.21.15.37:47224) 2023-10-06T04:41:36.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c4f14700 1 -- 172.21.15.37:0/3843996524 learned_addr learned my addr 172.21.15.37:0/3843996524 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:36.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c5715700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79ac003c50 0x7f79c015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c5f16700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79c00b1000 0x7f79c015dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c4f14700 1 -- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79ac003c50 msgr2=0x7f79c015f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c4f14700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79ac003c50 0x7f79c015f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c4f14700 1 -- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79c00b1000 msgr2=0x7f79c015dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c4f14700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79c00b1000 0x7f79c015dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c4f14700 1 -- 172.21.15.37:0/3843996524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00b14a0 con 0x7f79c00b0650 2023-10-06T04:41:36.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c5f16700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79c00b1000 0x7f79c015dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:36.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c5715700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79ac003c50 0x7f79c015f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:36.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c4f14700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79c00b0650 0x7f79c00b0ac0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f79b0011d40 tx=0x7f79b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:36.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79b57fa700 1 -- 172.21.15.37:0/3843996524 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b000fac0 con 0x7f79c00b0650 2023-10-06T04:41:36.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79b57fa700 1 -- 172.21.15.37:0/3843996524 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b000fc20 con 0x7f79c00b0650 2023-10-06T04:41:36.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c6717700 1 -- 172.21.15.37:0/3843996524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c01561a0 con 0x7f79c00b0650 2023-10-06T04:41:36.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79b57fa700 1 -- 172.21.15.37:0/3843996524 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0014440 con 0x7f79c00b0650 2023-10-06T04:41:36.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.992+0000 7f79c6717700 1 -- 172.21.15.37:0/3843996524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c015d1b0 con 0x7f79c00b0650 2023-10-06T04:41:36.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.996+0000 7f79c6717700 1 -- 172.21.15.37:0/3843996524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c015d970 con 0x7f79c00b0650 2023-10-06T04:41:36.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.996+0000 7f79b57fa700 1 -- 172.21.15.37:0/3843996524 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f79b0014a80 con 0x7f79c00b0650 2023-10-06T04:41:36.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:35.996+0000 7f79b57fa700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f79a4060550 0x7f79a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.000+0000 7f79b57fa700 1 -- 172.21.15.37:0/3843996524 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f79b0018030 con 0x7f79c00b0650 2023-10-06T04:41:36.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.000+0000 7f79c5715700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f79a4060550 0x7f79a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.000+0000 7f79c5715700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f79a4060550 0x7f79a4062a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00d010 tx=0x7f79bc017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:36.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.000+0000 7f79b57fa700 1 -- 172.21.15.37:0/3843996524 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f79b004db70 con 0x7f79c00b0650 2023-10-06T04:41:36.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.200+0000 7f79c6717700 1 -- 172.21.15.37:0/3843996524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79c00708a0 con 0x7f79c00b0650 2023-10-06T04:41:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.200+0000 7f79b57fa700 1 -- 172.21.15.37:0/3843996524 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f79b0051190 con 0x7f79c00b0650 2023-10-06T04:41:36.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:36.206 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3716256971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3716256971},{"type":"v1","addr":"172.21.15.37:6833","nonce":3716256971}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/893255287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":893255287},{"type":"v1","addr":"172.21.15.37:6835","nonce":893255287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3794492713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3794492713},{"type":"v1","addr":"172.21.15.83:6837","nonce":3794492713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:54.053558+0000","modified":"2023-10-06T04:41:31.918744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":58,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6835/1381995756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1381995756},{"type":"v1","addr":"172.21.15.83:6835","nonce":1381995756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:41:36.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.200+0000 7f79c6717700 1 -- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f79a4060550 msgr2=0x7f79a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.200+0000 7f79c6717700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f79a4060550 0x7f79a4062a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00d010 tx=0x7f79bc017000 comp rx=0 tx=0).stop 2023-10-06T04:41:36.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.204+0000 7f79c6717700 1 -- 172.21.15.37:0/3843996524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79c00b0650 msgr2=0x7f79c00b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.204+0000 7f79c6717700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79c00b0650 0x7f79c00b0ac0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f79b0011d40 tx=0x7f79b00091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.204+0000 7f79c6717700 1 -- 172.21.15.37:0/3843996524 shutdown_connections 2023-10-06T04:41:36.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.204+0000 7f79c6717700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f79a4060550 0x7f79a4062a00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.204+0000 7f79c6717700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79c00b1000 0x7f79c015dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.204+0000 7f79c6717700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79c00b0650 0x7f79c00b0ac0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.204+0000 7f79c6717700 1 --2- 172.21.15.37:0/3843996524 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79ac003c50 0x7f79c015f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.204+0000 7f79c6717700 1 -- 172.21.15.37:0/3843996524 >> 172.21.15.37:0/3843996524 conn(0x7f79c0068e00 msgr2=0x7f79c00cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:36.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.204+0000 7f79c6717700 1 -- 172.21.15.37:0/3843996524 shutdown_connections 2023-10-06T04:41:36.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.204+0000 7f79c6717700 1 -- 172.21.15.37:0/3843996524 wait complete. 2023-10-06T04:41:36.210 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2023-10-06T04:41:36.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:41:36.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.328+0000 7fe029eb0700 1 Processor -- start 2023-10-06T04:41:36.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.328+0000 7fe029eb0700 1 -- start start 2023-10-06T04:41:36.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe029eb0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe0240cbd50 0x7fe0240cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe029eb0700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0240c8b60 con 0x7fe024155cd0 2023-10-06T04:41:36.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe029eb0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02415a6e0 con 0x7fe0240ad750 2023-10-06T04:41:36.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe029eb0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0240ae2c0 con 0x7fe0240cbd50 2023-10-06T04:41:36.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe023fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe024155cd0 0x7fe0240c8ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42126/0 (socket says 172.21.15.37:42126) 2023-10-06T04:41:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe023fff700 1 -- 172.21.15.37:0/1416220398 learned_addr learned my addr 172.21.15.37:0/1416220398 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe0237fe700 1 --2- 172.21.15.37:0/1416220398 >> v2:172.21.15.83:3300/0 conn(0x7fe0240cbd50 0x7fe0240cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe0227fc700 1 -- 172.21.15.37:0/1416220398 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140300389 0 0) 0x7fe0240c8b60 con 0x7fe024155cd0 2023-10-06T04:41:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe0227fc700 1 -- 172.21.15.37:0/1416220398 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe00c003570 con 0x7fe024155cd0 2023-10-06T04:41:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe0227fc700 1 -- 172.21.15.37:0/1416220398 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882468539 0 0) 0x7fe02415a6e0 con 0x7fe0240ad750 2023-10-06T04:41:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe0227fc700 1 -- 172.21.15.37:0/1416220398 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0240c8b60 con 0x7fe0240ad750 2023-10-06T04:41:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe0237fe700 1 -- 172.21.15.37:0/1416220398 >> v1:172.21.15.83:6789/0 conn(0x7fe0240ad750 legacy=0x7fe0241555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe0237fe700 1 -- 172.21.15.37:0/1416220398 >> v1:172.21.15.37:6789/0 conn(0x7fe024155cd0 legacy=0x7fe0240c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe0237fe700 1 -- 172.21.15.37:0/1416220398 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0240c8230 con 0x7fe0240cbd50 2023-10-06T04:41:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe0237fe700 1 --2- 172.21.15.37:0/1416220398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0240cbd50 0x7fe0240cc120 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe0140098e0 tx=0x7fe0140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48ea423af39ca772 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe0227fc700 1 -- 172.21.15.37:0/1416220398 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014011630 con 0x7fe0240cbd50 2023-10-06T04:41:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe0227fc700 1 -- 172.21.15.37:0/1416220398 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe014011790 con 0x7fe0240cbd50 2023-10-06T04:41:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe0227fc700 1 -- 172.21.15.37:0/1416220398 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014011b30 con 0x7fe0240cbd50 2023-10-06T04:41:36.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe029eb0700 1 -- 172.21.15.37:0/1416220398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0240cbd50 msgr2=0x7fe0240cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe029eb0700 1 --2- 172.21.15.37:0/1416220398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0240cbd50 0x7fe0240cc120 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe0140098e0 tx=0x7fe0140091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe029eb0700 1 -- 172.21.15.37:0/1416220398 shutdown_connections 2023-10-06T04:41:36.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe029eb0700 1 --2- 172.21.15.37:0/1416220398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0240cbd50 0x7fe0240cc120 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe029eb0700 1 -- 172.21.15.37:0/1416220398 >> 172.21.15.37:0/1416220398 conn(0x7fe0240667b0 msgr2=0x7fe024066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:36.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe029eb0700 1 -- 172.21.15.37:0/1416220398 shutdown_connections 2023-10-06T04:41:36.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.332+0000 7fe029eb0700 1 -- 172.21.15.37:0/1416220398 wait complete. 2023-10-06T04:41:36.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe029eb0700 1 Processor -- start 2023-10-06T04:41:36.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe029eb0700 1 -- start start 2023-10-06T04:41:36.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe029eb0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0240ad750 0x7fe024148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe029eb0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0240cbd50 0x7fe0240b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe029eb0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe024155cd0 0x7fe02414a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe029eb0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0240b1880 con 0x7fe0240cbd50 2023-10-06T04:41:36.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe029eb0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0240c53b0 con 0x7fe024155cd0 2023-10-06T04:41:36.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe029eb0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0240c5600 con 0x7fe0240ad750 2023-10-06T04:41:36.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe022ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0240cbd50 0x7fe0240b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe022ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0240cbd50 0x7fe0240b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47236/0 (socket says 172.21.15.37:47236) 2023-10-06T04:41:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe022ffd700 1 -- 172.21.15.37:0/4001088936 learned_addr learned my addr 172.21.15.37:0/4001088936 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe0237fe700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0240ad750 0x7fe024148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.336+0000 7fe023fff700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe024155cd0 0x7fe02414a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe022ffd700 1 -- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0240ad750 msgr2=0x7fe024148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe022ffd700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0240ad750 0x7fe024148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe022ffd700 1 -- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe024155cd0 msgr2=0x7fe02414a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe022ffd700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe024155cd0 0x7fe02414a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe022ffd700 1 -- 172.21.15.37:0/4001088936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe014009420 con 0x7fe0240cbd50 2023-10-06T04:41:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe022ffd700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0240cbd50 0x7fe0240b0db0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe01800c790 tx=0x7fe018007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe00b7fe700 1 -- 172.21.15.37:0/4001088936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe018010510 con 0x7fe0240cbd50 2023-10-06T04:41:36.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe00b7fe700 1 -- 172.21.15.37:0/4001088936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe018010670 con 0x7fe0240cbd50 2023-10-06T04:41:36.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe029eb0700 1 -- 172.21.15.37:0/4001088936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0240c58e0 con 0x7fe0240cbd50 2023-10-06T04:41:36.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe00b7fe700 1 -- 172.21.15.37:0/4001088936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe018010a10 con 0x7fe0240cbd50 2023-10-06T04:41:36.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe029eb0700 1 -- 172.21.15.37:0/4001088936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0240c5ea0 con 0x7fe0240cbd50 2023-10-06T04:41:36.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe029eb0700 1 -- 172.21.15.37:0/4001088936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0240c60c0 con 0x7fe0240cbd50 2023-10-06T04:41:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe00b7fe700 1 -- 172.21.15.37:0/4001088936 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe01801b3b0 con 0x7fe0240cbd50 2023-10-06T04:41:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe00b7fe700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe010060550 0x7fe010062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe00b7fe700 1 -- 172.21.15.37:0/4001088936 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe01807c740 con 0x7fe0240cbd50 2023-10-06T04:41:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.340+0000 7fe0237fe700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe010060550 0x7fe010062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.344+0000 7fe0237fe700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe010060550 0x7fe010062a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe0140093f0 tx=0x7fe014017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.348+0000 7fe00b7fe700 1 -- 172.21.15.37:0/4001088936 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe01804cac0 con 0x7fe0240cbd50 2023-10-06T04:41:36.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.512+0000 7fe029eb0700 1 -- 172.21.15.37:0/4001088936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe024070ee0 con 0x7fe0240cbd50 2023-10-06T04:41:36.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.516+0000 7fe00b7fe700 1 -- 172.21.15.37:0/4001088936 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+17152 (secure 0 0 0) 0x7fe018017020 con 0x7fe0240cbd50 2023-10-06T04:41:36.522 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:36.523 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":59,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:41:27.888956+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:52.204019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:53.038979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/3410822358":"2023-10-07T04:41:27.878627+0000","172.21.15.37:6834/3410822358":"2023-10-07T04:41:27.878627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:41:36.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.520+0000 7fe029eb0700 1 -- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe010060550 msgr2=0x7fe010062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.520+0000 7fe029eb0700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe010060550 0x7fe010062a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe0140093f0 tx=0x7fe014017000 comp rx=0 tx=0).stop 2023-10-06T04:41:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.520+0000 7fe029eb0700 1 -- 172.21.15.37:0/4001088936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0240cbd50 msgr2=0x7fe0240b0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.520+0000 7fe029eb0700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0240cbd50 0x7fe0240b0db0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe01800c790 tx=0x7fe018007e10 comp rx=0 tx=0).stop 2023-10-06T04:41:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.520+0000 7fe029eb0700 1 -- 172.21.15.37:0/4001088936 shutdown_connections 2023-10-06T04:41:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.520+0000 7fe029eb0700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe010060550 0x7fe010062a00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.520+0000 7fe029eb0700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe024155cd0 0x7fe02414a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.520+0000 7fe029eb0700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0240cbd50 0x7fe0240b0db0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.520+0000 7fe029eb0700 1 --2- 172.21.15.37:0/4001088936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0240ad750 0x7fe024148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.520+0000 7fe029eb0700 1 -- 172.21.15.37:0/4001088936 >> 172.21.15.37:0/4001088936 conn(0x7fe0240667b0 msgr2=0x7fe024069800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.520+0000 7fe029eb0700 1 -- 172.21.15.37:0/4001088936 shutdown_connections 2023-10-06T04:41:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.520+0000 7fe029eb0700 1 -- 172.21.15.37:0/4001088936 wait complete. 2023-10-06T04:41:36.537 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:41:36.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:41:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.648+0000 7f0950e23700 1 Processor -- start 2023-10-06T04:41:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.648+0000 7f0950e23700 1 -- start start 2023-10-06T04:41:36.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.648+0000 7f0950e23700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f094c0aa8d0 0x7f094c0c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f0950e23700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c0ca610 con 0x7f094c0c79c0 2023-10-06T04:41:36.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f0950e23700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c0c9a00 con 0x7f094c0cc1a0 2023-10-06T04:41:36.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f0950e23700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0c9ce0 con 0x7f094c0aa8d0 2023-10-06T04:41:36.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f094c0c79c0 0x7f094c0c06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42140/0 (socket says 172.21.15.37:42140) 2023-10-06T04:41:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094bfff700 1 -- 172.21.15.37:0/1630032737 learned_addr learned my addr 172.21.15.37:0/1630032737 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:36.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094b7fe700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f094c0aa8d0 0x7f094c0c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574801753 0 0) 0x7f094c0ca610 con 0x7f094c0c79c0 2023-10-06T04:41:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f092c003570 con 0x7f094c0c79c0 2023-10-06T04:41:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128090663 0 0) 0x7f094c0c9a00 con 0x7f094c0cc1a0 2023-10-06T04:41:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f094c0ca610 con 0x7f094c0cc1a0 2023-10-06T04:41:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3480482627 0 0) 0x7f092c003570 con 0x7f094c0c79c0 2023-10-06T04:41:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f094c0aa8d0 msgr2=0x7f094c0c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f094c0aa8d0 0x7f094c0c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 >> v1:172.21.15.83:6789/0 conn(0x7f094c0cc1a0 legacy=0x7f094c0c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c0c9fc0 con 0x7f094c0c79c0 2023-10-06T04:41:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2124785089 0 0) 0x7f09440017f0 con 0x7f094c0c79c0 2023-10-06T04:41:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 >> v1:172.21.15.37:6789/0 conn(0x7f094c0c79c0 legacy=0x7f094c0c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f092c003c20 0x7f092c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f094c0aa8d0 0x7f092c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f092c004d50 0x7f092c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0c9ce0 con 0x7f092c003c20 2023-10-06T04:41:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c00bb40 con 0x7f092c004d50 2023-10-06T04:41:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092c00bd00 con 0x7f094c0aa8d0 2023-10-06T04:41:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094b7fe700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f092c003c20 0x7f092c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094bfff700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f092c004d50 0x7f092c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f0943fff700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f094c0aa8d0 0x7f092c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094b7fe700 1 -- 172.21.15.37:0/1630032737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f094c0aa8d0 msgr2=0x7f092c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094b7fe700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f094c0aa8d0 0x7f092c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094b7fe700 1 -- 172.21.15.37:0/1630032737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f092c004d50 msgr2=0x7f092c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094b7fe700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f092c004d50 0x7f092c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094b7fe700 1 -- 172.21.15.37:0/1630032737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c003570 con 0x7f092c003c20 2023-10-06T04:41:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094bfff700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f092c004d50 0x7f092c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094b7fe700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f092c003c20 0x7f092c004010 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f093c009c00 tx=0x7f093c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd7bcb199ec03c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00e710 con 0x7f092c003c20 2023-10-06T04:41:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c00e870 con 0x7f092c003c20 2023-10-06T04:41:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094affd700 1 -- 172.21.15.37:0/1630032737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00ec30 con 0x7f092c003c20 2023-10-06T04:41:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f0950e23700 1 -- 172.21.15.37:0/1630032737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f092c003c20 msgr2=0x7f092c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f0950e23700 1 --2- 172.21.15.37:0/1630032737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f092c003c20 0x7f092c004010 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f093c009c00 tx=0x7f093c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.652+0000 7f094bfff700 1 -- 172.21.15.37:0/1630032737 reap_dead start 2023-10-06T04:41:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.656+0000 7f0950e23700 1 -- 172.21.15.37:0/1630032737 shutdown_connections 2023-10-06T04:41:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.656+0000 7f0950e23700 1 -- 172.21.15.37:0/1630032737 >> 172.21.15.37:0/1630032737 conn(0x7f094c068780 msgr2=0x7f094c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:36.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.656+0000 7f0950e23700 1 -- 172.21.15.37:0/1630032737 shutdown_connections 2023-10-06T04:41:36.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.656+0000 7f0950e23700 1 -- 172.21.15.37:0/1630032737 wait complete. 2023-10-06T04:41:36.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.656+0000 7f0950e23700 1 Processor -- start 2023-10-06T04:41:36.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.656+0000 7f0950e23700 1 -- start start 2023-10-06T04:41:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0950e23700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f092c003c20 0x7f094c149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0950e23700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f094c0b0d00 0x7f094c145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0950e23700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f094c0af6c0 0x7f094c148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0950e23700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0c3200 con 0x7f094c0b0d00 2023-10-06T04:41:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0950e23700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c14d8a0 con 0x7f094c0af6c0 2023-10-06T04:41:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0950e23700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0b0870 con 0x7f092c003c20 2023-10-06T04:41:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0943fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f094c0b0d00 0x7f094c145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0943fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f094c0b0d00 0x7f094c145090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47252/0 (socket says 172.21.15.37:47252) 2023-10-06T04:41:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0943fff700 1 -- 172.21.15.37:0/2352046564 learned_addr learned my addr 172.21.15.37:0/2352046564 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f094b7fe700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f092c003c20 0x7f094c149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f094bfff700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f094c0af6c0 0x7f094c148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0943fff700 1 -- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f092c003c20 msgr2=0x7f094c149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0943fff700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f092c003c20 0x7f094c149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0943fff700 1 -- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f094c0af6c0 msgr2=0x7f094c148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0943fff700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f094c0af6c0 0x7f094c148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0943fff700 1 -- 172.21.15.37:0/2352046564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c149f90 con 0x7f094c0b0d00 2023-10-06T04:41:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f094bfff700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f094c0af6c0 0x7f094c148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:41:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f094b7fe700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f092c003c20 0x7f094c149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:41:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0943fff700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f094c0b0d00 0x7f094c145090 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f093400e5f0 tx=0x7f0934009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f09437fe700 1 -- 172.21.15.37:0/2352046564 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934012590 con 0x7f094c0b0d00 2023-10-06T04:41:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f09437fe700 1 -- 172.21.15.37:0/2352046564 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09340126f0 con 0x7f094c0b0d00 2023-10-06T04:41:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f09437fe700 1 -- 172.21.15.37:0/2352046564 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934012ab0 con 0x7f094c0b0d00 2023-10-06T04:41:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0950e23700 1 -- 172.21.15.37:0/2352046564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c0afc60 con 0x7f094c0b0d00 2023-10-06T04:41:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0950e23700 1 -- 172.21.15.37:0/2352046564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c0b0220 con 0x7f094c0b0d00 2023-10-06T04:41:36.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.660+0000 7f0950e23700 1 -- 172.21.15.37:0/2352046564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c0b0a00 con 0x7f094c0b0d00 2023-10-06T04:41:36.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.664+0000 7f09437fe700 1 -- 172.21.15.37:0/2352046564 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f093401d460 con 0x7f094c0b0d00 2023-10-06T04:41:36.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.664+0000 7f09437fe700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0930060580 0x7f0930062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.664+0000 7f09437fe700 1 -- 172.21.15.37:0/2352046564 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f093407cda0 con 0x7f094c0b0d00 2023-10-06T04:41:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.664+0000 7f094b7fe700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0930060580 0x7f0930062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.664+0000 7f094b7fe700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0930060580 0x7f0930062a30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f093c0091e0 tx=0x7f093c01a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:36.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.672+0000 7f09437fe700 1 -- 172.21.15.37:0/2352046564 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f093404d0a0 con 0x7f094c0b0d00 2023-10-06T04:41:36.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.868+0000 7f0950e23700 1 -- 172.21.15.37:0/2352046564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f094c0708a0 con 0x7f094c0b0d00 2023-10-06T04:41:36.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.868+0000 7f09437fe700 1 -- 172.21.15.37:0/2352046564 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f09340506c0 con 0x7f094c0b0d00 2023-10-06T04:41:36.875 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:36.875 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3716256971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3716256971},{"type":"v1","addr":"172.21.15.37:6833","nonce":3716256971}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/893255287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":893255287},{"type":"v1","addr":"172.21.15.37:6835","nonce":893255287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3794492713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3794492713},{"type":"v1","addr":"172.21.15.83:6837","nonce":3794492713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:54.053558+0000","modified":"2023-10-06T04:41:31.918744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":58,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6835/1381995756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1381995756},{"type":"v1","addr":"172.21.15.83:6835","nonce":1381995756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:41:36.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.872+0000 7f0950e23700 1 -- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0930060580 msgr2=0x7f0930062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.872+0000 7f0950e23700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0930060580 0x7f0930062a30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f093c0091e0 tx=0x7f093c01a000 comp rx=0 tx=0).stop 2023-10-06T04:41:36.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.872+0000 7f0950e23700 1 -- 172.21.15.37:0/2352046564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f094c0b0d00 msgr2=0x7f094c145090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:36.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.872+0000 7f0950e23700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f094c0b0d00 0x7f094c145090 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f093400e5f0 tx=0x7f0934009040 comp rx=0 tx=0).stop 2023-10-06T04:41:36.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.872+0000 7f0950e23700 1 -- 172.21.15.37:0/2352046564 shutdown_connections 2023-10-06T04:41:36.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.872+0000 7f0950e23700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0930060580 0x7f0930062a30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.872+0000 7f0950e23700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f094c0af6c0 0x7f094c148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.872+0000 7f0950e23700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f094c0b0d00 0x7f094c145090 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.872+0000 7f0950e23700 1 --2- 172.21.15.37:0/2352046564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f092c003c20 0x7f094c149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:36.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.872+0000 7f0950e23700 1 -- 172.21.15.37:0/2352046564 >> 172.21.15.37:0/2352046564 conn(0x7f094c068780 msgr2=0x7f094c069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:36.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.872+0000 7f0950e23700 1 -- 172.21.15.37:0/2352046564 shutdown_connections 2023-10-06T04:41:36.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.872+0000 7f0950e23700 1 -- 172.21.15.37:0/2352046564 wait complete. 2023-10-06T04:41:36.879 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2023-10-06T04:41:36.889 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:41:36.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f292e444700 1 Processor -- start 2023-10-06T04:41:36.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f292e444700 1 -- start start 2023-10-06T04:41:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f292e444700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2928150070 0x7f2928067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f292e444700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29280ca370 con 0x7f2928068230 2023-10-06T04:41:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f292e444700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29280ca090 con 0x7f292814fca0 2023-10-06T04:41:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f292e444700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29280686d0 con 0x7f2928150070 2023-10-06T04:41:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f29277fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2928150070 0x7f2928067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f29277fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2928150070 0x7f2928067cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47264/0 (socket says 172.21.15.37:47264) 2023-10-06T04:41:37.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f29277fe700 1 -- 172.21.15.37:0/3589258081 learned_addr learned my addr 172.21.15.37:0/3589258081 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:37.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f29277fe700 1 -- 172.21.15.37:0/3589258081 >> v1:172.21.15.83:6789/0 conn(0x7f292814fca0 legacy=0x7f29280cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:37.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f29277fe700 1 -- 172.21.15.37:0/3589258081 >> v1:172.21.15.37:6789/0 conn(0x7f2928068230 legacy=0x7f292806be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f29277fe700 1 -- 172.21.15.37:0/3589258081 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29280ca700 con 0x7f2928150070 2023-10-06T04:41:37.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.992+0000 7f29277fe700 1 --2- 172.21.15.37:0/3589258081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2928150070 0x7f2928067cf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f291c0099b0 tx=0x7f291c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf2d2771fe562fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:37.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.996+0000 7f2926ffd700 1 -- 172.21.15.37:0/3589258081 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c00b820 con 0x7f2928150070 2023-10-06T04:41:37.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.996+0000 7f2926ffd700 1 -- 172.21.15.37:0/3589258081 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c00b980 con 0x7f2928150070 2023-10-06T04:41:37.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.996+0000 7f2926ffd700 1 -- 172.21.15.37:0/3589258081 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c00bd20 con 0x7f2928150070 2023-10-06T04:41:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.996+0000 7f292e444700 1 -- 172.21.15.37:0/3589258081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2928150070 msgr2=0x7f2928067cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.996+0000 7f292e444700 1 --2- 172.21.15.37:0/3589258081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2928150070 0x7f2928067cf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f291c0099b0 tx=0x7f291c009250 comp rx=0 tx=0).stop 2023-10-06T04:41:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.996+0000 7f292e444700 1 -- 172.21.15.37:0/3589258081 shutdown_connections 2023-10-06T04:41:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.996+0000 7f292e444700 1 --2- 172.21.15.37:0/3589258081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2928150070 0x7f2928067cf0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.996+0000 7f292e444700 1 -- 172.21.15.37:0/3589258081 >> 172.21.15.37:0/3589258081 conn(0x7f2928068e00 msgr2=0x7f2928069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.996+0000 7f292e444700 1 -- 172.21.15.37:0/3589258081 shutdown_connections 2023-10-06T04:41:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:36.996+0000 7f292e444700 1 -- 172.21.15.37:0/3589258081 wait complete. 2023-10-06T04:41:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292e444700 1 Processor -- start 2023-10-06T04:41:37.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292e444700 1 -- start start 2023-10-06T04:41:37.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292e444700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2928068230 0x7f2928152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292e444700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f292814fca0 0x7f29280cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292e444700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2928150070 0x7f2928150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292e444700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2928153410 con 0x7f2928150070 2023-10-06T04:41:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292e444700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2928152a40 con 0x7f2928068230 2023-10-06T04:41:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292e444700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29281514a0 con 0x7f292814fca0 2023-10-06T04:41:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292c9e1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2928150070 0x7f2928150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292c9e1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2928150070 0x7f2928150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47272/0 (socket says 172.21.15.37:47272) 2023-10-06T04:41:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292c9e1700 1 -- 172.21.15.37:0/1394571823 learned_addr learned my addr 172.21.15.37:0/1394571823 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f2927fff700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2928068230 0x7f2928152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f29277fe700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f292814fca0 0x7f29280cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292c9e1700 1 -- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f292814fca0 msgr2=0x7f29280cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292c9e1700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f292814fca0 0x7f29280cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292c9e1700 1 -- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2928068230 msgr2=0x7f2928152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292c9e1700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2928068230 0x7f2928152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.000+0000 7f292c9e1700 1 -- 172.21.15.37:0/1394571823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c0094f0 con 0x7f2928150070 2023-10-06T04:41:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.004+0000 7f292c9e1700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2928150070 0x7f2928150750 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f292000c8e0 tx=0x7f2920001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.004+0000 7f290ffff700 1 -- 172.21.15.37:0/1394571823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920012630 con 0x7f2928150070 2023-10-06T04:41:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.004+0000 7f290ffff700 1 -- 172.21.15.37:0/1394571823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2920012790 con 0x7f2928150070 2023-10-06T04:41:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.004+0000 7f292e444700 1 -- 172.21.15.37:0/1394571823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2928152110 con 0x7f2928150070 2023-10-06T04:41:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.004+0000 7f290ffff700 1 -- 172.21.15.37:0/1394571823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920012b50 con 0x7f2928150070 2023-10-06T04:41:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.004+0000 7f292e444700 1 -- 172.21.15.37:0/1394571823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29281526d0 con 0x7f2928150070 2023-10-06T04:41:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.004+0000 7f292e444700 1 -- 172.21.15.37:0/1394571823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2928152bf0 con 0x7f2928150070 2023-10-06T04:41:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.004+0000 7f290ffff700 1 -- 172.21.15.37:0/1394571823 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f292001a3a0 con 0x7f2928150070 2023-10-06T04:41:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.004+0000 7f290ffff700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2914060580 0x7f2914062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.004+0000 7f290ffff700 1 -- 172.21.15.37:0/1394571823 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f292007cbf0 con 0x7f2928150070 2023-10-06T04:41:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.004+0000 7f2927fff700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2914060580 0x7f2914062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.004+0000 7f2927fff700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2914060580 0x7f2914062a30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2918003a30 tx=0x7f2918007ea0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:37.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.012+0000 7f290ffff700 1 -- 172.21.15.37:0/1394571823 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2928152bf0 con 0x7f2928150070 2023-10-06T04:41:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.212+0000 7f292e444700 1 -- 172.21.15.37:0/1394571823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2928152bf0 con 0x7f2928150070 2023-10-06T04:41:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.212+0000 7f290ffff700 1 -- 172.21.15.37:0/1394571823 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f2928152bf0 con 0x7f2928150070 2023-10-06T04:41:37.217 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:37.217 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3716256971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3716256971},{"type":"v1","addr":"172.21.15.37:6833","nonce":3716256971}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/893255287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":893255287},{"type":"v1","addr":"172.21.15.37:6835","nonce":893255287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3794492713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3794492713},{"type":"v1","addr":"172.21.15.83:6837","nonce":3794492713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:54.053558+0000","modified":"2023-10-06T04:41:31.918744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":58,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6835/1381995756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1381995756},{"type":"v1","addr":"172.21.15.83:6835","nonce":1381995756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:41:37.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.212+0000 7f292e444700 1 -- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2914060580 msgr2=0x7f2914062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.212+0000 7f292e444700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2914060580 0x7f2914062a30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2918003a30 tx=0x7f2918007ea0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.212+0000 7f292e444700 1 -- 172.21.15.37:0/1394571823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2928150070 msgr2=0x7f2928150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.212+0000 7f292e444700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2928150070 0x7f2928150750 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f292000c8e0 tx=0x7f2920001710 comp rx=0 tx=0).stop 2023-10-06T04:41:37.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.216+0000 7f292e444700 1 -- 172.21.15.37:0/1394571823 shutdown_connections 2023-10-06T04:41:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.216+0000 7f292e444700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2914060580 0x7f2914062a30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.216+0000 7f292e444700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2928150070 0x7f2928150750 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.216+0000 7f292e444700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f292814fca0 0x7f29280cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.216+0000 7f292e444700 1 --2- 172.21.15.37:0/1394571823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2928068230 0x7f2928152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.216+0000 7f292e444700 1 -- 172.21.15.37:0/1394571823 >> 172.21.15.37:0/1394571823 conn(0x7f2928068e00 msgr2=0x7f292815bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.216+0000 7f292e444700 1 -- 172.21.15.37:0/1394571823 shutdown_connections 2023-10-06T04:41:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.216+0000 7f292e444700 1 -- 172.21.15.37:0/1394571823 wait complete. 2023-10-06T04:41:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2023-10-06T04:41:37.234 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:41:37.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.332+0000 7f9cf555c700 1 Processor -- start 2023-10-06T04:41:37.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.332+0000 7f9cf555c700 1 -- start start 2023-10-06T04:41:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9cf555c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9cf01587d0 0x7f9cf015d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9cf555c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9cf0158ba0 0x7f9cf0067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9cf555c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf0159040 con 0x7f9cf0068230 2023-10-06T04:41:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9cf555c700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf015d6d0 con 0x7f9cf01587d0 2023-10-06T04:41:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9cf555c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf00686b0 con 0x7f9cf0158ba0 2023-10-06T04:41:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9ceffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9cf01587d0 0x7f9cf015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9cf4d5b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9cf0068230 0x7f9cf00ae510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42150/0 (socket says 172.21.15.37:42150) 2023-10-06T04:41:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9cf4d5b700 1 -- 172.21.15.37:0/436739449 learned_addr learned my addr 172.21.15.37:0/436739449 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9cef7fe700 1 --2- 172.21.15.37:0/436739449 >> v2:172.21.15.83:3300/0 conn(0x7f9cf0158ba0 0x7f9cf0067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9ceffff700 1 --2- 172.21.15.37:0/436739449 >> v2:172.21.15.37:3300/0 conn(0x7f9cf01587d0 0x7f9cf015d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47284/0 (socket says 172.21.15.37:47284) 2023-10-06T04:41:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9ceeffd700 1 -- 172.21.15.37:0/436739449 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355984462 0 0) 0x7f9cf0159040 con 0x7f9cf0068230 2023-10-06T04:41:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9ceeffd700 1 -- 172.21.15.37:0/436739449 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cd8003570 con 0x7f9cf0068230 2023-10-06T04:41:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9ceffff700 1 -- 172.21.15.37:0/436739449 >> v2:172.21.15.83:3300/0 conn(0x7f9cf0158ba0 msgr2=0x7f9cf0067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9ceffff700 1 --2- 172.21.15.37:0/436739449 >> v2:172.21.15.83:3300/0 conn(0x7f9cf0158ba0 0x7f9cf0067cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9ceffff700 1 -- 172.21.15.37:0/436739449 >> v1:172.21.15.37:6789/0 conn(0x7f9cf0068230 legacy=0x7f9cf00ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9ceffff700 1 -- 172.21.15.37:0/436739449 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf00af7f0 con 0x7f9cf01587d0 2023-10-06T04:41:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9cef7fe700 1 --2- 172.21.15.37:0/436739449 >> v2:172.21.15.83:3300/0 conn(0x7f9cf0158ba0 0x7f9cf0067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9ceffff700 1 --2- 172.21.15.37:0/436739449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01587d0 0x7f9cf015d190 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00670c0 tx=0x7f9ce40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9618f63e29659d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9ceeffd700 1 -- 172.21.15.37:0/436739449 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4011630 con 0x7f9cf01587d0 2023-10-06T04:41:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9ceeffd700 1 -- 172.21.15.37:0/436739449 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce40117b0 con 0x7f9cf01587d0 2023-10-06T04:41:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.336+0000 7f9ceeffd700 1 -- 172.21.15.37:0/436739449 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4011b70 con 0x7f9cf01587d0 2023-10-06T04:41:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.340+0000 7f9cf555c700 1 -- 172.21.15.37:0/436739449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01587d0 msgr2=0x7f9cf015d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.340+0000 7f9cf555c700 1 --2- 172.21.15.37:0/436739449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01587d0 0x7f9cf015d190 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00670c0 tx=0x7f9ce40091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.340+0000 7f9cf555c700 1 -- 172.21.15.37:0/436739449 shutdown_connections 2023-10-06T04:41:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.340+0000 7f9cf555c700 1 --2- 172.21.15.37:0/436739449 >> v2:172.21.15.83:3300/0 conn(0x7f9cf0158ba0 0x7f9cf0067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.340+0000 7f9cf555c700 1 --2- 172.21.15.37:0/436739449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01587d0 0x7f9cf015d190 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.340+0000 7f9cf555c700 1 -- 172.21.15.37:0/436739449 >> 172.21.15.37:0/436739449 conn(0x7f9cf00cc5f0 msgr2=0x7f9cf00cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:37.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.340+0000 7f9cf555c700 1 -- 172.21.15.37:0/436739449 shutdown_connections 2023-10-06T04:41:37.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.340+0000 7f9cf555c700 1 -- 172.21.15.37:0/436739449 wait complete. 2023-10-06T04:41:37.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.340+0000 7f9cf555c700 1 Processor -- start 2023-10-06T04:41:37.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.340+0000 7f9cf555c700 1 -- start start 2023-10-06T04:41:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cf555c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0068230 0x7f9cf00c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cf555c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf01587d0 0x7f9cf016c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cf555c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9cf0158ba0 0x7f9cf016cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cf555c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf00c4b00 con 0x7f9cf0068230 2023-10-06T04:41:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cf555c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf0154c50 con 0x7f9cf01587d0 2023-10-06T04:41:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cf555c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf00c5360 con 0x7f9cf0158ba0 2023-10-06T04:41:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9ceffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0068230 0x7f9cf00c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9ceffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0068230 0x7f9cf00c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47292/0 (socket says 172.21.15.37:47292) 2023-10-06T04:41:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9ceffff700 1 -- 172.21.15.37:0/3537138568 learned_addr learned my addr 172.21.15.37:0/3537138568 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cef7fe700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf01587d0 0x7f9cf016c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cf4d5b700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9cf0158ba0 0x7f9cf016cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9ceffff700 1 -- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9cf0158ba0 msgr2=0x7f9cf016cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9ceffff700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9cf0158ba0 0x7f9cf016cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9ceffff700 1 -- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf01587d0 msgr2=0x7f9cf016c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9ceffff700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf01587d0 0x7f9cf016c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9ceffff700 1 -- 172.21.15.37:0/3537138568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce0009420 con 0x7f9cf0068230 2023-10-06T04:41:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9ceffff700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0068230 0x7f9cf00c2710 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9cf006a380 tx=0x7f9ce4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cd7fff700 1 -- 172.21.15.37:0/3537138568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce401f070 con 0x7f9cf0068230 2023-10-06T04:41:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cd7fff700 1 -- 172.21.15.37:0/3537138568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce4011920 con 0x7f9cf0068230 2023-10-06T04:41:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cf555c700 1 -- 172.21.15.37:0/3537138568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce4009420 con 0x7f9cf0068230 2023-10-06T04:41:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cd7fff700 1 -- 172.21.15.37:0/3537138568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4023410 con 0x7f9cf0068230 2023-10-06T04:41:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.344+0000 7f9cf555c700 1 -- 172.21.15.37:0/3537138568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf00c4d10 con 0x7f9cf0068230 2023-10-06T04:41:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.348+0000 7f9cf555c700 1 -- 172.21.15.37:0/3537138568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf00708a0 con 0x7f9cf0068230 2023-10-06T04:41:37.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.348+0000 7f9cd7fff700 1 -- 172.21.15.37:0/3537138568 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9ce402c3b0 con 0x7f9cf0068230 2023-10-06T04:41:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.348+0000 7f9cd7fff700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9cdc060550 0x7f9cdc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.348+0000 7f9cd7fff700 1 -- 172.21.15.37:0/3537138568 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f9ce407dda0 con 0x7f9cf0068230 2023-10-06T04:41:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.348+0000 7f9cef7fe700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9cdc060550 0x7f9cdc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.348+0000 7f9cef7fe700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9cdc060550 0x7f9cdc062a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00c48f0 tx=0x7f9ce00091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:37.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.356+0000 7f9cd7fff700 1 -- 172.21.15.37:0/3537138568 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9ce404e0a0 con 0x7f9cf0068230 2023-10-06T04:41:37.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.520+0000 7f9cf555c700 1 -- 172.21.15.37:0/3537138568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cf00afad0 con 0x7f9cf0068230 2023-10-06T04:41:37.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.520+0000 7f9cd7fff700 1 -- 172.21.15.37:0/3537138568 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+17152 (secure 0 0 0) 0x7f9ce4015090 con 0x7f9cf0068230 2023-10-06T04:41:37.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:37.527 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":59,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:41:27.888956+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:52.204019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:53.038979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/3410822358":"2023-10-07T04:41:27.878627+0000","172.21.15.37:6834/3410822358":"2023-10-07T04:41:27.878627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:41:37.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.524+0000 7f9cf555c700 1 -- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9cdc060550 msgr2=0x7f9cdc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.524+0000 7f9cf555c700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9cdc060550 0x7f9cdc062a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00c48f0 tx=0x7f9ce00091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.524+0000 7f9cf555c700 1 -- 172.21.15.37:0/3537138568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0068230 msgr2=0x7f9cf00c2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.524+0000 7f9cf555c700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0068230 0x7f9cf00c2710 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9cf006a380 tx=0x7f9ce4017000 comp rx=0 tx=0).stop 2023-10-06T04:41:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.524+0000 7f9cf555c700 1 -- 172.21.15.37:0/3537138568 shutdown_connections 2023-10-06T04:41:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.524+0000 7f9cf555c700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9cdc060550 0x7f9cdc062a00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.524+0000 7f9cf555c700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf01587d0 0x7f9cf016c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.524+0000 7f9cf555c700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9cf0158ba0 0x7f9cf016cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.524+0000 7f9cf555c700 1 --2- 172.21.15.37:0/3537138568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0068230 0x7f9cf00c2710 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.524+0000 7f9cf555c700 1 -- 172.21.15.37:0/3537138568 >> 172.21.15.37:0/3537138568 conn(0x7f9cf00cc5f0 msgr2=0x7f9cf015c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.524+0000 7f9cf555c700 1 -- 172.21.15.37:0/3537138568 shutdown_connections 2023-10-06T04:41:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.524+0000 7f9cf555c700 1 -- 172.21.15.37:0/3537138568 wait complete. 2023-10-06T04:41:37.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:41:37.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 Processor -- start 2023-10-06T04:41:37.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 -- start start 2023-10-06T04:41:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f180ac150 0x7f4f180682f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f180c93a0 0x7f4f180c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1815aab0 con 0x7f4f18067f20 2023-10-06T04:41:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1815ad90 con 0x7f4f180c93a0 2023-10-06T04:41:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815b070 con 0x7f4f180ac150 2023-10-06T04:41:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f177fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f180c93a0 0x7f4f180c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f177fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f180c93a0 0x7f4f180c9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47302/0 (socket says 172.21.15.37:47302) 2023-10-06T04:41:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f177fe700 1 -- 172.21.15.37:0/1262800207 learned_addr learned my addr 172.21.15.37:0/1262800207 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f0e7fc700 1 --2- 172.21.15.37:0/1262800207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f180ac150 0x7f4f180682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f177fe700 1 -- 172.21.15.37:0/1262800207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f180ac150 msgr2=0x7f4f180682f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:37.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f177fe700 1 --2- 172.21.15.37:0/1262800207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f180ac150 0x7f4f180682f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f177fe700 1 -- 172.21.15.37:0/1262800207 >> v1:172.21.15.83:6789/0 conn(0x7f4f18067f20 legacy=0x7f4f180aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f177fe700 1 -- 172.21.15.37:0/1262800207 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1815b350 con 0x7f4f180c93a0 2023-10-06T04:41:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f177fe700 1 --2- 172.21.15.37:0/1262800207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f180c93a0 0x7f4f180c9800 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009f20 tx=0x7f4f10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a6460695e8efaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f167fc700 1 -- 172.21.15.37:0/1262800207 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000e070 con 0x7f4f180c93a0 2023-10-06T04:41:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f167fc700 1 -- 172.21.15.37:0/1262800207 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1000b9d0 con 0x7f4f180c93a0 2023-10-06T04:41:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f167fc700 1 -- 172.21.15.37:0/1262800207 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f100092e0 con 0x7f4f180c93a0 2023-10-06T04:41:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1262800207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f180c93a0 msgr2=0x7f4f180c9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 --2- 172.21.15.37:0/1262800207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f180c93a0 0x7f4f180c9800 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009f20 tx=0x7f4f10009840 comp rx=0 tx=0).stop 2023-10-06T04:41:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1262800207 shutdown_connections 2023-10-06T04:41:37.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 --2- 172.21.15.37:0/1262800207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f180c93a0 0x7f4f180c9800 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 --2- 172.21.15.37:0/1262800207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f180ac150 0x7f4f180682f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.648+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1262800207 >> 172.21.15.37:0/1262800207 conn(0x7f4f18068e00 msgr2=0x7f4f18069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:37.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1262800207 shutdown_connections 2023-10-06T04:41:37.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1262800207 wait complete. 2023-10-06T04:41:37.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f1d9e9700 1 Processor -- start 2023-10-06T04:41:37.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f1d9e9700 1 -- start start 2023-10-06T04:41:37.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f1d9e9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f18067f20 0x7f4f181513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f1d9e9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f180ac150 0x7f4f180b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f1d9e9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f180c93a0 0x7f4f180691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f1d9e9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c5380 con 0x7f4f18067f20 2023-10-06T04:41:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f1d9e9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180b1090 con 0x7f4f180c93a0 2023-10-06T04:41:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f1d9e9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180b1370 con 0x7f4f180ac150 2023-10-06T04:41:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f16ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f18067f20 0x7f4f181513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f16ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f18067f20 0x7f4f181513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47318/0 (socket says 172.21.15.37:47318) 2023-10-06T04:41:37.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f16ffd700 1 -- 172.21.15.37:0/1647074881 learned_addr learned my addr 172.21.15.37:0/1647074881 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:37.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f0e7fc700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f180ac150 0x7f4f180b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f177fe700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f180c93a0 0x7f4f180691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f16ffd700 1 -- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f180ac150 msgr2=0x7f4f180b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f16ffd700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f180ac150 0x7f4f180b0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f16ffd700 1 -- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f180c93a0 msgr2=0x7f4f180691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f16ffd700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f180c93a0 0x7f4f180691d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f16ffd700 1 -- 172.21.15.37:0/1647074881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f10009ae0 con 0x7f4f18067f20 2023-10-06T04:41:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.652+0000 7f4f177fe700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f180c93a0 0x7f4f180691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:41:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.656+0000 7f4f16ffd700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f18067f20 0x7f4f181513e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800c590 tx=0x7f4f0800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.656+0000 7f4f0f7fe700 1 -- 172.21.15.37:0/1647074881 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08011590 con 0x7f4f18067f20 2023-10-06T04:41:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.656+0000 7f4f0f7fe700 1 -- 172.21.15.37:0/1647074881 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f080116f0 con 0x7f4f18067f20 2023-10-06T04:41:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.656+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1647074881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180b1650 con 0x7f4f18067f20 2023-10-06T04:41:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.656+0000 7f4f0f7fe700 1 -- 172.21.15.37:0/1647074881 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08011ab0 con 0x7f4f18067f20 2023-10-06T04:41:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.656+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1647074881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f18166e10 con 0x7f4f18067f20 2023-10-06T04:41:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.656+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1647074881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f180c6970 con 0x7f4f18067f20 2023-10-06T04:41:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.656+0000 7f4f0f7fe700 1 -- 172.21.15.37:0/1647074881 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4f0801b3b0 con 0x7f4f18067f20 2023-10-06T04:41:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.656+0000 7f4f0f7fe700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4ef8060550 0x7f4ef8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.660+0000 7f4f0f7fe700 1 -- 172.21.15.37:0/1647074881 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4f0807c070 con 0x7f4f18067f20 2023-10-06T04:41:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.660+0000 7f4f0e7fc700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4ef8060550 0x7f4ef8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.660+0000 7f4f0e7fc700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4ef8060550 0x7f4ef8062a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4f181536c0 tx=0x7f4f00008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:37.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.668+0000 7f4f0f7fe700 1 -- 172.21.15.37:0/1647074881 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4f0804c370 con 0x7f4f18067f20 2023-10-06T04:41:37.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.860+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1647074881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4f18070ee0 con 0x7f4f18067f20 2023-10-06T04:41:37.867 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T04:41:37.864+0000 7f2a85d34700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:41:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.872+0000 7f4f0f7fe700 1 -- 172.21.15.37:0/1647074881 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4f08017090 con 0x7f4f18067f20 2023-10-06T04:41:37.881 INFO:tasks.ceph.mds.b.smithi083.stderr: -70> 2023-10-06T04:41:34.899+0000 7f81af539700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:41:37.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.876+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4ef8060550 msgr2=0x7f4ef8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.876+0000 7f4f1d9e9700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4ef8060550 0x7f4ef8062a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4f181536c0 tx=0x7f4f00008040 comp rx=0 tx=0).stop 2023-10-06T04:41:37.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.876+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1647074881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f18067f20 msgr2=0x7f4f181513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:37.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.876+0000 7f4f1d9e9700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f18067f20 0x7f4f181513e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800c590 tx=0x7f4f0800c950 comp rx=0 tx=0).stop 2023-10-06T04:41:37.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.876+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1647074881 shutdown_connections 2023-10-06T04:41:37.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.876+0000 7f4f1d9e9700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4ef8060550 0x7f4ef8062a00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.876+0000 7f4f1d9e9700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f180c93a0 0x7f4f180691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.876+0000 7f4f1d9e9700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f180ac150 0x7f4f180b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.876+0000 7f4f1d9e9700 1 --2- 172.21.15.37:0/1647074881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f18067f20 0x7f4f181513e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:37.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.876+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1647074881 >> 172.21.15.37:0/1647074881 conn(0x7f4f18068e00 msgr2=0x7f4f1806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:37.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.876+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1647074881 shutdown_connections 2023-10-06T04:41:37.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:37.876+0000 7f4f1d9e9700 1 -- 172.21.15.37:0/1647074881 wait complete. 2023-10-06T04:41:37.884 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:41:37.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:41:37.904 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T04:41:38.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.000+0000 7f4c1093d700 1 Processor -- start 2023-10-06T04:41:38.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.000+0000 7f4c1093d700 1 -- start start 2023-10-06T04:41:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c1093d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c0c09b2b0 0x7f4c0c068e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c1093d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0c06bae0 con 0x7f4c0c0cab70 2023-10-06T04:41:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c1093d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0c06bdc0 con 0x7f4c0c0ca7a0 2023-10-06T04:41:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c1093d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c1592a0 con 0x7f4c0c09b2b0 2023-10-06T04:41:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c0b59e700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4c0c0cab70 0x7f4c0c0cb5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42166/0 (socket says 172.21.15.37:42166) 2023-10-06T04:41:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c0b59e700 1 -- 172.21.15.37:0/1528494759 learned_addr learned my addr 172.21.15.37:0/1528494759 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c03fff700 1 --2- 172.21.15.37:0/1528494759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c0c09b2b0 0x7f4c0c068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c0a59c700 1 -- 172.21.15.37:0/1528494759 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995590714 0 0) 0x7f4c0c06bae0 con 0x7f4c0c0cab70 2023-10-06T04:41:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c0a59c700 1 -- 172.21.15.37:0/1528494759 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf8003570 con 0x7f4c0c0cab70 2023-10-06T04:41:38.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c0a59c700 1 -- 172.21.15.37:0/1528494759 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255227235 0 0) 0x7f4c0c06bdc0 con 0x7f4c0c0ca7a0 2023-10-06T04:41:38.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c0a59c700 1 -- 172.21.15.37:0/1528494759 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c0c06bae0 con 0x7f4c0c0ca7a0 2023-10-06T04:41:38.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c03fff700 1 -- 172.21.15.37:0/1528494759 >> v1:172.21.15.83:6789/0 conn(0x7f4c0c0ca7a0 legacy=0x7f4c0c09a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c03fff700 1 -- 172.21.15.37:0/1528494759 >> v1:172.21.15.37:6789/0 conn(0x7f4c0c0cab70 legacy=0x7f4c0c0cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c0a59c700 1 -- 172.21.15.37:0/1528494759 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3409575867 0 0) 0x7f4bf8003570 con 0x7f4c0c0cab70 2023-10-06T04:41:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c03fff700 1 -- 172.21.15.37:0/1528494759 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c06c0a0 con 0x7f4c0c09b2b0 2023-10-06T04:41:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c03fff700 1 --2- 172.21.15.37:0/1528494759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c0c09b2b0 0x7f4c0c068e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009910 tx=0x7f4bf40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dc2b1be9b3d32ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c0a59c700 1 -- 172.21.15.37:0/1528494759 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4011630 con 0x7f4c0c09b2b0 2023-10-06T04:41:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c0a59c700 1 -- 172.21.15.37:0/1528494759 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf4011790 con 0x7f4c0c09b2b0 2023-10-06T04:41:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c0a59c700 1 -- 172.21.15.37:0/1528494759 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4011b30 con 0x7f4c0c09b2b0 2023-10-06T04:41:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c1093d700 1 -- 172.21.15.37:0/1528494759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c0c09b2b0 msgr2=0x7f4c0c068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c1093d700 1 --2- 172.21.15.37:0/1528494759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c0c09b2b0 0x7f4c0c068e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009910 tx=0x7f4bf40091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c1093d700 1 -- 172.21.15.37:0/1528494759 shutdown_connections 2023-10-06T04:41:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c1093d700 1 --2- 172.21.15.37:0/1528494759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c0c09b2b0 0x7f4c0c068e00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c1093d700 1 -- 172.21.15.37:0/1528494759 >> 172.21.15.37:0/1528494759 conn(0x7f4c0c0667b0 msgr2=0x7f4c0c066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c1093d700 1 -- 172.21.15.37:0/1528494759 shutdown_connections 2023-10-06T04:41:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.004+0000 7f4c1093d700 1 -- 172.21.15.37:0/1528494759 wait complete. 2023-10-06T04:41:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c1093d700 1 Processor -- start 2023-10-06T04:41:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c1093d700 1 -- start start 2023-10-06T04:41:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c1093d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c0c09b2b0 0x7f4c0c143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c1093d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c0c0ca7a0 0x7f4c0c0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c1093d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c0c0cab70 0x7f4c0c068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c1093d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c15a460 con 0x7f4c0c0cab70 2023-10-06T04:41:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c1093d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c159850 con 0x7f4c0c0ca7a0 2023-10-06T04:41:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c1093d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c159b30 con 0x7f4c0c09b2b0 2023-10-06T04:41:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c0b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c0c0cab70 0x7f4c0c068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c0ad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c0c09b2b0 0x7f4c0c143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c0ad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c0c09b2b0 0x7f4c0c143b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:56886/0 (socket says 172.21.15.37:56886) 2023-10-06T04:41:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c0b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c0c0cab70 0x7f4c0c068e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47328/0 (socket says 172.21.15.37:47328) 2023-10-06T04:41:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c0ad9d700 1 -- 172.21.15.37:0/2772336461 learned_addr learned my addr 172.21.15.37:0/2772336461 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.008+0000 7f4c03fff700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c0c0ca7a0 0x7f4c0c0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:38.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c0b59e700 1 -- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c0c09b2b0 msgr2=0x7f4c0c143b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c0b59e700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c0c09b2b0 0x7f4c0c143b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c0b59e700 1 -- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c0c0ca7a0 msgr2=0x7f4c0c0c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c0b59e700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c0c0ca7a0 0x7f4c0c0c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c0b59e700 1 -- 172.21.15.37:0/2772336461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf4009420 con 0x7f4c0c0cab70 2023-10-06T04:41:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c0b59e700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c0c0cab70 0x7f4c0c068e00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4c04000f80 tx=0x7f4c04001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c02ffd700 1 -- 172.21.15.37:0/2772336461 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04004dc0 con 0x7f4c0c0cab70 2023-10-06T04:41:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c02ffd700 1 -- 172.21.15.37:0/2772336461 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c04007150 con 0x7f4c0c0cab70 2023-10-06T04:41:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c1093d700 1 -- 172.21.15.37:0/2772336461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0c159e10 con 0x7f4c0c0cab70 2023-10-06T04:41:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c02ffd700 1 -- 172.21.15.37:0/2772336461 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04007510 con 0x7f4c0c0cab70 2023-10-06T04:41:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c1093d700 1 -- 172.21.15.37:0/2772336461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c1440b0 con 0x7f4c0c0cab70 2023-10-06T04:41:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c1093d700 1 -- 172.21.15.37:0/2772336461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0c15a5d0 con 0x7f4c0c0cab70 2023-10-06T04:41:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.012+0000 7f4c02ffd700 1 -- 172.21.15.37:0/2772336461 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4c040078c0 con 0x7f4c0c0cab70 2023-10-06T04:41:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.016+0000 7f4c02ffd700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4bec060550 0x7f4bec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.016+0000 7f4c02ffd700 1 -- 172.21.15.37:0/2772336461 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f4c0407ca50 con 0x7f4c0c0cab70 2023-10-06T04:41:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.016+0000 7f4c0ad9d700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4bec060550 0x7f4bec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.016+0000 7f4c0ad9d700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4bec060550 0x7f4bec062a00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc003b40 tx=0x7f4bfc007e00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.024+0000 7f4c02ffd700 1 -- 172.21.15.37:0/2772336461 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4c0404cc50 con 0x7f4c0c0cab70 2023-10-06T04:41:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.216+0000 7f4c1093d700 1 -- 172.21.15.37:0/2772336461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4c0c0708a0 con 0x7f4c0c0cab70 2023-10-06T04:41:38.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.872+0000 7f4c02ffd700 1 -- 172.21.15.37:0/2772336461 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4c04050270 con 0x7f4c0c0cab70 2023-10-06T04:41:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.876+0000 7f4c1093d700 1 -- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4bec060550 msgr2=0x7f4bec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.876+0000 7f4c1093d700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4bec060550 0x7f4bec062a00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc003b40 tx=0x7f4bfc007e00 comp rx=0 tx=0).stop 2023-10-06T04:41:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.876+0000 7f4c1093d700 1 -- 172.21.15.37:0/2772336461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c0c0cab70 msgr2=0x7f4c0c068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.876+0000 7f4c1093d700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c0c0cab70 0x7f4c0c068e00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4c04000f80 tx=0x7f4c04001640 comp rx=0 tx=0).stop 2023-10-06T04:41:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.876+0000 7f4c1093d700 1 -- 172.21.15.37:0/2772336461 shutdown_connections 2023-10-06T04:41:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.876+0000 7f4c1093d700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4bec060550 0x7f4bec062a00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.876+0000 7f4c1093d700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c0c0ca7a0 0x7f4c0c0c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:38.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.876+0000 7f4c1093d700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c0c0cab70 0x7f4c0c068e00 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:38.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.876+0000 7f4c1093d700 1 --2- 172.21.15.37:0/2772336461 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c0c09b2b0 0x7f4c0c143b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:38.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.876+0000 7f4c1093d700 1 -- 172.21.15.37:0/2772336461 >> 172.21.15.37:0/2772336461 conn(0x7f4c0c0667b0 msgr2=0x7f4c0c156280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:38.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.876+0000 7f4c1093d700 1 -- 172.21.15.37:0/2772336461 shutdown_connections 2023-10-06T04:41:38.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:38.876+0000 7f4c1093d700 1 -- 172.21.15.37:0/2772336461 wait complete. 2023-10-06T04:41:38.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:41:39.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f762ad15700 1 Processor -- start 2023-10-06T04:41:39.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f762ad15700 1 -- start start 2023-10-06T04:41:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f762ad15700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f762406e030 0x7f762415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f762ad15700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f762406e400 0x7f762406e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f762ad15700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76240c8500 con 0x7f76240c7b00 2023-10-06T04:41:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f762ad15700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76240c7670 con 0x7f762406e030 2023-10-06T04:41:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f762ad15700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76240c6aa0 con 0x7f762406e400 2023-10-06T04:41:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7629512700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f76240c7b00 0x7f762415d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38206/0 (socket says 172.21.15.37:38206) 2023-10-06T04:41:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7629512700 1 -- 172.21.15.37:0/1214481164 learned_addr learned my addr 172.21.15.37:0/1214481164 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7629d13700 1 --2- 172.21.15.37:0/1214481164 >> v2:172.21.15.83:3300/0 conn(0x7f762406e030 0x7f762415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f762a514700 1 --2- 172.21.15.37:0/1214481164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f762406e400 0x7f762406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7628d11700 1 -- 172.21.15.37:0/1214481164 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255189933 0 0) 0x7f76240c8500 con 0x7f76240c7b00 2023-10-06T04:41:39.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7628d11700 1 -- 172.21.15.37:0/1214481164 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7610003570 con 0x7f76240c7b00 2023-10-06T04:41:39.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7629d13700 1 -- 172.21.15.37:0/1214481164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f762406e400 msgr2=0x7f762406e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:39.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7629d13700 1 --2- 172.21.15.37:0/1214481164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f762406e400 0x7f762406e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:39.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7629d13700 1 -- 172.21.15.37:0/1214481164 >> v1:172.21.15.37:6789/0 conn(0x7f76240c7b00 legacy=0x7f762415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:39.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7629d13700 1 -- 172.21.15.37:0/1214481164 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76240c6d40 con 0x7f762406e030 2023-10-06T04:41:39.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7629d13700 1 --2- 172.21.15.37:0/1214481164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f762406e030 0x7f762415cb20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f76200098e0 tx=0x7f76200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18bca31cadff5869 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:39.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7628d11700 1 -- 172.21.15.37:0/1214481164 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620011630 con 0x7f762406e030 2023-10-06T04:41:39.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7628d11700 1 -- 172.21.15.37:0/1214481164 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7620011790 con 0x7f762406e030 2023-10-06T04:41:39.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.020+0000 7f7628d11700 1 -- 172.21.15.37:0/1214481164 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620011b30 con 0x7f762406e030 2023-10-06T04:41:39.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.024+0000 7f762ad15700 1 -- 172.21.15.37:0/1214481164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f762406e030 msgr2=0x7f762415cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:39.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.024+0000 7f762ad15700 1 --2- 172.21.15.37:0/1214481164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f762406e030 0x7f762415cb20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f76200098e0 tx=0x7f76200091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:39.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.024+0000 7f762ad15700 1 -- 172.21.15.37:0/1214481164 shutdown_connections 2023-10-06T04:41:39.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.024+0000 7f762ad15700 1 --2- 172.21.15.37:0/1214481164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f762406e400 0x7f762406e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:39.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.024+0000 7f762ad15700 1 --2- 172.21.15.37:0/1214481164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f762406e030 0x7f762415cb20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:39.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.024+0000 7f762ad15700 1 -- 172.21.15.37:0/1214481164 >> 172.21.15.37:0/1214481164 conn(0x7f76240cc000 msgr2=0x7f76240cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:39.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.024+0000 7f762ad15700 1 -- 172.21.15.37:0/1214481164 shutdown_connections 2023-10-06T04:41:39.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.024+0000 7f762ad15700 1 -- 172.21.15.37:0/1214481164 wait complete. 2023-10-06T04:41:39.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.024+0000 7f762ad15700 1 Processor -- start 2023-10-06T04:41:39.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.024+0000 7f762ad15700 1 -- start start 2023-10-06T04:41:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762ad15700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f762406e030 0x7f76240c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762ad15700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f762406e400 0x7f76240c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762ad15700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240c7b00 0x7f7624157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762ad15700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76240c3dd0 con 0x7f76240c7b00 2023-10-06T04:41:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762ad15700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76240c31c0 con 0x7f762406e400 2023-10-06T04:41:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762ad15700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76240c34a0 con 0x7f762406e030 2023-10-06T04:41:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762a514700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240c7b00 0x7f7624157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f7629512700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f762406e400 0x7f76240c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f7629d13700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f762406e030 0x7f76240c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f7629512700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f762406e400 0x7f76240c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:50154/0 (socket says 172.21.15.37:50154) 2023-10-06T04:41:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f7629d13700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f762406e030 0x7f76240c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:57084/0 (socket says 172.21.15.37:57084) 2023-10-06T04:41:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f7629512700 1 -- 172.21.15.37:0/1434445576 learned_addr learned my addr 172.21.15.37:0/1434445576 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762a514700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240c7b00 0x7f7624157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60106/0 (socket says 172.21.15.37:60106) 2023-10-06T04:41:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762a514700 1 -- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f762406e030 msgr2=0x7f76240c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762a514700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f762406e030 0x7f76240c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762a514700 1 -- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f762406e400 msgr2=0x7f76240c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762a514700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f762406e400 0x7f76240c4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762a514700 1 -- 172.21.15.37:0/1434445576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7620009420 con 0x7f76240c7b00 2023-10-06T04:41:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f7629512700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f762406e400 0x7f76240c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762a514700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240c7b00 0x7f7624157870 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f761c009e50 tx=0x7f761c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f7619ffb700 1 -- 172.21.15.37:0/1434445576 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c00caa0 con 0x7f76240c7b00 2023-10-06T04:41:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f7619ffb700 1 -- 172.21.15.37:0/1434445576 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761c00f040 con 0x7f76240c7b00 2023-10-06T04:41:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762ad15700 1 -- 172.21.15.37:0/1434445576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76240c3780 con 0x7f76240c7b00 2023-10-06T04:41:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f7619ffb700 1 -- 172.21.15.37:0/1434445576 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c00ce50 con 0x7f76240c7b00 2023-10-06T04:41:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.028+0000 7f762ad15700 1 -- 172.21.15.37:0/1434445576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7624153400 con 0x7f76240c7b00 2023-10-06T04:41:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.032+0000 7f762ad15700 1 -- 172.21.15.37:0/1434445576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762415c810 con 0x7f76240c7b00 2023-10-06T04:41:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.032+0000 7f7619ffb700 1 -- 172.21.15.37:0/1434445576 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f761c014690 con 0x7f76240c7b00 2023-10-06T04:41:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.032+0000 7f7619ffb700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7608060580 0x7f7608062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.032+0000 7f7619ffb700 1 -- 172.21.15.37:0/1434445576 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f761c07d6d0 con 0x7f76240c7b00 2023-10-06T04:41:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.032+0000 7f7629d13700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7608060580 0x7f7608062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.036+0000 7f7629d13700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7608060580 0x7f7608062a30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76200091e0 tx=0x7f7620017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:39.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.040+0000 7f7619ffb700 1 -- 172.21.15.37:0/1434445576 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f762415c810 con 0x7f76240c7b00 2023-10-06T04:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.208+0000 7f762ad15700 1 -- 172.21.15.37:0/1434445576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f762415c810 con 0x7f76240c7b00 2023-10-06T04:41:40.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.992+0000 7f7619ffb700 1 -- 172.21.15.37:0/1434445576 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v61) v1 ==== 181+0+0 (secure 0 0 0) 0x7f762415c810 con 0x7f76240c7b00 2023-10-06T04:41:40.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.996+0000 7f762ad15700 1 -- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7608060580 msgr2=0x7f7608062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:40.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:39.996+0000 7f762ad15700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7608060580 0x7f7608062a30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76200091e0 tx=0x7f7620017000 comp rx=0 tx=0).stop 2023-10-06T04:41:40.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.000+0000 7f762ad15700 1 -- 172.21.15.37:0/1434445576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240c7b00 msgr2=0x7f7624157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:40.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.000+0000 7f762ad15700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240c7b00 0x7f7624157870 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f761c009e50 tx=0x7f761c00b040 comp rx=0 tx=0).stop 2023-10-06T04:41:40.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.000+0000 7f762ad15700 1 -- 172.21.15.37:0/1434445576 shutdown_connections 2023-10-06T04:41:40.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.000+0000 7f762ad15700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f7608060580 0x7f7608062a30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:40.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.000+0000 7f762ad15700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f762406e400 0x7f76240c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:40.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.000+0000 7f762ad15700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240c7b00 0x7f7624157870 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:40.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.000+0000 7f762ad15700 1 --2- 172.21.15.37:0/1434445576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f762406e030 0x7f76240c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:40.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.000+0000 7f762ad15700 1 -- 172.21.15.37:0/1434445576 >> 172.21.15.37:0/1434445576 conn(0x7f76240cc000 msgr2=0x7f76240c8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:40.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.000+0000 7f762ad15700 1 -- 172.21.15.37:0/1434445576 shutdown_connections 2023-10-06T04:41:40.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.000+0000 7f762ad15700 1 -- 172.21.15.37:0/1434445576 wait complete. 2023-10-06T04:41:40.006 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:41:40.017 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:41:40.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80c29c7700 1 Processor -- start 2023-10-06T04:41:40.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80c29c7700 1 -- start start 2023-10-06T04:41:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80c29c7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80bc156190 0x7f80bc06b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80c29c7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0cbcb0 0x7f80bc0cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80c29c7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80bc06ce00 con 0x7f80bc150130 2023-10-06T04:41:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80c29c7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc156600 con 0x7f80bc156190 2023-10-06T04:41:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80c29c7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0af010 con 0x7f80bc0cbcb0 2023-10-06T04:41:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80bb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80bc156190 0x7f80bc06b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80bbfff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f80bc150130 0x7f80bc0c8610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:52452/0 (socket says 172.21.15.37:52452) 2023-10-06T04:41:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80bb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80bc156190 0x7f80bc06b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60122/0 (socket says 172.21.15.37:60122) 2023-10-06T04:41:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80bbfff700 1 -- 172.21.15.37:0/2143906811 learned_addr learned my addr 172.21.15.37:0/2143906811 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80c0f64700 1 --2- 172.21.15.37:0/2143906811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0cbcb0 0x7f80bc0cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80baffd700 1 -- 172.21.15.37:0/2143906811 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890393619 0 0) 0x7f80bc06ce00 con 0x7f80bc150130 2023-10-06T04:41:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80bb7fe700 1 -- 172.21.15.37:0/2143906811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0cbcb0 msgr2=0x7f80bc0cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.124+0000 7f80bb7fe700 1 --2- 172.21.15.37:0/2143906811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0cbcb0 0x7f80bc0cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80bb7fe700 1 -- 172.21.15.37:0/2143906811 >> v1:172.21.15.83:6789/0 conn(0x7f80bc150130 legacy=0x7f80bc0c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80bb7fe700 1 -- 172.21.15.37:0/2143906811 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc1598c0 con 0x7f80bc156190 2023-10-06T04:41:40.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80bb7fe700 1 --2- 172.21.15.37:0/2143906811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc156190 0x7f80bc06b2c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f80b00098e0 tx=0x7f80b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61417bf99f602ea0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:40.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80baffd700 1 -- 172.21.15.37:0/2143906811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000b640 con 0x7f80bc156190 2023-10-06T04:41:40.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80baffd700 1 -- 172.21.15.37:0/2143906811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b000b7a0 con 0x7f80bc156190 2023-10-06T04:41:40.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80baffd700 1 -- 172.21.15.37:0/2143906811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000bb40 con 0x7f80bc156190 2023-10-06T04:41:40.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80c29c7700 1 -- 172.21.15.37:0/2143906811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc156190 msgr2=0x7f80bc06b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:40.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80c29c7700 1 --2- 172.21.15.37:0/2143906811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc156190 0x7f80bc06b2c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f80b00098e0 tx=0x7f80b00091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:40.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80c29c7700 1 -- 172.21.15.37:0/2143906811 shutdown_connections 2023-10-06T04:41:40.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80c29c7700 1 --2- 172.21.15.37:0/2143906811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0cbcb0 0x7f80bc0cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:40.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80c29c7700 1 --2- 172.21.15.37:0/2143906811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc156190 0x7f80bc06b2c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:40.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80c29c7700 1 -- 172.21.15.37:0/2143906811 >> 172.21.15.37:0/2143906811 conn(0x7f80bc068e00 msgr2=0x7f80bc069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:40.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80c29c7700 1 -- 172.21.15.37:0/2143906811 shutdown_connections 2023-10-06T04:41:40.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.128+0000 7f80c29c7700 1 -- 172.21.15.37:0/2143906811 wait complete. 2023-10-06T04:41:40.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80c29c7700 1 Processor -- start 2023-10-06T04:41:40.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80c29c7700 1 -- start start 2023-10-06T04:41:40.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80c29c7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0cbcb0 0x7f80bc14ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80c29c7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc150130 0x7f80bc15b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80c29c7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc156190 0x7f80bc1585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80c29c7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc15ace0 con 0x7f80bc156190 2023-10-06T04:41:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80c29c7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc14d3b0 con 0x7f80bc150130 2023-10-06T04:41:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80c29c7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc15a0d0 con 0x7f80bc0cbcb0 2023-10-06T04:41:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80c0f64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc156190 0x7f80bc1585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80c0f64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc156190 0x7f80bc1585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60128/0 (socket says 172.21.15.37:60128) 2023-10-06T04:41:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80c0f64700 1 -- 172.21.15.37:0/318148154 learned_addr learned my addr 172.21.15.37:0/318148154 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80bb7fe700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc150130 0x7f80bc15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.132+0000 7f80bbfff700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0cbcb0 0x7f80bc14ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80c0f64700 1 -- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0cbcb0 msgr2=0x7f80bc14ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80c0f64700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0cbcb0 0x7f80bc14ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80c0f64700 1 -- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc150130 msgr2=0x7f80bc15b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80c0f64700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc150130 0x7f80bc15b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80c0f64700 1 -- 172.21.15.37:0/318148154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b0009420 con 0x7f80bc156190 2023-10-06T04:41:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80c0f64700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc156190 0x7f80bc1585b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009e90 tx=0x7f80b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80a3fff700 1 -- 172.21.15.37:0/318148154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b400cb70 con 0x7f80bc156190 2023-10-06T04:41:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80a3fff700 1 -- 172.21.15.37:0/318148154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b400f040 con 0x7f80bc156190 2023-10-06T04:41:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80c29c7700 1 -- 172.21.15.37:0/318148154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80bc15a3b0 con 0x7f80bc156190 2023-10-06T04:41:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80a3fff700 1 -- 172.21.15.37:0/318148154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4012430 con 0x7f80bc156190 2023-10-06T04:41:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80c29c7700 1 -- 172.21.15.37:0/318148154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc15a970 con 0x7f80bc156190 2023-10-06T04:41:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80c29c7700 1 -- 172.21.15.37:0/318148154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc15ae20 con 0x7f80bc156190 2023-10-06T04:41:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80a3fff700 1 -- 172.21.15.37:0/318148154 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f80b40127e0 con 0x7f80bc156190 2023-10-06T04:41:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80a3fff700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f80a8060550 0x7f80a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80a3fff700 1 -- 172.21.15.37:0/318148154 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6112+0+0 (secure 0 0 0) 0x7f80b4016070 con 0x7f80bc156190 2023-10-06T04:41:40.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.136+0000 7f80bbfff700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f80a8060550 0x7f80a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:40.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.140+0000 7f80bbfff700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f80a8060550 0x7f80a8062a00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f80ac007fd0 tx=0x7f80ac007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:40.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.140+0000 7f80a3fff700 1 -- 172.21.15.37:0/318148154 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f80bc15ae20 con 0x7f80bc156190 2023-10-06T04:41:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:40.304+0000 7f80c29c7700 1 -- 172.21.15.37:0/318148154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f80bc15ae20 con 0x7f80bc156190 2023-10-06T04:41:41.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.000+0000 7f80a3fff700 1 -- 172.21.15.37:0/318148154 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v62) v1 ==== 169+0+0 (secure 0 0 0) 0x7f80bc15ae20 con 0x7f80bc156190 2023-10-06T04:41:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.008+0000 7f80c29c7700 1 -- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f80a8060550 msgr2=0x7f80a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.008+0000 7f80c29c7700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f80a8060550 0x7f80a8062a00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f80ac007fd0 tx=0x7f80ac007d30 comp rx=0 tx=0).stop 2023-10-06T04:41:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.008+0000 7f80c29c7700 1 -- 172.21.15.37:0/318148154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc156190 msgr2=0x7f80bc1585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.008+0000 7f80c29c7700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc156190 0x7f80bc1585b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009e90 tx=0x7f80b400b040 comp rx=0 tx=0).stop 2023-10-06T04:41:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.008+0000 7f80c29c7700 1 -- 172.21.15.37:0/318148154 shutdown_connections 2023-10-06T04:41:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.008+0000 7f80c29c7700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f80a8060550 0x7f80a8062a00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.008+0000 7f80c29c7700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc150130 0x7f80bc15b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.008+0000 7f80c29c7700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80bc156190 0x7f80bc1585b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.008+0000 7f80c29c7700 1 --2- 172.21.15.37:0/318148154 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc0cbcb0 0x7f80bc14ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.008+0000 7f80c29c7700 1 -- 172.21.15.37:0/318148154 >> 172.21.15.37:0/318148154 conn(0x7f80bc068e00 msgr2=0x7f80bc0ca280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.008+0000 7f80c29c7700 1 -- 172.21.15.37:0/318148154 shutdown_connections 2023-10-06T04:41:41.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.008+0000 7f80c29c7700 1 -- 172.21.15.37:0/318148154 wait complete. 2023-10-06T04:41:41.018 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-10-06T04:41:41.032 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T04:41:41.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.136+0000 7fe61bfff700 1 Processor -- start 2023-10-06T04:41:41.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.136+0000 7fe61bfff700 1 -- start start 2023-10-06T04:41:41.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c06e190 0x7fe61c06e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:41.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe61c0c7240 0x7fe61c15c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:41.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61c0c6db0 con 0x7fe61c15cf30 2023-10-06T04:41:41.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61c06f350 con 0x7fe61c0c7240 2023-10-06T04:41:41.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c15d3b0 con 0x7fe61c06e190 2023-10-06T04:41:41.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe6127fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe61c0c7240 0x7fe61c15c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:41.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61affd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c06e190 0x7fe61c06e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:41.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61b7fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fe61c15cf30 0x7fe61c1587c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:52462/0 (socket says 172.21.15.37:52462) 2023-10-06T04:41:41.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe6127fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe61c0c7240 0x7fe61c15c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:50172/0 (socket says 172.21.15.37:50172) 2023-10-06T04:41:41.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61b7fe700 1 -- 172.21.15.37:0/3906346624 learned_addr learned my addr 172.21.15.37:0/3906346624 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:41.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe6127fc700 1 -- 172.21.15.37:0/3906346624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c06e190 msgr2=0x7fe61c06e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:41.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe6127fc700 1 --2- 172.21.15.37:0/3906346624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c06e190 0x7fe61c06e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe6127fc700 1 -- 172.21.15.37:0/3906346624 >> v1:172.21.15.83:6789/0 conn(0x7fe61c15cf30 legacy=0x7fe61c1587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe6127fc700 1 -- 172.21.15.37:0/3906346624 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c15d5d0 con 0x7fe61c0c7240 2023-10-06T04:41:41.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61a7fc700 1 -- 172.21.15.37:0/3906346624 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587795205 0 0) 0x7fe61c0c6db0 con 0x7fe61c15cf30 2023-10-06T04:41:41.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe6127fc700 1 --2- 172.21.15.37:0/3906346624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c0c7240 0x7fe61c15c9f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe604009910 tx=0x7fe6040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=299341275ee8b9dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:41.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61a7fc700 1 -- 172.21.15.37:0/3906346624 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60400b640 con 0x7fe61c0c7240 2023-10-06T04:41:41.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61a7fc700 1 -- 172.21.15.37:0/3906346624 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60400b7a0 con 0x7fe61c0c7240 2023-10-06T04:41:41.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61a7fc700 1 -- 172.21.15.37:0/3906346624 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60400bb60 con 0x7fe61c0c7240 2023-10-06T04:41:41.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 -- 172.21.15.37:0/3906346624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c0c7240 msgr2=0x7fe61c15c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 --2- 172.21.15.37:0/3906346624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c0c7240 0x7fe61c15c9f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe604009910 tx=0x7fe6040091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 -- 172.21.15.37:0/3906346624 shutdown_connections 2023-10-06T04:41:41.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 --2- 172.21.15.37:0/3906346624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c0c7240 0x7fe61c15c9f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 --2- 172.21.15.37:0/3906346624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c06e190 0x7fe61c06e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 -- 172.21.15.37:0/3906346624 >> 172.21.15.37:0/3906346624 conn(0x7fe61c0c9570 msgr2=0x7fe61c067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:41.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 -- 172.21.15.37:0/3906346624 shutdown_connections 2023-10-06T04:41:41.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.140+0000 7fe61bfff700 1 -- 172.21.15.37:0/3906346624 wait complete. 2023-10-06T04:41:41.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61bfff700 1 Processor -- start 2023-10-06T04:41:41.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61bfff700 1 -- start start 2023-10-06T04:41:41.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c06e190 0x7fe61c169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:41.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c0c7240 0x7fe61c0b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:41.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c15cf30 0x7fe61c0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:41.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61bfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c0b1450 con 0x7fe61c06e190 2023-10-06T04:41:41.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61bfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c16afb0 con 0x7fe61c15cf30 2023-10-06T04:41:41.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61bfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c16a270 con 0x7fe61c0c7240 2023-10-06T04:41:41.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c06e190 0x7fe61c169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:41.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c06e190 0x7fe61c169bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60136/0 (socket says 172.21.15.37:60136) 2023-10-06T04:41:41.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61affd700 1 -- 172.21.15.37:0/2504361824 learned_addr learned my addr 172.21.15.37:0/2504361824 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:41.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61b7fe700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c15cf30 0x7fe61c0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:41.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe6127fc700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c0c7240 0x7fe61c0b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:41.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61affd700 1 -- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c0c7240 msgr2=0x7fe61c0b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61affd700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c0c7240 0x7fe61c0b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61affd700 1 -- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c15cf30 msgr2=0x7fe61c0aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61affd700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c15cf30 0x7fe61c0aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.144+0000 7fe61affd700 1 -- 172.21.15.37:0/2504361824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe604009420 con 0x7fe61c06e190 2023-10-06T04:41:41.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.148+0000 7fe61affd700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c06e190 0x7fe61c169bb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00ec80 tx=0x7fe60c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:41.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.148+0000 7fe6137fe700 1 -- 172.21.15.37:0/2504361824 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00c850 con 0x7fe61c06e190 2023-10-06T04:41:41.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.148+0000 7fe6137fe700 1 -- 172.21.15.37:0/2504361824 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c00c9b0 con 0x7fe61c06e190 2023-10-06T04:41:41.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.148+0000 7fe61bfff700 1 -- 172.21.15.37:0/2504361824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c16a680 con 0x7fe61c06e190 2023-10-06T04:41:41.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.148+0000 7fe6137fe700 1 -- 172.21.15.37:0/2504361824 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00cd50 con 0x7fe61c06e190 2023-10-06T04:41:41.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.148+0000 7fe61bfff700 1 -- 172.21.15.37:0/2504361824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c16ac40 con 0x7fe61c06e190 2023-10-06T04:41:41.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.148+0000 7fe61bfff700 1 -- 172.21.15.37:0/2504361824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61c0708a0 con 0x7fe61c06e190 2023-10-06T04:41:41.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.148+0000 7fe6137fe700 1 -- 172.21.15.37:0/2504361824 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe60c013680 con 0x7fe61c06e190 2023-10-06T04:41:41.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.148+0000 7fe6137fe700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe5fc060550 0x7fe5fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:41.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.148+0000 7fe6137fe700 1 -- 172.21.15.37:0/2504361824 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fe60c07cec0 con 0x7fe61c06e190 2023-10-06T04:41:41.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.152+0000 7fe6127fc700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe5fc060550 0x7fe5fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:41.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.152+0000 7fe6127fc700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe5fc060550 0x7fe5fc062a00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe604009860 tx=0x7fe604017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:41.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.160+0000 7fe6137fe700 1 -- 172.21.15.37:0/2504361824 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe60c04d410 con 0x7fe61c06e190 2023-10-06T04:41:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.328+0000 7fe61bfff700 1 -- 172.21.15.37:0/2504361824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe61c15d8b0 con 0x7fe61c06e190 2023-10-06T04:41:41.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.336+0000 7fe6137fe700 1 -- 172.21.15.37:0/2504361824 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe60c050a30 con 0x7fe61c06e190 2023-10-06T04:41:41.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.336+0000 7fe61bfff700 1 -- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe5fc060550 msgr2=0x7fe5fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.336+0000 7fe61bfff700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe5fc060550 0x7fe5fc062a00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe604009860 tx=0x7fe604017000 comp rx=0 tx=0).stop 2023-10-06T04:41:41.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.336+0000 7fe61bfff700 1 -- 172.21.15.37:0/2504361824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c06e190 msgr2=0x7fe61c169bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.336+0000 7fe61bfff700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c06e190 0x7fe61c169bb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00ec80 tx=0x7fe60c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.336+0000 7fe61bfff700 1 -- 172.21.15.37:0/2504361824 shutdown_connections 2023-10-06T04:41:41.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.336+0000 7fe61bfff700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe5fc060550 0x7fe5fc062a00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.336+0000 7fe61bfff700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c15cf30 0x7fe61c0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.336+0000 7fe61bfff700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c0c7240 0x7fe61c0b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.336+0000 7fe61bfff700 1 --2- 172.21.15.37:0/2504361824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c06e190 0x7fe61c169bb0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.336+0000 7fe61bfff700 1 -- 172.21.15.37:0/2504361824 >> 172.21.15.37:0/2504361824 conn(0x7fe61c0c9570 msgr2=0x7fe61c0ac2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.340+0000 7fe61bfff700 1 -- 172.21.15.37:0/2504361824 shutdown_connections 2023-10-06T04:41:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.340+0000 7fe61bfff700 1 -- 172.21.15.37:0/2504361824 wait complete. 2023-10-06T04:41:41.358 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_mds_readonly' 2023-10-06T04:41:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86cbfff700 1 Processor -- start 2023-10-06T04:41:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86cbfff700 1 -- start start 2023-10-06T04:41:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86cbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86cc0acff0 0x7f86cc0c3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86cbfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86cc0c42e0 con 0x7f86cc06d500 2023-10-06T04:41:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86cbfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86cc0c36d0 con 0x7f86cc0acc20 2023-10-06T04:41:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86cbfff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86cc0c39b0 con 0x7f86cc0acff0 2023-10-06T04:41:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86c3fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f86cc06d500 0x7f86cc0c2960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38210/0 (socket says 172.21.15.37:38210) 2023-10-06T04:41:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86c3fff700 1 -- 172.21.15.37:0/2437440100 learned_addr learned my addr 172.21.15.37:0/2437440100 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86cb7fe700 1 --2- 172.21.15.37:0/2437440100 >> v2:172.21.15.37:3300/0 conn(0x7f86cc0acff0 0x7f86cc0c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86ca7fc700 1 -- 172.21.15.37:0/2437440100 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079846063 0 0) 0x7f86cc0c36d0 con 0x7f86cc0acc20 2023-10-06T04:41:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86ca7fc700 1 -- 172.21.15.37:0/2437440100 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b8003570 con 0x7f86cc0acc20 2023-10-06T04:41:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86cb7fe700 1 -- 172.21.15.37:0/2437440100 >> v1:172.21.15.83:6789/0 conn(0x7f86cc0acc20 legacy=0x7f86cc06cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86cb7fe700 1 -- 172.21.15.37:0/2437440100 >> v1:172.21.15.37:6789/0 conn(0x7f86cc06d500 legacy=0x7f86cc0c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86cb7fe700 1 -- 172.21.15.37:0/2437440100 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc0c3c90 con 0x7f86cc0acff0 2023-10-06T04:41:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86cb7fe700 1 --2- 172.21.15.37:0/2437440100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86cc0acff0 0x7f86cc0c3070 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009e60 tx=0x7f86c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c68ff1db118db7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86ca7fc700 1 -- 172.21.15.37:0/2437440100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c400e070 con 0x7f86cc0acff0 2023-10-06T04:41:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86ca7fc700 1 -- 172.21.15.37:0/2437440100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c400bb60 con 0x7f86cc0acff0 2023-10-06T04:41:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.460+0000 7f86ca7fc700 1 -- 172.21.15.37:0/2437440100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4012430 con 0x7f86cc0acff0 2023-10-06T04:41:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.464+0000 7f86cbfff700 1 -- 172.21.15.37:0/2437440100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86cc0acff0 msgr2=0x7f86cc0c3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.464+0000 7f86cbfff700 1 --2- 172.21.15.37:0/2437440100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86cc0acff0 0x7f86cc0c3070 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009e60 tx=0x7f86c4009780 comp rx=0 tx=0).stop 2023-10-06T04:41:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.464+0000 7f86cbfff700 1 -- 172.21.15.37:0/2437440100 shutdown_connections 2023-10-06T04:41:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.464+0000 7f86cbfff700 1 --2- 172.21.15.37:0/2437440100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86cc0acff0 0x7f86cc0c3070 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.464+0000 7f86cbfff700 1 -- 172.21.15.37:0/2437440100 >> 172.21.15.37:0/2437440100 conn(0x7f86cc06c280 msgr2=0x7f86cc0cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.464+0000 7f86cbfff700 1 -- 172.21.15.37:0/2437440100 shutdown_connections 2023-10-06T04:41:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.464+0000 7f86cbfff700 1 -- 172.21.15.37:0/2437440100 wait complete. 2023-10-06T04:41:41.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.464+0000 7f86cbfff700 1 Processor -- start 2023-10-06T04:41:41.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.464+0000 7f86cbfff700 1 -- start start 2023-10-06T04:41:41.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.464+0000 7f86cbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86cc06d500 0x7f86cc0b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:41.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.464+0000 7f86cbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86cc0acc20 0x7f86cc154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:41.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.464+0000 7f86cbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86cc0acff0 0x7f86cc0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:41.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86cbfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc158e80 con 0x7f86cc0acc20 2023-10-06T04:41:41.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86cbfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0b1310 con 0x7f86cc0acff0 2023-10-06T04:41:41.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86cbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0b15f0 con 0x7f86cc06d500 2023-10-06T04:41:41.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86cc0acc20 0x7f86cc154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86cc0acc20 0x7f86cc154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60150/0 (socket says 172.21.15.37:60150) 2023-10-06T04:41:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c3fff700 1 -- 172.21.15.37:0/3918681013 learned_addr learned my addr 172.21.15.37:0/3918681013 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86cb7fe700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86cc0acff0 0x7f86cc0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86caffd700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86cc06d500 0x7f86cc0b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c3fff700 1 -- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86cc06d500 msgr2=0x7f86cc0b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c3fff700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86cc06d500 0x7f86cc0b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c3fff700 1 -- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86cc0acff0 msgr2=0x7f86cc0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c3fff700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86cc0acff0 0x7f86cc0b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c3fff700 1 -- 172.21.15.37:0/3918681013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c4009a20 con 0x7f86cc0acc20 2023-10-06T04:41:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c3fff700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86cc0acc20 0x7f86cc154730 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f86b400c590 tx=0x7f86b4001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c2ffd700 1 -- 172.21.15.37:0/3918681013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4005b30 con 0x7f86cc0acc20 2023-10-06T04:41:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c2ffd700 1 -- 172.21.15.37:0/3918681013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b4005cb0 con 0x7f86cc0acc20 2023-10-06T04:41:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86cbfff700 1 -- 172.21.15.37:0/3918681013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86cc0b18d0 con 0x7f86cc0acc20 2023-10-06T04:41:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c2ffd700 1 -- 172.21.15.37:0/3918681013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4007320 con 0x7f86cc0acc20 2023-10-06T04:41:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86cbfff700 1 -- 172.21.15.37:0/3918681013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86cc0b1e90 con 0x7f86cc0acc20 2023-10-06T04:41:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86cbfff700 1 -- 172.21.15.37:0/3918681013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86cc0b20b0 con 0x7f86cc0acc20 2023-10-06T04:41:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c2ffd700 1 -- 172.21.15.37:0/3918681013 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f86b401b3b0 con 0x7f86cc0acc20 2023-10-06T04:41:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c2ffd700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f86ac060550 0x7f86ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.468+0000 7f86c2ffd700 1 -- 172.21.15.37:0/3918681013 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f86b407bb50 con 0x7f86cc0acc20 2023-10-06T04:41:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.472+0000 7f86caffd700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f86ac060550 0x7f86ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.472+0000 7f86caffd700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f86ac060550 0x7f86ac062a00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0cc170 tx=0x7f86bc007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:41.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.476+0000 7f86c2ffd700 1 -- 172.21.15.37:0/3918681013 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f86b404c140 con 0x7f86cc0acc20 2023-10-06T04:41:41.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:41.692+0000 7f86cbfff700 1 -- 172.21.15.37:0/3918681013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_mds_readonly"]} v 0) v1 -- 0x7f86cc0708a0 con 0x7f86cc0acc20 2023-10-06T04:41:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.012+0000 7f86c2ffd700 1 -- 172.21.15.37:0/3918681013 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_mds_readonly"]}]=0 v151) v1 ==== 144+0+0 (secure 0 0 0) 0x7f86b404f760 con 0x7f86cc0acc20 2023-10-06T04:41:42.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.016+0000 7f86cbfff700 1 -- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f86ac060550 msgr2=0x7f86ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:42.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.016+0000 7f86cbfff700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f86ac060550 0x7f86ac062a00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0cc170 tx=0x7f86bc007d50 comp rx=0 tx=0).stop 2023-10-06T04:41:42.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.016+0000 7f86cbfff700 1 -- 172.21.15.37:0/3918681013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86cc0acc20 msgr2=0x7f86cc154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:42.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.016+0000 7f86cbfff700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86cc0acc20 0x7f86cc154730 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f86b400c590 tx=0x7f86b4001020 comp rx=0 tx=0).stop 2023-10-06T04:41:42.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.016+0000 7f86cbfff700 1 -- 172.21.15.37:0/3918681013 shutdown_connections 2023-10-06T04:41:42.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.016+0000 7f86cbfff700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f86ac060550 0x7f86ac062a00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.016+0000 7f86cbfff700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86cc0acff0 0x7f86cc0b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.016+0000 7f86cbfff700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86cc0acc20 0x7f86cc154730 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.016+0000 7f86cbfff700 1 --2- 172.21.15.37:0/3918681013 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86cc06d500 0x7f86cc0b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.016+0000 7f86cbfff700 1 -- 172.21.15.37:0/3918681013 >> 172.21.15.37:0/3918681013 conn(0x7f86cc06c280 msgr2=0x7f86cc1572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.016+0000 7f86cbfff700 1 -- 172.21.15.37:0/3918681013 shutdown_connections 2023-10-06T04:41:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.016+0000 7f86cbfff700 1 -- 172.21.15.37:0/3918681013 wait complete. 2023-10-06T04:41:42.039 INFO:tasks.cephfs_test_runner:test if MDS behave correct when it's readonly ... ok 2023-10-06T04:41:42.039 INFO:tasks.cephfs_test_runner: 2023-10-06T04:41:42.039 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T04:41:42.039 INFO:tasks.cephfs_test_runner:Ran 2 tests in 103.305s 2023-10-06T04:41:42.039 INFO:tasks.cephfs_test_runner: 2023-10-06T04:41:42.039 INFO:tasks.cephfs_test_runner:OK 2023-10-06T04:41:42.040 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T04:41:42.049 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-06T04:41:42.120 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-06T04:41:42.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:42.121 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T04:41:42.129 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T04:41:42.129 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:41:42.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:42.129 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:41:42.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:42.186 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:41:42.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:42.203 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T04:41:42.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:42.348 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:41:42.356 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:41:42.356 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:41:42.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:42.356 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:41:42.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:42.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:41:42.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:41:42.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-10-06T04:41:42.590 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T04:41:42.600 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T04:41:42.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:41:42.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.711+0000 7feaa1ca0700 1 Processor -- start 2023-10-06T04:41:42.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.711+0000 7feaa1ca0700 1 -- start start 2023-10-06T04:41:42.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7feaa1ca0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea9c0ae470 0x7fea9c0a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:42.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7feaa1ca0700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c1572b0 con 0x7fea9c0ab420 2023-10-06T04:41:42.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7feaa1ca0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c157590 con 0x7fea9c0af5e0 2023-10-06T04:41:42.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7feaa1ca0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c157f30 con 0x7fea9c0ae470 2023-10-06T04:41:42.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7fea9affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea9c0ae470 0x7fea9c0a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:42.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7fea9affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea9c0ae470 0x7fea9c0a8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60166/0 (socket says 172.21.15.37:60166) 2023-10-06T04:41:42.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7fea9affd700 1 -- 172.21.15.37:0/939956075 learned_addr learned my addr 172.21.15.37:0/939956075 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:42.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7fea9affd700 1 -- 172.21.15.37:0/939956075 >> v1:172.21.15.83:6789/0 conn(0x7fea9c0af5e0 legacy=0x7fea9c0add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:42.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7fea9affd700 1 -- 172.21.15.37:0/939956075 >> v1:172.21.15.37:6789/0 conn(0x7fea9c0ab420 legacy=0x7fea9c0a92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:42.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7fea9affd700 1 -- 172.21.15.37:0/939956075 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c157870 con 0x7fea9c0ae470 2023-10-06T04:41:42.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7fea9affd700 1 --2- 172.21.15.37:0/939956075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9c0ae470 0x7fea9c0a8d90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fea900099b0 tx=0x7fea90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f237619e5b03594 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:42.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7fea9a7fc700 1 -- 172.21.15.37:0/939956075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000b860 con 0x7fea9c0ae470 2023-10-06T04:41:42.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7fea9a7fc700 1 -- 172.21.15.37:0/939956075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9000b9c0 con 0x7fea9c0ae470 2023-10-06T04:41:42.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7fea9a7fc700 1 -- 172.21.15.37:0/939956075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000bd80 con 0x7fea9c0ae470 2023-10-06T04:41:42.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7feaa1ca0700 1 -- 172.21.15.37:0/939956075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9c0ae470 msgr2=0x7fea9c0a8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:42.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7feaa1ca0700 1 --2- 172.21.15.37:0/939956075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9c0ae470 0x7fea9c0a8d90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fea900099b0 tx=0x7fea90009250 comp rx=0 tx=0).stop 2023-10-06T04:41:42.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7feaa1ca0700 1 -- 172.21.15.37:0/939956075 shutdown_connections 2023-10-06T04:41:42.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7feaa1ca0700 1 --2- 172.21.15.37:0/939956075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9c0ae470 0x7fea9c0a8d90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:42.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.715+0000 7feaa1ca0700 1 -- 172.21.15.37:0/939956075 >> 172.21.15.37:0/939956075 conn(0x7fea9c0ccc60 msgr2=0x7fea9c06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:42.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.719+0000 7feaa1ca0700 1 -- 172.21.15.37:0/939956075 shutdown_connections 2023-10-06T04:41:42.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.719+0000 7feaa1ca0700 1 -- 172.21.15.37:0/939956075 wait complete. 2023-10-06T04:41:42.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.719+0000 7feaa1ca0700 1 Processor -- start 2023-10-06T04:41:42.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.719+0000 7feaa1ca0700 1 -- start start 2023-10-06T04:41:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.719+0000 7feaa1ca0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea9c0ab420 0x7fea9c14e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7feaa1ca0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9c0ae470 0x7fea9c1538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7feaa1ca0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea9c0af5e0 0x7fea9c0cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7feaa1ca0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0ca520 con 0x7fea9c0ae470 2023-10-06T04:41:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7feaa1ca0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0c9910 con 0x7fea9c0ab420 2023-10-06T04:41:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7feaa1ca0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0c9bf0 con 0x7fea9c0af5e0 2023-10-06T04:41:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea9affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9c0ae470 0x7fea9c1538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea9affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9c0ae470 0x7fea9c1538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60168/0 (socket says 172.21.15.37:60168) 2023-10-06T04:41:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea9affd700 1 -- 172.21.15.37:0/2836996208 learned_addr learned my addr 172.21.15.37:0/2836996208 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea9bfff700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea9c0af5e0 0x7fea9c0cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea9b7fe700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea9c0ab420 0x7fea9c14e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea9affd700 1 -- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea9c0af5e0 msgr2=0x7fea9c0cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea9affd700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea9c0af5e0 0x7fea9c0cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea9affd700 1 -- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea9c0ab420 msgr2=0x7fea9c14e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea9affd700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea9c0ab420 0x7fea9c14e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea9affd700 1 -- 172.21.15.37:0/2836996208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea900094f0 con 0x7fea9c0ae470 2023-10-06T04:41:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea9bfff700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea9c0af5e0 0x7fea9c0cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea9affd700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9c0ae470 0x7fea9c1538e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fea9c06da10 tx=0x7fea90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea837fe700 1 -- 172.21.15.37:0/2836996208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9001f070 con 0x7fea9c0ae470 2023-10-06T04:41:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea837fe700 1 -- 172.21.15.37:0/2836996208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea90006a90 con 0x7fea9c0ae470 2023-10-06T04:41:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7feaa1ca0700 1 -- 172.21.15.37:0/2836996208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c0c9ed0 con 0x7fea9c0ae470 2023-10-06T04:41:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7fea837fe700 1 -- 172.21.15.37:0/2836996208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90011e00 con 0x7fea9c0ae470 2023-10-06T04:41:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7feaa1ca0700 1 -- 172.21.15.37:0/2836996208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c0c95a0 con 0x7fea9c0ae470 2023-10-06T04:41:42.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.723+0000 7feaa1ca0700 1 -- 172.21.15.37:0/2836996208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c070ee0 con 0x7fea9c0ae470 2023-10-06T04:41:42.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.727+0000 7fea837fe700 1 -- 172.21.15.37:0/2836996208 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fea90023070 con 0x7fea9c0ae470 2023-10-06T04:41:42.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.727+0000 7fea837fe700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fea88060580 0x7fea88062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:42.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.727+0000 7fea837fe700 1 -- 172.21.15.37:0/2836996208 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fea9007da00 con 0x7fea9c0ae470 2023-10-06T04:41:42.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.727+0000 7fea9b7fe700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fea88060580 0x7fea88062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.727+0000 7fea9b7fe700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fea88060580 0x7fea88062a30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fea8c003a80 tx=0x7fea8c007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:42.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.731+0000 7fea837fe700 1 -- 172.21.15.37:0/2836996208 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fea9004dff0 con 0x7fea9c0ae470 2023-10-06T04:41:42.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.903+0000 7feaa1ca0700 1 -- 172.21.15.37:0/2836996208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea9c0ca350 con 0x7fea9c0ae470 2023-10-06T04:41:42.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.903+0000 7fea837fe700 1 -- 172.21.15.37:0/2836996208 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+14066 (secure 0 0 0) 0x7fea90051610 con 0x7fea9c0ae470 2023-10-06T04:41:42.910 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:42.911 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:41:40.985446+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6835/1381995756":"2023-10-07T04:41:37.865975+0000","172.21.15.83:6834/1381995756":"2023-10-07T04:41:37.865975+0000","172.21.15.37:6835/3410822358":"2023-10-07T04:41:27.878627+0000","172.21.15.37:6834/3410822358":"2023-10-07T04:41:27.878627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:41:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.907+0000 7feaa1ca0700 1 -- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fea88060580 msgr2=0x7fea88062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.907+0000 7feaa1ca0700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fea88060580 0x7fea88062a30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fea8c003a80 tx=0x7fea8c007ec0 comp rx=0 tx=0).stop 2023-10-06T04:41:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.907+0000 7feaa1ca0700 1 -- 172.21.15.37:0/2836996208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9c0ae470 msgr2=0x7fea9c1538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:42.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.907+0000 7feaa1ca0700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9c0ae470 0x7fea9c1538e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fea9c06da10 tx=0x7fea90017000 comp rx=0 tx=0).stop 2023-10-06T04:41:42.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.907+0000 7feaa1ca0700 1 -- 172.21.15.37:0/2836996208 shutdown_connections 2023-10-06T04:41:42.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.907+0000 7feaa1ca0700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fea88060580 0x7fea88062a30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:42.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.907+0000 7feaa1ca0700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea9c0af5e0 0x7fea9c0cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:42.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.907+0000 7feaa1ca0700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9c0ae470 0x7fea9c1538e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:42.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.907+0000 7feaa1ca0700 1 --2- 172.21.15.37:0/2836996208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea9c0ab420 0x7fea9c14e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:42.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.907+0000 7feaa1ca0700 1 -- 172.21.15.37:0/2836996208 >> 172.21.15.37:0/2836996208 conn(0x7fea9c0ccc60 msgr2=0x7fea9c06e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:42.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.907+0000 7feaa1ca0700 1 -- 172.21.15.37:0/2836996208 shutdown_connections 2023-10-06T04:41:42.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:42.907+0000 7feaa1ca0700 1 -- 172.21.15.37:0/2836996208 wait complete. 2023-10-06T04:41:42.926 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:41:42.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:41:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.027+0000 7fd88924e700 1 Processor -- start 2023-10-06T04:41:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.027+0000 7fd88924e700 1 -- start start 2023-10-06T04:41:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd8840aa6c0 0x7fd8841561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8840ab5a0 0x7fd8840acd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8840ac6f0 con 0x7fd8840aaa90 2023-10-06T04:41:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8840abb20 con 0x7fd8840aa6c0 2023-10-06T04:41:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8840abdc0 con 0x7fd8840ab5a0 2023-10-06T04:41:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88259c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8840ab5a0 0x7fd8840acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd882d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd8840aa6c0 0x7fd8841561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd882d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd8840aa6c0 0x7fd8841561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:50202/0 (socket says 172.21.15.37:50202) 2023-10-06T04:41:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88259c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8840ab5a0 0x7fd8840acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:57148/0 (socket says 172.21.15.37:57148) 2023-10-06T04:41:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd882d9d700 1 -- 172.21.15.37:0/1679617359 learned_addr learned my addr 172.21.15.37:0/1679617359 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:43.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd882d9d700 1 -- 172.21.15.37:0/1679617359 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8840ab5a0 msgr2=0x7fd8840acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:43.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd882d9d700 1 --2- 172.21.15.37:0/1679617359 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8840ab5a0 0x7fd8840acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd882d9d700 1 -- 172.21.15.37:0/1679617359 >> v1:172.21.15.83:6789/0 conn(0x7fd8840aaa90 legacy=0x7fd884152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd882d9d700 1 -- 172.21.15.37:0/1679617359 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8840ac0a0 con 0x7fd8840aa6c0 2023-10-06T04:41:43.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd882d9d700 1 --2- 172.21.15.37:0/1679617359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8840aa6c0 0x7fd8841561f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd8740099b0 tx=0x7fd874009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa78354cca0849a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:43.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd881d9b700 1 -- 172.21.15.37:0/1679617359 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874009ea0 con 0x7fd8840aa6c0 2023-10-06T04:41:43.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd881d9b700 1 -- 172.21.15.37:0/1679617359 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87400b860 con 0x7fd8840aa6c0 2023-10-06T04:41:43.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd881d9b700 1 -- 172.21.15.37:0/1679617359 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87400bc00 con 0x7fd8840aa6c0 2023-10-06T04:41:43.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 -- 172.21.15.37:0/1679617359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8840aa6c0 msgr2=0x7fd8841561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 --2- 172.21.15.37:0/1679617359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8840aa6c0 0x7fd8841561f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd8740099b0 tx=0x7fd874009250 comp rx=0 tx=0).stop 2023-10-06T04:41:43.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 -- 172.21.15.37:0/1679617359 shutdown_connections 2023-10-06T04:41:43.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 --2- 172.21.15.37:0/1679617359 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8840ab5a0 0x7fd8840acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 --2- 172.21.15.37:0/1679617359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8840aa6c0 0x7fd8841561f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 -- 172.21.15.37:0/1679617359 >> 172.21.15.37:0/1679617359 conn(0x7fd8840ccc60 msgr2=0x7fd88406c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:43.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 -- 172.21.15.37:0/1679617359 shutdown_connections 2023-10-06T04:41:43.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.031+0000 7fd88924e700 1 -- 172.21.15.37:0/1679617359 wait complete. 2023-10-06T04:41:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88924e700 1 Processor -- start 2023-10-06T04:41:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88924e700 1 -- start start 2023-10-06T04:41:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88924e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8840aa6c0 0x7fd8840994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88924e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8840aaa90 0x7fd88406b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88924e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8840ab5a0 0x7fd88406b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88924e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88406a070 con 0x7fd8840aaa90 2023-10-06T04:41:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88924e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88406a330 con 0x7fd8840aa6c0 2023-10-06T04:41:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88924e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88406a610 con 0x7fd8840ab5a0 2023-10-06T04:41:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8840aaa90 0x7fd88406b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8840aaa90 0x7fd88406b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60184/0 (socket says 172.21.15.37:60184) 2023-10-06T04:41:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88259c700 1 -- 172.21.15.37:0/2433295000 learned_addr learned my addr 172.21.15.37:0/2433295000 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd882d9d700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8840aa6c0 0x7fd8840994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88359e700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8840ab5a0 0x7fd88406b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88259c700 1 -- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8840ab5a0 msgr2=0x7fd88406b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88259c700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8840ab5a0 0x7fd88406b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88259c700 1 -- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8840aa6c0 msgr2=0x7fd8840994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88259c700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8840aa6c0 0x7fd8840994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88259c700 1 -- 172.21.15.37:0/2433295000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8740094f0 con 0x7fd8840aaa90 2023-10-06T04:41:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd88259c700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8840aaa90 0x7fd88406b0f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd878010bb0 tx=0x7fd87800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.035+0000 7fd86affd700 1 -- 172.21.15.37:0/2433295000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87800a620 con 0x7fd8840aaa90 2023-10-06T04:41:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.039+0000 7fd86affd700 1 -- 172.21.15.37:0/2433295000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87800c950 con 0x7fd8840aaa90 2023-10-06T04:41:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.039+0000 7fd88924e700 1 -- 172.21.15.37:0/2433295000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88406a8f0 con 0x7fd8840aaa90 2023-10-06T04:41:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.039+0000 7fd86affd700 1 -- 172.21.15.37:0/2433295000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87800ccf0 con 0x7fd8840aaa90 2023-10-06T04:41:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.039+0000 7fd88924e700 1 -- 172.21.15.37:0/2433295000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd884099a20 con 0x7fd8840aaa90 2023-10-06T04:41:43.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.039+0000 7fd88924e700 1 -- 172.21.15.37:0/2433295000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd884070ee0 con 0x7fd8840aaa90 2023-10-06T04:41:43.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.039+0000 7fd86affd700 1 -- 172.21.15.37:0/2433295000 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd878018620 con 0x7fd8840aaa90 2023-10-06T04:41:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.039+0000 7fd86affd700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd870060550 0x7fd870062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.039+0000 7fd86affd700 1 -- 172.21.15.37:0/2433295000 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fd87807e250 con 0x7fd8840aaa90 2023-10-06T04:41:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.039+0000 7fd882d9d700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd870060550 0x7fd870062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.043+0000 7fd882d9d700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd870060550 0x7fd870062a00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd8740099b0 tx=0x7fd874017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.047+0000 7fd86affd700 1 -- 172.21.15.37:0/2433295000 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd878052230 con 0x7fd8840aaa90 2023-10-06T04:41:43.173 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:41:43.176 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:41:43.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.207+0000 7fd88924e700 1 -- 172.21.15.37:0/2433295000 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8840ac380 con 0x7fd870060550 2023-10-06T04:41:43.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd86affd700 1 -- 172.21.15.37:0/2433295000 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71158 (secure 0 0 0) 0x7fd8840ac380 con 0x7fd870060550 2023-10-06T04:41:43.221 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:43.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd88924e700 1 -- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd870060550 msgr2=0x7fd870062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd88924e700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd870060550 0x7fd870062a00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd8740099b0 tx=0x7fd874017000 comp rx=0 tx=0).stop 2023-10-06T04:41:43.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd88924e700 1 -- 172.21.15.37:0/2433295000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8840aaa90 msgr2=0x7fd88406b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd88924e700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8840aaa90 0x7fd88406b0f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd878010bb0 tx=0x7fd87800a330 comp rx=0 tx=0).stop 2023-10-06T04:41:43.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd88924e700 1 -- 172.21.15.37:0/2433295000 shutdown_connections 2023-10-06T04:41:43.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd88924e700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fd870060550 0x7fd870062a00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd88924e700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8840ab5a0 0x7fd88406b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd88924e700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8840aaa90 0x7fd88406b0f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd88924e700 1 --2- 172.21.15.37:0/2433295000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8840aa6c0 0x7fd8840994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd88924e700 1 -- 172.21.15.37:0/2433295000 >> 172.21.15.37:0/2433295000 conn(0x7fd8840ccc60 msgr2=0x7fd8840b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:43.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd88924e700 1 -- 172.21.15.37:0/2433295000 shutdown_connections 2023-10-06T04:41:43.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.215+0000 7fd88924e700 1 -- 172.21.15.37:0/2433295000 wait complete. 2023-10-06T04:41:43.225 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:41:43.237 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2023-10-06T04:41:43.084484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2401640,"kb_used_data":6952,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752573080,"statfs":{"total":773094113280,"available":770634833920,"internally_reserved":0,"allocated":7118848,"data_stored":3939872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11535,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-49,"num_read_kb":-60,"num_write":-63,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002026"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.652022+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:41:40.652022+0000","last_peered":"2023-10-06T04:41:40.652022+0000","last_clean":"2023-10-06T04:41:40.652022+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:41:40.652022+0000","last_undegraded":"2023-10-06T04:41:40.652022+0000","last_fullsized":"2023-10-06T04:41:40.652022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.649428+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:41:40.649428+0000","last_peered":"2023-10-06T04:41:40.649428+0000","last_clean":"2023-10-06T04:41:40.649428+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:41:40.649428+0000","last_undegraded":"2023-10-06T04:41:40.649428+0000","last_fullsized":"2023-10-06T04:41:40.649428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.658180+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:41:40.658180+0000","last_peered":"2023-10-06T04:41:40.658180+0000","last_clean":"2023-10-06T04:41:40.658180+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:41:40.658180+0000","last_undegraded":"2023-10-06T04:41:40.658180+0000","last_fullsized":"2023-10-06T04:41:40.658180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.652860+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:41:40.652860+0000","last_peered":"2023-10-06T04:41:40.652860+0000","last_clean":"2023-10-06T04:41:40.652860+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:41:40.652860+0000","last_undegraded":"2023-10-06T04:41:40.652860+0000","last_fullsized":"2023-10-06T04:41:40.652860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.653367+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:41:40.653367+0000","last_peered":"2023-10-06T04:41:40.653367+0000","last_clean":"2023-10-06T04:41:40.653367+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:41:40.653367+0000","last_undegraded":"2023-10-06T04:41:40.653367+0000","last_fullsized":"2023-10-06T04:41:40.653367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:39.990185+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:41:39.990185+0000","last_peered":"2023-10-06T04:41:39.990185+0000","last_clean":"2023-10-06T04:41:39.990185+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:41:39.990185+0000","last_undegraded":"2023-10-06T04:41:39.990185+0000","last_fullsized":"2023-10-06T04:41:39.990185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.655168+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:41:40.655168+0000","last_peered":"2023-10-06T04:41:40.655168+0000","last_clean":"2023-10-06T04:41:40.655168+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:41:40.655168+0000","last_undegraded":"2023-10-06T04:41:40.655168+0000","last_fullsized":"2023-10-06T04:41:40.655168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.654485+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:41:40.654485+0000","last_peered":"2023-10-06T04:41:40.654485+0000","last_clean":"2023-10-06T04:41:40.654485+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:41:40.654485+0000","last_undegraded":"2023-10-06T04:41:40.654485+0000","last_fullsized":"2023-10-06T04:41:40.654485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":198,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.655297+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:41:40.655297+0000","last_peered":"2023-10-06T04:41:40.655297+0000","last_clean":"2023-10-06T04:41:40.655297+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:41:40.655297+0000","last_undegraded":"2023-10-06T04:41:40.655297+0000","last_fullsized":"2023-10-06T04:41:40.655297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509478,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.92900000000000005,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.46100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.94299999999999995,"5min":1.673,"15min":1.673},"last":1.0129999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84299999999999997,"15min":0.84499999999999997},"min":{"1min":0.54900000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1439999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.1819999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.91400000000000003,"15min":0.92700000000000005},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.202,"5min":1.744,"15min":1.744},"last":1.417},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1910000000000001,"5min":1.323,"15min":1.323},"last":1.3580000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.008,"15min":1.016},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.329,"5min":1.802,"15min":1.802},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.1899999999999999,"15min":1.2},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.494,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.1200000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.171,"15min":1.177},"min":{"1min":0.79700000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5409999999999999,"5min":1.879,"15min":1.879},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.1220000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.45}]},{"osd":6,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1970000000000001,"15min":1.2090000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4850000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.167,"15min":1.1830000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3380000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.966}]},{"osd":7,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.212,"15min":1.23},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4099999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.871},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3109999999999999,"15min":1.3260000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.611,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.748}]}]},{"osd":0,"up_from":15,"seq":64424509476,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":935260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1879999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.95299999999999996,"15min":0.96099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.22,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1870000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.99099999999999999,"15min":0.98299999999999998},"min":{"1min":0.77900000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0089999999999999,"15min":1.018},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0660000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.167,"15min":1.179},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.3959999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1259999999999999,"15min":1.1379999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.482,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.3420000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.101,"15min":1.1120000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.2450000000000001,"15min":1.2569999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.5900000000000001,"5min":1.617,"15min":1.617},"last":1.393}]},{"osd":7,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.177,"15min":1.1870000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3759999999999999,"5min":1.385,"15min":1.385},"last":1.2350000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":935260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.196,"5min":3.347,"15min":3.347},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.93200000000000005,"15min":0.95199999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.244,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.628}]},{"osd":1,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85199999999999998,"15min":0.84399999999999997},"min":{"1min":0.58199999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.329},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2230000000000001,"5min":1.226,"15min":1.226},"last":1.052}]},{"osd":2,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.93600000000000005,"15min":0.93200000000000005},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.90800000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93700000000000006,"15min":0.92700000000000005},"min":{"1min":0.63700000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.109},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.1200000000000001,"15min":1.1399999999999999},"min":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.25,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.204}]},{"osd":4,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.94499999999999995,"15min":0.93600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.246},{"interface":"front","average":{"1min":1.052,"5min":1.1699999999999999,"15min":1.1899999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.3540000000000001,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":1.2949999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.107,"15min":1.1279999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.329,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.147},{"interface":"front","average":{"1min":1.131,"5min":1.123,"15min":1.121},"min":{"1min":0.81399999999999995,"5min":0.747,"15min":0.747},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.4059999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2470000000000001,"15min":1.262},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.423,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.2549999999999999,"15min":1.276},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.3799999999999999,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.2609999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.93700000000000006,"15min":0.93300000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.006,"15min":1.006},"min":{"1min":0.59699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0880000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.68400000000000005,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.141,"5min":1.268,"15min":1.268},"last":0.995},{"interface":"front","average":{"1min":0.879,"5min":0.85499999999999998,"15min":0.85099999999999998},"min":{"1min":0.61899999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.2250000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.98499999999999999,"15min":0.97499999999999998},"min":{"1min":0.875,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.995,"5min":1.054,"15min":1.0640000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.321,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.026}]},{"osd":3,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.04,"15min":1.05},"min":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.2729999999999999,"5min":1.448,"15min":1.448},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0700000000000001,"15min":1.0720000000000001},"min":{"1min":0.79000000000000004,"5min":0.752,"15min":0.752},"max":{"1min":1.4099999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1379999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.64100000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.198,"5min":1.389,"15min":1.389},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0489999999999999,"15min":1.0509999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.96599999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.044,"15min":1.046},"min":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.111,"15min":1.1080000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.87}]},{"osd":7,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1040000000000001,"15min":1.1000000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.95599999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.635,"5min":1.665,"15min":1.665},"last":1.1779999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.878,"15min":0.85499999999999998},"min":{"1min":0.58299999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.0069999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.97099999999999997,"15min":0.96499999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90100000000000002,"15min":0.89500000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2130000000000001,"5min":1.248,"15min":1.248},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0449999999999999,"15min":1.0329999999999999},"min":{"1min":0.73899999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":3.5310000000000001,"5min":3.5310000000000001,"15min":3.5310000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.0089999999999999,"15min":0.97699999999999998},"min":{"1min":0.70199999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":3.2229999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0369999999999999,"15min":1.0269999999999999},"min":{"1min":0.755,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.0609999999999999,"15min":1.034},"min":{"1min":0.84299999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.99099999999999999,"15min":0.98999999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.117,"5min":1.115,"15min":1.115},"min":{"1min":0.79200000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.83799999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.077,"15min":1.073},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.165,"5min":1.129,"15min":1.123},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.0940000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2,"15min":1.1990000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2410000000000001,"15min":1.2350000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":3.2120000000000002,"5min":3.2120000000000002,"15min":3.2120000000000002},"last":1.056}]}]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.85599999999999998,"15min":0.84399999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.01,"15min":1.0169999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2729999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.98199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.89800000000000002,"15min":0.89000000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2909999999999999,"5min":1.319,"15min":1.319},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.90800000000000003,"15min":0.91000000000000003},"min":{"1min":0.65400000000000003,"5min":0.62,"15min":0.62},"max":{"1min":1.159,"5min":1.256,"15min":1.256},"last":0.875}]},{"osd":2,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.024,"15min":1.03},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.624},{"interface":"front","average":{"1min":1.044,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3480000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.0569999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.96499999999999997,"15min":0.95699999999999996},"min":{"1min":0.72899999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1,"15min":1.006},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.361,"5min":1.47,"15min":1.47},"last":0.94399999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.76300000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.266,"5min":1.429,"15min":1.429},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.0569999999999999,"15min":1.044},"min":{"1min":0.69299999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.464,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2869999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0600000000000001,"15min":1.0549999999999999},"min":{"1min":0.80900000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.97199999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.3999999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2130000000000001,"15min":1.204},"min":{"1min":1,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.272,"15min":1.276},"min":{"1min":1.079,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.6459999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.321}]}]},{"osd":2,"up_from":14,"seq":60129542180,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.76200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0369999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55400000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.234,"15min":1.234},"last":0.78300000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.0740000000000001,"5min":1.284,"15min":1.284},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.751,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.046,"5min":1.123,"15min":1.123},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.044,"5min":1,"15min":0.99299999999999999},"min":{"1min":0.64400000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3680000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.94699999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.028,"15min":1.0289999999999999},"min":{"1min":0.70699999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.149,"15min":1.143},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.86899999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1859999999999999,"15min":1.181},"min":{"1min":0.86399999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.024},{"interface":"front","average":{"1min":1.117,"5min":1.085,"15min":1.079},"min":{"1min":0.90300000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.3720000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.88800000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2490000000000001,"15min":1.2569999999999999},"min":{"1min":0.93700000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4770000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.292,"15min":1.29},"min":{"1min":1.0669999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.6579999999999999,"5min":2.048,"15min":2.048},"last":1.1160000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1819999999999999,"15min":1.1739999999999999},"min":{"1min":0.94399999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2909999999999999,"15min":1.302},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.6060000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.155}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2589999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.0089999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.59599999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.464,"5min":1.53,"15min":1.53},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1699999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89400000000000002,"15min":0.88800000000000001},"min":{"1min":0.61599999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.349,"5min":1.903,"15min":1.903},"last":0.82399999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5760000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.24},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.71199999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.385,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.98699999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.153,"15min":1.1519999999999999},"min":{"1min":0.76800000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.675,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1240000000000001,"15min":1.121},"min":{"1min":0.81100000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3740000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.357}]},{"osd":6,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.216,"15min":1.2190000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5740000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.333},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.206,"15min":1.21},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.6619999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.1850000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.107,"15min":1.0980000000000001},"min":{"1min":0.79600000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.532,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.90400000000000003,"5min":0.624,"15min":0.624},"max":{"1min":1.7529999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.27}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:41:43.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:41:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaffff700 1 Processor -- start 2023-10-06T04:41:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaffff700 1 -- start start 2023-10-06T04:41:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1eb0155110 0x7f1eb00c0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1eb00c6960 0x7f1eb006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaffff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb00c79e0 con 0x7f1eb01554e0 2023-10-06T04:41:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaffff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb00c2450 con 0x7f1eb0155110 2023-10-06T04:41:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaffff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb00cc5c0 con 0x7f1eb00c6960 2023-10-06T04:41:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaeffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1eb0155110 0x7f1eb00c0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaf7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1eb01554e0 0x7f1eb00cbeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38230/0 (socket says 172.21.15.37:38230) 2023-10-06T04:41:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaf7fe700 1 -- 172.21.15.37:0/4111438646 learned_addr learned my addr 172.21.15.37:0/4111438646 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eae7fc700 1 --2- 172.21.15.37:0/4111438646 >> v2:172.21.15.83:3300/0 conn(0x7f1eb00c6960 0x7f1eb006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaeffd700 1 -- 172.21.15.37:0/4111438646 >> v2:172.21.15.83:3300/0 conn(0x7f1eb00c6960 msgr2=0x7f1eb006d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaeffd700 1 --2- 172.21.15.37:0/4111438646 >> v2:172.21.15.83:3300/0 conn(0x7f1eb00c6960 0x7f1eb006d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaeffd700 1 -- 172.21.15.37:0/4111438646 >> v1:172.21.15.37:6789/0 conn(0x7f1eb01554e0 legacy=0x7f1eb00cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eadffb700 1 -- 172.21.15.37:0/4111438646 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190440491 0 0) 0x7f1eb00c79e0 con 0x7f1eb01554e0 2023-10-06T04:41:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaeffd700 1 -- 172.21.15.37:0/4111438646 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb00c6dd0 con 0x7f1eb0155110 2023-10-06T04:41:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eae7fc700 1 --2- 172.21.15.37:0/4111438646 >> v2:172.21.15.83:3300/0 conn(0x7f1eb00c6960 0x7f1eb006d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eaeffd700 1 --2- 172.21.15.37:0/4111438646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb0155110 0x7f1eb00c0f00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00c1a30 tx=0x7f1ea00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ed02aa08e174f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eadffb700 1 -- 172.21.15.37:0/4111438646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0009e80 con 0x7f1eb0155110 2023-10-06T04:41:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eadffb700 1 -- 172.21.15.37:0/4111438646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea000b820 con 0x7f1eb0155110 2023-10-06T04:41:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.387+0000 7f1eadffb700 1 -- 172.21.15.37:0/4111438646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000bba0 con 0x7f1eb0155110 2023-10-06T04:41:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 -- 172.21.15.37:0/4111438646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb0155110 msgr2=0x7f1eb00c0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 --2- 172.21.15.37:0/4111438646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb0155110 0x7f1eb00c0f00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00c1a30 tx=0x7f1ea00091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 -- 172.21.15.37:0/4111438646 shutdown_connections 2023-10-06T04:41:43.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 --2- 172.21.15.37:0/4111438646 >> v2:172.21.15.83:3300/0 conn(0x7f1eb00c6960 0x7f1eb006d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 --2- 172.21.15.37:0/4111438646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb0155110 0x7f1eb00c0f00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 -- 172.21.15.37:0/4111438646 >> 172.21.15.37:0/4111438646 conn(0x7f1eb0068780 msgr2=0x7f1eb00cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:43.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 -- 172.21.15.37:0/4111438646 shutdown_connections 2023-10-06T04:41:43.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 -- 172.21.15.37:0/4111438646 wait complete. 2023-10-06T04:41:43.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 Processor -- start 2023-10-06T04:41:43.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 -- start start 2023-10-06T04:41:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb00c6960 0x7f1eb013ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb0155110 0x7f1eb00c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1eb01554e0 0x7f1eb00ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb00c5b40 con 0x7f1eb00c6960 2023-10-06T04:41:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb0143110 con 0x7f1eb0155110 2023-10-06T04:41:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb013f230 con 0x7f1eb01554e0 2023-10-06T04:41:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb00c6960 0x7f1eb013ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb00c6960 0x7f1eb013ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60198/0 (socket says 172.21.15.37:60198) 2023-10-06T04:41:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.391+0000 7f1eaeffd700 1 -- 172.21.15.37:0/991839661 learned_addr learned my addr 172.21.15.37:0/991839661 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1eae7fc700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb0155110 0x7f1eb00c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1eaf7fe700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1eb01554e0 0x7f1eb00ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1eaeffd700 1 -- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1eb01554e0 msgr2=0x7f1eb00ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1eaeffd700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1eb01554e0 0x7f1eb00ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1eaeffd700 1 -- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb0155110 msgr2=0x7f1eb00c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1eaeffd700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb0155110 0x7f1eb00c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1eaeffd700 1 -- 172.21.15.37:0/991839661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea0009420 con 0x7f1eb00c6960 2023-10-06T04:41:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1eaeffd700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb00c6960 0x7f1eb013ecf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000b3c0 tx=0x7f1ea0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1ea6ffd700 1 -- 172.21.15.37:0/991839661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000bba0 con 0x7f1eb00c6960 2023-10-06T04:41:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1ea6ffd700 1 -- 172.21.15.37:0/991839661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea0011420 con 0x7f1eb00c6960 2023-10-06T04:41:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1eaffff700 1 -- 172.21.15.37:0/991839661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb00c5860 con 0x7f1eb00c6960 2023-10-06T04:41:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1ea6ffd700 1 -- 172.21.15.37:0/991839661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00117c0 con 0x7f1eb00c6960 2023-10-06T04:41:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1eaffff700 1 -- 172.21.15.37:0/991839661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb0142da0 con 0x7f1eb00c6960 2023-10-06T04:41:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1eaffff700 1 -- 172.21.15.37:0/991839661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb0142920 con 0x7f1eb00c6960 2023-10-06T04:41:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.395+0000 7f1ea6ffd700 1 -- 172.21.15.37:0/991839661 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1ea0011b30 con 0x7f1eb00c6960 2023-10-06T04:41:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.399+0000 7f1ea6ffd700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e90060550 0x7f1e90062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.399+0000 7f1ea6ffd700 1 -- 172.21.15.37:0/991839661 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f1ea007e220 con 0x7f1eb00c6960 2023-10-06T04:41:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.399+0000 7f1eae7fc700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e90060550 0x7f1e90062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.399+0000 7f1eae7fc700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e90060550 0x7f1e90062a00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1e98006f00 tx=0x7f1e98008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.403+0000 7f1ea6ffd700 1 -- 172.21.15.37:0/991839661 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1eb0142920 con 0x7f1eb00c6960 2023-10-06T04:41:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.563+0000 7f1eaffff700 1 -- 172.21.15.37:0/991839661 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1eb0142920 con 0x7f1e90060550 2023-10-06T04:41:43.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.571+0000 7f1ea6ffd700 1 -- 172.21.15.37:0/991839661 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71158 (secure 0 0 0) 0x7f1eb0142920 con 0x7f1e90060550 2023-10-06T04:41:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:43.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.575+0000 7f1eaffff700 1 -- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e90060550 msgr2=0x7f1e90062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.575+0000 7f1eaffff700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e90060550 0x7f1e90062a00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1e98006f00 tx=0x7f1e98008040 comp rx=0 tx=0).stop 2023-10-06T04:41:43.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.575+0000 7f1eaffff700 1 -- 172.21.15.37:0/991839661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb00c6960 msgr2=0x7f1eb013ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.575+0000 7f1eaffff700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb00c6960 0x7f1eb013ecf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000b3c0 tx=0x7f1ea0017000 comp rx=0 tx=0).stop 2023-10-06T04:41:43.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.575+0000 7f1eaffff700 1 -- 172.21.15.37:0/991839661 shutdown_connections 2023-10-06T04:41:43.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.575+0000 7f1eaffff700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1e90060550 0x7f1e90062a00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.575+0000 7f1eaffff700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1eb0155110 0x7f1eb00c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.575+0000 7f1eaffff700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1eb01554e0 0x7f1eb00ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.575+0000 7f1eaffff700 1 --2- 172.21.15.37:0/991839661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb00c6960 0x7f1eb013ecf0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.575+0000 7f1eaffff700 1 -- 172.21.15.37:0/991839661 >> 172.21.15.37:0/991839661 conn(0x7f1eb0068780 msgr2=0x7f1eb0069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:43.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.575+0000 7f1eaffff700 1 -- 172.21.15.37:0/991839661 shutdown_connections 2023-10-06T04:41:43.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.575+0000 7f1eaffff700 1 -- 172.21.15.37:0/991839661 wait complete. 2023-10-06T04:41:43.582 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:41:43.595 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2023-10-06T04:41:43.084484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2401640,"kb_used_data":6952,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752573080,"statfs":{"total":773094113280,"available":770634833920,"internally_reserved":0,"allocated":7118848,"data_stored":3939872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11535,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-49,"num_read_kb":-60,"num_write":-63,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002026"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.652022+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:41:40.652022+0000","last_peered":"2023-10-06T04:41:40.652022+0000","last_clean":"2023-10-06T04:41:40.652022+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:41:40.652022+0000","last_undegraded":"2023-10-06T04:41:40.652022+0000","last_fullsized":"2023-10-06T04:41:40.652022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.649428+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:41:40.649428+0000","last_peered":"2023-10-06T04:41:40.649428+0000","last_clean":"2023-10-06T04:41:40.649428+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:41:40.649428+0000","last_undegraded":"2023-10-06T04:41:40.649428+0000","last_fullsized":"2023-10-06T04:41:40.649428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.658180+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:41:40.658180+0000","last_peered":"2023-10-06T04:41:40.658180+0000","last_clean":"2023-10-06T04:41:40.658180+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:41:40.658180+0000","last_undegraded":"2023-10-06T04:41:40.658180+0000","last_fullsized":"2023-10-06T04:41:40.658180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.652860+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:41:40.652860+0000","last_peered":"2023-10-06T04:41:40.652860+0000","last_clean":"2023-10-06T04:41:40.652860+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:41:40.652860+0000","last_undegraded":"2023-10-06T04:41:40.652860+0000","last_fullsized":"2023-10-06T04:41:40.652860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.653367+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:41:40.653367+0000","last_peered":"2023-10-06T04:41:40.653367+0000","last_clean":"2023-10-06T04:41:40.653367+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:41:40.653367+0000","last_undegraded":"2023-10-06T04:41:40.653367+0000","last_fullsized":"2023-10-06T04:41:40.653367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:39.990185+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:41:39.990185+0000","last_peered":"2023-10-06T04:41:39.990185+0000","last_clean":"2023-10-06T04:41:39.990185+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:41:39.990185+0000","last_undegraded":"2023-10-06T04:41:39.990185+0000","last_fullsized":"2023-10-06T04:41:39.990185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.655168+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:41:40.655168+0000","last_peered":"2023-10-06T04:41:40.655168+0000","last_clean":"2023-10-06T04:41:40.655168+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:41:40.655168+0000","last_undegraded":"2023-10-06T04:41:40.655168+0000","last_fullsized":"2023-10-06T04:41:40.655168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.654485+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:41:40.654485+0000","last_peered":"2023-10-06T04:41:40.654485+0000","last_clean":"2023-10-06T04:41:40.654485+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:41:40.654485+0000","last_undegraded":"2023-10-06T04:41:40.654485+0000","last_fullsized":"2023-10-06T04:41:40.654485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":198,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.655297+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:41:40.655297+0000","last_peered":"2023-10-06T04:41:40.655297+0000","last_clean":"2023-10-06T04:41:40.655297+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:41:40.655297+0000","last_undegraded":"2023-10-06T04:41:40.655297+0000","last_fullsized":"2023-10-06T04:41:40.655297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509478,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.92900000000000005,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.46100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.94299999999999995,"5min":1.673,"15min":1.673},"last":1.0129999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84299999999999997,"15min":0.84499999999999997},"min":{"1min":0.54900000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1439999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.1819999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.91400000000000003,"15min":0.92700000000000005},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.202,"5min":1.744,"15min":1.744},"last":1.417},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1910000000000001,"5min":1.323,"15min":1.323},"last":1.3580000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.008,"15min":1.016},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.329,"5min":1.802,"15min":1.802},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.1899999999999999,"15min":1.2},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.494,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.1200000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.171,"15min":1.177},"min":{"1min":0.79700000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5409999999999999,"5min":1.879,"15min":1.879},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.1220000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.45}]},{"osd":6,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1970000000000001,"15min":1.2090000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4850000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.167,"15min":1.1830000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3380000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.966}]},{"osd":7,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.212,"15min":1.23},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4099999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.871},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3109999999999999,"15min":1.3260000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.611,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.748}]}]},{"osd":0,"up_from":15,"seq":64424509476,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":935260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1879999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.95299999999999996,"15min":0.96099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.22,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1870000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.99099999999999999,"15min":0.98299999999999998},"min":{"1min":0.77900000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0089999999999999,"15min":1.018},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0660000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.167,"15min":1.179},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.3959999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1259999999999999,"15min":1.1379999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.482,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.3420000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.101,"15min":1.1120000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.2450000000000001,"15min":1.2569999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.5900000000000001,"5min":1.617,"15min":1.617},"last":1.393}]},{"osd":7,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.177,"15min":1.1870000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3759999999999999,"5min":1.385,"15min":1.385},"last":1.2350000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":935260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.196,"5min":3.347,"15min":3.347},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.93200000000000005,"15min":0.95199999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.244,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.628}]},{"osd":1,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85199999999999998,"15min":0.84399999999999997},"min":{"1min":0.58199999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.329},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2230000000000001,"5min":1.226,"15min":1.226},"last":1.052}]},{"osd":2,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.93600000000000005,"15min":0.93200000000000005},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.90800000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93700000000000006,"15min":0.92700000000000005},"min":{"1min":0.63700000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.109},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.1200000000000001,"15min":1.1399999999999999},"min":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.25,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.204}]},{"osd":4,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.94499999999999995,"15min":0.93600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.246},{"interface":"front","average":{"1min":1.052,"5min":1.1699999999999999,"15min":1.1899999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.3540000000000001,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":1.2949999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.107,"15min":1.1279999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.329,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.147},{"interface":"front","average":{"1min":1.131,"5min":1.123,"15min":1.121},"min":{"1min":0.81399999999999995,"5min":0.747,"15min":0.747},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.4059999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2470000000000001,"15min":1.262},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.423,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.2549999999999999,"15min":1.276},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.3799999999999999,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.2609999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.93700000000000006,"15min":0.93300000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.006,"15min":1.006},"min":{"1min":0.59699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0880000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.68400000000000005,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.141,"5min":1.268,"15min":1.268},"last":0.995},{"interface":"front","average":{"1min":0.879,"5min":0.85499999999999998,"15min":0.85099999999999998},"min":{"1min":0.61899999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.2250000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.98499999999999999,"15min":0.97499999999999998},"min":{"1min":0.875,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.995,"5min":1.054,"15min":1.0640000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.321,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.026}]},{"osd":3,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.04,"15min":1.05},"min":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.2729999999999999,"5min":1.448,"15min":1.448},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0700000000000001,"15min":1.0720000000000001},"min":{"1min":0.79000000000000004,"5min":0.752,"15min":0.752},"max":{"1min":1.4099999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1379999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.64100000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.198,"5min":1.389,"15min":1.389},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0489999999999999,"15min":1.0509999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.96599999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.044,"15min":1.046},"min":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.111,"15min":1.1080000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.87}]},{"osd":7,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1040000000000001,"15min":1.1000000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.95599999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.635,"5min":1.665,"15min":1.665},"last":1.1779999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.878,"15min":0.85499999999999998},"min":{"1min":0.58299999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.0069999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.97099999999999997,"15min":0.96499999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90100000000000002,"15min":0.89500000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2130000000000001,"5min":1.248,"15min":1.248},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0449999999999999,"15min":1.0329999999999999},"min":{"1min":0.73899999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":3.5310000000000001,"5min":3.5310000000000001,"15min":3.5310000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.0089999999999999,"15min":0.97699999999999998},"min":{"1min":0.70199999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":3.2229999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0369999999999999,"15min":1.0269999999999999},"min":{"1min":0.755,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.0609999999999999,"15min":1.034},"min":{"1min":0.84299999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.99099999999999999,"15min":0.98999999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.117,"5min":1.115,"15min":1.115},"min":{"1min":0.79200000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.83799999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.077,"15min":1.073},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.165,"5min":1.129,"15min":1.123},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.0940000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2,"15min":1.1990000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2410000000000001,"15min":1.2350000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":3.2120000000000002,"5min":3.2120000000000002,"15min":3.2120000000000002},"last":1.056}]}]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.85599999999999998,"15min":0.84399999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.01,"15min":1.0169999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2729999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.98199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.89800000000000002,"15min":0.89000000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2909999999999999,"5min":1.319,"15min":1.319},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.90800000000000003,"15min":0.91000000000000003},"min":{"1min":0.65400000000000003,"5min":0.62,"15min":0.62},"max":{"1min":1.159,"5min":1.256,"15min":1.256},"last":0.875}]},{"osd":2,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.024,"15min":1.03},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.624},{"interface":"front","average":{"1min":1.044,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3480000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.0569999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.96499999999999997,"15min":0.95699999999999996},"min":{"1min":0.72899999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1,"15min":1.006},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.361,"5min":1.47,"15min":1.47},"last":0.94399999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.76300000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.266,"5min":1.429,"15min":1.429},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.0569999999999999,"15min":1.044},"min":{"1min":0.69299999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.464,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2869999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0600000000000001,"15min":1.0549999999999999},"min":{"1min":0.80900000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.97199999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.3999999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2130000000000001,"15min":1.204},"min":{"1min":1,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.272,"15min":1.276},"min":{"1min":1.079,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.6459999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.321}]}]},{"osd":2,"up_from":14,"seq":60129542180,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.76200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0369999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55400000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.234,"15min":1.234},"last":0.78300000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.0740000000000001,"5min":1.284,"15min":1.284},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.751,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.046,"5min":1.123,"15min":1.123},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.044,"5min":1,"15min":0.99299999999999999},"min":{"1min":0.64400000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3680000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.94699999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.028,"15min":1.0289999999999999},"min":{"1min":0.70699999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.149,"15min":1.143},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.86899999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1859999999999999,"15min":1.181},"min":{"1min":0.86399999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.024},{"interface":"front","average":{"1min":1.117,"5min":1.085,"15min":1.079},"min":{"1min":0.90300000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.3720000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.88800000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2490000000000001,"15min":1.2569999999999999},"min":{"1min":0.93700000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4770000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.292,"15min":1.29},"min":{"1min":1.0669999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.6579999999999999,"5min":2.048,"15min":2.048},"last":1.1160000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1819999999999999,"15min":1.1739999999999999},"min":{"1min":0.94399999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2909999999999999,"15min":1.302},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.6060000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.155}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2589999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.0089999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.59599999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.464,"5min":1.53,"15min":1.53},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1699999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89400000000000002,"15min":0.88800000000000001},"min":{"1min":0.61599999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.349,"5min":1.903,"15min":1.903},"last":0.82399999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5760000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.24},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.71199999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.385,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.98699999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.153,"15min":1.1519999999999999},"min":{"1min":0.76800000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.675,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1240000000000001,"15min":1.121},"min":{"1min":0.81100000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3740000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.357}]},{"osd":6,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.216,"15min":1.2190000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5740000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.333},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.206,"15min":1.21},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.6619999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.1850000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.107,"15min":1.0980000000000001},"min":{"1min":0.79600000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.532,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.90400000000000003,"5min":0.624,"15min":0.624},"max":{"1min":1.7529999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.27}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:41:43.597 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:41:43.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:41:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabd523c700 1 Processor -- start 2023-10-06T04:41:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabd523c700 1 -- start start 2023-10-06T04:41:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabd523c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fabd00cbd50 0x7fabd00cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabd523c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabd006e910 0x7fabd015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabd523c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd006dd70 con 0x7fabd00c9820 2023-10-06T04:41:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabd523c700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd00add50 con 0x7fabd006e910 2023-10-06T04:41:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabd523c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd00ae030 con 0x7fabd00cbd50 2023-10-06T04:41:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabc659c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fabd00c9820 0x7fabd006e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38242/0 (socket says 172.21.15.37:38242) 2023-10-06T04:41:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabc659c700 1 -- 172.21.15.37:0/1566771918 learned_addr learned my addr 172.21.15.37:0/1566771918 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabced9d700 1 --2- 172.21.15.37:0/1566771918 >> v2:172.21.15.83:3300/0 conn(0x7fabd00cbd50 0x7fabd00cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabcf59e700 1 --2- 172.21.15.37:0/1566771918 >> v2:172.21.15.37:3300/0 conn(0x7fabd006e910 0x7fabd015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabce59c700 1 -- 172.21.15.37:0/1566771918 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812112489 0 0) 0x7fabd006dd70 con 0x7fabd00c9820 2023-10-06T04:41:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabce59c700 1 -- 172.21.15.37:0/1566771918 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabbc003570 con 0x7fabd00c9820 2023-10-06T04:41:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabcf59e700 1 -- 172.21.15.37:0/1566771918 >> v2:172.21.15.83:3300/0 conn(0x7fabd00cbd50 msgr2=0x7fabd00cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabcf59e700 1 --2- 172.21.15.37:0/1566771918 >> v2:172.21.15.83:3300/0 conn(0x7fabd00cbd50 0x7fabd00cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabce59c700 1 -- 172.21.15.37:0/1566771918 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1565039749 0 0) 0x7fabbc003570 con 0x7fabd00c9820 2023-10-06T04:41:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabcf59e700 1 -- 172.21.15.37:0/1566771918 >> v1:172.21.15.37:6789/0 conn(0x7fabd00c9820 legacy=0x7fabd006e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabcf59e700 1 -- 172.21.15.37:0/1566771918 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd00ae310 con 0x7fabd006e910 2023-10-06T04:41:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabcf59e700 1 --2- 172.21.15.37:0/1566771918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd006e910 0x7fabd015cd30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009e60 tx=0x7fabc8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25db7ef04393c3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabce59c700 1 -- 172.21.15.37:0/1566771918 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc800e070 con 0x7fabd006e910 2023-10-06T04:41:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabce59c700 1 -- 172.21.15.37:0/1566771918 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc800b7a0 con 0x7fabd006e910 2023-10-06T04:41:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabce59c700 1 -- 172.21.15.37:0/1566771918 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8001470 con 0x7fabd006e910 2023-10-06T04:41:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabd523c700 1 -- 172.21.15.37:0/1566771918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd006e910 msgr2=0x7fabd015cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabd523c700 1 --2- 172.21.15.37:0/1566771918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd006e910 0x7fabd015cd30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009e60 tx=0x7fabc8009780 comp rx=0 tx=0).stop 2023-10-06T04:41:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabd523c700 1 -- 172.21.15.37:0/1566771918 shutdown_connections 2023-10-06T04:41:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabd523c700 1 --2- 172.21.15.37:0/1566771918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd006e910 0x7fabd015cd30 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.703+0000 7fabd523c700 1 --2- 172.21.15.37:0/1566771918 >> v2:172.21.15.83:3300/0 conn(0x7fabd00cbd50 0x7fabd00cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.707+0000 7fabd523c700 1 -- 172.21.15.37:0/1566771918 >> 172.21.15.37:0/1566771918 conn(0x7fabd00667b0 msgr2=0x7fabd0066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.707+0000 7fabd523c700 1 -- 172.21.15.37:0/1566771918 shutdown_connections 2023-10-06T04:41:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.707+0000 7fabd523c700 1 -- 172.21.15.37:0/1566771918 wait complete. 2023-10-06T04:41:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.707+0000 7fabd523c700 1 Processor -- start 2023-10-06T04:41:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.707+0000 7fabd523c700 1 -- start start 2023-10-06T04:41:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.707+0000 7fabd523c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabd006e910 0x7fabd0156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.707+0000 7fabd523c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd00c9820 0x7fabd00c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.707+0000 7fabd523c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fabd00cbd50 0x7fabd00c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.707+0000 7fabd523c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0160870 con 0x7fabd00c9820 2023-10-06T04:41:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.707+0000 7fabd523c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0156d40 con 0x7fabd006e910 2023-10-06T04:41:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.707+0000 7fabd523c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd015fcf0 con 0x7fabd00cbd50 2023-10-06T04:41:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd00c9820 0x7fabd00c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd00c9820 0x7fabd00c06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60214/0 (socket says 172.21.15.37:60214) 2023-10-06T04:41:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc659c700 1 -- 172.21.15.37:0/704472720 learned_addr learned my addr 172.21.15.37:0/704472720 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabcf59e700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fabd00cbd50 0x7fabd00c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabced9d700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabd006e910 0x7fabd0156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc659c700 1 -- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fabd00cbd50 msgr2=0x7fabd00c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc659c700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fabd00cbd50 0x7fabd00c0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc659c700 1 -- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabd006e910 msgr2=0x7fabd0156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc659c700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabd006e910 0x7fabd0156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc659c700 1 -- 172.21.15.37:0/704472720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc8009a20 con 0x7fabd00c9820 2023-10-06T04:41:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc659c700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd00c9820 0x7fabd00c06e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fabb800cb90 tx=0x7fabb8001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc77fe700 1 -- 172.21.15.37:0/704472720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8007430 con 0x7fabd00c9820 2023-10-06T04:41:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabd523c700 1 -- 172.21.15.37:0/704472720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd015ffd0 con 0x7fabd00c9820 2023-10-06T04:41:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc77fe700 1 -- 172.21.15.37:0/704472720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb80075b0 con 0x7fabd00c9820 2023-10-06T04:41:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc77fe700 1 -- 172.21.15.37:0/704472720 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8004a80 con 0x7fabd00c9820 2023-10-06T04:41:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabd523c700 1 -- 172.21.15.37:0/704472720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd0160590 con 0x7fabd00c9820 2023-10-06T04:41:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabd523c700 1 -- 172.21.15.37:0/704472720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd0070ee0 con 0x7fabd00c9820 2023-10-06T04:41:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc77fe700 1 -- 172.21.15.37:0/704472720 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fabb800a590 con 0x7fabd00c9820 2023-10-06T04:41:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc77fe700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fabb0060550 0x7fabb0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.711+0000 7fabc77fe700 1 -- 172.21.15.37:0/704472720 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fabb807c1a0 con 0x7fabd00c9820 2023-10-06T04:41:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.715+0000 7fabced9d700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fabb0060550 0x7fabb0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:43.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.715+0000 7fabced9d700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fabb0060550 0x7fabb0062a00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009ca0 tx=0x7fabc0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.723+0000 7fabc77fe700 1 -- 172.21.15.37:0/704472720 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fabb804c730 con 0x7fabd00c9820 2023-10-06T04:41:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.879+0000 7fabd523c700 1 -- 172.21.15.37:0/704472720 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabd006da00 con 0x7fabb0060550 2023-10-06T04:41:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabc77fe700 1 -- 172.21.15.37:0/704472720 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71158 (secure 0 0 0) 0x7fabd006da00 con 0x7fabb0060550 2023-10-06T04:41:43.895 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:43.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabd523c700 1 -- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fabb0060550 msgr2=0x7fabb0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabd523c700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fabb0060550 0x7fabb0062a00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009ca0 tx=0x7fabc0008040 comp rx=0 tx=0).stop 2023-10-06T04:41:43.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabd523c700 1 -- 172.21.15.37:0/704472720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd00c9820 msgr2=0x7fabd00c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:43.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabd523c700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd00c9820 0x7fabd00c06e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fabb800cb90 tx=0x7fabb8001bd0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabd523c700 1 -- 172.21.15.37:0/704472720 shutdown_connections 2023-10-06T04:41:43.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabd523c700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fabb0060550 0x7fabb0062a00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabd523c700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fabd00cbd50 0x7fabd00c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabd523c700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd00c9820 0x7fabd00c06e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabd523c700 1 --2- 172.21.15.37:0/704472720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabd006e910 0x7fabd0156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:43.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabd523c700 1 -- 172.21.15.37:0/704472720 >> 172.21.15.37:0/704472720 conn(0x7fabd00667b0 msgr2=0x7fabd01576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:43.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabd523c700 1 -- 172.21.15.37:0/704472720 shutdown_connections 2023-10-06T04:41:43.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:43.891+0000 7fabd523c700 1 -- 172.21.15.37:0/704472720 wait complete. 2023-10-06T04:41:43.898 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:41:43.909 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2023-10-06T04:41:43.084484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2401640,"kb_used_data":6952,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752573080,"statfs":{"total":773094113280,"available":770634833920,"internally_reserved":0,"allocated":7118848,"data_stored":3939872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11535,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-49,"num_read_kb":-60,"num_write":-63,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002026"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.652022+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:41:40.652022+0000","last_peered":"2023-10-06T04:41:40.652022+0000","last_clean":"2023-10-06T04:41:40.652022+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:41:40.652022+0000","last_undegraded":"2023-10-06T04:41:40.652022+0000","last_fullsized":"2023-10-06T04:41:40.652022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.649428+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:41:40.649428+0000","last_peered":"2023-10-06T04:41:40.649428+0000","last_clean":"2023-10-06T04:41:40.649428+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:41:40.649428+0000","last_undegraded":"2023-10-06T04:41:40.649428+0000","last_fullsized":"2023-10-06T04:41:40.649428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.658180+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:41:40.658180+0000","last_peered":"2023-10-06T04:41:40.658180+0000","last_clean":"2023-10-06T04:41:40.658180+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:41:40.658180+0000","last_undegraded":"2023-10-06T04:41:40.658180+0000","last_fullsized":"2023-10-06T04:41:40.658180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.652860+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:41:40.652860+0000","last_peered":"2023-10-06T04:41:40.652860+0000","last_clean":"2023-10-06T04:41:40.652860+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:41:40.652860+0000","last_undegraded":"2023-10-06T04:41:40.652860+0000","last_fullsized":"2023-10-06T04:41:40.652860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.653367+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:41:40.653367+0000","last_peered":"2023-10-06T04:41:40.653367+0000","last_clean":"2023-10-06T04:41:40.653367+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:41:40.653367+0000","last_undegraded":"2023-10-06T04:41:40.653367+0000","last_fullsized":"2023-10-06T04:41:40.653367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:39.990185+0000","last_change":"2023-10-06T04:39:05.622804+0000","last_active":"2023-10-06T04:41:39.990185+0000","last_peered":"2023-10-06T04:41:39.990185+0000","last_clean":"2023-10-06T04:41:39.990185+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:41:39.990185+0000","last_undegraded":"2023-10-06T04:41:39.990185+0000","last_fullsized":"2023-10-06T04:41:39.990185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:34.088227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.655168+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:41:40.655168+0000","last_peered":"2023-10-06T04:41:40.655168+0000","last_clean":"2023-10-06T04:41:40.655168+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:41:40.655168+0000","last_undegraded":"2023-10-06T04:41:40.655168+0000","last_fullsized":"2023-10-06T04:41:40.655168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.654485+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:41:40.654485+0000","last_peered":"2023-10-06T04:41:40.654485+0000","last_clean":"2023-10-06T04:41:40.654485+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:41:40.654485+0000","last_undegraded":"2023-10-06T04:41:40.654485+0000","last_fullsized":"2023-10-06T04:41:40.654485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":198,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.655297+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:41:40.655297+0000","last_peered":"2023-10-06T04:41:40.655297+0000","last_clean":"2023-10-06T04:41:40.655297+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:41:40.655297+0000","last_undegraded":"2023-10-06T04:41:40.655297+0000","last_fullsized":"2023-10-06T04:41:40.655297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509478,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.92900000000000005,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.46100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.94299999999999995,"5min":1.673,"15min":1.673},"last":1.0129999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84299999999999997,"15min":0.84499999999999997},"min":{"1min":0.54900000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1439999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.1819999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.91400000000000003,"15min":0.92700000000000005},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.202,"5min":1.744,"15min":1.744},"last":1.417},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1910000000000001,"5min":1.323,"15min":1.323},"last":1.3580000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.008,"15min":1.016},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.329,"5min":1.802,"15min":1.802},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.1899999999999999,"15min":1.2},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.494,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.1200000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.171,"15min":1.177},"min":{"1min":0.79700000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5409999999999999,"5min":1.879,"15min":1.879},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.1220000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.45}]},{"osd":6,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1970000000000001,"15min":1.2090000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4850000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.167,"15min":1.1830000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3380000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.966}]},{"osd":7,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.212,"15min":1.23},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4099999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.871},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3109999999999999,"15min":1.3260000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.611,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.748}]}]},{"osd":0,"up_from":15,"seq":64424509476,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":935260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1879999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.95299999999999996,"15min":0.96099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.22,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1870000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.99099999999999999,"15min":0.98299999999999998},"min":{"1min":0.77900000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0089999999999999,"15min":1.018},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0660000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.167,"15min":1.179},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.3959999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1259999999999999,"15min":1.1379999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.482,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.3420000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.101,"15min":1.1120000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.2450000000000001,"15min":1.2569999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.5900000000000001,"5min":1.617,"15min":1.617},"last":1.393}]},{"osd":7,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.177,"15min":1.1870000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3759999999999999,"5min":1.385,"15min":1.385},"last":1.2350000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":935260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.196,"5min":3.347,"15min":3.347},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.93200000000000005,"15min":0.95199999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.244,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.628}]},{"osd":1,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85199999999999998,"15min":0.84399999999999997},"min":{"1min":0.58199999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.329},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2230000000000001,"5min":1.226,"15min":1.226},"last":1.052}]},{"osd":2,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.93600000000000005,"15min":0.93200000000000005},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.90800000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93700000000000006,"15min":0.92700000000000005},"min":{"1min":0.63700000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.109},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.1200000000000001,"15min":1.1399999999999999},"min":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.25,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.204}]},{"osd":4,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.94499999999999995,"15min":0.93600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.246},{"interface":"front","average":{"1min":1.052,"5min":1.1699999999999999,"15min":1.1899999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.3540000000000001,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":1.2949999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.107,"15min":1.1279999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.329,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.147},{"interface":"front","average":{"1min":1.131,"5min":1.123,"15min":1.121},"min":{"1min":0.81399999999999995,"5min":0.747,"15min":0.747},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.4059999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2470000000000001,"15min":1.262},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.423,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.2549999999999999,"15min":1.276},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.3799999999999999,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.2609999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.93700000000000006,"15min":0.93300000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.006,"15min":1.006},"min":{"1min":0.59699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0880000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.68400000000000005,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.141,"5min":1.268,"15min":1.268},"last":0.995},{"interface":"front","average":{"1min":0.879,"5min":0.85499999999999998,"15min":0.85099999999999998},"min":{"1min":0.61899999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.2250000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.98499999999999999,"15min":0.97499999999999998},"min":{"1min":0.875,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.995,"5min":1.054,"15min":1.0640000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.321,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.026}]},{"osd":3,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.04,"15min":1.05},"min":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.2729999999999999,"5min":1.448,"15min":1.448},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0700000000000001,"15min":1.0720000000000001},"min":{"1min":0.79000000000000004,"5min":0.752,"15min":0.752},"max":{"1min":1.4099999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1379999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.64100000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.198,"5min":1.389,"15min":1.389},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0489999999999999,"15min":1.0509999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.96599999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.044,"15min":1.046},"min":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.111,"15min":1.1080000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.87}]},{"osd":7,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1040000000000001,"15min":1.1000000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.95599999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.635,"5min":1.665,"15min":1.665},"last":1.1779999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.878,"15min":0.85499999999999998},"min":{"1min":0.58299999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.0069999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.97099999999999997,"15min":0.96499999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90100000000000002,"15min":0.89500000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2130000000000001,"5min":1.248,"15min":1.248},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0449999999999999,"15min":1.0329999999999999},"min":{"1min":0.73899999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":3.5310000000000001,"5min":3.5310000000000001,"15min":3.5310000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.0089999999999999,"15min":0.97699999999999998},"min":{"1min":0.70199999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":3.2229999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0369999999999999,"15min":1.0269999999999999},"min":{"1min":0.755,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.0609999999999999,"15min":1.034},"min":{"1min":0.84299999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.99099999999999999,"15min":0.98999999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.117,"5min":1.115,"15min":1.115},"min":{"1min":0.79200000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.83799999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.077,"15min":1.073},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.165,"5min":1.129,"15min":1.123},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.0940000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2,"15min":1.1990000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2410000000000001,"15min":1.2350000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":3.2120000000000002,"5min":3.2120000000000002,"15min":3.2120000000000002},"last":1.056}]}]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.85599999999999998,"15min":0.84399999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.01,"15min":1.0169999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2729999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.98199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.89800000000000002,"15min":0.89000000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2909999999999999,"5min":1.319,"15min":1.319},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.90800000000000003,"15min":0.91000000000000003},"min":{"1min":0.65400000000000003,"5min":0.62,"15min":0.62},"max":{"1min":1.159,"5min":1.256,"15min":1.256},"last":0.875}]},{"osd":2,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.024,"15min":1.03},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.624},{"interface":"front","average":{"1min":1.044,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3480000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.0569999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.96499999999999997,"15min":0.95699999999999996},"min":{"1min":0.72899999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1,"15min":1.006},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.361,"5min":1.47,"15min":1.47},"last":0.94399999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.76300000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.266,"5min":1.429,"15min":1.429},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.0569999999999999,"15min":1.044},"min":{"1min":0.69299999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.464,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2869999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0600000000000001,"15min":1.0549999999999999},"min":{"1min":0.80900000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.97199999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.3999999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2130000000000001,"15min":1.204},"min":{"1min":1,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.272,"15min":1.276},"min":{"1min":1.079,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.6459999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.321}]}]},{"osd":2,"up_from":14,"seq":60129542180,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.76200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0369999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55400000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.234,"15min":1.234},"last":0.78300000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.0740000000000001,"5min":1.284,"15min":1.284},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.751,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.046,"5min":1.123,"15min":1.123},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.044,"5min":1,"15min":0.99299999999999999},"min":{"1min":0.64400000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3680000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.94699999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.028,"15min":1.0289999999999999},"min":{"1min":0.70699999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.149,"15min":1.143},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.86899999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1859999999999999,"15min":1.181},"min":{"1min":0.86399999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.024},{"interface":"front","average":{"1min":1.117,"5min":1.085,"15min":1.079},"min":{"1min":0.90300000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.3720000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.88800000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2490000000000001,"15min":1.2569999999999999},"min":{"1min":0.93700000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4770000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.292,"15min":1.29},"min":{"1min":1.0669999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.6579999999999999,"5min":2.048,"15min":2.048},"last":1.1160000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1819999999999999,"15min":1.1739999999999999},"min":{"1min":0.94399999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2909999999999999,"15min":1.302},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.6060000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.155}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2589999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.0089999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.59599999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.464,"5min":1.53,"15min":1.53},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1699999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89400000000000002,"15min":0.88800000000000001},"min":{"1min":0.61599999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.349,"5min":1.903,"15min":1.903},"last":0.82399999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5760000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.24},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.71199999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.385,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.98699999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.153,"15min":1.1519999999999999},"min":{"1min":0.76800000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.675,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1240000000000001,"15min":1.121},"min":{"1min":0.81100000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3740000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.357}]},{"osd":6,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.216,"15min":1.2190000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5740000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.333},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.206,"15min":1.21},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.6619999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.1850000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.107,"15min":1.0980000000000001},"min":{"1min":0.79600000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.532,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.90400000000000003,"5min":0.624,"15min":0.624},"max":{"1min":1.7529999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.27}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:41:43.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:41:44.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.015+0000 7f4b3a1fc700 1 Processor -- start 2023-10-06T04:41:44.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.015+0000 7f4b3a1fc700 1 -- start start 2023-10-06T04:41:44.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b3a1fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4b3406e880 0x7f4b340caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:44.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b3a1fc700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340b1040 con 0x7f4b340cc230 2023-10-06T04:41:44.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b3a1fc700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340c06e0 con 0x7f4b34154660 2023-10-06T04:41:44.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b3a1fc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b340caf90 con 0x7f4b3406e880 2023-10-06T04:41:44.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b2bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4b340cc230 0x7f4b341572b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38250/0 (socket says 172.21.15.37:38250) 2023-10-06T04:41:44.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b2bfff700 1 -- 172.21.15.37:0/2434696317 learned_addr learned my addr 172.21.15.37:0/2434696317 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:44.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b33fff700 1 --2- 172.21.15.37:0/2434696317 >> v2:172.21.15.83:3300/0 conn(0x7f4b3406e880 0x7f4b340caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:44.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b33fff700 1 -- 172.21.15.37:0/2434696317 >> v1:172.21.15.83:6789/0 conn(0x7f4b34154660 legacy=0x7f4b340cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:44.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b33fff700 1 -- 172.21.15.37:0/2434696317 >> v1:172.21.15.37:6789/0 conn(0x7f4b340cc230 legacy=0x7f4b341572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:44.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b33fff700 1 -- 172.21.15.37:0/2434696317 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b340c0980 con 0x7f4b3406e880 2023-10-06T04:41:44.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b33fff700 1 --2- 172.21.15.37:0/2434696317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b3406e880 0x7f4b340caa50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009e60 tx=0x7f4b2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c606f81acefca2c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:44.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b32ffd700 1 -- 172.21.15.37:0/2434696317 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00e070 con 0x7f4b3406e880 2023-10-06T04:41:44.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b32ffd700 1 -- 172.21.15.37:0/2434696317 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c00bc30 con 0x7f4b3406e880 2023-10-06T04:41:44.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b32ffd700 1 -- 172.21.15.37:0/2434696317 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c012430 con 0x7f4b3406e880 2023-10-06T04:41:44.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/2434696317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b3406e880 msgr2=0x7f4b340caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b3a1fc700 1 --2- 172.21.15.37:0/2434696317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b3406e880 0x7f4b340caa50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009e60 tx=0x7f4b2c009780 comp rx=0 tx=0).stop 2023-10-06T04:41:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/2434696317 shutdown_connections 2023-10-06T04:41:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b3a1fc700 1 --2- 172.21.15.37:0/2434696317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b3406e880 0x7f4b340caa50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/2434696317 >> 172.21.15.37:0/2434696317 conn(0x7f4b340667b0 msgr2=0x7f4b34066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/2434696317 shutdown_connections 2023-10-06T04:41:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.019+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/2434696317 wait complete. 2023-10-06T04:41:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b3a1fc700 1 Processor -- start 2023-10-06T04:41:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b3a1fc700 1 -- start start 2023-10-06T04:41:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b3a1fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b3406e880 0x7f4b34159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b3a1fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b340cc230 0x7f4b34146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b3a1fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b34154660 0x7f4b340af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b3a1fc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3415c3d0 con 0x7f4b34154660 2023-10-06T04:41:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b3a1fc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3415b7c0 con 0x7f4b340cc230 2023-10-06T04:41:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b3a1fc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3415baa0 con 0x7f4b3406e880 2023-10-06T04:41:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b33fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b34154660 0x7f4b340af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b33fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b34154660 0x7f4b340af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60222/0 (socket says 172.21.15.37:60222) 2023-10-06T04:41:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b33fff700 1 -- 172.21.15.37:0/1020851974 learned_addr learned my addr 172.21.15.37:0/1020851974 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b2bfff700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b340cc230 0x7f4b34146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b337fe700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b3406e880 0x7f4b34159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b33fff700 1 -- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b3406e880 msgr2=0x7f4b34159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b33fff700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b3406e880 0x7f4b34159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b33fff700 1 -- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b340cc230 msgr2=0x7f4b34146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b33fff700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b340cc230 0x7f4b34146ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b33fff700 1 -- 172.21.15.37:0/1020851974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c009a20 con 0x7f4b34154660 2023-10-06T04:41:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.023+0000 7f4b33fff700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b34154660 0x7f4b340af8e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4b340cc840 tx=0x7f4b2c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.027+0000 7f4b2b7fe700 1 -- 172.21.15.37:0/1020851974 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c007000 con 0x7f4b34154660 2023-10-06T04:41:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.027+0000 7f4b2b7fe700 1 -- 172.21.15.37:0/1020851974 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c012e30 con 0x7f4b34154660 2023-10-06T04:41:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.027+0000 7f4b2b7fe700 1 -- 172.21.15.37:0/1020851974 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c01b850 con 0x7f4b34154660 2023-10-06T04:41:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.027+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/1020851974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3415bd80 con 0x7f4b34154660 2023-10-06T04:41:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.027+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/1020851974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b34159750 con 0x7f4b34154660 2023-10-06T04:41:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.027+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/1020851974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3415c540 con 0x7f4b34154660 2023-10-06T04:41:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.027+0000 7f4b2b7fe700 1 -- 172.21.15.37:0/1020851974 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4b2c01bc40 con 0x7f4b34154660 2023-10-06T04:41:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.027+0000 7f4b2b7fe700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4b14060550 0x7f4b14062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.027+0000 7f4b2b7fe700 1 -- 172.21.15.37:0/1020851974 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f4b2c07ea00 con 0x7f4b34154660 2023-10-06T04:41:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.027+0000 7f4b337fe700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4b14060550 0x7f4b14062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.031+0000 7f4b337fe700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4b14060550 0x7f4b14062a00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4b240039e0 tx=0x7f4b24007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.035+0000 7f4b2b7fe700 1 -- 172.21.15.37:0/1020851974 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4b2c04ef50 con 0x7f4b34154660 2023-10-06T04:41:44.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.199+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/1020851974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b34070ee0 con 0x7f4b34154660 2023-10-06T04:41:44.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.203+0000 7f4b2b7fe700 1 -- 172.21.15.37:0/1020851974 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+14066 (secure 0 0 0) 0x7f4b2c052570 con 0x7f4b34154660 2023-10-06T04:41:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:44.209 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"fsid":"77bb67cc-15eb-432c-9ac1-b724f40102d2","created":"2023-10-06T04:38:46.662955+0000","modified":"2023-10-06T04:41:40.985446+0000","last_up_change":"2023-10-06T04:38:57.561617+0000","last_in_change":"2023-10-06T04:38:48.712730+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:38:57.083952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:39:04.547586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"61e9946e-403f-4948-9740-1862fbe3105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":33416},{"type":"v1","addr":"172.21.15.37:6817","nonce":33416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":33416},{"type":"v1","addr":"172.21.15.37:6819","nonce":33416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":33416},{"type":"v1","addr":"172.21.15.37:6823","nonce":33416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":33416},{"type":"v1","addr":"172.21.15.37:6821","nonce":33416}]},"public_addr":"172.21.15.37:6817/33416","cluster_addr":"172.21.15.37:6819/33416","heartbeat_back_addr":"172.21.15.37:6823/33416","heartbeat_front_addr":"172.21.15.37:6821/33416","state":["exists","up"]},{"osd":1,"uuid":"43d3d13b-f3ee-4773-a9bb-3381f73c16e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":33414},{"type":"v1","addr":"172.21.15.37:6803","nonce":33414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":33414},{"type":"v1","addr":"172.21.15.37:6806","nonce":33414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":33414},{"type":"v1","addr":"172.21.15.37:6813","nonce":33414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":33414},{"type":"v1","addr":"172.21.15.37:6810","nonce":33414}]},"public_addr":"172.21.15.37:6803/33414","cluster_addr":"172.21.15.37:6806/33414","heartbeat_back_addr":"172.21.15.37:6813/33414","heartbeat_front_addr":"172.21.15.37:6810/33414","state":["exists","up"]},{"osd":2,"uuid":"0dc99a64-f6a6-414f-8e83-0e5d715cbd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":33415},{"type":"v1","addr":"172.21.15.37:6802","nonce":33415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":33415},{"type":"v1","addr":"172.21.15.37:6807","nonce":33415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":33415},{"type":"v1","addr":"172.21.15.37:6815","nonce":33415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":33415},{"type":"v1","addr":"172.21.15.37:6811","nonce":33415}]},"public_addr":"172.21.15.37:6802/33415","cluster_addr":"172.21.15.37:6807/33415","heartbeat_back_addr":"172.21.15.37:6815/33415","heartbeat_front_addr":"172.21.15.37:6811/33415","state":["exists","up"]},{"osd":3,"uuid":"3f3f6ae4-129d-4639-9327-723828581123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":33417},{"type":"v1","addr":"172.21.15.37:6825","nonce":33417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":33417},{"type":"v1","addr":"172.21.15.37:6827","nonce":33417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":33417},{"type":"v1","addr":"172.21.15.37:6831","nonce":33417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":33417},{"type":"v1","addr":"172.21.15.37:6829","nonce":33417}]},"public_addr":"172.21.15.37:6825/33417","cluster_addr":"172.21.15.37:6827/33417","heartbeat_back_addr":"172.21.15.37:6831/33417","heartbeat_front_addr":"172.21.15.37:6829/33417","state":["exists","up"]},{"osd":4,"uuid":"08659d6f-1c95-40c4-99ab-8179ed28fd85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":33662},{"type":"v1","addr":"172.21.15.83:6817","nonce":33662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":33662},{"type":"v1","addr":"172.21.15.83:6819","nonce":33662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":33662},{"type":"v1","addr":"172.21.15.83:6823","nonce":33662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":33662},{"type":"v1","addr":"172.21.15.83:6821","nonce":33662}]},"public_addr":"172.21.15.83:6817/33662","cluster_addr":"172.21.15.83:6819/33662","heartbeat_back_addr":"172.21.15.83:6823/33662","heartbeat_front_addr":"172.21.15.83:6821/33662","state":["exists","up"]},{"osd":5,"uuid":"a7470b79-8f88-4f4b-9fdb-0aacb6de8311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":33663},{"type":"v1","addr":"172.21.15.83:6801","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":33663},{"type":"v1","addr":"172.21.15.83:6803","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":33663},{"type":"v1","addr":"172.21.15.83:6807","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":33663},{"type":"v1","addr":"172.21.15.83:6805","nonce":33663}]},"public_addr":"172.21.15.83:6801/33663","cluster_addr":"172.21.15.83:6803/33663","heartbeat_back_addr":"172.21.15.83:6807/33663","heartbeat_front_addr":"172.21.15.83:6805/33663","state":["exists","up"]},{"osd":6,"uuid":"d2e1ba14-42a5-4eeb-87da-00d86fb901af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":33693},{"type":"v1","addr":"172.21.15.83:6809","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":33693},{"type":"v1","addr":"172.21.15.83:6811","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":33693},{"type":"v1","addr":"172.21.15.83:6815","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":33693},{"type":"v1","addr":"172.21.15.83:6813","nonce":33693}]},"public_addr":"172.21.15.83:6809/33693","cluster_addr":"172.21.15.83:6811/33693","heartbeat_back_addr":"172.21.15.83:6815/33693","heartbeat_front_addr":"172.21.15.83:6813/33693","state":["exists","up"]},{"osd":7,"uuid":"fbaa2bfd-b7b1-4c14-b952-1252d83181fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":33674},{"type":"v1","addr":"172.21.15.83:6825","nonce":33674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":33674},{"type":"v1","addr":"172.21.15.83:6827","nonce":33674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":33674},{"type":"v1","addr":"172.21.15.83:6831","nonce":33674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":33674},{"type":"v1","addr":"172.21.15.83:6829","nonce":33674}]},"public_addr":"172.21.15.83:6825/33674","cluster_addr":"172.21.15.83:6827/33674","heartbeat_back_addr":"172.21.15.83:6831/33674","heartbeat_front_addr":"172.21.15.83:6829/33674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.149860+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.743565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.913248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.208187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.125736+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.921478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:53.878819+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:38:54.278892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6835/1381995756":"2023-10-07T04:41:37.865975+0000","172.21.15.83:6834/1381995756":"2023-10-07T04:41:37.865975+0000","172.21.15.37:6835/3410822358":"2023-10-07T04:41:27.878627+0000","172.21.15.37:6834/3410822358":"2023-10-07T04:41:27.878627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:41:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.207+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4b14060550 msgr2=0x7f4b14062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.207+0000 7f4b3a1fc700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4b14060550 0x7f4b14062a00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4b240039e0 tx=0x7f4b24007ec0 comp rx=0 tx=0).stop 2023-10-06T04:41:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.207+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/1020851974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b34154660 msgr2=0x7f4b340af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.207+0000 7f4b3a1fc700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b34154660 0x7f4b340af8e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4b340cc840 tx=0x7f4b2c019000 comp rx=0 tx=0).stop 2023-10-06T04:41:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.207+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/1020851974 shutdown_connections 2023-10-06T04:41:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.207+0000 7f4b3a1fc700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f4b14060550 0x7f4b14062a00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.207+0000 7f4b3a1fc700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b340cc230 0x7f4b34146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.207+0000 7f4b3a1fc700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b34154660 0x7f4b340af8e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.207+0000 7f4b3a1fc700 1 --2- 172.21.15.37:0/1020851974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b3406e880 0x7f4b34159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.207+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/1020851974 >> 172.21.15.37:0/1020851974 conn(0x7f4b340667b0 msgr2=0x7f4b34152210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.207+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/1020851974 shutdown_connections 2023-10-06T04:41:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:44.207+0000 7f4b3a1fc700 1 -- 172.21.15.37:0/1020851974 wait complete. 2023-10-06T04:41:45.229 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T04:41:45.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:41:45.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb76439a700 1 Processor -- start 2023-10-06T04:41:45.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb76439a700 1 -- start start 2023-10-06T04:41:45.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb76439a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb75c0aed30 0x7fb75c0af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb76439a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb75c0cc6c0 0x7fb75c0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb76439a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c0af730 con 0x7fb75c159f90 2023-10-06T04:41:45.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb76439a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c15d920 con 0x7fb75c0cc6c0 2023-10-06T04:41:45.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb76439a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c0cd080 con 0x7fb75c0aed30 2023-10-06T04:41:45.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb762937700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb75c0cc6c0 0x7fb75c0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb762937700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb75c0cc6c0 0x7fb75c0ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60232/0 (socket says 172.21.15.37:60232) 2023-10-06T04:41:45.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb762937700 1 -- 172.21.15.37:0/1000591205 learned_addr learned my addr 172.21.15.37:0/1000591205 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:45.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb762136700 1 --2- 172.21.15.37:0/1000591205 >> v2:172.21.15.83:3300/0 conn(0x7fb75c0aed30 0x7fb75c0af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb762937700 1 -- 172.21.15.37:0/1000591205 >> v2:172.21.15.83:3300/0 conn(0x7fb75c0aed30 msgr2=0x7fb75c0af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:45.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb762937700 1 --2- 172.21.15.37:0/1000591205 >> v2:172.21.15.83:3300/0 conn(0x7fb75c0aed30 0x7fb75c0af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb762937700 1 -- 172.21.15.37:0/1000591205 >> v1:172.21.15.83:6789/0 conn(0x7fb75c159f90 legacy=0x7fb75c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb762937700 1 -- 172.21.15.37:0/1000591205 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c15c910 con 0x7fb75c0cc6c0 2023-10-06T04:41:45.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb762937700 1 --2- 172.21.15.37:0/1000591205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c0cc6c0 0x7fb75c0ccb40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb75c06a530 tx=0x7fb754009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7d5ff2ee5aeb65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:45.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb761134700 1 -- 172.21.15.37:0/1000591205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75400e070 con 0x7fb75c0cc6c0 2023-10-06T04:41:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb761134700 1 -- 172.21.15.37:0/1000591205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75400ba20 con 0x7fb75c0cc6c0 2023-10-06T04:41:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.351+0000 7fb761134700 1 -- 172.21.15.37:0/1000591205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7540092e0 con 0x7fb75c0cc6c0 2023-10-06T04:41:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 -- 172.21.15.37:0/1000591205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c0cc6c0 msgr2=0x7fb75c0ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 --2- 172.21.15.37:0/1000591205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c0cc6c0 0x7fb75c0ccb40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb75c06a530 tx=0x7fb754009840 comp rx=0 tx=0).stop 2023-10-06T04:41:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 -- 172.21.15.37:0/1000591205 shutdown_connections 2023-10-06T04:41:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 --2- 172.21.15.37:0/1000591205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c0cc6c0 0x7fb75c0ccb40 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 --2- 172.21.15.37:0/1000591205 >> v2:172.21.15.83:3300/0 conn(0x7fb75c0aed30 0x7fb75c0af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 -- 172.21.15.37:0/1000591205 >> 172.21.15.37:0/1000591205 conn(0x7fb75c067cf0 msgr2=0x7fb75c0680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 -- 172.21.15.37:0/1000591205 shutdown_connections 2023-10-06T04:41:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 -- 172.21.15.37:0/1000591205 wait complete. 2023-10-06T04:41:45.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 Processor -- start 2023-10-06T04:41:45.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 -- start start 2023-10-06T04:41:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb75c0aed30 0x7fb75c0c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb75c0cc6c0 0x7fb75c1493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c159f90 0x7fb75c1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0c6f40 con 0x7fb75c159f90 2023-10-06T04:41:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0c7770 con 0x7fb75c0aed30 2023-10-06T04:41:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb76439a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0b51b0 con 0x7fb75c0cc6c0 2023-10-06T04:41:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb762937700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c159f90 0x7fb75c1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb762937700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c159f90 0x7fb75c1498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60248/0 (socket says 172.21.15.37:60248) 2023-10-06T04:41:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb762937700 1 -- 172.21.15.37:0/3377402460 learned_addr learned my addr 172.21.15.37:0/3377402460 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb762136700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb75c0aed30 0x7fb75c0c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.355+0000 7fb761935700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb75c0cc6c0 0x7fb75c1493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.359+0000 7fb762937700 1 -- 172.21.15.37:0/3377402460 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb75c0cc6c0 msgr2=0x7fb75c1493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.359+0000 7fb762937700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb75c0cc6c0 0x7fb75c1493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.359+0000 7fb762937700 1 -- 172.21.15.37:0/3377402460 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb75c0aed30 msgr2=0x7fb75c0c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.359+0000 7fb762937700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb75c0aed30 0x7fb75c0c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.359+0000 7fb762937700 1 -- 172.21.15.37:0/3377402460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754009ae0 con 0x7fb75c159f90 2023-10-06T04:41:45.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.359+0000 7fb762937700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c159f90 0x7fb75c1498f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb75c088e00 tx=0x7fb754018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:45.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.359+0000 7fb7527fc700 1 -- 172.21.15.37:0/3377402460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754008a80 con 0x7fb75c159f90 2023-10-06T04:41:45.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.359+0000 7fb7527fc700 1 -- 172.21.15.37:0/3377402460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb754008c00 con 0x7fb75c159f90 2023-10-06T04:41:45.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.359+0000 7fb76439a700 1 -- 172.21.15.37:0/3377402460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c0c7120 con 0x7fb75c159f90 2023-10-06T04:41:45.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.359+0000 7fb7527fc700 1 -- 172.21.15.37:0/3377402460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75401c410 con 0x7fb75c159f90 2023-10-06T04:41:45.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.359+0000 7fb76439a700 1 -- 172.21.15.37:0/3377402460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c0ca060 con 0x7fb75c159f90 2023-10-06T04:41:45.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.359+0000 7fb76439a700 1 -- 172.21.15.37:0/3377402460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb75c04be00 con 0x7fb75c159f90 2023-10-06T04:41:45.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.363+0000 7fb7527fc700 1 -- 172.21.15.37:0/3377402460 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb754003040 con 0x7fb75c159f90 2023-10-06T04:41:45.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.363+0000 7fb7527fc700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb740060550 0x7fb740062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.363+0000 7fb7527fc700 1 -- 172.21.15.37:0/3377402460 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fb75407e330 con 0x7fb75c159f90 2023-10-06T04:41:45.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.363+0000 7fb7527fc700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x7fb740066f80 0x7fb7400693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.363+0000 7fb7527fc700 1 -- 172.21.15.37:0/3377402460 --> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb740069a80 con 0x7fb740066f80 2023-10-06T04:41:45.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.363+0000 7fb7527fc700 1 -- 172.21.15.37:0/3377402460 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb75407e700 con 0x7fb75c159f90 2023-10-06T04:41:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.363+0000 7fb762136700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb740060550 0x7fb740062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.363+0000 7fb761935700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x7fb740066f80 0x7fb7400693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.363+0000 7fb761935700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x7fb740066f80 0x7fb7400693b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.363+0000 7fb762136700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb740060550 0x7fb740062a00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb758009d00 tx=0x7fb758009120 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.363+0000 7fb7527fc700 1 -- 172.21.15.37:0/3377402460 <== osd.0 v2:172.21.15.37:6816/33416 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb740069a80 con 0x7fb740066f80 2023-10-06T04:41:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb76439a700 1 -- 172.21.15.37:0/3377402460 --> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb75c068370 con 0x7fb740066f80 2023-10-06T04:41:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb7527fc700 1 -- 172.21.15.37:0/3377402460 <== osd.0 v2:172.21.15.37:6816/33416 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb75c068370 con 0x7fb740066f80 2023-10-06T04:41:45.388 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:41:45.389 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:41:45.389 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:41:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb76439a700 1 -- 172.21.15.37:0/3377402460 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x7fb740066f80 msgr2=0x7fb7400693b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb76439a700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.37:6816/33416,v1:172.21.15.37:6817/33416] conn(0x7fb740066f80 0x7fb7400693b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb76439a700 1 -- 172.21.15.37:0/3377402460 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb740060550 msgr2=0x7fb740062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb76439a700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fb740060550 0x7fb740062a00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb758009d00 tx=0x7fb758009120 comp rx=0 tx=0).stop 2023-10-06T04:41:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb76439a700 1 -- 172.21.15.37:0/3377402460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c159f90 msgr2=0x7fb75c1498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb76439a700 1 --2- 172.21.15.37:0/3377402460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c159f90 0x7fb75c1498f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb75c088e00 tx=0x7fb754018000 comp rx=0 tx=0).stop 2023-10-06T04:41:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb762937700 1 -- 172.21.15.37:0/3377402460 reap_dead start 2023-10-06T04:41:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb76439a700 1 -- 172.21.15.37:0/3377402460 shutdown_connections 2023-10-06T04:41:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb76439a700 1 -- 172.21.15.37:0/3377402460 >> 172.21.15.37:0/3377402460 conn(0x7fb75c067cf0 msgr2=0x7fb75c15b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb76439a700 1 -- 172.21.15.37:0/3377402460 shutdown_connections 2023-10-06T04:41:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.383+0000 7fb76439a700 1 -- 172.21.15.37:0/3377402460 wait complete. 2023-10-06T04:41:45.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T04:41:45.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.515+0000 7f390399a700 1 Processor -- start 2023-10-06T04:41:45.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.515+0000 7f390399a700 1 -- start start 2023-10-06T04:41:45.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38fc0acf30 0x7f38fc068e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38fc06d290 0x7f38fc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38fc06a0a0 con 0x7f38fc0b3590 2023-10-06T04:41:45.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38fc06dc10 con 0x7f38fc0acf30 2023-10-06T04:41:45.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc0ad300 con 0x7f38fc06d290 2023-10-06T04:41:45.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f3901736700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38fc0acf30 0x7f38fc068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f3901736700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38fc0acf30 0x7f38fc068e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60260/0 (socket says 172.21.15.37:60260) 2023-10-06T04:41:45.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f3901736700 1 -- 172.21.15.37:0/1133459159 learned_addr learned my addr 172.21.15.37:0/1133459159 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:45.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f3901f37700 1 --2- 172.21.15.37:0/1133459159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38fc06d290 0x7f38fc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f3901736700 1 -- 172.21.15.37:0/1133459159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38fc06d290 msgr2=0x7f38fc06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:45.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f3901736700 1 --2- 172.21.15.37:0/1133459159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38fc06d290 0x7f38fc06d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f3901736700 1 -- 172.21.15.37:0/1133459159 >> v1:172.21.15.83:6789/0 conn(0x7f38fc0b3590 legacy=0x7f38fc06a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f3901736700 1 -- 172.21.15.37:0/1133459159 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc0b3a10 con 0x7f38fc0acf30 2023-10-06T04:41:45.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f3901736700 1 --2- 172.21.15.37:0/1133459159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc0acf30 0x7f38fc068e00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0b3c00 tx=0x7f38f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d040267c86403b97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:45.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f38f3fff700 1 -- 172.21.15.37:0/1133459159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f800b860 con 0x7f38fc0acf30 2023-10-06T04:41:45.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f38f3fff700 1 -- 172.21.15.37:0/1133459159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f800b9c0 con 0x7f38fc0acf30 2023-10-06T04:41:45.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f38f3fff700 1 -- 172.21.15.37:0/1133459159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f800bd80 con 0x7f38fc0acf30 2023-10-06T04:41:45.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 -- 172.21.15.37:0/1133459159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc0acf30 msgr2=0x7f38fc068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 --2- 172.21.15.37:0/1133459159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc0acf30 0x7f38fc068e00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0b3c00 tx=0x7f38f8009250 comp rx=0 tx=0).stop 2023-10-06T04:41:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 -- 172.21.15.37:0/1133459159 shutdown_connections 2023-10-06T04:41:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 --2- 172.21.15.37:0/1133459159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38fc06d290 0x7f38fc06d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 --2- 172.21.15.37:0/1133459159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc0acf30 0x7f38fc068e00 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 -- 172.21.15.37:0/1133459159 >> 172.21.15.37:0/1133459159 conn(0x7f38fc06c430 msgr2=0x7f38fc0af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 -- 172.21.15.37:0/1133459159 shutdown_connections 2023-10-06T04:41:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.519+0000 7f390399a700 1 -- 172.21.15.37:0/1133459159 wait complete. 2023-10-06T04:41:45.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f390399a700 1 Processor -- start 2023-10-06T04:41:45.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f390399a700 1 -- start start 2023-10-06T04:41:45.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f390399a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38fc06d290 0x7f38fc169c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f390399a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc0acf30 0x7f38fc0cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f390399a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38fc0b3590 0x7f38fc0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f390399a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc15e170 con 0x7f38fc0acf30 2023-10-06T04:41:45.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f390399a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc15d560 con 0x7f38fc06d290 2023-10-06T04:41:45.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f390399a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc15d840 con 0x7f38fc0b3590 2023-10-06T04:41:45.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f3900f35700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc0acf30 0x7f38fc0cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f3900f35700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc0acf30 0x7f38fc0cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60262/0 (socket says 172.21.15.37:60262) 2023-10-06T04:41:45.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f3901736700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38fc06d290 0x7f38fc169c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f3900f35700 1 -- 172.21.15.37:0/3119503233 learned_addr learned my addr 172.21.15.37:0/3119503233 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:45.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f3901f37700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38fc0b3590 0x7f38fc0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f3900f35700 1 -- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38fc0b3590 msgr2=0x7f38fc0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f3900f35700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38fc0b3590 0x7f38fc0cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f3900f35700 1 -- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38fc06d290 msgr2=0x7f38fc169c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f3900f35700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38fc06d290 0x7f38fc169c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f3900f35700 1 -- 172.21.15.37:0/3119503233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f80094f0 con 0x7f38fc0acf30 2023-10-06T04:41:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.523+0000 7f3901736700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38fc06d290 0x7f38fc169c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.527+0000 7f3900f35700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc0acf30 0x7f38fc0cbf30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c4e0 tx=0x7f38ec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.527+0000 7f38f17fa700 1 -- 172.21.15.37:0/3119503233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec011590 con 0x7f38fc0acf30 2023-10-06T04:41:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.527+0000 7f38f17fa700 1 -- 172.21.15.37:0/3119503233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec011710 con 0x7f38fc0acf30 2023-10-06T04:41:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.527+0000 7f390399a700 1 -- 172.21.15.37:0/3119503233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38fc15db20 con 0x7f38fc0acf30 2023-10-06T04:41:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.527+0000 7f38f17fa700 1 -- 172.21.15.37:0/3119503233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec011ad0 con 0x7f38fc0acf30 2023-10-06T04:41:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.527+0000 7f390399a700 1 -- 172.21.15.37:0/3119503233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38fc16a190 con 0x7f38fc0acf30 2023-10-06T04:41:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.527+0000 7f390399a700 1 -- 172.21.15.37:0/3119503233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38fc0c96f0 con 0x7f38fc0acf30 2023-10-06T04:41:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.527+0000 7f38f17fa700 1 -- 172.21.15.37:0/3119503233 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f38ec01b3b0 con 0x7f38fc0acf30 2023-10-06T04:41:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.527+0000 7f38f17fa700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f38e0060550 0x7f38e0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.527+0000 7f38f17fa700 1 -- 172.21.15.37:0/3119503233 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f38ec07bbc0 con 0x7f38fc0acf30 2023-10-06T04:41:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.527+0000 7f3901736700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f38e0060550 0x7f38e0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.531+0000 7f3901736700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f38e0060550 0x7f38e0062a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0b3c00 tx=0x7f38f8016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.535+0000 7f38f17fa700 1 -- 172.21.15.37:0/3119503233 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f38ec04c1b0 con 0x7f38fc0acf30 2023-10-06T04:41:45.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.703+0000 7f390399a700 1 -- 172.21.15.37:0/3119503233 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f38fc070ee0 con 0x7f38e0060550 2023-10-06T04:41:45.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.703+0000 7f38f17fa700 1 -- 172.21.15.37:0/3119503233 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38fc070ee0 con 0x7f38e0060550 2023-10-06T04:41:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.707+0000 7f390399a700 1 -- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f38e0060550 msgr2=0x7f38e0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.707+0000 7f390399a700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f38e0060550 0x7f38e0062a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0b3c00 tx=0x7f38f8016000 comp rx=0 tx=0).stop 2023-10-06T04:41:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.707+0000 7f390399a700 1 -- 172.21.15.37:0/3119503233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc0acf30 msgr2=0x7f38fc0cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.707+0000 7f390399a700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc0acf30 0x7f38fc0cbf30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c4e0 tx=0x7f38ec00c7f0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.707+0000 7f390399a700 1 -- 172.21.15.37:0/3119503233 shutdown_connections 2023-10-06T04:41:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.707+0000 7f390399a700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f38e0060550 0x7f38e0062a00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.707+0000 7f390399a700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38fc0b3590 0x7f38fc0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.707+0000 7f390399a700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc0acf30 0x7f38fc0cbf30 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.707+0000 7f390399a700 1 --2- 172.21.15.37:0/3119503233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38fc06d290 0x7f38fc169c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.707+0000 7f390399a700 1 -- 172.21.15.37:0/3119503233 >> 172.21.15.37:0/3119503233 conn(0x7f38fc06c430 msgr2=0x7f38fc159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.707+0000 7f390399a700 1 -- 172.21.15.37:0/3119503233 shutdown_connections 2023-10-06T04:41:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.707+0000 7f390399a700 1 -- 172.21.15.37:0/3119503233 wait complete. 2023-10-06T04:41:45.716 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T04:41:45.729 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T04:41:45.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:41:45.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.835+0000 7f49ecafa700 1 Processor -- start 2023-10-06T04:41:45.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.835+0000 7f49ecafa700 1 -- start start 2023-10-06T04:41:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.835+0000 7f49ecafa700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49e8159f90 0x7f49e80af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49ecafa700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e80af730 con 0x7f49e80aed30 2023-10-06T04:41:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49ecafa700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e815c910 con 0x7f49e80cc6c0 2023-10-06T04:41:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49ecafa700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e815d920 con 0x7f49e8159f90 2023-10-06T04:41:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49e5d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49e8159f90 0x7f49e80af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49e5d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49e8159f90 0x7f49e80af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60278/0 (socket says 172.21.15.37:60278) 2023-10-06T04:41:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49e5d9b700 1 -- 172.21.15.37:0/159460679 learned_addr learned my addr 172.21.15.37:0/159460679 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49e659c700 1 --1- 172.21.15.37:0/159460679 >> v1:172.21.15.37:6789/0 conn(0x7f49e80aed30 0x7f49e80cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38260/0 (socket says 172.21.15.37:38260) 2023-10-06T04:41:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49e5d9b700 1 -- 172.21.15.37:0/159460679 >> v1:172.21.15.83:6789/0 conn(0x7f49e80cc6c0 legacy=0x7f49e80cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49e5d9b700 1 -- 172.21.15.37:0/159460679 >> v1:172.21.15.37:6789/0 conn(0x7f49e80aed30 legacy=0x7f49e80cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49e5d9b700 1 -- 172.21.15.37:0/159460679 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e815d490 con 0x7f49e8159f90 2023-10-06T04:41:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49e5d9b700 1 --2- 172.21.15.37:0/159460679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8159f90 0x7f49e80af100 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f49d80099b0 tx=0x7f49d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37f38051c741977 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49e559a700 1 -- 172.21.15.37:0/159460679 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800b860 con 0x7f49e8159f90 2023-10-06T04:41:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49e559a700 1 -- 172.21.15.37:0/159460679 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d800b9c0 con 0x7f49e8159f90 2023-10-06T04:41:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49e559a700 1 -- 172.21.15.37:0/159460679 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800bd60 con 0x7f49e8159f90 2023-10-06T04:41:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49ecafa700 1 -- 172.21.15.37:0/159460679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8159f90 msgr2=0x7f49e80af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49ecafa700 1 --2- 172.21.15.37:0/159460679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8159f90 0x7f49e80af100 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f49d80099b0 tx=0x7f49d8009250 comp rx=0 tx=0).stop 2023-10-06T04:41:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49ecafa700 1 -- 172.21.15.37:0/159460679 shutdown_connections 2023-10-06T04:41:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49ecafa700 1 --2- 172.21.15.37:0/159460679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8159f90 0x7f49e80af100 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49ecafa700 1 -- 172.21.15.37:0/159460679 >> 172.21.15.37:0/159460679 conn(0x7f49e8067cf0 msgr2=0x7f49e80680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49ecafa700 1 -- 172.21.15.37:0/159460679 shutdown_connections 2023-10-06T04:41:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.839+0000 7f49ecafa700 1 -- 172.21.15.37:0/159460679 wait complete. 2023-10-06T04:41:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49ecafa700 1 Processor -- start 2023-10-06T04:41:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49ecafa700 1 -- start start 2023-10-06T04:41:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49ecafa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80aed30 0x7f49e814b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49ecafa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49e80cc6c0 0x7f49e80b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49ecafa700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49e8159f90 0x7f49e80c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49ecafa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80ca490 con 0x7f49e80aed30 2023-10-06T04:41:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49ecafa700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80b2bd0 con 0x7f49e80cc6c0 2023-10-06T04:41:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49ecafa700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80c8420 con 0x7f49e8159f90 2023-10-06T04:41:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80aed30 0x7f49e814b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80aed30 0x7f49e814b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60290/0 (socket says 172.21.15.37:60290) 2023-10-06T04:41:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49e659c700 1 -- 172.21.15.37:0/2576125332 learned_addr learned my addr 172.21.15.37:0/2576125332 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49e5d9b700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49e80cc6c0 0x7f49e80b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49e6d9d700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49e8159f90 0x7f49e80c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49e659c700 1 -- 172.21.15.37:0/2576125332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49e8159f90 msgr2=0x7f49e80c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49e659c700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49e8159f90 0x7f49e80c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49e659c700 1 -- 172.21.15.37:0/2576125332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49e80cc6c0 msgr2=0x7f49e80b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49e659c700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49e80cc6c0 0x7f49e80b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49e659c700 1 -- 172.21.15.37:0/2576125332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80094f0 con 0x7f49e80aed30 2023-10-06T04:41:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.843+0000 7f49e6d9d700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49e8159f90 0x7f49e80c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.847+0000 7f49e659c700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80aed30 0x7f49e814b830 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00c560 tx=0x7f49dc007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.847+0000 7f49d67fc700 1 -- 172.21.15.37:0/2576125332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0072e0 con 0x7f49e80aed30 2023-10-06T04:41:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.847+0000 7f49d67fc700 1 -- 172.21.15.37:0/2576125332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc007440 con 0x7f49e80aed30 2023-10-06T04:41:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.847+0000 7f49ecafa700 1 -- 172.21.15.37:0/2576125332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e80c7b80 con 0x7f49e80aed30 2023-10-06T04:41:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.847+0000 7f49d67fc700 1 -- 172.21.15.37:0/2576125332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0057f0 con 0x7f49e80aed30 2023-10-06T04:41:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.847+0000 7f49ecafa700 1 -- 172.21.15.37:0/2576125332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e80c8140 con 0x7f49e80aed30 2023-10-06T04:41:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.847+0000 7f49ecafa700 1 -- 172.21.15.37:0/2576125332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49e804be00 con 0x7f49e80aed30 2023-10-06T04:41:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.847+0000 7f49d67fc700 1 -- 172.21.15.37:0/2576125332 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f49dc005ba0 con 0x7f49e80aed30 2023-10-06T04:41:45.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.851+0000 7f49d67fc700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f49c8060620 0x7f49c8062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.851+0000 7f49d67fc700 1 -- 172.21.15.37:0/2576125332 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f49dc07bc80 con 0x7f49e80aed30 2023-10-06T04:41:45.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.851+0000 7f49e5d9b700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f49c8060620 0x7f49c8062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.851+0000 7f49d67fc700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] conn(0x7f49c8067050 0x7f49c8069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.851+0000 7f49d67fc700 1 -- 172.21.15.37:0/2576125332 --> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49c8069b50 con 0x7f49c8067050 2023-10-06T04:41:45.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.851+0000 7f49d67fc700 1 -- 172.21.15.37:0/2576125332 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49dc080220 con 0x7f49e80aed30 2023-10-06T04:41:45.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.851+0000 7f49e6d9d700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] conn(0x7f49c8067050 0x7f49c8069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.851+0000 7f49e6d9d700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] conn(0x7f49c8067050 0x7f49c8069480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:45.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.851+0000 7f49e5d9b700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f49c8060620 0x7f49c8062ad0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f49d80099b0 tx=0x7f49d8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:45.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.851+0000 7f49d67fc700 1 -- 172.21.15.37:0/2576125332 <== osd.1 v2:172.21.15.37:6801/33414 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f49c8069b50 con 0x7f49c8067050 2023-10-06T04:41:45.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49ecafa700 1 -- 172.21.15.37:0/2576125332 --> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f49e815cb60 con 0x7f49c8067050 2023-10-06T04:41:45.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49d67fc700 1 -- 172.21.15.37:0/2576125332 <== osd.1 v2:172.21.15.37:6801/33414 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f49e815cb60 con 0x7f49c8067050 2023-10-06T04:41:45.875 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:41:45.875 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:41:45.876 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:41:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49ecafa700 1 -- 172.21.15.37:0/2576125332 >> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] conn(0x7f49c8067050 msgr2=0x7f49c8069480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49ecafa700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.37:6801/33414,v1:172.21.15.37:6803/33414] conn(0x7f49c8067050 0x7f49c8069480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49ecafa700 1 -- 172.21.15.37:0/2576125332 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f49c8060620 msgr2=0x7f49c8062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49ecafa700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f49c8060620 0x7f49c8062ad0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f49d80099b0 tx=0x7f49d8017000 comp rx=0 tx=0).stop 2023-10-06T04:41:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49ecafa700 1 -- 172.21.15.37:0/2576125332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80aed30 msgr2=0x7f49e814b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49ecafa700 1 --2- 172.21.15.37:0/2576125332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80aed30 0x7f49e814b830 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00c560 tx=0x7f49dc007f00 comp rx=0 tx=0).stop 2023-10-06T04:41:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49e6d9d700 1 -- 172.21.15.37:0/2576125332 reap_dead start 2023-10-06T04:41:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49ecafa700 1 -- 172.21.15.37:0/2576125332 shutdown_connections 2023-10-06T04:41:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49ecafa700 1 -- 172.21.15.37:0/2576125332 >> 172.21.15.37:0/2576125332 conn(0x7f49e8067cf0 msgr2=0x7f49e8157bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49ecafa700 1 -- 172.21.15.37:0/2576125332 shutdown_connections 2023-10-06T04:41:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.867+0000 7f49ecafa700 1 -- 172.21.15.37:0/2576125332 wait complete. 2023-10-06T04:41:45.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T04:41:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.987+0000 7f037c902700 1 Processor -- start 2023-10-06T04:41:45.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.987+0000 7f037c902700 1 -- start start 2023-10-06T04:41:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037c902700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0378158aa0 0x7f0378158e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037c902700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f03780cb1e0 0x7f037806c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037c902700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03780ac1a0 con 0x7f0378067cf0 2023-10-06T04:41:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037c902700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037806cca0 con 0x7f03780cb1e0 2023-10-06T04:41:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037c902700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037806cee0 con 0x7f0378158aa0 2023-10-06T04:41:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f0376d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0378158aa0 0x7f0378158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f036ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f03780cb1e0 0x7f037806c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037759e700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f0378067cf0 0x7f037806e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:52522/0 (socket says 172.21.15.37:52522) 2023-10-06T04:41:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037759e700 1 -- 172.21.15.37:0/2925079158 learned_addr learned my addr 172.21.15.37:0/2925079158 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037659c700 1 -- 172.21.15.37:0/2925079158 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033734175 0 0) 0x7f03780ac1a0 con 0x7f0378067cf0 2023-10-06T04:41:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037659c700 1 -- 172.21.15.37:0/2925079158 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0364003570 con 0x7f0378067cf0 2023-10-06T04:41:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f0376d9d700 1 -- 172.21.15.37:0/2925079158 >> v2:172.21.15.83:3300/0 conn(0x7f03780cb1e0 msgr2=0x7f037806c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f0376d9d700 1 --2- 172.21.15.37:0/2925079158 >> v2:172.21.15.83:3300/0 conn(0x7f03780cb1e0 0x7f037806c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f0376d9d700 1 -- 172.21.15.37:0/2925079158 >> v1:172.21.15.83:6789/0 conn(0x7f0378067cf0 legacy=0x7f037806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f0376d9d700 1 -- 172.21.15.37:0/2925079158 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780c7560 con 0x7f0378158aa0 2023-10-06T04:41:46.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f036ffff700 1 --2- 172.21.15.37:0/2925079158 >> v2:172.21.15.83:3300/0 conn(0x7f03780cb1e0 0x7f037806c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:46.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f0376d9d700 1 --2- 172.21.15.37:0/2925079158 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0378158aa0 0x7f0378158e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f03680098e0 tx=0x7f03680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeed239be9c8e64f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037659c700 1 -- 172.21.15.37:0/2925079158 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368011630 con 0x7f0378158aa0 2023-10-06T04:41:46.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037659c700 1 -- 172.21.15.37:0/2925079158 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0368011790 con 0x7f0378158aa0 2023-10-06T04:41:46.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037659c700 1 -- 172.21.15.37:0/2925079158 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368011b10 con 0x7f0378158aa0 2023-10-06T04:41:46.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037c902700 1 -- 172.21.15.37:0/2925079158 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0378158aa0 msgr2=0x7f0378158e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.991+0000 7f037c902700 1 --2- 172.21.15.37:0/2925079158 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0378158aa0 0x7f0378158e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f03680098e0 tx=0x7f03680091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.995+0000 7f037c902700 1 -- 172.21.15.37:0/2925079158 shutdown_connections 2023-10-06T04:41:46.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.995+0000 7f037c902700 1 --2- 172.21.15.37:0/2925079158 >> v2:172.21.15.83:3300/0 conn(0x7f03780cb1e0 0x7f037806c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.995+0000 7f037c902700 1 --2- 172.21.15.37:0/2925079158 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0378158aa0 0x7f0378158e70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.995+0000 7f037c902700 1 -- 172.21.15.37:0/2925079158 >> 172.21.15.37:0/2925079158 conn(0x7f037806b1c0 msgr2=0x7f03780cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:46.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.995+0000 7f037c902700 1 -- 172.21.15.37:0/2925079158 shutdown_connections 2023-10-06T04:41:46.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.995+0000 7f037c902700 1 -- 172.21.15.37:0/2925079158 wait complete. 2023-10-06T04:41:46.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.995+0000 7f037c902700 1 Processor -- start 2023-10-06T04:41:46.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.995+0000 7f037c902700 1 -- start start 2023-10-06T04:41:46.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f037c902700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0378067cf0 0x7f03780c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f037c902700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03780cb1e0 0x7f037815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f037c902700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0378158aa0 0x7f03780c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f037c902700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037815baf0 con 0x7f03780cb1e0 2023-10-06T04:41:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f037c902700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780c3a60 con 0x7f0378158aa0 2023-10-06T04:41:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f037c902700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037815bd20 con 0x7f0378067cf0 2023-10-06T04:41:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f036ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03780cb1e0 0x7f037815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f036ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03780cb1e0 0x7f037815b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60298/0 (socket says 172.21.15.37:60298) 2023-10-06T04:41:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f036ffff700 1 -- 172.21.15.37:0/1249242632 learned_addr learned my addr 172.21.15.37:0/1249242632 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f037759e700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0378158aa0 0x7f03780c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f0376d9d700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0378067cf0 0x7f03780c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f036ffff700 1 -- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0378067cf0 msgr2=0x7f03780c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f036ffff700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0378067cf0 0x7f03780c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f036ffff700 1 -- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0378158aa0 msgr2=0x7f03780c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f036ffff700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0378158aa0 0x7f03780c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f036ffff700 1 -- 172.21.15.37:0/1249242632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0360009420 con 0x7f03780cb1e0 2023-10-06T04:41:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f036ffff700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03780cb1e0 0x7f037815b5b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f036000ec80 tx=0x7f03600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f036effd700 1 -- 172.21.15.37:0/1249242632 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036000c920 con 0x7f03780cb1e0 2023-10-06T04:41:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f036effd700 1 -- 172.21.15.37:0/1249242632 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036000ca80 con 0x7f03780cb1e0 2023-10-06T04:41:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f037c902700 1 -- 172.21.15.37:0/1249242632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0368009420 con 0x7f03780cb1e0 2023-10-06T04:41:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f036effd700 1 -- 172.21.15.37:0/1249242632 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036000ce00 con 0x7f03780cb1e0 2023-10-06T04:41:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:45.999+0000 7f037c902700 1 -- 172.21.15.37:0/1249242632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037815c2e0 con 0x7f03780cb1e0 2023-10-06T04:41:46.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.003+0000 7f037c902700 1 -- 172.21.15.37:0/1249242632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03780c3bd0 con 0x7f03780cb1e0 2023-10-06T04:41:46.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.003+0000 7f036effd700 1 -- 172.21.15.37:0/1249242632 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0360013680 con 0x7f03780cb1e0 2023-10-06T04:41:46.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.003+0000 7f036effd700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0358060580 0x7f0358062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.003+0000 7f036effd700 1 -- 172.21.15.37:0/1249242632 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f036007cb00 con 0x7f03780cb1e0 2023-10-06T04:41:46.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.003+0000 7f0376d9d700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0358060580 0x7f0358062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.007+0000 7f0376d9d700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0358060580 0x7f0358062a30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f03680091e0 tx=0x7f0368017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.011+0000 7f036effd700 1 -- 172.21.15.37:0/1249242632 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f03780c3bd0 con 0x7f03780cb1e0 2023-10-06T04:41:46.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.175+0000 7f037c902700 1 -- 172.21.15.37:0/1249242632 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f03780c3bd0 con 0x7f0358060580 2023-10-06T04:41:46.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f036effd700 1 -- 172.21.15.37:0/1249242632 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f03780c3bd0 con 0x7f0358060580 2023-10-06T04:41:46.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f037c902700 1 -- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0358060580 msgr2=0x7f0358062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f037c902700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0358060580 0x7f0358062a30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f03680091e0 tx=0x7f0368017000 comp rx=0 tx=0).stop 2023-10-06T04:41:46.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f037c902700 1 -- 172.21.15.37:0/1249242632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03780cb1e0 msgr2=0x7f037815b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f037c902700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03780cb1e0 0x7f037815b5b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f036000ec80 tx=0x7f03600091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f037c902700 1 -- 172.21.15.37:0/1249242632 shutdown_connections 2023-10-06T04:41:46.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f037c902700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f0358060580 0x7f0358062a30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f037c902700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0378158aa0 0x7f03780c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f037c902700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03780cb1e0 0x7f037815b5b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f037c902700 1 --2- 172.21.15.37:0/1249242632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0378067cf0 0x7f03780c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f037c902700 1 -- 172.21.15.37:0/1249242632 >> 172.21.15.37:0/1249242632 conn(0x7f037806b1c0 msgr2=0x7f0378157420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f037c902700 1 -- 172.21.15.37:0/1249242632 shutdown_connections 2023-10-06T04:41:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.179+0000 7f037c902700 1 -- 172.21.15.37:0/1249242632 wait complete. 2023-10-06T04:41:46.188 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T04:41:46.203 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T04:41:46.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.311+0000 7ff762dfe700 1 Processor -- start 2023-10-06T04:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.311+0000 7ff762dfe700 1 -- start start 2023-10-06T04:41:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff762dfe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff75c14c6e0 0x7ff75c0c9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff762dfe700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c0c9cd0 con 0x7ff75c0c7ab0 2023-10-06T04:41:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff762dfe700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c156e00 con 0x7ff75c14cab0 2023-10-06T04:41:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff762dfe700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff75c1561f0 con 0x7ff75c14c6e0 2023-10-06T04:41:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff7625fd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff75c0c7ab0 0x7ff75c159780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38276/0 (socket says 172.21.15.37:38276) 2023-10-06T04:41:46.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff7625fd700 1 -- 172.21.15.37:0/2518134296 learned_addr learned my addr 172.21.15.37:0/2518134296 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:46.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff761dfc700 1 --2- 172.21.15.37:0/2518134296 >> v2:172.21.15.83:3300/0 conn(0x7ff75c14c6e0 0x7ff75c0c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff760dfa700 1 -- 172.21.15.37:0/2518134296 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445816737 0 0) 0x7ff75c0c9cd0 con 0x7ff75c0c7ab0 2023-10-06T04:41:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff760dfa700 1 -- 172.21.15.37:0/2518134296 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff748003570 con 0x7ff75c0c7ab0 2023-10-06T04:41:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff761dfc700 1 -- 172.21.15.37:0/2518134296 >> v1:172.21.15.83:6789/0 conn(0x7ff75c14cab0 legacy=0x7ff75c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff761dfc700 1 -- 172.21.15.37:0/2518134296 >> v1:172.21.15.37:6789/0 conn(0x7ff75c0c7ab0 legacy=0x7ff75c159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff760dfa700 1 -- 172.21.15.37:0/2518134296 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2763346635 0 0) 0x7ff748003570 con 0x7ff75c0c7ab0 2023-10-06T04:41:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff761dfc700 1 -- 172.21.15.37:0/2518134296 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c1564d0 con 0x7ff75c14c6e0 2023-10-06T04:41:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff761dfc700 1 --2- 172.21.15.37:0/2518134296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff75c14c6e0 0x7ff75c0c9790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff7580098e0 tx=0x7ff7580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9630fc8d7b67cf01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff760dfa700 1 -- 172.21.15.37:0/2518134296 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540017f0 con 0x7ff75c14c6e0 2023-10-06T04:41:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff760dfa700 1 -- 172.21.15.37:0/2518134296 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff758011420 con 0x7ff75c14c6e0 2023-10-06T04:41:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.315+0000 7ff760dfa700 1 -- 172.21.15.37:0/2518134296 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7580117a0 con 0x7ff75c14c6e0 2023-10-06T04:41:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.319+0000 7ff762dfe700 1 -- 172.21.15.37:0/2518134296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff75c14c6e0 msgr2=0x7ff75c0c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.319+0000 7ff762dfe700 1 --2- 172.21.15.37:0/2518134296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff75c14c6e0 0x7ff75c0c9790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff7580098e0 tx=0x7ff7580091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.319+0000 7ff762dfe700 1 -- 172.21.15.37:0/2518134296 shutdown_connections 2023-10-06T04:41:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.319+0000 7ff762dfe700 1 --2- 172.21.15.37:0/2518134296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff75c14c6e0 0x7ff75c0c9790 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.319+0000 7ff762dfe700 1 -- 172.21.15.37:0/2518134296 >> 172.21.15.37:0/2518134296 conn(0x7ff75c0687c0 msgr2=0x7ff75c0cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.319+0000 7ff762dfe700 1 -- 172.21.15.37:0/2518134296 shutdown_connections 2023-10-06T04:41:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.319+0000 7ff762dfe700 1 -- 172.21.15.37:0/2518134296 wait complete. 2023-10-06T04:41:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.319+0000 7ff762dfe700 1 Processor -- start 2023-10-06T04:41:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.319+0000 7ff762dfe700 1 -- start start 2023-10-06T04:41:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff762dfe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff75c0c7ab0 0x7ff75c0ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff762dfe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff75c14c6e0 0x7ff75c0c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff762dfe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff75c14cab0 0x7ff75c157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff762dfe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c0c55b0 con 0x7ff75c14c6e0 2023-10-06T04:41:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff762dfe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c0c5890 con 0x7ff75c0c7ab0 2023-10-06T04:41:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff762dfe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c157170 con 0x7ff75c14cab0 2023-10-06T04:41:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff7615fb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff75c14c6e0 0x7ff75c0c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff7615fb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff75c14c6e0 0x7ff75c0c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60302/0 (socket says 172.21.15.37:60302) 2023-10-06T04:41:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff7615fb700 1 -- 172.21.15.37:0/1032872344 learned_addr learned my addr 172.21.15.37:0/1032872344 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff761dfc700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff75c0c7ab0 0x7ff75c0ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff7625fd700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff75c14cab0 0x7ff75c157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff7615fb700 1 -- 172.21.15.37:0/1032872344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff75c14cab0 msgr2=0x7ff75c157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff7615fb700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff75c14cab0 0x7ff75c157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff7615fb700 1 -- 172.21.15.37:0/1032872344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff75c0c7ab0 msgr2=0x7ff75c0ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff7615fb700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff75c0c7ab0 0x7ff75c0ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff7615fb700 1 -- 172.21.15.37:0/1032872344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff758009420 con 0x7ff75c14c6e0 2023-10-06T04:41:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff7625fd700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff75c14cab0 0x7ff75c157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff7615fb700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff75c14c6e0 0x7ff75c0c4d80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00c590 tx=0x7ff74c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff751ffb700 1 -- 172.21.15.37:0/1032872344 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c011590 con 0x7ff75c14c6e0 2023-10-06T04:41:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff751ffb700 1 -- 172.21.15.37:0/1032872344 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c011710 con 0x7ff75c14c6e0 2023-10-06T04:41:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff762dfe700 1 -- 172.21.15.37:0/1032872344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c157450 con 0x7ff75c14c6e0 2023-10-06T04:41:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff751ffb700 1 -- 172.21.15.37:0/1032872344 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c011ad0 con 0x7ff75c14c6e0 2023-10-06T04:41:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff762dfe700 1 -- 172.21.15.37:0/1032872344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c157eb0 con 0x7ff75c14c6e0 2023-10-06T04:41:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff762dfe700 1 -- 172.21.15.37:0/1032872344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff75c156ff0 con 0x7ff75c14c6e0 2023-10-06T04:41:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff751ffb700 1 -- 172.21.15.37:0/1032872344 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff74c01b3b0 con 0x7ff75c14c6e0 2023-10-06T04:41:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.323+0000 7ff751ffb700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff740060580 0x7ff740062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.327+0000 7ff751ffb700 1 -- 172.21.15.37:0/1032872344 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7ff74c07c300 con 0x7ff75c14c6e0 2023-10-06T04:41:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.327+0000 7ff751ffb700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] conn(0x7ff740066fb0 0x7ff7400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.327+0000 7ff751ffb700 1 -- 172.21.15.37:0/1032872344 --> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff740069ab0 con 0x7ff740066fb0 2023-10-06T04:41:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.327+0000 7ff751ffb700 1 -- 172.21.15.37:0/1032872344 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff74c07c6d0 con 0x7ff75c14c6e0 2023-10-06T04:41:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.327+0000 7ff7625fd700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] conn(0x7ff740066fb0 0x7ff7400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.327+0000 7ff761dfc700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff740060580 0x7ff740062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.327+0000 7ff7625fd700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] conn(0x7ff740066fb0 0x7ff7400693e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.327+0000 7ff761dfc700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff740060580 0x7ff740062a30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff758009fd0 tx=0x7ff758016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.327+0000 7ff751ffb700 1 -- 172.21.15.37:0/1032872344 <== osd.2 v2:172.21.15.37:6800/33415 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff740069ab0 con 0x7ff740066fb0 2023-10-06T04:41:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.339+0000 7ff762dfe700 1 -- 172.21.15.37:0/1032872344 --> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff75c04be00 con 0x7ff740066fb0 2023-10-06T04:41:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.339+0000 7ff751ffb700 1 -- 172.21.15.37:0/1032872344 <== osd.2 v2:172.21.15.37:6800/33415 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff75c04be00 con 0x7ff740066fb0 2023-10-06T04:41:46.349 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:41:46.349 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:41:46.349 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:41:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.339+0000 7ff762dfe700 1 -- 172.21.15.37:0/1032872344 >> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] conn(0x7ff740066fb0 msgr2=0x7ff7400693e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.339+0000 7ff762dfe700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.37:6800/33415,v1:172.21.15.37:6802/33415] conn(0x7ff740066fb0 0x7ff7400693e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.343+0000 7ff762dfe700 1 -- 172.21.15.37:0/1032872344 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff740060580 msgr2=0x7ff740062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.343+0000 7ff762dfe700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ff740060580 0x7ff740062a30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff758009fd0 tx=0x7ff758016000 comp rx=0 tx=0).stop 2023-10-06T04:41:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.343+0000 7ff762dfe700 1 -- 172.21.15.37:0/1032872344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff75c14c6e0 msgr2=0x7ff75c0c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.343+0000 7ff762dfe700 1 --2- 172.21.15.37:0/1032872344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff75c14c6e0 0x7ff75c0c4d80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00c590 tx=0x7ff74c007f50 comp rx=0 tx=0).stop 2023-10-06T04:41:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.343+0000 7ff7625fd700 1 -- 172.21.15.37:0/1032872344 reap_dead start 2023-10-06T04:41:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.343+0000 7ff762dfe700 1 -- 172.21.15.37:0/1032872344 shutdown_connections 2023-10-06T04:41:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.343+0000 7ff762dfe700 1 -- 172.21.15.37:0/1032872344 >> 172.21.15.37:0/1032872344 conn(0x7ff75c0687c0 msgr2=0x7ff75c0c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.343+0000 7ff762dfe700 1 -- 172.21.15.37:0/1032872344 shutdown_connections 2023-10-06T04:41:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.343+0000 7ff762dfe700 1 -- 172.21.15.37:0/1032872344 wait complete. 2023-10-06T04:41:46.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T04:41:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 Processor -- start 2023-10-06T04:41:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 -- start start 2023-10-06T04:41:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a3c0cc230 0x7f9a3c0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9a3c06e880 0x7f9a3c1572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c0b1040 con 0x7f9a3c154660 2023-10-06T04:41:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c0caf90 con 0x7f9a3c0cc230 2023-10-06T04:41:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c0c06e0 con 0x7f9a3c06e880 2023-10-06T04:41:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a327fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a3c0cc230 0x7f9a3c0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a327fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a3c0cc230 0x7f9a3c0caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60318/0 (socket says 172.21.15.37:60318) 2023-10-06T04:41:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a327fc700 1 -- 172.21.15.37:0/2428211662 learned_addr learned my addr 172.21.15.37:0/2428211662 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a3b7fe700 1 --2- 172.21.15.37:0/2428211662 >> v2:172.21.15.83:3300/0 conn(0x7f9a3c06e880 0x7f9a3c1572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a327fc700 1 -- 172.21.15.37:0/2428211662 >> v2:172.21.15.83:3300/0 conn(0x7f9a3c06e880 msgr2=0x7f9a3c1572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a327fc700 1 --2- 172.21.15.37:0/2428211662 >> v2:172.21.15.83:3300/0 conn(0x7f9a3c06e880 0x7f9a3c1572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a327fc700 1 -- 172.21.15.37:0/2428211662 >> v1:172.21.15.83:6789/0 conn(0x7f9a3c154660 legacy=0x7f9a3c0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a3a7fc700 1 -- 172.21.15.37:0/2428211662 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499661306 0 0) 0x7f9a3c0b1040 con 0x7f9a3c154660 2023-10-06T04:41:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a327fc700 1 -- 172.21.15.37:0/2428211662 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0c0980 con 0x7f9a3c0cc230 2023-10-06T04:41:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a327fc700 1 --2- 172.21.15.37:0/2428211662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a3c0cc230 0x7f9a3c0caa50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0c0da0 tx=0x7f9a24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b222449a8705a812 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a3a7fc700 1 -- 172.21.15.37:0/2428211662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400b860 con 0x7f9a3c0cc230 2023-10-06T04:41:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a3a7fc700 1 -- 172.21.15.37:0/2428211662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2400b9c0 con 0x7f9a3c0cc230 2023-10-06T04:41:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a3a7fc700 1 -- 172.21.15.37:0/2428211662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400bd80 con 0x7f9a3c0cc230 2023-10-06T04:41:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 -- 172.21.15.37:0/2428211662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a3c0cc230 msgr2=0x7f9a3c0caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 --2- 172.21.15.37:0/2428211662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a3c0cc230 0x7f9a3c0caa50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0c0da0 tx=0x7f9a24009250 comp rx=0 tx=0).stop 2023-10-06T04:41:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 -- 172.21.15.37:0/2428211662 shutdown_connections 2023-10-06T04:41:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 --2- 172.21.15.37:0/2428211662 >> v2:172.21.15.83:3300/0 conn(0x7f9a3c06e880 0x7f9a3c1572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 --2- 172.21.15.37:0/2428211662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a3c0cc230 0x7f9a3c0caa50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 -- 172.21.15.37:0/2428211662 >> 172.21.15.37:0/2428211662 conn(0x7f9a3c0667b0 msgr2=0x7f9a3c066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 -- 172.21.15.37:0/2428211662 shutdown_connections 2023-10-06T04:41:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.471+0000 7f9a413e0700 1 -- 172.21.15.37:0/2428211662 wait complete. 2023-10-06T04:41:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a413e0700 1 Processor -- start 2023-10-06T04:41:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a413e0700 1 -- start start 2023-10-06T04:41:46.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a413e0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a3c06e880 0x7f9a3c14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a413e0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a3c0cc230 0x7f9a3c0c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a413e0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a3c154660 0x7f9a3c0af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a413e0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c167ab0 con 0x7f9a3c06e880 2023-10-06T04:41:46.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a413e0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c166ea0 con 0x7f9a3c154660 2023-10-06T04:41:46.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a413e0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c167180 con 0x7f9a3c0cc230 2023-10-06T04:41:46.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a3affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a3c06e880 0x7f9a3c14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a3affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a3c06e880 0x7f9a3c14d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60328/0 (socket says 172.21.15.37:60328) 2023-10-06T04:41:46.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a3affd700 1 -- 172.21.15.37:0/1909472212 learned_addr learned my addr 172.21.15.37:0/1909472212 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:46.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a3b7fe700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a3c154660 0x7f9a3c0af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.475+0000 7f9a327fc700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a3c0cc230 0x7f9a3c0c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a3affd700 1 -- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a3c0cc230 msgr2=0x7f9a3c0c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a3affd700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a3c0cc230 0x7f9a3c0c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a3affd700 1 -- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a3c154660 msgr2=0x7f9a3c0af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a3affd700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a3c154660 0x7f9a3c0af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a3affd700 1 -- 172.21.15.37:0/1909472212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a240094f0 con 0x7f9a3c06e880 2023-10-06T04:41:46.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a3b7fe700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a3c154660 0x7f9a3c0af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:46.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a3affd700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a3c06e880 0x7f9a3c14d190 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00c530 tx=0x7f9a2c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a337fe700 1 -- 172.21.15.37:0/1909472212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c011590 con 0x7f9a3c06e880 2023-10-06T04:41:46.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a337fe700 1 -- 172.21.15.37:0/1909472212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c0116f0 con 0x7f9a3c06e880 2023-10-06T04:41:46.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a413e0700 1 -- 172.21.15.37:0/1909472212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c167460 con 0x7f9a3c06e880 2023-10-06T04:41:46.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a337fe700 1 -- 172.21.15.37:0/1909472212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c011ab0 con 0x7f9a3c06e880 2023-10-06T04:41:46.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a413e0700 1 -- 172.21.15.37:0/1909472212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c14d6d0 con 0x7f9a3c06e880 2023-10-06T04:41:46.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a413e0700 1 -- 172.21.15.37:0/1909472212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3c070ee0 con 0x7f9a3c06e880 2023-10-06T04:41:46.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.479+0000 7f9a337fe700 1 -- 172.21.15.37:0/1909472212 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9a2c01b3b0 con 0x7f9a3c06e880 2023-10-06T04:41:46.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.483+0000 7f9a337fe700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9a1c060550 0x7f9a1c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.483+0000 7f9a337fe700 1 -- 172.21.15.37:0/1909472212 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f9a2c07beb0 con 0x7f9a3c06e880 2023-10-06T04:41:46.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.483+0000 7f9a327fc700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9a1c060550 0x7f9a1c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.483+0000 7f9a327fc700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9a1c060550 0x7f9a1c062a00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0c0da0 tx=0x7f9a24017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.491+0000 7f9a337fe700 1 -- 172.21.15.37:0/1909472212 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9a2c04c400 con 0x7f9a3c06e880 2023-10-06T04:41:46.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.655+0000 7f9a413e0700 1 -- 172.21.15.37:0/1909472212 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a3c167bf0 con 0x7f9a1c060550 2023-10-06T04:41:46.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.659+0000 7f9a337fe700 1 -- 172.21.15.37:0/1909472212 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9a24000c50 con 0x7f9a1c060550 2023-10-06T04:41:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.663+0000 7f9a413e0700 1 -- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9a1c060550 msgr2=0x7f9a1c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.663+0000 7f9a413e0700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9a1c060550 0x7f9a1c062a00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0c0da0 tx=0x7f9a24017000 comp rx=0 tx=0).stop 2023-10-06T04:41:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.663+0000 7f9a413e0700 1 -- 172.21.15.37:0/1909472212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a3c06e880 msgr2=0x7f9a3c14d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.663+0000 7f9a413e0700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a3c06e880 0x7f9a3c14d190 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00c530 tx=0x7f9a2c00c8f0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.663+0000 7f9a413e0700 1 -- 172.21.15.37:0/1909472212 shutdown_connections 2023-10-06T04:41:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.663+0000 7f9a413e0700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f9a1c060550 0x7f9a1c062a00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.663+0000 7f9a413e0700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a3c154660 0x7f9a3c0af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.663+0000 7f9a413e0700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a3c0cc230 0x7f9a3c0c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.663+0000 7f9a413e0700 1 --2- 172.21.15.37:0/1909472212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a3c06e880 0x7f9a3c14d190 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.663+0000 7f9a413e0700 1 -- 172.21.15.37:0/1909472212 >> 172.21.15.37:0/1909472212 conn(0x7f9a3c0667b0 msgr2=0x7f9a3c14fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:46.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.663+0000 7f9a413e0700 1 -- 172.21.15.37:0/1909472212 shutdown_connections 2023-10-06T04:41:46.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.663+0000 7f9a413e0700 1 -- 172.21.15.37:0/1909472212 wait complete. 2023-10-06T04:41:46.690 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T04:41:46.690 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T04:41:46.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:41:46.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.803+0000 7fc6ffceb700 1 Processor -- start 2023-10-06T04:41:46.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.803+0000 7fc6ffceb700 1 -- start start 2023-10-06T04:41:46.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6ffceb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6f8159f90 0x7fc6f80af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6ffceb700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f80af730 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6ffceb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f815c910 con 0x7fc6f80aed30 2023-10-06T04:41:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6ffceb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f815d920 con 0x7fc6f8159f90 2023-10-06T04:41:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fe288700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc6f80cc6c0 0x7fc6f80cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38278/0 (socket says 172.21.15.37:38278) 2023-10-06T04:41:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fe288700 1 -- 172.21.15.37:0/3268153485 learned_addr learned my addr 172.21.15.37:0/3268153485 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fd286700 1 --2- 172.21.15.37:0/3268153485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6f8159f90 0x7fc6f80af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fca85700 1 -- 172.21.15.37:0/3268153485 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838443383 0 0) 0x7fc6f80af730 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fca85700 1 -- 172.21.15.37:0/3268153485 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e4003570 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fca85700 1 -- 172.21.15.37:0/3268153485 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600874779 0 0) 0x7fc6f815c910 con 0x7fc6f80aed30 2023-10-06T04:41:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fca85700 1 -- 172.21.15.37:0/3268153485 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6f80af730 con 0x7fc6f80aed30 2023-10-06T04:41:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fd286700 1 -- 172.21.15.37:0/3268153485 >> v1:172.21.15.83:6789/0 conn(0x7fc6f80aed30 legacy=0x7fc6f80cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fd286700 1 -- 172.21.15.37:0/3268153485 >> v1:172.21.15.37:6789/0 conn(0x7fc6f80cc6c0 legacy=0x7fc6f80cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fd286700 1 -- 172.21.15.37:0/3268153485 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f815d490 con 0x7fc6f8159f90 2023-10-06T04:41:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fd286700 1 --2- 172.21.15.37:0/3268153485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6f8159f90 0x7fc6f80af100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009910 tx=0x7fc6f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb4cf15803c19f58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fca85700 1 -- 172.21.15.37:0/3268153485 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4011630 con 0x7fc6f8159f90 2023-10-06T04:41:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fca85700 1 -- 172.21.15.37:0/3268153485 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f4011790 con 0x7fc6f8159f90 2023-10-06T04:41:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6fca85700 1 -- 172.21.15.37:0/3268153485 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4011b10 con 0x7fc6f8159f90 2023-10-06T04:41:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6ffceb700 1 -- 172.21.15.37:0/3268153485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6f8159f90 msgr2=0x7fc6f80af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6ffceb700 1 --2- 172.21.15.37:0/3268153485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6f8159f90 0x7fc6f80af100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009910 tx=0x7fc6f40091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6ffceb700 1 -- 172.21.15.37:0/3268153485 shutdown_connections 2023-10-06T04:41:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6ffceb700 1 --2- 172.21.15.37:0/3268153485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6f8159f90 0x7fc6f80af100 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6ffceb700 1 -- 172.21.15.37:0/3268153485 >> 172.21.15.37:0/3268153485 conn(0x7fc6f8067cf0 msgr2=0x7fc6f80680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6ffceb700 1 -- 172.21.15.37:0/3268153485 shutdown_connections 2023-10-06T04:41:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.807+0000 7fc6ffceb700 1 -- 172.21.15.37:0/3268153485 wait complete. 2023-10-06T04:41:46.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6ffceb700 1 Processor -- start 2023-10-06T04:41:46.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6ffceb700 1 -- start start 2023-10-06T04:41:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6ffceb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6f80aed30 0x7fc6f80b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6ffceb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6f80cc6c0 0x7fc6f814c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6ffceb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6f8159f90 0x7fc6f8069370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6ffceb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8169a90 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6ffceb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80b5990 con 0x7fc6f8159f90 2023-10-06T04:41:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6ffceb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8169440 con 0x7fc6f80aed30 2023-10-06T04:41:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6fd286700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6f80cc6c0 0x7fc6f814c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6fd286700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6f80cc6c0 0x7fc6f814c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60338/0 (socket says 172.21.15.37:60338) 2023-10-06T04:41:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6fd286700 1 -- 172.21.15.37:0/988255804 learned_addr learned my addr 172.21.15.37:0/988255804 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6fe288700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6f8159f90 0x7fc6f8069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6fda87700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6f80aed30 0x7fc6f80b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6fd286700 1 -- 172.21.15.37:0/988255804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6f80aed30 msgr2=0x7fc6f80b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6fd286700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6f80aed30 0x7fc6f80b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6fd286700 1 -- 172.21.15.37:0/988255804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6f8159f90 msgr2=0x7fc6f8069370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.811+0000 7fc6fd286700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6f8159f90 0x7fc6f8069370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.815+0000 7fc6fd286700 1 -- 172.21.15.37:0/988255804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f4009420 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.815+0000 7fc6fd286700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6f80cc6c0 0x7fc6f814c6a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8088e00 tx=0x7fc6f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.815+0000 7fc6edffb700 1 -- 172.21.15.37:0/988255804 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4011900 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.815+0000 7fc6edffb700 1 -- 172.21.15.37:0/988255804 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f4011a60 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.815+0000 7fc6edffb700 1 -- 172.21.15.37:0/988255804 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4025640 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.815+0000 7fc6ffceb700 1 -- 172.21.15.37:0/988255804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f8169720 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.815+0000 7fc6ffceb700 1 -- 172.21.15.37:0/988255804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f8169110 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.815+0000 7fc6ffceb700 1 -- 172.21.15.37:0/988255804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6f804be00 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.819+0000 7fc6edffb700 1 -- 172.21.15.37:0/988255804 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc6f4025a30 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.819+0000 7fc6edffb700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc6dc060550 0x7fc6dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.819+0000 7fc6edffb700 1 -- 172.21.15.37:0/988255804 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fc6f407ec30 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.819+0000 7fc6edffb700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] conn(0x7fc6dc066f00 0x7fc6dc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.819+0000 7fc6edffb700 1 -- 172.21.15.37:0/988255804 --> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6dc069a00 con 0x7fc6dc066f00 2023-10-06T04:41:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.819+0000 7fc6fda87700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc6dc060550 0x7fc6dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.819+0000 7fc6edffb700 1 -- 172.21.15.37:0/988255804 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6f407ef20 con 0x7fc6f80cc6c0 2023-10-06T04:41:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.819+0000 7fc6fe288700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] conn(0x7fc6dc066f00 0x7fc6dc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.819+0000 7fc6fe288700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] conn(0x7fc6dc066f00 0x7fc6dc069330 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.819+0000 7fc6fda87700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc6dc060550 0x7fc6dc062a00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8000c00 tx=0x7fc6e8007d20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.819+0000 7fc6edffb700 1 -- 172.21.15.37:0/988255804 <== osd.3 v2:172.21.15.37:6824/33417 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc6dc069a00 con 0x7fc6dc066f00 2023-10-06T04:41:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6ffceb700 1 -- 172.21.15.37:0/988255804 --> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc6f81698b0 con 0x7fc6dc066f00 2023-10-06T04:41:46.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6edffb700 1 -- 172.21.15.37:0/988255804 <== osd.3 v2:172.21.15.37:6824/33417 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc6f81698b0 con 0x7fc6dc066f00 2023-10-06T04:41:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:41:46.846 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:41:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:41:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6ffceb700 1 -- 172.21.15.37:0/988255804 >> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] conn(0x7fc6dc066f00 msgr2=0x7fc6dc069330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6ffceb700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.37:6824/33417,v1:172.21.15.37:6825/33417] conn(0x7fc6dc066f00 0x7fc6dc069330 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6ffceb700 1 -- 172.21.15.37:0/988255804 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc6dc060550 msgr2=0x7fc6dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6ffceb700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc6dc060550 0x7fc6dc062a00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8000c00 tx=0x7fc6e8007d20 comp rx=0 tx=0).stop 2023-10-06T04:41:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6ffceb700 1 -- 172.21.15.37:0/988255804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6f80cc6c0 msgr2=0x7fc6f814c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6ffceb700 1 --2- 172.21.15.37:0/988255804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6f80cc6c0 0x7fc6f814c6a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8088e00 tx=0x7fc6f4017000 comp rx=0 tx=0).stop 2023-10-06T04:41:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6fe288700 1 -- 172.21.15.37:0/988255804 reap_dead start 2023-10-06T04:41:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6ffceb700 1 -- 172.21.15.37:0/988255804 shutdown_connections 2023-10-06T04:41:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6ffceb700 1 -- 172.21.15.37:0/988255804 >> 172.21.15.37:0/988255804 conn(0x7fc6f8067cf0 msgr2=0x7fc6f81586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6ffceb700 1 -- 172.21.15.37:0/988255804 shutdown_connections 2023-10-06T04:41:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.839+0000 7fc6ffceb700 1 -- 172.21.15.37:0/988255804 wait complete. 2023-10-06T04:41:46.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T04:41:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.967+0000 7f1dd0b6a700 1 Processor -- start 2023-10-06T04:41:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.967+0000 7f1dd0b6a700 1 -- start start 2023-10-06T04:41:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.967+0000 7f1dd0b6a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1dcc0cc230 0x7f1dcc0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.967+0000 7f1dd0b6a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0b1040 con 0x7f1dcc06e880 2023-10-06T04:41:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.967+0000 7f1dd0b6a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0c06e0 con 0x7f1dcc154660 2023-10-06T04:41:46.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.967+0000 7f1dd0b6a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc0caf90 con 0x7f1dcc0cc230 2023-10-06T04:41:46.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.967+0000 7f1dc9d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1dcc0cc230 0x7f1dcc0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.967+0000 7f1dc9d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1dcc0cc230 0x7f1dcc0caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60350/0 (socket says 172.21.15.37:60350) 2023-10-06T04:41:46.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.967+0000 7f1dc9d9b700 1 -- 172.21.15.37:0/1772633527 learned_addr learned my addr 172.21.15.37:0/1772633527 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dc959a700 1 -- 172.21.15.37:0/1772633527 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226244702 0 0) 0x7f1dcc0c06e0 con 0x7f1dcc154660 2023-10-06T04:41:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dc959a700 1 -- 172.21.15.37:0/1772633527 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dac003570 con 0x7f1dcc154660 2023-10-06T04:41:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dc9d9b700 1 -- 172.21.15.37:0/1772633527 >> v1:172.21.15.83:6789/0 conn(0x7f1dcc154660 legacy=0x7f1dcc0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dc9d9b700 1 -- 172.21.15.37:0/1772633527 >> v1:172.21.15.37:6789/0 conn(0x7f1dcc06e880 legacy=0x7f1dcc1572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dc9d9b700 1 -- 172.21.15.37:0/1772633527 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0c0980 con 0x7f1dcc0cc230 2023-10-06T04:41:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dc9d9b700 1 --2- 172.21.15.37:0/1772633527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dcc0cc230 0x7f1dcc0caa50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009f20 tx=0x7f1dbc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d31776c0091093 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dc959a700 1 -- 172.21.15.37:0/1772633527 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc00e070 con 0x7f1dcc0cc230 2023-10-06T04:41:46.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dc959a700 1 -- 172.21.15.37:0/1772633527 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc00b9d0 con 0x7f1dcc0cc230 2023-10-06T04:41:46.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dc959a700 1 -- 172.21.15.37:0/1772633527 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0092e0 con 0x7f1dcc0cc230 2023-10-06T04:41:46.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1772633527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dcc0cc230 msgr2=0x7f1dcc0caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dd0b6a700 1 --2- 172.21.15.37:0/1772633527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dcc0cc230 0x7f1dcc0caa50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009f20 tx=0x7f1dbc009840 comp rx=0 tx=0).stop 2023-10-06T04:41:46.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1772633527 shutdown_connections 2023-10-06T04:41:46.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dd0b6a700 1 --2- 172.21.15.37:0/1772633527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dcc0cc230 0x7f1dcc0caa50 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1772633527 >> 172.21.15.37:0/1772633527 conn(0x7f1dcc0667b0 msgr2=0x7f1dcc066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:46.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1772633527 shutdown_connections 2023-10-06T04:41:46.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.971+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1772633527 wait complete. 2023-10-06T04:41:46.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dd0b6a700 1 Processor -- start 2023-10-06T04:41:46.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dd0b6a700 1 -- start start 2023-10-06T04:41:46.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dd0b6a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dcc06e880 0x7f1dcc167c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dd0b6a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1dcc0cc230 0x7f1dcc156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dd0b6a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1dcc154660 0x7f1dcc1594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dd0b6a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1677b0 con 0x7f1dcc06e880 2023-10-06T04:41:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dd0b6a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc159bf0 con 0x7f1dcc0cc230 2023-10-06T04:41:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dd0b6a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc159ed0 con 0x7f1dcc154660 2023-10-06T04:41:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dca59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dcc06e880 0x7f1dcc167c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dca59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dcc06e880 0x7f1dcc167c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60354/0 (socket says 172.21.15.37:60354) 2023-10-06T04:41:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dca59c700 1 -- 172.21.15.37:0/1651245705 learned_addr learned my addr 172.21.15.37:0/1651245705 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dc9d9b700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1dcc0cc230 0x7f1dcc156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dcad9d700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1dcc154660 0x7f1dcc1594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dca59c700 1 -- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1dcc154660 msgr2=0x7f1dcc1594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dca59c700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1dcc154660 0x7f1dcc1594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dca59c700 1 -- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1dcc0cc230 msgr2=0x7f1dcc156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dca59c700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1dcc0cc230 0x7f1dcc156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dca59c700 1 -- 172.21.15.37:0/1651245705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc009ae0 con 0x7f1dcc06e880 2023-10-06T04:41:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.975+0000 7f1dcad9d700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1dcc154660 0x7f1dcc1594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.979+0000 7f1dca59c700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dcc06e880 0x7f1dcc167c40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400c580 tx=0x7f1dc4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.979+0000 7f1dc27fc700 1 -- 172.21.15.37:0/1651245705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4010510 con 0x7f1dcc06e880 2023-10-06T04:41:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.979+0000 7f1dc27fc700 1 -- 172.21.15.37:0/1651245705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4010670 con 0x7f1dcc06e880 2023-10-06T04:41:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.979+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1651245705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc167440 con 0x7f1dcc06e880 2023-10-06T04:41:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.979+0000 7f1dc27fc700 1 -- 172.21.15.37:0/1651245705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4010a30 con 0x7f1dcc06e880 2023-10-06T04:41:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.979+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1651245705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc145d40 con 0x7f1dcc06e880 2023-10-06T04:41:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.979+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1651245705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc157120 con 0x7f1dcc06e880 2023-10-06T04:41:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.979+0000 7f1dc27fc700 1 -- 172.21.15.37:0/1651245705 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1dc401b400 con 0x7f1dcc06e880 2023-10-06T04:41:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.979+0000 7f1dc27fc700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1db0060550 0x7f1db0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.983+0000 7f1dc27fc700 1 -- 172.21.15.37:0/1651245705 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f1dc407c3b0 con 0x7f1dcc06e880 2023-10-06T04:41:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.983+0000 7f1dc9d9b700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1db0060550 0x7f1db0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.983+0000 7f1dc9d9b700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1db0060550 0x7f1db0062a00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0cc630 tx=0x7f1dbc018000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:46.987+0000 7f1dc27fc700 1 -- 172.21.15.37:0/1651245705 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1dc404c9a0 con 0x7f1dcc06e880 2023-10-06T04:41:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.147+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1651245705 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1dcc1678f0 con 0x7f1db0060550 2023-10-06T04:41:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.147+0000 7f1dc27fc700 1 -- 172.21.15.37:0/1651245705 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1dbc000f40 con 0x7f1db0060550 2023-10-06T04:41:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.151+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1db0060550 msgr2=0x7f1db0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.151+0000 7f1dd0b6a700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1db0060550 0x7f1db0062a00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0cc630 tx=0x7f1dbc018000 comp rx=0 tx=0).stop 2023-10-06T04:41:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.151+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1651245705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dcc06e880 msgr2=0x7f1dcc167c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.151+0000 7f1dd0b6a700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dcc06e880 0x7f1dcc167c40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400c580 tx=0x7f1dc4007e10 comp rx=0 tx=0).stop 2023-10-06T04:41:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.151+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1651245705 shutdown_connections 2023-10-06T04:41:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.151+0000 7f1dd0b6a700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1db0060550 0x7f1db0062a00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.151+0000 7f1dd0b6a700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1dcc0cc230 0x7f1dcc156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.151+0000 7f1dd0b6a700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1dcc154660 0x7f1dcc1594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.151+0000 7f1dd0b6a700 1 --2- 172.21.15.37:0/1651245705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dcc06e880 0x7f1dcc167c40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.151+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1651245705 >> 172.21.15.37:0/1651245705 conn(0x7f1dcc0667b0 msgr2=0x7f1dcc06d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.151+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1651245705 shutdown_connections 2023-10-06T04:41:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.151+0000 7f1dd0b6a700 1 -- 172.21.15.37:0/1651245705 wait complete. 2023-10-06T04:41:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T04:41:47.169 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T04:41:47.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:41:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cd97d700 1 Processor -- start 2023-10-06T04:41:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cd97d700 1 -- start start 2023-10-06T04:41:47.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cd97d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04c8159030 0x7f04c80b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cd97d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8159400 0x7f04c80c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cd97d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c80b1550 con 0x7f04c80c2e60 2023-10-06T04:41:47.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cd97d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c80c3300 con 0x7f04c8159030 2023-10-06T04:41:47.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cd97d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80b1f20 con 0x7f04c8159400 2023-10-06T04:41:47.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cc97b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04c8159030 0x7f04c80b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cc97b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04c8159030 0x7f04c80b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60368/0 (socket says 172.21.15.37:60368) 2023-10-06T04:41:47.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cc97b700 1 -- 172.21.15.37:0/1492571220 learned_addr learned my addr 172.21.15.37:0/1492571220 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:47.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04c7fff700 1 --2- 172.21.15.37:0/1492571220 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8159400 0x7f04c80c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cc97b700 1 -- 172.21.15.37:0/1492571220 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8159400 msgr2=0x7f04c80c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:47.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cc97b700 1 --2- 172.21.15.37:0/1492571220 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8159400 0x7f04c80c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cc97b700 1 -- 172.21.15.37:0/1492571220 >> v1:172.21.15.83:6789/0 conn(0x7f04c80c2e60 legacy=0x7f04c8159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.283+0000 7f04cc97b700 1 -- 172.21.15.37:0/1492571220 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c80b0940 con 0x7f04c8159030 2023-10-06T04:41:47.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04cc97b700 1 --2- 172.21.15.37:0/1492571220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c8159030 0x7f04c80b19e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0099b0 tx=0x7f04bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb0b01c4b329054 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04c77fe700 1 -- 172.21.15.37:0/1492571220 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc009ea0 con 0x7f04c8159030 2023-10-06T04:41:47.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04c77fe700 1 -- 172.21.15.37:0/1492571220 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc00b8f0 con 0x7f04c8159030 2023-10-06T04:41:47.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04c77fe700 1 -- 172.21.15.37:0/1492571220 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00bc90 con 0x7f04c8159030 2023-10-06T04:41:47.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04cd97d700 1 -- 172.21.15.37:0/1492571220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c8159030 msgr2=0x7f04c80b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04cd97d700 1 --2- 172.21.15.37:0/1492571220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c8159030 0x7f04c80b19e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0099b0 tx=0x7f04bc009250 comp rx=0 tx=0).stop 2023-10-06T04:41:47.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04cd97d700 1 -- 172.21.15.37:0/1492571220 shutdown_connections 2023-10-06T04:41:47.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04cd97d700 1 --2- 172.21.15.37:0/1492571220 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8159400 0x7f04c80c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04cd97d700 1 --2- 172.21.15.37:0/1492571220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c8159030 0x7f04c80b19e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04cd97d700 1 -- 172.21.15.37:0/1492571220 >> 172.21.15.37:0/1492571220 conn(0x7f04c80667b0 msgr2=0x7f04c8066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:47.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04cd97d700 1 -- 172.21.15.37:0/1492571220 shutdown_connections 2023-10-06T04:41:47.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04cd97d700 1 -- 172.21.15.37:0/1492571220 wait complete. 2023-10-06T04:41:47.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04cd97d700 1 Processor -- start 2023-10-06T04:41:47.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.287+0000 7f04cd97d700 1 -- start start 2023-10-06T04:41:47.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cd97d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c80c2e60 0x7f04c81502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cd97d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8146810 0x7f04c816acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cd97d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04c8157990 0x7f04c8157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cd97d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c8158370 con 0x7f04c80c2e60 2023-10-06T04:41:47.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cd97d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c8150830 con 0x7f04c8157990 2023-10-06T04:41:47.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cd97d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80cc700 con 0x7f04c8146810 2023-10-06T04:41:47.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cc97b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c80c2e60 0x7f04c81502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cc97b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c80c2e60 0x7f04c81502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60380/0 (socket says 172.21.15.37:60380) 2023-10-06T04:41:47.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cc97b700 1 -- 172.21.15.37:0/1705715757 learned_addr learned my addr 172.21.15.37:0/1705715757 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:47.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04c7fff700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8146810 0x7f04c816acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cd17c700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04c8157990 0x7f04c8157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cc97b700 1 -- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8146810 msgr2=0x7f04c816acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cc97b700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8146810 0x7f04c816acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cc97b700 1 -- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04c8157990 msgr2=0x7f04c8157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cc97b700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04c8157990 0x7f04c8157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cc97b700 1 -- 172.21.15.37:0/1705715757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc0094f0 con 0x7f04c80c2e60 2023-10-06T04:41:47.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cc97b700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c80c2e60 0x7f04c81502f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f04c806fc70 tx=0x7f04bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04c4ff9700 1 -- 172.21.15.37:0/1705715757 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc000cc0 con 0x7f04c80c2e60 2023-10-06T04:41:47.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04c4ff9700 1 -- 172.21.15.37:0/1705715757 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc00ba60 con 0x7f04c80c2e60 2023-10-06T04:41:47.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cd97d700 1 -- 172.21.15.37:0/1705715757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c80cc9e0 con 0x7f04c80c2e60 2023-10-06T04:41:47.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04c4ff9700 1 -- 172.21.15.37:0/1705715757 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc026430 con 0x7f04c80c2e60 2023-10-06T04:41:47.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.291+0000 7f04cd97d700 1 -- 172.21.15.37:0/1705715757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c80ccfa0 con 0x7f04c80c2e60 2023-10-06T04:41:47.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.295+0000 7f04cd97d700 1 -- 172.21.15.37:0/1705715757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04c804be00 con 0x7f04c80c2e60 2023-10-06T04:41:47.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.295+0000 7f04c4ff9700 1 -- 172.21.15.37:0/1705715757 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f04bc023030 con 0x7f04c80c2e60 2023-10-06T04:41:47.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.295+0000 7f04c4ff9700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f04b4060550 0x7f04b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.295+0000 7f04c4ff9700 1 -- 172.21.15.37:0/1705715757 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f04bc07db70 con 0x7f04c80c2e60 2023-10-06T04:41:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.295+0000 7f04c4ff9700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] conn(0x7f04b4066f80 0x7f04b40693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.295+0000 7f04c4ff9700 1 -- 172.21.15.37:0/1705715757 --> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04b4069a80 con 0x7f04b4066f80 2023-10-06T04:41:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.295+0000 7f04c4ff9700 1 -- 172.21.15.37:0/1705715757 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04bc082240 con 0x7f04c80c2e60 2023-10-06T04:41:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.295+0000 7f04c7fff700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f04b4060550 0x7f04b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.295+0000 7f04cd17c700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] conn(0x7f04b4066f80 0x7f04b40693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.295+0000 7f04cd17c700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] conn(0x7f04b4066f80 0x7f04b40693b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.295+0000 7f04c7fff700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f04b4060550 0x7f04b4062a00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f04c806ac30 tx=0x7f04b80091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.299+0000 7f04c4ff9700 1 -- 172.21.15.37:0/1705715757 <== osd.4 v2:172.21.15.83:6816/33662 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f04b4069a80 con 0x7f04b4066f80 2023-10-06T04:41:47.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.315+0000 7f04cd97d700 1 -- 172.21.15.37:0/1705715757 --> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f04c80b0c20 con 0x7f04b4066f80 2023-10-06T04:41:47.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.319+0000 7f04c4ff9700 1 -- 172.21.15.37:0/1705715757 <== osd.4 v2:172.21.15.83:6816/33662 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f04c80b0c20 con 0x7f04b4066f80 2023-10-06T04:41:47.326 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:41:47.326 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:41:47.326 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:41:47.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.319+0000 7f04cd97d700 1 -- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] conn(0x7f04b4066f80 msgr2=0x7f04b40693b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.319+0000 7f04cd97d700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:6816/33662,v1:172.21.15.83:6817/33662] conn(0x7f04b4066f80 0x7f04b40693b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.319+0000 7f04cd97d700 1 -- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f04b4060550 msgr2=0x7f04b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.319+0000 7f04cd97d700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f04b4060550 0x7f04b4062a00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f04c806ac30 tx=0x7f04b80091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.319+0000 7f04cd97d700 1 -- 172.21.15.37:0/1705715757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c80c2e60 msgr2=0x7f04c81502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.319+0000 7f04cd97d700 1 --2- 172.21.15.37:0/1705715757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c80c2e60 0x7f04c81502f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f04c806fc70 tx=0x7f04bc017000 comp rx=0 tx=0).stop 2023-10-06T04:41:47.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.319+0000 7f04cd17c700 1 -- 172.21.15.37:0/1705715757 reap_dead start 2023-10-06T04:41:47.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.319+0000 7f04cd97d700 1 -- 172.21.15.37:0/1705715757 shutdown_connections 2023-10-06T04:41:47.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.319+0000 7f04cd97d700 1 -- 172.21.15.37:0/1705715757 >> 172.21.15.37:0/1705715757 conn(0x7f04c80667b0 msgr2=0x7f04c8154ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:47.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.319+0000 7f04cd97d700 1 -- 172.21.15.37:0/1705715757 shutdown_connections 2023-10-06T04:41:47.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.319+0000 7f04cd97d700 1 -- 172.21.15.37:0/1705715757 wait complete. 2023-10-06T04:41:47.337 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T04:41:47.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.443+0000 7fca64c9b700 1 Processor -- start 2023-10-06T04:41:47.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.443+0000 7fca64c9b700 1 -- start start 2023-10-06T04:41:47.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cc120 0x7fca6006e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fca6006e740 0x7fca6015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6006dd70 con 0x7fca600cbd50 2023-10-06T04:41:47.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6006ebc0 con 0x7fca6006e740 2023-10-06T04:41:47.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca600add50 con 0x7fca600cc120 2023-10-06T04:41:47.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fca6006e740 0x7fca6015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5dd9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cc120 0x7fca6006e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5e59c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fca600cbd50 0x7fca600c9820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:52590/0 (socket says 172.21.15.37:52590) 2023-10-06T04:41:47.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5e59c700 1 -- 172.21.15.37:0/107397945 learned_addr learned my addr 172.21.15.37:0/107397945 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:47.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fca6006e740 0x7fca6015cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60388/0 (socket says 172.21.15.37:60388) 2023-10-06T04:41:47.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5dd9b700 1 -- 172.21.15.37:0/107397945 >> v2:172.21.15.37:3300/0 conn(0x7fca6006e740 msgr2=0x7fca6015cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:47.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5dd9b700 1 --2- 172.21.15.37:0/107397945 >> v2:172.21.15.37:3300/0 conn(0x7fca6006e740 0x7fca6015cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5dd9b700 1 -- 172.21.15.37:0/107397945 >> v1:172.21.15.83:6789/0 conn(0x7fca600cbd50 legacy=0x7fca600c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5dd9b700 1 -- 172.21.15.37:0/107397945 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca600ae030 con 0x7fca600cc120 2023-10-06T04:41:47.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5d59a700 1 -- 172.21.15.37:0/107397945 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805278052 0 0) 0x7fca6006dd70 con 0x7fca600cbd50 2023-10-06T04:41:47.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5dd9b700 1 --2- 172.21.15.37:0/107397945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cc120 0x7fca6006e200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fca480098e0 tx=0x7fca480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0c21a934bb8a02c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5d59a700 1 -- 172.21.15.37:0/107397945 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4800b640 con 0x7fca600cc120 2023-10-06T04:41:47.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5d59a700 1 -- 172.21.15.37:0/107397945 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4800b7a0 con 0x7fca600cc120 2023-10-06T04:41:47.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca5d59a700 1 -- 172.21.15.37:0/107397945 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4800bb40 con 0x7fca600cc120 2023-10-06T04:41:47.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 -- 172.21.15.37:0/107397945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cc120 msgr2=0x7fca6006e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 --2- 172.21.15.37:0/107397945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cc120 0x7fca6006e200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fca480098e0 tx=0x7fca480091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 -- 172.21.15.37:0/107397945 shutdown_connections 2023-10-06T04:41:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 --2- 172.21.15.37:0/107397945 >> v2:172.21.15.37:3300/0 conn(0x7fca6006e740 0x7fca6015cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 --2- 172.21.15.37:0/107397945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cc120 0x7fca6006e200 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 -- 172.21.15.37:0/107397945 >> 172.21.15.37:0/107397945 conn(0x7fca600667b0 msgr2=0x7fca60066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 -- 172.21.15.37:0/107397945 shutdown_connections 2023-10-06T04:41:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.447+0000 7fca64c9b700 1 -- 172.21.15.37:0/107397945 wait complete. 2023-10-06T04:41:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca64c9b700 1 Processor -- start 2023-10-06T04:41:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca64c9b700 1 -- start start 2023-10-06T04:41:47.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca64c9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca6006e740 0x7fca60153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca64c9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cbd50 0x7fca6015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca64c9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca600cc120 0x7fca6015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca64c9b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca60154bc0 con 0x7fca6006e740 2023-10-06T04:41:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca64c9b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6016e880 con 0x7fca600cc120 2023-10-06T04:41:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca64c9b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6015b5e0 con 0x7fca600cbd50 2023-10-06T04:41:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca5dd9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cbd50 0x7fca6015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca5dd9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cbd50 0x7fca6015a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:57344/0 (socket says 172.21.15.37:57344) 2023-10-06T04:41:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca5ed9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca600cc120 0x7fca6015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca5dd9b700 1 -- 172.21.15.37:0/25641539 learned_addr learned my addr 172.21.15.37:0/25641539 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca5e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca6006e740 0x7fca60153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca5ed9d700 1 -- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cbd50 msgr2=0x7fca6015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca5ed9d700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cbd50 0x7fca6015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca5ed9d700 1 -- 172.21.15.37:0/25641539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca6006e740 msgr2=0x7fca60153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca5ed9d700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca6006e740 0x7fca60153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca5ed9d700 1 -- 172.21.15.37:0/25641539 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca48009420 con 0x7fca600cc120 2023-10-06T04:41:47.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca5dd9b700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cbd50 0x7fca6015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:41:47.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.451+0000 7fca5ed9d700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca600cc120 0x7fca6015aef0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fca58009e50 tx=0x7fca5800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.455+0000 7fca567fc700 1 -- 172.21.15.37:0/25641539 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5800caa0 con 0x7fca600cc120 2023-10-06T04:41:47.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.455+0000 7fca567fc700 1 -- 172.21.15.37:0/25641539 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5800f040 con 0x7fca600cc120 2023-10-06T04:41:47.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.455+0000 7fca64c9b700 1 -- 172.21.15.37:0/25641539 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6015b8c0 con 0x7fca600cc120 2023-10-06T04:41:47.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.455+0000 7fca567fc700 1 -- 172.21.15.37:0/25641539 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5800ce50 con 0x7fca600cc120 2023-10-06T04:41:47.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.455+0000 7fca64c9b700 1 -- 172.21.15.37:0/25641539 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6016edb0 con 0x7fca600cc120 2023-10-06T04:41:47.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.455+0000 7fca64c9b700 1 -- 172.21.15.37:0/25641539 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6016efd0 con 0x7fca600cc120 2023-10-06T04:41:47.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.455+0000 7fca567fc700 1 -- 172.21.15.37:0/25641539 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fca58014690 con 0x7fca600cc120 2023-10-06T04:41:47.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.455+0000 7fca567fc700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fca40060550 0x7fca40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.455+0000 7fca567fc700 1 -- 172.21.15.37:0/25641539 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fca5807d310 con 0x7fca600cc120 2023-10-06T04:41:47.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.455+0000 7fca5e59c700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fca40060550 0x7fca40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.459+0000 7fca5e59c700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fca40060550 0x7fca40062a00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fca6015bde0 tx=0x7fca50007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.467+0000 7fca567fc700 1 -- 172.21.15.37:0/25641539 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca58051390 con 0x7fca600cc120 2023-10-06T04:41:47.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 -- 172.21.15.37:0/25641539 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fca60070ee0 con 0x7fca40060550 2023-10-06T04:41:47.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca567fc700 1 -- 172.21.15.37:0/25641539 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fca60070ee0 con 0x7fca40060550 2023-10-06T04:41:47.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 -- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fca40060550 msgr2=0x7fca40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fca40060550 0x7fca40062a00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fca6015bde0 tx=0x7fca50007d30 comp rx=0 tx=0).stop 2023-10-06T04:41:47.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 -- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca600cc120 msgr2=0x7fca6015aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca600cc120 0x7fca6015aef0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fca58009e50 tx=0x7fca5800b040 comp rx=0 tx=0).stop 2023-10-06T04:41:47.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 -- 172.21.15.37:0/25641539 shutdown_connections 2023-10-06T04:41:47.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fca40060550 0x7fca40062a00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca600cc120 0x7fca6015aef0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca600cbd50 0x7fca6015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 --2- 172.21.15.37:0/25641539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca6006e740 0x7fca60153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 -- 172.21.15.37:0/25641539 >> 172.21.15.37:0/25641539 conn(0x7fca600667b0 msgr2=0x7fca600ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:47.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 -- 172.21.15.37:0/25641539 shutdown_connections 2023-10-06T04:41:47.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.631+0000 7fca64c9b700 1 -- 172.21.15.37:0/25641539 wait complete. 2023-10-06T04:41:47.641 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T04:41:47.651 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T04:41:47.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:41:47.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.763+0000 7f6c1c894700 1 Processor -- start 2023-10-06T04:41:47.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.763+0000 7f6c1c894700 1 -- start start 2023-10-06T04:41:47.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c1c894700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c18156190 0x7f6c1806b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c1c894700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6c180cbcb0 0x7f6c180cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c1c894700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1806ce00 con 0x7f6c18150130 2023-10-06T04:41:47.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c1c894700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c18156600 con 0x7f6c18156190 2023-10-06T04:41:47.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c1c894700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c180af010 con 0x7f6c180cbcb0 2023-10-06T04:41:47.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c0dd9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c18156190 0x7f6c1806b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c0dd9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c18156190 0x7f6c1806b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60420/0 (socket says 172.21.15.37:60420) 2023-10-06T04:41:47.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c0dd9b700 1 -- 172.21.15.37:0/2460419286 learned_addr learned my addr 172.21.15.37:0/2460419286 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:47.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c16d9d700 1 --2- 172.21.15.37:0/2460419286 >> v2:172.21.15.83:3300/0 conn(0x7f6c180cbcb0 0x7f6c180cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c0dd9b700 1 -- 172.21.15.37:0/2460419286 >> v2:172.21.15.83:3300/0 conn(0x7f6c180cbcb0 msgr2=0x7f6c180cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:47.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c0dd9b700 1 --2- 172.21.15.37:0/2460419286 >> v2:172.21.15.83:3300/0 conn(0x7f6c180cbcb0 0x7f6c180cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c0dd9b700 1 -- 172.21.15.37:0/2460419286 >> v1:172.21.15.83:6789/0 conn(0x7f6c18150130 legacy=0x7f6c180c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c0dd9b700 1 -- 172.21.15.37:0/2460419286 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c181598c0 con 0x7f6c18156190 2023-10-06T04:41:47.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c0dd9b700 1 --2- 172.21.15.37:0/2460419286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c18156190 0x7f6c1806b2c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6c180c6fc0 tx=0x7f6c0000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2293e13dab395d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c15d9b700 1 -- 172.21.15.37:0/2460419286 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000dba0 con 0x7f6c18156190 2023-10-06T04:41:47.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c15d9b700 1 -- 172.21.15.37:0/2460419286 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0000dd00 con 0x7f6c18156190 2023-10-06T04:41:47.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.767+0000 7f6c15d9b700 1 -- 172.21.15.37:0/2460419286 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000196d0 con 0x7f6c18156190 2023-10-06T04:41:47.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.771+0000 7f6c1c894700 1 -- 172.21.15.37:0/2460419286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c18156190 msgr2=0x7f6c1806b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.771+0000 7f6c1c894700 1 --2- 172.21.15.37:0/2460419286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c18156190 0x7f6c1806b2c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6c180c6fc0 tx=0x7f6c0000b4f0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.771+0000 7f6c1c894700 1 -- 172.21.15.37:0/2460419286 shutdown_connections 2023-10-06T04:41:47.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.771+0000 7f6c1c894700 1 --2- 172.21.15.37:0/2460419286 >> v2:172.21.15.83:3300/0 conn(0x7f6c180cbcb0 0x7f6c180cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.771+0000 7f6c1c894700 1 --2- 172.21.15.37:0/2460419286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c18156190 0x7f6c1806b2c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.771+0000 7f6c1c894700 1 -- 172.21.15.37:0/2460419286 >> 172.21.15.37:0/2460419286 conn(0x7f6c18068e00 msgr2=0x7f6c18069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:47.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.771+0000 7f6c1c894700 1 -- 172.21.15.37:0/2460419286 shutdown_connections 2023-10-06T04:41:47.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.771+0000 7f6c1c894700 1 -- 172.21.15.37:0/2460419286 wait complete. 2023-10-06T04:41:47.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.771+0000 7f6c1c894700 1 Processor -- start 2023-10-06T04:41:47.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.771+0000 7f6c1c894700 1 -- start start 2023-10-06T04:41:47.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c1c894700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c180cbcb0 0x7f6c1814ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c1c894700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c18150130 0x7f6c1815a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c1c894700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c18156190 0x7f6c180b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c1c894700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1814fc70 con 0x7f6c18150130 2023-10-06T04:41:47.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c1c894700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1814f1a0 con 0x7f6c180cbcb0 2023-10-06T04:41:47.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c1c894700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18159d50 con 0x7f6c18156190 2023-10-06T04:41:47.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c0dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c18150130 0x7f6c1815a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c0dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c18150130 0x7f6c1815a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60422/0 (socket says 172.21.15.37:60422) 2023-10-06T04:41:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c0dd9b700 1 -- 172.21.15.37:0/3863906508 learned_addr learned my addr 172.21.15.37:0/3863906508 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c1659c700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c180cbcb0 0x7f6c1814ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c16d9d700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c18156190 0x7f6c180b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c0dd9b700 1 -- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c18156190 msgr2=0x7f6c180b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c0dd9b700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c18156190 0x7f6c180b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c0dd9b700 1 -- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c180cbcb0 msgr2=0x7f6c1814ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c0dd9b700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c180cbcb0 0x7f6c1814ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c0dd9b700 1 -- 172.21.15.37:0/3863906508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0000b790 con 0x7f6c18150130 2023-10-06T04:41:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c0dd9b700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c18150130 0x7f6c1815a7a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6c1806ba50 tx=0x7f6c0001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c0effd700 1 -- 172.21.15.37:0/3863906508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000de70 con 0x7f6c18150130 2023-10-06T04:41:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c0effd700 1 -- 172.21.15.37:0/3863906508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c00010680 con 0x7f6c18150130 2023-10-06T04:41:47.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c1c894700 1 -- 172.21.15.37:0/3863906508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1815a310 con 0x7f6c18150130 2023-10-06T04:41:47.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c0effd700 1 -- 172.21.15.37:0/3863906508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00010a40 con 0x7f6c18150130 2023-10-06T04:41:47.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.775+0000 7f6c1c894700 1 -- 172.21.15.37:0/3863906508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c180b06a0 con 0x7f6c18150130 2023-10-06T04:41:47.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.779+0000 7f6c1c894700 1 -- 172.21.15.37:0/3863906508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c1804be00 con 0x7f6c18150130 2023-10-06T04:41:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.779+0000 7f6c0effd700 1 -- 172.21.15.37:0/3863906508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6c000183e0 con 0x7f6c18150130 2023-10-06T04:41:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.779+0000 7f6c0effd700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6bf8060550 0x7f6bf8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.779+0000 7f6c0effd700 1 -- 172.21.15.37:0/3863906508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f6c00014070 con 0x7f6c18150130 2023-10-06T04:41:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.779+0000 7f6c0effd700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] conn(0x7f6bf8066f80 0x7f6bf80693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.779+0000 7f6c0effd700 1 -- 172.21.15.37:0/3863906508 --> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6bf8069a80 con 0x7f6bf8066f80 2023-10-06T04:41:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.779+0000 7f6c0effd700 1 -- 172.21.15.37:0/3863906508 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c0007e9f0 con 0x7f6c18150130 2023-10-06T04:41:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.779+0000 7f6c1659c700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6bf8060550 0x7f6bf8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.779+0000 7f6c16d9d700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] conn(0x7f6bf8066f80 0x7f6bf80693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.783+0000 7f6c1659c700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6bf8060550 0x7f6bf8062a00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6c080039e0 tx=0x7f6c08007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.783+0000 7f6c16d9d700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] conn(0x7f6bf8066f80 0x7f6bf80693b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.783+0000 7f6c0effd700 1 -- 172.21.15.37:0/3863906508 <== osd.5 v2:172.21.15.83:6800/33663 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6bf8069a80 con 0x7f6bf8066f80 2023-10-06T04:41:47.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c1c894700 1 -- 172.21.15.37:0/3863906508 --> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6c180cba90 con 0x7f6bf8066f80 2023-10-06T04:41:47.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c0effd700 1 -- 172.21.15.37:0/3863906508 <== osd.5 v2:172.21.15.83:6800/33663 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6c180cba90 con 0x7f6bf8066f80 2023-10-06T04:41:47.810 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:41:47.810 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:41:47.810 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:41:47.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c1c894700 1 -- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] conn(0x7f6bf8066f80 msgr2=0x7f6bf80693b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c1c894700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:6800/33663,v1:172.21.15.83:6801/33663] conn(0x7f6bf8066f80 0x7f6bf80693b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c1c894700 1 -- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6bf8060550 msgr2=0x7f6bf8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c1c894700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f6bf8060550 0x7f6bf8062a00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6c080039e0 tx=0x7f6c08007ec0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c1c894700 1 -- 172.21.15.37:0/3863906508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c18150130 msgr2=0x7f6c1815a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c1c894700 1 --2- 172.21.15.37:0/3863906508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c18150130 0x7f6c1815a7a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6c1806ba50 tx=0x7f6c0001b000 comp rx=0 tx=0).stop 2023-10-06T04:41:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c16d9d700 1 -- 172.21.15.37:0/3863906508 reap_dead start 2023-10-06T04:41:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c1c894700 1 -- 172.21.15.37:0/3863906508 shutdown_connections 2023-10-06T04:41:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c1c894700 1 -- 172.21.15.37:0/3863906508 >> 172.21.15.37:0/3863906508 conn(0x7f6c18068e00 msgr2=0x7f6c180c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c1c894700 1 -- 172.21.15.37:0/3863906508 shutdown_connections 2023-10-06T04:41:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.803+0000 7f6c1c894700 1 -- 172.21.15.37:0/3863906508 wait complete. 2023-10-06T04:41:47.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T04:41:47.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f091c9b5700 1 Processor -- start 2023-10-06T04:41:47.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f091c9b5700 1 -- start start 2023-10-06T04:41:47.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f091c9b5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09181550a0 0x7f09180ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f091c9b5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0918155470 0x7f09180afce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f091c9b5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09180adff0 con 0x7f09180b0220 2023-10-06T04:41:47.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f091c9b5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09180b06a0 con 0x7f09181550a0 2023-10-06T04:41:47.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f091c9b5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09180ab500 con 0x7f0918155470 2023-10-06T04:41:47.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f0916d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09181550a0 0x7f09180ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f0916d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09181550a0 0x7f09180ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60432/0 (socket says 172.21.15.37:60432) 2023-10-06T04:41:47.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f0916d9d700 1 -- 172.21.15.37:0/142427354 learned_addr learned my addr 172.21.15.37:0/142427354 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:47.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f090ffff700 1 --2- 172.21.15.37:0/142427354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0918155470 0x7f09180afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f0916d9d700 1 -- 172.21.15.37:0/142427354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0918155470 msgr2=0x7f09180afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:47.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f0916d9d700 1 --2- 172.21.15.37:0/142427354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0918155470 0x7f09180afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.935+0000 7f0916d9d700 1 -- 172.21.15.37:0/142427354 >> v1:172.21.15.37:6789/0 conn(0x7f09180b0220 legacy=0x7f09180aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f0916d9d700 1 -- 172.21.15.37:0/142427354 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09180ae9c0 con 0x7f09181550a0 2023-10-06T04:41:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f0916d9d700 1 --2- 172.21.15.37:0/142427354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09181550a0 0x7f09180ae480 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f09080099b0 tx=0x7f0908009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba0bbf81ca89874 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f091659c700 1 -- 172.21.15.37:0/142427354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090800b860 con 0x7f09181550a0 2023-10-06T04:41:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f091659c700 1 -- 172.21.15.37:0/142427354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090800b9c0 con 0x7f09181550a0 2023-10-06T04:41:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f091659c700 1 -- 172.21.15.37:0/142427354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090800bd40 con 0x7f09181550a0 2023-10-06T04:41:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f091c9b5700 1 -- 172.21.15.37:0/142427354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09181550a0 msgr2=0x7f09180ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f091c9b5700 1 --2- 172.21.15.37:0/142427354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09181550a0 0x7f09180ae480 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f09080099b0 tx=0x7f0908009250 comp rx=0 tx=0).stop 2023-10-06T04:41:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f091c9b5700 1 -- 172.21.15.37:0/142427354 shutdown_connections 2023-10-06T04:41:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f091c9b5700 1 --2- 172.21.15.37:0/142427354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0918155470 0x7f09180afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f091c9b5700 1 --2- 172.21.15.37:0/142427354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09181550a0 0x7f09180ae480 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f091c9b5700 1 -- 172.21.15.37:0/142427354 >> 172.21.15.37:0/142427354 conn(0x7f09180ccb50 msgr2=0x7f091806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f091c9b5700 1 -- 172.21.15.37:0/142427354 shutdown_connections 2023-10-06T04:41:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.939+0000 7f091c9b5700 1 -- 172.21.15.37:0/142427354 wait complete. 2023-10-06T04:41:47.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f091c9b5700 1 Processor -- start 2023-10-06T04:41:47.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f091c9b5700 1 -- start start 2023-10-06T04:41:47.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f091c9b5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09180b0220 0x7f091815a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f091c9b5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09181550a0 0x7f091815bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f091c9b5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0918155470 0x7f09180aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f091c9b5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09180aaf80 con 0x7f0918155470 2023-10-06T04:41:47.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f091c9b5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091815aee0 con 0x7f09180b0220 2023-10-06T04:41:47.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f091c9b5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091815b1c0 con 0x7f09181550a0 2023-10-06T04:41:47.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f091759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0918155470 0x7f09180aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f091759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0918155470 0x7f09180aaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60448/0 (socket says 172.21.15.37:60448) 2023-10-06T04:41:47.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f091759e700 1 -- 172.21.15.37:0/375646699 learned_addr learned my addr 172.21.15.37:0/375646699 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:47.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f090ffff700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09181550a0 0x7f091815bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.943+0000 7f0916d9d700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09180b0220 0x7f091815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f091759e700 1 -- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09181550a0 msgr2=0x7f091815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f091759e700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09181550a0 0x7f091815bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f091759e700 1 -- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09180b0220 msgr2=0x7f091815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:47.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f091759e700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09180b0220 0x7f091815a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:47.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f091759e700 1 -- 172.21.15.37:0/375646699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09080094f0 con 0x7f0918155470 2023-10-06T04:41:47.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f091759e700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0918155470 0x7f09180aaa40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f091000c8e0 tx=0x7f0910001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f090effd700 1 -- 172.21.15.37:0/375646699 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910012630 con 0x7f0918155470 2023-10-06T04:41:47.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f090effd700 1 -- 172.21.15.37:0/375646699 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0910012790 con 0x7f0918155470 2023-10-06T04:41:47.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f090effd700 1 -- 172.21.15.37:0/375646699 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910012b50 con 0x7f0918155470 2023-10-06T04:41:47.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f091c9b5700 1 -- 172.21.15.37:0/375646699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091815b4a0 con 0x7f0918155470 2023-10-06T04:41:47.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f091c9b5700 1 -- 172.21.15.37:0/375646699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091815ba60 con 0x7f0918155470 2023-10-06T04:41:47.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f091c9b5700 1 -- 172.21.15.37:0/375646699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091815bc50 con 0x7f0918155470 2023-10-06T04:41:47.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f090effd700 1 -- 172.21.15.37:0/375646699 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f091001a3a0 con 0x7f0918155470 2023-10-06T04:41:47.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f090effd700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f08f8060580 0x7f08f8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:47.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f090effd700 1 -- 172.21.15.37:0/375646699 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f091007c940 con 0x7f0918155470 2023-10-06T04:41:47.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.947+0000 7f0916d9d700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f08f8060580 0x7f08f8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:47.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.951+0000 7f0916d9d700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f08f8060580 0x7f08f8062a30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f09080099b0 tx=0x7f0908017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:47.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:47.955+0000 7f090effd700 1 -- 172.21.15.37:0/375646699 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f09100509c0 con 0x7f0918155470 2023-10-06T04:41:48.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.119+0000 7f091c9b5700 1 -- 172.21.15.37:0/375646699 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f09180708a0 con 0x7f08f8060580 2023-10-06T04:41:48.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.119+0000 7f090effd700 1 -- 172.21.15.37:0/375646699 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f09180708a0 con 0x7f08f8060580 2023-10-06T04:41:48.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.123+0000 7f091c9b5700 1 -- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f08f8060580 msgr2=0x7f08f8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.123+0000 7f091c9b5700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f08f8060580 0x7f08f8062a30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f09080099b0 tx=0x7f0908017000 comp rx=0 tx=0).stop 2023-10-06T04:41:48.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.123+0000 7f091c9b5700 1 -- 172.21.15.37:0/375646699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0918155470 msgr2=0x7f09180aaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.123+0000 7f091c9b5700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0918155470 0x7f09180aaa40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f091000c8e0 tx=0x7f0910001710 comp rx=0 tx=0).stop 2023-10-06T04:41:48.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.123+0000 7f091c9b5700 1 -- 172.21.15.37:0/375646699 shutdown_connections 2023-10-06T04:41:48.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.123+0000 7f091c9b5700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f08f8060580 0x7f08f8062a30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.123+0000 7f091c9b5700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0918155470 0x7f09180aaa40 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.123+0000 7f091c9b5700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09181550a0 0x7f091815bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.123+0000 7f091c9b5700 1 --2- 172.21.15.37:0/375646699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09180b0220 0x7f091815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.123+0000 7f091c9b5700 1 -- 172.21.15.37:0/375646699 >> 172.21.15.37:0/375646699 conn(0x7f09180ccb50 msgr2=0x7f09180ac250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:48.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.123+0000 7f091c9b5700 1 -- 172.21.15.37:0/375646699 shutdown_connections 2023-10-06T04:41:48.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.123+0000 7f091c9b5700 1 -- 172.21.15.37:0/375646699 wait complete. 2023-10-06T04:41:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T04:41:48.140 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T04:41:48.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:41:48.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a94ef9700 1 Processor -- start 2023-10-06T04:41:48.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a94ef9700 1 -- start start 2023-10-06T04:41:48.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a94ef9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a901557f0 0x7f3a900c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a94ef9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3a900b0680 0x7f3a900af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a94ef9700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a900aca00 con 0x7f3a900aef50 2023-10-06T04:41:48.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a94ef9700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a900afcf0 con 0x7f3a900b0680 2023-10-06T04:41:48.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a94ef9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900c8fb0 con 0x7f3a901557f0 2023-10-06T04:41:48.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a8ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3a900b0680 0x7f3a900af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a8f7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a901557f0 0x7f3a900c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a8ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3a900b0680 0x7f3a900af3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:50414/0 (socket says 172.21.15.37:50414) 2023-10-06T04:41:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a8ffff700 1 -- 172.21.15.37:0/3520175715 learned_addr learned my addr 172.21.15.37:0/3520175715 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a86ffd700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3a900aef50 0x7f3a900aff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:52616/0 (socket says 172.21.15.37:52616) 2023-10-06T04:41:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a8ffff700 1 -- 172.21.15.37:0/3520175715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a901557f0 msgr2=0x7f3a900c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a8ffff700 1 --2- 172.21.15.37:0/3520175715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a901557f0 0x7f3a900c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a8ffff700 1 -- 172.21.15.37:0/3520175715 >> v1:172.21.15.83:6789/0 conn(0x7f3a900aef50 legacy=0x7f3a900aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a8ffff700 1 -- 172.21.15.37:0/3520175715 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a900cc5d0 con 0x7f3a900b0680 2023-10-06T04:41:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.247+0000 7f3a8ffff700 1 --2- 172.21.15.37:0/3520175715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a900b0680 0x7f3a900af3a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009f20 tx=0x7f3a88009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5293f7a896822b82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a8effd700 1 -- 172.21.15.37:0/3520175715 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800e070 con 0x7f3a900b0680 2023-10-06T04:41:48.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a8effd700 1 -- 172.21.15.37:0/3520175715 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8800b9d0 con 0x7f3a900b0680 2023-10-06T04:41:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a8effd700 1 -- 172.21.15.37:0/3520175715 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a880092e0 con 0x7f3a900b0680 2023-10-06T04:41:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a94ef9700 1 -- 172.21.15.37:0/3520175715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a900b0680 msgr2=0x7f3a900af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a94ef9700 1 --2- 172.21.15.37:0/3520175715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a900b0680 0x7f3a900af3a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009f20 tx=0x7f3a88009840 comp rx=0 tx=0).stop 2023-10-06T04:41:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a94ef9700 1 -- 172.21.15.37:0/3520175715 shutdown_connections 2023-10-06T04:41:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a94ef9700 1 --2- 172.21.15.37:0/3520175715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a900b0680 0x7f3a900af3a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a94ef9700 1 --2- 172.21.15.37:0/3520175715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a901557f0 0x7f3a900c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a94ef9700 1 -- 172.21.15.37:0/3520175715 >> 172.21.15.37:0/3520175715 conn(0x7f3a900687b0 msgr2=0x7f3a900cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a94ef9700 1 -- 172.21.15.37:0/3520175715 shutdown_connections 2023-10-06T04:41:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a94ef9700 1 -- 172.21.15.37:0/3520175715 wait complete. 2023-10-06T04:41:48.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a94ef9700 1 Processor -- start 2023-10-06T04:41:48.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.251+0000 7f3a94ef9700 1 -- start start 2023-10-06T04:41:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a94ef9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a900aef50 0x7f3a900ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a94ef9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a900b0680 0x7f3a90144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a94ef9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a901557f0 0x7f3a90145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a94ef9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90151d90 con 0x7f3a900b0680 2023-10-06T04:41:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a94ef9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9015a450 con 0x7f3a900aef50 2023-10-06T04:41:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a94ef9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90159840 con 0x7f3a901557f0 2023-10-06T04:41:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a86ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a900b0680 0x7f3a90144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a8ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a901557f0 0x7f3a90145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a8f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a900aef50 0x7f3a900ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a8ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a901557f0 0x7f3a90145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:57394/0 (socket says 172.21.15.37:57394) 2023-10-06T04:41:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a8ffff700 1 -- 172.21.15.37:0/56842186 learned_addr learned my addr 172.21.15.37:0/56842186 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a86ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a900b0680 0x7f3a90144ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60450/0 (socket says 172.21.15.37:60450) 2023-10-06T04:41:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a86ffd700 1 -- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a901557f0 msgr2=0x7f3a90145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a86ffd700 1 --2- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a901557f0 0x7f3a90145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a86ffd700 1 -- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a900aef50 msgr2=0x7f3a900ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a86ffd700 1 --2- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a900aef50 0x7f3a900ab370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a86ffd700 1 -- 172.21.15.37:0/56842186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a88009ae0 con 0x7f3a900b0680 2023-10-06T04:41:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a86ffd700 1 --2- 172.21.15.37:0/56842186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a900b0680 0x7f3a90144ec0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c590 tx=0x7f3a78007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a87fff700 1 -- 172.21.15.37:0/56842186 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78005a70 con 0x7f3a900b0680 2023-10-06T04:41:48.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a87fff700 1 -- 172.21.15.37:0/56842186 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a78005bf0 con 0x7f3a900b0680 2023-10-06T04:41:48.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a94ef9700 1 -- 172.21.15.37:0/56842186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a90159b20 con 0x7f3a900b0680 2023-10-06T04:41:48.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a87fff700 1 -- 172.21.15.37:0/56842186 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780070d0 con 0x7f3a900b0680 2023-10-06T04:41:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.255+0000 7f3a94ef9700 1 -- 172.21.15.37:0/56842186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9015a0e0 con 0x7f3a900b0680 2023-10-06T04:41:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.259+0000 7f3a94ef9700 1 -- 172.21.15.37:0/56842186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a9004be00 con 0x7f3a900b0680 2023-10-06T04:41:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.259+0000 7f3a87fff700 1 -- 172.21.15.37:0/56842186 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3a78007480 con 0x7f3a900b0680 2023-10-06T04:41:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.259+0000 7f3a87fff700 1 --2- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3a70060550 0x7f3a70062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.259+0000 7f3a87fff700 1 -- 172.21.15.37:0/56842186 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f3a7807c220 con 0x7f3a900b0680 2023-10-06T04:41:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.259+0000 7f3a8f7fe700 1 --2- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3a70060550 0x7f3a70062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.259+0000 7f3a87fff700 1 --2- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] conn(0x7f3a70066f80 0x7f3a700693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.259+0000 7f3a87fff700 1 -- 172.21.15.37:0/56842186 --> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a70069a80 con 0x7f3a70066f80 2023-10-06T04:41:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.259+0000 7f3a87fff700 1 -- 172.21.15.37:0/56842186 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a7807c5f0 con 0x7f3a900b0680 2023-10-06T04:41:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.259+0000 7f3a8ffff700 1 --2- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] conn(0x7f3a70066f80 0x7f3a700693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.263+0000 7f3a8f7fe700 1 --2- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3a70060550 0x7f3a70062a00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009db0 tx=0x7f3a800091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.263+0000 7f3a8ffff700 1 --2- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] conn(0x7f3a70066f80 0x7f3a700693b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.263+0000 7f3a87fff700 1 -- 172.21.15.37:0/56842186 <== osd.6 v2:172.21.15.83:6808/33693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3a70069a80 con 0x7f3a70066f80 2023-10-06T04:41:48.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a94ef9700 1 -- 172.21.15.37:0/56842186 --> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3a900675a0 con 0x7f3a70066f80 2023-10-06T04:41:48.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a87fff700 1 -- 172.21.15.37:0/56842186 <== osd.6 v2:172.21.15.83:6808/33693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3a900675a0 con 0x7f3a70066f80 2023-10-06T04:41:48.289 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:41:48.289 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:41:48.289 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:41:48.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a94ef9700 1 -- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] conn(0x7f3a70066f80 msgr2=0x7f3a700693b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a94ef9700 1 --2- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:6808/33693,v1:172.21.15.83:6809/33693] conn(0x7f3a70066f80 0x7f3a700693b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a94ef9700 1 -- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3a70060550 msgr2=0x7f3a70062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a94ef9700 1 --2- 172.21.15.37:0/56842186 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f3a70060550 0x7f3a70062a00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009db0 tx=0x7f3a800091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a94ef9700 1 -- 172.21.15.37:0/56842186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a900b0680 msgr2=0x7f3a90144ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a94ef9700 1 --2- 172.21.15.37:0/56842186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a900b0680 0x7f3a90144ec0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c590 tx=0x7f3a78007eb0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a8ffff700 1 -- 172.21.15.37:0/56842186 reap_dead start 2023-10-06T04:41:48.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a94ef9700 1 -- 172.21.15.37:0/56842186 shutdown_connections 2023-10-06T04:41:48.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a94ef9700 1 -- 172.21.15.37:0/56842186 >> 172.21.15.37:0/56842186 conn(0x7f3a900687b0 msgr2=0x7f3a900ca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:48.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a94ef9700 1 -- 172.21.15.37:0/56842186 shutdown_connections 2023-10-06T04:41:48.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.283+0000 7f3a94ef9700 1 -- 172.21.15.37:0/56842186 wait complete. 2023-10-06T04:41:48.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T04:41:48.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7db599700 1 Processor -- start 2023-10-06T04:41:48.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7db599700 1 -- start start 2023-10-06T04:41:48.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7db599700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc7d406f050 0x7fc7d40c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7db599700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d406f420 0x7fc7d415d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7db599700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7d406e590 0x7fc7d40cc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7db599700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d415ddb0 con 0x7fc7d406e590 2023-10-06T04:41:48.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7db599700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d40c9240 con 0x7fc7d406f050 2023-10-06T04:41:48.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7db599700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d415df90 con 0x7fc7d406f420 2023-10-06T04:41:48.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7dad98700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7d406e590 0x7fc7d40cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7dad98700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7d406e590 0x7fc7d40cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60464/0 (socket says 172.21.15.37:60464) 2023-10-06T04:41:48.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7dad98700 1 -- 172.21.15.37:0/1095846755 learned_addr learned my addr 172.21.15.37:0/1095846755 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:48.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7d9d96700 1 --2- 172.21.15.37:0/1095846755 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d406f420 0x7fc7d415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7da597700 1 --2- 172.21.15.37:0/1095846755 >> v2:172.21.15.83:3300/0 conn(0x7fc7d406f050 0x7fc7d40c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7dad98700 1 -- 172.21.15.37:0/1095846755 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d406f420 msgr2=0x7fc7d415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:48.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.407+0000 7fc7dad98700 1 --2- 172.21.15.37:0/1095846755 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d406f420 0x7fc7d415d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7dad98700 1 -- 172.21.15.37:0/1095846755 >> v2:172.21.15.83:3300/0 conn(0x7fc7d406f050 msgr2=0x7fc7d40c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:48.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7dad98700 1 --2- 172.21.15.37:0/1095846755 >> v2:172.21.15.83:3300/0 conn(0x7fc7d406f050 0x7fc7d40c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7dad98700 1 -- 172.21.15.37:0/1095846755 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d40c00c0 con 0x7fc7d406e590 2023-10-06T04:41:48.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7da597700 1 --2- 172.21.15.37:0/1095846755 >> v2:172.21.15.83:3300/0 conn(0x7fc7d406f050 0x7fc7d40c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:41:48.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7dad98700 1 --2- 172.21.15.37:0/1095846755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7d406e590 0x7fc7d40cc860 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc7d406e1e0 tx=0x7fc7cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a00566750505d27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7d9595700 1 -- 172.21.15.37:0/1095846755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc00e070 con 0x7fc7d406e590 2023-10-06T04:41:48.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7d9595700 1 -- 172.21.15.37:0/1095846755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc00ba20 con 0x7fc7d406e590 2023-10-06T04:41:48.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7d9595700 1 -- 172.21.15.37:0/1095846755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0092e0 con 0x7fc7d406e590 2023-10-06T04:41:48.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7db599700 1 -- 172.21.15.37:0/1095846755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7d406e590 msgr2=0x7fc7d40cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7db599700 1 --2- 172.21.15.37:0/1095846755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7d406e590 0x7fc7d40cc860 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc7d406e1e0 tx=0x7fc7cc009840 comp rx=0 tx=0).stop 2023-10-06T04:41:48.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7db599700 1 -- 172.21.15.37:0/1095846755 shutdown_connections 2023-10-06T04:41:48.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7db599700 1 --2- 172.21.15.37:0/1095846755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7d406e590 0x7fc7d40cc860 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7db599700 1 --2- 172.21.15.37:0/1095846755 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d406f420 0x7fc7d415d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7db599700 1 --2- 172.21.15.37:0/1095846755 >> v2:172.21.15.83:3300/0 conn(0x7fc7d406f050 0x7fc7d40c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7db599700 1 -- 172.21.15.37:0/1095846755 >> 172.21.15.37:0/1095846755 conn(0x7fc7d4068e00 msgr2=0x7fc7d4069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:48.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7db599700 1 -- 172.21.15.37:0/1095846755 shutdown_connections 2023-10-06T04:41:48.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7db599700 1 -- 172.21.15.37:0/1095846755 wait complete. 2023-10-06T04:41:48.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7db599700 1 Processor -- start 2023-10-06T04:41:48.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.411+0000 7fc7db599700 1 -- start start 2023-10-06T04:41:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7db599700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7d406e590 0x7fc7d415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7db599700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7d406f050 0x7fc7d416d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7db599700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d406f420 0x7fc7d4160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7db599700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d415d4b0 con 0x7fc7d406f050 2023-10-06T04:41:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7db599700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d40c1bf0 con 0x7fc7d406e590 2023-10-06T04:41:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7db599700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d40c4670 con 0x7fc7d406f420 2023-10-06T04:41:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7d9d96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7d406f050 0x7fc7d416d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7d9d96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7d406f050 0x7fc7d416d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60468/0 (socket says 172.21.15.37:60468) 2023-10-06T04:41:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7d9d96700 1 -- 172.21.15.37:0/3505877264 learned_addr learned my addr 172.21.15.37:0/3505877264 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7da597700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7d406e590 0x7fc7d415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7dad98700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d406f420 0x7fc7d4160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7d9d96700 1 -- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d406f420 msgr2=0x7fc7d4160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7d9d96700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d406f420 0x7fc7d4160c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7d9d96700 1 -- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7d406e590 msgr2=0x7fc7d415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7d9d96700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7d406e590 0x7fc7d415cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7d9d96700 1 -- 172.21.15.37:0/3505877264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc009ae0 con 0x7fc7d406f050 2023-10-06T04:41:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7d9d96700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7d406f050 0x7fc7d416d7d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000ec80 tx=0x7fc7d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7c67fc700 1 -- 172.21.15.37:0/3505877264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00096b0 con 0x7fc7d406f050 2023-10-06T04:41:48.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7c67fc700 1 -- 172.21.15.37:0/3505877264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d000c850 con 0x7fc7d406f050 2023-10-06T04:41:48.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7db599700 1 -- 172.21.15.37:0/3505877264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d416e170 con 0x7fc7d406f050 2023-10-06T04:41:48.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7c67fc700 1 -- 172.21.15.37:0/3505877264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000cc10 con 0x7fc7d406f050 2023-10-06T04:41:48.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.415+0000 7fc7db599700 1 -- 172.21.15.37:0/3505877264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d416e730 con 0x7fc7d406f050 2023-10-06T04:41:48.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.419+0000 7fc7c67fc700 1 -- 172.21.15.37:0/3505877264 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc7d0013470 con 0x7fc7d406f050 2023-10-06T04:41:48.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.419+0000 7fc7db599700 1 -- 172.21.15.37:0/3505877264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d40c1da0 con 0x7fc7d406f050 2023-10-06T04:41:48.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.419+0000 7fc7c67fc700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc7b8060550 0x7fc7b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.419+0000 7fc7c67fc700 1 -- 172.21.15.37:0/3505877264 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fc7d007c9a0 con 0x7fc7d406f050 2023-10-06T04:41:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.419+0000 7fc7da597700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc7b8060550 0x7fc7b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.419+0000 7fc7da597700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc7b8060550 0x7fc7b8062a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8006f00 tx=0x7fc7c8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.427+0000 7fc7c67fc700 1 -- 172.21.15.37:0/3505877264 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc7d40c1da0 con 0x7fc7d406f050 2023-10-06T04:41:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.587+0000 7fc7db599700 1 -- 172.21.15.37:0/3505877264 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7d40c1d60 con 0x7fc7b8060550 2023-10-06T04:41:48.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.587+0000 7fc7c67fc700 1 -- 172.21.15.37:0/3505877264 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc7d40c1d60 con 0x7fc7b8060550 2023-10-06T04:41:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.591+0000 7fc7db599700 1 -- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc7b8060550 msgr2=0x7fc7b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.591+0000 7fc7db599700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc7b8060550 0x7fc7b8062a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8006f00 tx=0x7fc7c8008040 comp rx=0 tx=0).stop 2023-10-06T04:41:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.591+0000 7fc7db599700 1 -- 172.21.15.37:0/3505877264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7d406f050 msgr2=0x7fc7d416d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.591+0000 7fc7db599700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7d406f050 0x7fc7d416d7d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000ec80 tx=0x7fc7d00091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.591+0000 7fc7db599700 1 -- 172.21.15.37:0/3505877264 shutdown_connections 2023-10-06T04:41:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.591+0000 7fc7db599700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fc7b8060550 0x7fc7b8062a00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.591+0000 7fc7db599700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d406f420 0x7fc7d4160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.591+0000 7fc7db599700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7d406f050 0x7fc7d416d7d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.591+0000 7fc7db599700 1 --2- 172.21.15.37:0/3505877264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7d406e590 0x7fc7d415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.591+0000 7fc7db599700 1 -- 172.21.15.37:0/3505877264 >> 172.21.15.37:0/3505877264 conn(0x7fc7d4068e00 msgr2=0x7fc7d40c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.591+0000 7fc7db599700 1 -- 172.21.15.37:0/3505877264 shutdown_connections 2023-10-06T04:41:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.591+0000 7fc7db599700 1 -- 172.21.15.37:0/3505877264 wait complete. 2023-10-06T04:41:48.601 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T04:41:48.610 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T04:41:48.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:41:48.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.715+0000 7fe0a2c75700 1 Processor -- start 2023-10-06T04:41:48.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.715+0000 7fe0a2c75700 1 -- start start 2023-10-06T04:41:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.715+0000 7fe0a2c75700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe09c158cc0 0x7fe09c159090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.715+0000 7fe0a2c75700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe09c0cbb30 0x7fe09c0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.715+0000 7fe0a2c75700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c15d810 con 0x7fe09c0c9180 2023-10-06T04:41:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.715+0000 7fe0a2c75700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0c9d10 con 0x7fe09c0cbb30 2023-10-06T04:41:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.715+0000 7fe0a2c75700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0cc4c0 con 0x7fe09c158cc0 2023-10-06T04:41:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.715+0000 7fe09bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe09c0cbb30 0x7fe09c0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.715+0000 7fe09bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe09c0cbb30 0x7fe09c0cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60480/0 (socket says 172.21.15.37:60480) 2023-10-06T04:41:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.715+0000 7fe09bfff700 1 -- 172.21.15.37:0/2070360402 learned_addr learned my addr 172.21.15.37:0/2070360402 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.715+0000 7fe0a0a11700 1 --2- 172.21.15.37:0/2070360402 >> v2:172.21.15.83:3300/0 conn(0x7fe09c158cc0 0x7fe09c159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe09bfff700 1 -- 172.21.15.37:0/2070360402 >> v2:172.21.15.83:3300/0 conn(0x7fe09c158cc0 msgr2=0x7fe09c159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:48.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe09bfff700 1 --2- 172.21.15.37:0/2070360402 >> v2:172.21.15.83:3300/0 conn(0x7fe09c158cc0 0x7fe09c159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe09bfff700 1 -- 172.21.15.37:0/2070360402 >> v1:172.21.15.37:6789/0 conn(0x7fe09c0c9180 legacy=0x7fe09c0c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe09bfff700 1 -- 172.21.15.37:0/2070360402 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c15cc00 con 0x7fe09c0cbb30 2023-10-06T04:41:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe09bfff700 1 --2- 172.21.15.37:0/2070360402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cbb30 0x7fe09c0cbf80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0b1a30 tx=0x7fe090009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67005bfaf52db974 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe09b7fe700 1 -- 172.21.15.37:0/2070360402 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090009e70 con 0x7fe09c0cbb30 2023-10-06T04:41:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe09b7fe700 1 -- 172.21.15.37:0/2070360402 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09000b860 con 0x7fe09c0cbb30 2023-10-06T04:41:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe09b7fe700 1 -- 172.21.15.37:0/2070360402 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09000bc00 con 0x7fe09c0cbb30 2023-10-06T04:41:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe0a2c75700 1 -- 172.21.15.37:0/2070360402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cbb30 msgr2=0x7fe09c0cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe0a2c75700 1 --2- 172.21.15.37:0/2070360402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cbb30 0x7fe09c0cbf80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0b1a30 tx=0x7fe090009250 comp rx=0 tx=0).stop 2023-10-06T04:41:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe0a2c75700 1 -- 172.21.15.37:0/2070360402 shutdown_connections 2023-10-06T04:41:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe0a2c75700 1 --2- 172.21.15.37:0/2070360402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cbb30 0x7fe09c0cbf80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe0a2c75700 1 --2- 172.21.15.37:0/2070360402 >> v2:172.21.15.83:3300/0 conn(0x7fe09c158cc0 0x7fe09c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe0a2c75700 1 -- 172.21.15.37:0/2070360402 >> 172.21.15.37:0/2070360402 conn(0x7fe09c0667b0 msgr2=0x7fe09c066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe0a2c75700 1 -- 172.21.15.37:0/2070360402 shutdown_connections 2023-10-06T04:41:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe0a2c75700 1 -- 172.21.15.37:0/2070360402 wait complete. 2023-10-06T04:41:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe0a2c75700 1 Processor -- start 2023-10-06T04:41:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.719+0000 7fe0a2c75700 1 -- start start 2023-10-06T04:41:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe0a2c75700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe09c0c9180 0x7fe09c158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe0a2c75700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cbb30 0x7fe09c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe0a2c75700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c158cc0 0x7fe09c150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe0a2c75700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0c5ec0 con 0x7fe09c0cbb30 2023-10-06T04:41:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe0a2c75700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0c6160 con 0x7fe09c158cc0 2023-10-06T04:41:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe0a2c75700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c156bc0 con 0x7fe09c0c9180 2023-10-06T04:41:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe09bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cbb30 0x7fe09c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe09bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cbb30 0x7fe09c155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60494/0 (socket says 172.21.15.37:60494) 2023-10-06T04:41:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe09bfff700 1 -- 172.21.15.37:0/74247114 learned_addr learned my addr 172.21.15.37:0/74247114 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:48.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe0a0a11700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe09c0c9180 0x7fe09c158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe0a1212700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c158cc0 0x7fe09c150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe09bfff700 1 -- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe09c0c9180 msgr2=0x7fe09c158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe09bfff700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe09c0c9180 0x7fe09c158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe09bfff700 1 -- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c158cc0 msgr2=0x7fe09c150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe09bfff700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c158cc0 0x7fe09c150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe09bfff700 1 -- 172.21.15.37:0/74247114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900094f0 con 0x7fe09c0cbb30 2023-10-06T04:41:48.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe09bfff700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cbb30 0x7fe09c155b10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe09000b3c0 tx=0x7fe090017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe098ff9700 1 -- 172.21.15.37:0/74247114 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090000d10 con 0x7fe09c0cbb30 2023-10-06T04:41:48.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe098ff9700 1 -- 172.21.15.37:0/74247114 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09000b9d0 con 0x7fe09c0cbb30 2023-10-06T04:41:48.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe0a2c75700 1 -- 172.21.15.37:0/74247114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c156050 con 0x7fe09c0cbb30 2023-10-06T04:41:48.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe098ff9700 1 -- 172.21.15.37:0/74247114 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090025420 con 0x7fe09c0cbb30 2023-10-06T04:41:48.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe0a2c75700 1 -- 172.21.15.37:0/74247114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c156600 con 0x7fe09c0cbb30 2023-10-06T04:41:48.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe0a2c75700 1 -- 172.21.15.37:0/74247114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe09c064710 con 0x7fe09c0cbb30 2023-10-06T04:41:48.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.723+0000 7fe098ff9700 1 -- 172.21.15.37:0/74247114 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe090023070 con 0x7fe09c0cbb30 2023-10-06T04:41:48.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.727+0000 7fe098ff9700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe088060550 0x7fe088062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.727+0000 7fe098ff9700 1 -- 172.21.15.37:0/74247114 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fe09007e580 con 0x7fe09c0cbb30 2023-10-06T04:41:48.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.727+0000 7fe0a0a11700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe088060550 0x7fe088062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.727+0000 7fe098ff9700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] conn(0x7fe088066e10 0x7fe088069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.727+0000 7fe098ff9700 1 -- 172.21.15.37:0/74247114 --> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe088069910 con 0x7fe088066e10 2023-10-06T04:41:48.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.727+0000 7fe098ff9700 1 -- 172.21.15.37:0/74247114 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe09007e870 con 0x7fe09c0cbb30 2023-10-06T04:41:48.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.727+0000 7fe0a1212700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] conn(0x7fe088066e10 0x7fe088069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.727+0000 7fe0a0a11700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe088060550 0x7fe088062a00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe094009fd0 tx=0x7fe09400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.727+0000 7fe0a1212700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] conn(0x7fe088066e10 0x7fe088069240 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.731+0000 7fe098ff9700 1 -- 172.21.15.37:0/74247114 <== osd.7 v2:172.21.15.83:6824/33674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe088069910 con 0x7fe088066e10 2023-10-06T04:41:48.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe0a2c75700 1 -- 172.21.15.37:0/74247114 --> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe09c063840 con 0x7fe088066e10 2023-10-06T04:41:48.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe098ff9700 1 -- 172.21.15.37:0/74247114 <== osd.7 v2:172.21.15.83:6824/33674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe08c001880 con 0x7fe088066e10 2023-10-06T04:41:48.755 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:41:48.755 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:41:48.755 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:41:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe0a2c75700 1 -- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] conn(0x7fe088066e10 msgr2=0x7fe088069240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe0a2c75700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:6824/33674,v1:172.21.15.83:6825/33674] conn(0x7fe088066e10 0x7fe088069240 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe0a2c75700 1 -- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe088060550 msgr2=0x7fe088062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe0a2c75700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7fe088060550 0x7fe088062a00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe094009fd0 tx=0x7fe09400b040 comp rx=0 tx=0).stop 2023-10-06T04:41:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe0a2c75700 1 -- 172.21.15.37:0/74247114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cbb30 msgr2=0x7fe09c155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe0a2c75700 1 --2- 172.21.15.37:0/74247114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cbb30 0x7fe09c155b10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe09000b3c0 tx=0x7fe090017000 comp rx=0 tx=0).stop 2023-10-06T04:41:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe0a1212700 1 -- 172.21.15.37:0/74247114 reap_dead start 2023-10-06T04:41:48.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe0a2c75700 1 -- 172.21.15.37:0/74247114 shutdown_connections 2023-10-06T04:41:48.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe0a2c75700 1 -- 172.21.15.37:0/74247114 >> 172.21.15.37:0/74247114 conn(0x7fe09c0667b0 msgr2=0x7fe09c15b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:48.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe0a2c75700 1 -- 172.21.15.37:0/74247114 shutdown_connections 2023-10-06T04:41:48.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.747+0000 7fe0a2c75700 1 -- 172.21.15.37:0/74247114 wait complete. 2023-10-06T04:41:48.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T04:41:48.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f16249fe700 1 Processor -- start 2023-10-06T04:41:48.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f16249fe700 1 -- start start 2023-10-06T04:41:48.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f16249fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f16201505a0 0x7f16200cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f16249fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16200cc110 0x7f16200ca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f16249fe700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16200c9750 con 0x7f16201501d0 2023-10-06T04:41:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f16249fe700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16200c9ff0 con 0x7f16201505a0 2023-10-06T04:41:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f16249fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16200cc560 con 0x7f16200cc110 2023-10-06T04:41:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f1617fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f16201505a0 0x7f16200cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f161e59c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f16201501d0 0x7f16201575b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:52620/0 (socket says 172.21.15.37:52620) 2023-10-06T04:41:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f161e59c700 1 -- 172.21.15.37:0/3545213019 learned_addr learned my addr 172.21.15.37:0/3545213019 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:41:48.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f161ed9d700 1 --2- 172.21.15.37:0/3545213019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16200cc110 0x7f16200ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f1617fff700 1 -- 172.21.15.37:0/3545213019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16200cc110 msgr2=0x7f16200ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:48.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f1617fff700 1 --2- 172.21.15.37:0/3545213019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16200cc110 0x7f16200ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f1617fff700 1 -- 172.21.15.37:0/3545213019 >> v1:172.21.15.83:6789/0 conn(0x7f16201501d0 legacy=0x7f16201575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f161dd9b700 1 -- 172.21.15.37:0/3545213019 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674502642 0 0) 0x7f16200c9750 con 0x7f16201501d0 2023-10-06T04:41:48.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f1617fff700 1 -- 172.21.15.37:0/3545213019 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162015a7f0 con 0x7f16201505a0 2023-10-06T04:41:48.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.871+0000 7f1617fff700 1 --2- 172.21.15.37:0/3545213019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16201505a0 0x7f16200cbbd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f16080098e0 tx=0x7f16080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdf1a5f48fca2e71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f161dd9b700 1 -- 172.21.15.37:0/3545213019 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160800b640 con 0x7f16201505a0 2023-10-06T04:41:48.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f161dd9b700 1 -- 172.21.15.37:0/3545213019 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160800b7a0 con 0x7f16201505a0 2023-10-06T04:41:48.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f161dd9b700 1 -- 172.21.15.37:0/3545213019 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160800bb40 con 0x7f16201505a0 2023-10-06T04:41:48.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 -- 172.21.15.37:0/3545213019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16201505a0 msgr2=0x7f16200cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 --2- 172.21.15.37:0/3545213019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16201505a0 0x7f16200cbbd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f16080098e0 tx=0x7f16080091a0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 -- 172.21.15.37:0/3545213019 shutdown_connections 2023-10-06T04:41:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 --2- 172.21.15.37:0/3545213019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16200cc110 0x7f16200ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 --2- 172.21.15.37:0/3545213019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16201505a0 0x7f16200cbbd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 -- 172.21.15.37:0/3545213019 >> 172.21.15.37:0/3545213019 conn(0x7f16200667b0 msgr2=0x7f1620066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 -- 172.21.15.37:0/3545213019 shutdown_connections 2023-10-06T04:41:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 -- 172.21.15.37:0/3545213019 wait complete. 2023-10-06T04:41:48.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 Processor -- start 2023-10-06T04:41:48.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 -- start start 2023-10-06T04:41:48.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16200cc110 0x7f162014d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16201501d0 0x7f1620158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16201505a0 0x7f162014c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16201595c0 con 0x7f16200cc110 2023-10-06T04:41:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1620159320 con 0x7f16201501d0 2023-10-06T04:41:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f16249fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162016c9d0 con 0x7f16201505a0 2023-10-06T04:41:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f161e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16200cc110 0x7f162014d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f161e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16200cc110 0x7f162014d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60500/0 (socket says 172.21.15.37:60500) 2023-10-06T04:41:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f161e59c700 1 -- 172.21.15.37:0/4113436709 learned_addr learned my addr 172.21.15.37:0/4113436709 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:48.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f161ed9d700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16201505a0 0x7f162014c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f1617fff700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16201501d0 0x7f1620158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f161e59c700 1 -- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16201505a0 msgr2=0x7f162014c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f161e59c700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16201505a0 0x7f162014c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f161e59c700 1 -- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16201501d0 msgr2=0x7f1620158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:48.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f161e59c700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16201501d0 0x7f1620158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.875+0000 7f161e59c700 1 -- 172.21.15.37:0/4113436709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1608009420 con 0x7f16200cc110 2023-10-06T04:41:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.879+0000 7f161e59c700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16200cc110 0x7f162014d030 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f161000c7e0 tx=0x7f1610007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.879+0000 7f16167fc700 1 -- 172.21.15.37:0/4113436709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610005b30 con 0x7f16200cc110 2023-10-06T04:41:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.879+0000 7f16249fe700 1 -- 172.21.15.37:0/4113436709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162016ccb0 con 0x7f16200cc110 2023-10-06T04:41:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.879+0000 7f16167fc700 1 -- 172.21.15.37:0/4113436709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1610005c90 con 0x7f16200cc110 2023-10-06T04:41:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.879+0000 7f16167fc700 1 -- 172.21.15.37:0/4113436709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610007300 con 0x7f16200cc110 2023-10-06T04:41:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.879+0000 7f16249fe700 1 -- 172.21.15.37:0/4113436709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162016d270 con 0x7f16200cc110 2023-10-06T04:41:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.879+0000 7f16249fe700 1 -- 172.21.15.37:0/4113436709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162016d460 con 0x7f16200cc110 2023-10-06T04:41:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.879+0000 7f16167fc700 1 -- 172.21.15.37:0/4113436709 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f16100076b0 con 0x7f16200cc110 2023-10-06T04:41:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.879+0000 7f16167fc700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1600060580 0x7f1600062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.879+0000 7f16167fc700 1 -- 172.21.15.37:0/4113436709 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f161007bd80 con 0x7f16200cc110 2023-10-06T04:41:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.879+0000 7f1617fff700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1600060580 0x7f1600062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.883+0000 7f1617fff700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1600060580 0x7f1600062a30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f16080093f0 tx=0x7f1608017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:48.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:48.887+0000 7f16167fc700 1 -- 172.21.15.37:0/4113436709 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f161004c2d0 con 0x7f16200cc110 2023-10-06T04:41:49.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.047+0000 7f16249fe700 1 -- 172.21.15.37:0/4113436709 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f1620070ee0 con 0x7f1600060580 2023-10-06T04:41:49.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.047+0000 7f16167fc700 1 -- 172.21.15.37:0/4113436709 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1620070ee0 con 0x7f1600060580 2023-10-06T04:41:49.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.051+0000 7f16249fe700 1 -- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1600060580 msgr2=0x7f1600062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:49.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.051+0000 7f16249fe700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1600060580 0x7f1600062a30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f16080093f0 tx=0x7f1608017000 comp rx=0 tx=0).stop 2023-10-06T04:41:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.051+0000 7f16249fe700 1 -- 172.21.15.37:0/4113436709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16200cc110 msgr2=0x7f162014d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.051+0000 7f16249fe700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16200cc110 0x7f162014d030 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f161000c7e0 tx=0x7f1610007df0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.051+0000 7f16249fe700 1 -- 172.21.15.37:0/4113436709 shutdown_connections 2023-10-06T04:41:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.051+0000 7f16249fe700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f1600060580 0x7f1600062a30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.051+0000 7f16249fe700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16201501d0 0x7f1620158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.051+0000 7f16249fe700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16201505a0 0x7f162014c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.051+0000 7f16249fe700 1 --2- 172.21.15.37:0/4113436709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16200cc110 0x7f162014d030 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.051+0000 7f16249fe700 1 -- 172.21.15.37:0/4113436709 >> 172.21.15.37:0/4113436709 conn(0x7f16200667b0 msgr2=0x7f1620069700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.051+0000 7f16249fe700 1 -- 172.21.15.37:0/4113436709 shutdown_connections 2023-10-06T04:41:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.051+0000 7f16249fe700 1 -- 172.21.15.37:0/4113436709 wait complete. 2023-10-06T04:41:49.058 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T04:41:49.068 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:41:49.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 Processor -- start 2023-10-06T04:41:49.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 -- start start 2023-10-06T04:41:49.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c40cbd50 0x7f11c40cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:49.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11c40c9820 0x7f11c40c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:49.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f11c406e200 0x7f11c406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:49.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c406dd70 con 0x7f11c40c9820 2023-10-06T04:41:49.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c406ebc0 con 0x7f11c406e200 2023-10-06T04:41:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c40add50 con 0x7f11c40cbd50 2023-10-06T04:41:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11c9d96700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11c40c9820 0x7f11c40c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11c9d96700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11c40c9820 0x7f11c40c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53860/0 (socket says 172.21.15.37:53860) 2023-10-06T04:41:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11c9d96700 1 -- 172.21.15.37:0/3317522513 learned_addr learned my addr 172.21.15.37:0/3317522513 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cad98700 1 --2- 172.21.15.37:0/3317522513 >> v2:172.21.15.83:3300/0 conn(0x7f11c406e200 0x7f11c406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11ca597700 1 --2- 172.21.15.37:0/3317522513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c40cbd50 0x7f11c40cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11c9d96700 1 -- 172.21.15.37:0/3317522513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c40cbd50 msgr2=0x7f11c40cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11c9d96700 1 --2- 172.21.15.37:0/3317522513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c40cbd50 0x7f11c40cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11c9d96700 1 -- 172.21.15.37:0/3317522513 >> v2:172.21.15.83:3300/0 conn(0x7f11c406e200 msgr2=0x7f11c406e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:41:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11c9d96700 1 --2- 172.21.15.37:0/3317522513 >> v2:172.21.15.83:3300/0 conn(0x7f11c406e200 0x7f11c406e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11c9d96700 1 -- 172.21.15.37:0/3317522513 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40ae030 con 0x7f11c40c9820 2023-10-06T04:41:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11ca597700 1 --2- 172.21.15.37:0/3317522513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c40cbd50 0x7f11c40cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:41:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11c9d96700 1 --2- 172.21.15.37:0/3317522513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c40c9820 0x7f11c40c9c70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f11c40c9080 tx=0x7f11bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc925f4e094163f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11c9595700 1 -- 172.21.15.37:0/3317522513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00e070 con 0x7f11c40c9820 2023-10-06T04:41:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11c9595700 1 -- 172.21.15.37:0/3317522513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc00ba50 con 0x7f11c40c9820 2023-10-06T04:41:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11c9595700 1 -- 172.21.15.37:0/3317522513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0092e0 con 0x7f11c40c9820 2023-10-06T04:41:49.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 -- 172.21.15.37:0/3317522513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c40c9820 msgr2=0x7f11c40c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:49.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 --2- 172.21.15.37:0/3317522513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c40c9820 0x7f11c40c9c70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f11c40c9080 tx=0x7f11bc009840 comp rx=0 tx=0).stop 2023-10-06T04:41:49.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 -- 172.21.15.37:0/3317522513 shutdown_connections 2023-10-06T04:41:49.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 --2- 172.21.15.37:0/3317522513 >> v2:172.21.15.83:3300/0 conn(0x7f11c406e200 0x7f11c406e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 --2- 172.21.15.37:0/3317522513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c40c9820 0x7f11c40c9c70 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 --2- 172.21.15.37:0/3317522513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c40cbd50 0x7f11c40cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 -- 172.21.15.37:0/3317522513 >> 172.21.15.37:0/3317522513 conn(0x7f11c40667b0 msgr2=0x7f11c4066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:49.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 -- 172.21.15.37:0/3317522513 shutdown_connections 2023-10-06T04:41:49.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.167+0000 7f11cc7fb700 1 -- 172.21.15.37:0/3317522513 wait complete. 2023-10-06T04:41:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11cc7fb700 1 Processor -- start 2023-10-06T04:41:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11cc7fb700 1 -- start start 2023-10-06T04:41:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11cc7fb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c406e200 0x7f11c416dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11cc7fb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c40c9820 0x7f11c4156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11cc7fb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11c40cbd50 0x7f11c415df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11cc7fb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c415da80 con 0x7f11c40c9820 2023-10-06T04:41:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11cc7fb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c416e130 con 0x7f11c40cbd50 2023-10-06T04:41:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11cc7fb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c415ce70 con 0x7f11c406e200 2023-10-06T04:41:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11c9d96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c40c9820 0x7f11c4156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11c9d96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c40c9820 0x7f11c4156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53864/0 (socket says 172.21.15.37:53864) 2023-10-06T04:41:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11c9d96700 1 -- 172.21.15.37:0/649012559 learned_addr learned my addr 172.21.15.37:0/649012559 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:41:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11ca597700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c406e200 0x7f11c416dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:49.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11cad98700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11c40cbd50 0x7f11c415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11c9d96700 1 -- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c406e200 msgr2=0x7f11c416dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11c9d96700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c406e200 0x7f11c416dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11c9d96700 1 -- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11c40cbd50 msgr2=0x7f11c415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11c9d96700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11c40cbd50 0x7f11c415df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11c9d96700 1 -- 172.21.15.37:0/649012559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc009ae0 con 0x7f11c40c9820 2023-10-06T04:41:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11c9d96700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c40c9820 0x7f11c4156c20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009430 tx=0x7f11bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11b67fc700 1 -- 172.21.15.37:0/649012559 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc008930 con 0x7f11c40c9820 2023-10-06T04:41:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11b67fc700 1 -- 172.21.15.37:0/649012559 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc008ab0 con 0x7f11c40c9820 2023-10-06T04:41:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11b67fc700 1 -- 172.21.15.37:0/649012559 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc008e70 con 0x7f11c40c9820 2023-10-06T04:41:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11cc7fb700 1 -- 172.21.15.37:0/649012559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c415d150 con 0x7f11c40c9820 2023-10-06T04:41:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.171+0000 7f11cc7fb700 1 -- 172.21.15.37:0/649012559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c415d710 con 0x7f11c40c9820 2023-10-06T04:41:49.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.175+0000 7f11cc7fb700 1 -- 172.21.15.37:0/649012559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c4070ee0 con 0x7f11c40c9820 2023-10-06T04:41:49.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.175+0000 7f11b67fc700 1 -- 172.21.15.37:0/649012559 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f11bc003040 con 0x7f11c40c9820 2023-10-06T04:41:49.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.175+0000 7f11b67fc700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f11a8060550 0x7f11a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:41:49.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.175+0000 7f11b67fc700 1 -- 172.21.15.37:0/649012559 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f11bc07df40 con 0x7f11c40c9820 2023-10-06T04:41:49.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.175+0000 7f11ca597700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f11a8060550 0x7f11a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:41:49.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.175+0000 7f11ca597700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f11a8060550 0x7f11a8062a00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f11b8006fd0 tx=0x7f11b8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:41:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.179+0000 7f11b67fc700 1 -- 172.21.15.37:0/649012559 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f11bc04e490 con 0x7f11c40c9820 2023-10-06T04:41:49.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.335+0000 7f11cc7fb700 1 -- 172.21.15.37:0/649012559 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11c406a5a0 con 0x7f11a8060550 2023-10-06T04:41:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.343+0000 7f11b67fc700 1 -- 172.21.15.37:0/649012559 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71065 (secure 0 0 0) 0x7f11c406a5a0 con 0x7f11a8060550 2023-10-06T04:41:49.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:41:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.347+0000 7f11cc7fb700 1 -- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f11a8060550 msgr2=0x7f11a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.347+0000 7f11cc7fb700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f11a8060550 0x7f11a8062a00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f11b8006fd0 tx=0x7f11b8008040 comp rx=0 tx=0).stop 2023-10-06T04:41:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.347+0000 7f11cc7fb700 1 -- 172.21.15.37:0/649012559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c40c9820 msgr2=0x7f11c4156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:41:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.347+0000 7f11cc7fb700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c40c9820 0x7f11c4156c20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009430 tx=0x7f11bc018000 comp rx=0 tx=0).stop 2023-10-06T04:41:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.347+0000 7f11cc7fb700 1 -- 172.21.15.37:0/649012559 shutdown_connections 2023-10-06T04:41:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.347+0000 7f11cc7fb700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f11a8060550 0x7f11a8062a00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.347+0000 7f11cc7fb700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11c40cbd50 0x7f11c415df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.347+0000 7f11cc7fb700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c40c9820 0x7f11c4156c20 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.347+0000 7f11cc7fb700 1 --2- 172.21.15.37:0/649012559 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c406e200 0x7f11c416dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:41:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.347+0000 7f11cc7fb700 1 -- 172.21.15.37:0/649012559 >> 172.21.15.37:0/649012559 conn(0x7f11c40667b0 msgr2=0x7f11c415ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:41:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.347+0000 7f11cc7fb700 1 -- 172.21.15.37:0/649012559 shutdown_connections 2023-10-06T04:41:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:41:49.347+0000 7f11cc7fb700 1 -- 172.21.15.37:0/649012559 wait complete. 2023-10-06T04:41:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:41:49.368 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2023-10-06T04:41:49.086194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2401640,"kb_used_data":6952,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752573080,"statfs":{"total":773094113280,"available":770634833920,"internally_reserved":0,"allocated":7118848,"data_stored":3939872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-77,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.098531"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.652022+0000","last_change":"2023-10-06T04:39:05.629064+0000","last_active":"2023-10-06T04:41:40.652022+0000","last_peered":"2023-10-06T04:41:40.652022+0000","last_clean":"2023-10-06T04:41:40.652022+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:41:40.652022+0000","last_undegraded":"2023-10-06T04:41:40.652022+0000","last_fullsized":"2023-10-06T04:41:40.652022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:13.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T04:41:41.171330+0000","last_change":"2023-10-06T04:39:05.626235+0000","last_active":"2023-10-06T04:41:41.171330+0000","last_peered":"2023-10-06T04:41:41.171330+0000","last_clean":"2023-10-06T04:41:41.171330+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:41:41.171330+0000","last_undegraded":"2023-10-06T04:41:41.171330+0000","last_fullsized":"2023-10-06T04:41:41.171330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.658180+0000","last_change":"2023-10-06T04:39:05.965888+0000","last_active":"2023-10-06T04:41:40.658180+0000","last_peered":"2023-10-06T04:41:40.658180+0000","last_clean":"2023-10-06T04:41:40.658180+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:41:40.658180+0000","last_undegraded":"2023-10-06T04:41:40.658180+0000","last_fullsized":"2023-10-06T04:41:40.658180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:15.891717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T04:41:41.174774+0000","last_change":"2023-10-06T04:39:05.964283+0000","last_active":"2023-10-06T04:41:41.174774+0000","last_peered":"2023-10-06T04:41:41.174774+0000","last_clean":"2023-10-06T04:41:41.174774+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:41:41.174774+0000","last_undegraded":"2023-10-06T04:41:41.174774+0000","last_fullsized":"2023-10-06T04:41:41.174774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.653367+0000","last_change":"2023-10-06T04:39:05.630002+0000","last_active":"2023-10-06T04:41:40.653367+0000","last_peered":"2023-10-06T04:41:40.653367+0000","last_clean":"2023-10-06T04:41:40.653367+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:41:40.653367+0000","last_undegraded":"2023-10-06T04:41:40.653367+0000","last_fullsized":"2023-10-06T04:41:40.653367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.068977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T04:41:47.062000+0000","last_change":"2023-10-06T04:41:47.061904+0000","last_active":"2023-10-06T04:41:47.062000+0000","last_peered":"2023-10-06T04:41:47.062000+0000","last_clean":"2023-10-06T04:41:47.062000+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:41:47.062000+0000","last_undegraded":"2023-10-06T04:41:47.062000+0000","last_fullsized":"2023-10-06T04:41:47.062000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:41:47.061539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:41:47.061539+0000","last_clean_scrub_stamp":"2023-10-06T04:41:47.061539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:42.858911+0000","scrub_duration":0.0044297770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.655168+0000","last_change":"2023-10-06T04:39:05.630755+0000","last_active":"2023-10-06T04:41:40.655168+0000","last_peered":"2023-10-06T04:41:40.655168+0000","last_clean":"2023-10-06T04:41:40.655168+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:41:40.655168+0000","last_undegraded":"2023-10-06T04:41:40.655168+0000","last_fullsized":"2023-10-06T04:41:40.655168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:44.354873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.654485+0000","last_change":"2023-10-06T04:39:05.627552+0000","last_active":"2023-10-06T04:41:40.654485+0000","last_peered":"2023-10-06T04:41:40.654485+0000","last_clean":"2023-10-06T04:41:40.654485+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:41:40.654485+0000","last_undegraded":"2023-10-06T04:41:40.654485+0000","last_fullsized":"2023-10-06T04:41:40.654485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:04.598892+0000","last_clean_scrub_stamp":"2023-10-06T04:39:04.598892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:34.331272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":198,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T04:41:40.655297+0000","last_change":"2023-10-06T04:38:59.347041+0000","last_active":"2023-10-06T04:41:40.655297+0000","last_peered":"2023-10-06T04:41:40.655297+0000","last_clean":"2023-10-06T04:41:40.655297+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:41:40.655297+0000","last_undegraded":"2023-10-06T04:41:40.655297+0000","last_fullsized":"2023-10-06T04:41:40.655297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:57.561617+0000","last_clean_scrub_stamp":"2023-10-06T04:38:57.561617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:35.922141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.92900000000000005,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.46100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.94299999999999995,"5min":1.673,"15min":1.673},"last":1.0720000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84299999999999997,"15min":0.84499999999999997},"min":{"1min":0.54900000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1439999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.86799999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.91400000000000003,"15min":0.92700000000000005},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.202,"5min":1.744,"15min":1.744},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1910000000000001,"5min":1.323,"15min":1.323},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.008,"15min":1.016},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.329,"5min":1.802,"15min":1.802},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.127,"5min":1.1899999999999999,"15min":1.2},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.494,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.95799999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.171,"15min":1.177},"min":{"1min":0.79700000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5409999999999999,"5min":1.879,"15min":1.879},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.1220000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1970000000000001,"15min":1.2090000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4850000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.073,"5min":1.167,"15min":1.1830000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3380000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.0089999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:41:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.212,"15min":1.23},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4099999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3109999999999999,"15min":1.3260000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.611,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.90700000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":935260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.5},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1879999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.95299999999999996,"15min":0.96099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.22,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.99099999999999999,"15min":0.98299999999999998},"min":{"1min":0.77900000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0089999999999999,"15min":1.018},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.167,"15min":1.179},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.3959999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1259999999999999,"15min":1.1379999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.482,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.1279999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.101,"15min":1.1120000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.2450000000000001,"15min":1.2569999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.5900000000000001,"5min":1.617,"15min":1.617},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:41:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.177,"15min":1.1870000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3759999999999999,"5min":1.385,"15min":1.385},"last":0.99299999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542181,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":935260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.196,"5min":3.347,"15min":3.347},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.93200000000000005,"15min":0.95199999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.244,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.91300000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85199999999999998,"15min":0.84399999999999997},"min":{"1min":0.58199999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2230000000000001,"5min":1.226,"15min":1.226},"last":0.98399999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.93600000000000005,"15min":0.93200000000000005},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.95199999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93700000000000006,"15min":0.92700000000000005},"min":{"1min":0.63700000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.1200000000000001,"15min":1.1399999999999999},"min":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.25,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.0629999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.94499999999999995,"15min":0.93600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.1699999999999999,"15min":1.1899999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.3540000000000001,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":1.1699999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.107,"15min":1.1279999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.329,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.02},{"interface":"front","average":{"1min":1.131,"5min":1.123,"15min":1.121},"min":{"1min":0.81399999999999995,"5min":0.747,"15min":0.747},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.038}]},{"osd":6,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2470000000000001,"15min":1.262},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.423,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.2549999999999999,"15min":1.276},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.3799999999999999,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.0880000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.93700000000000006,"15min":0.93300000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.006,"15min":1.006},"min":{"1min":0.59699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.68400000000000005,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.141,"5min":1.268,"15min":1.268},"last":1.143},{"interface":"front","average":{"1min":0.879,"5min":0.85499999999999998,"15min":0.85099999999999998},"min":{"1min":0.61899999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.98499999999999999,"15min":0.97499999999999998},"min":{"1min":0.875,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.748},{"interface":"front","average":{"1min":0.995,"5min":1.054,"15min":1.0640000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.321,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.96499999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.04,"15min":1.05},"min":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.2729999999999999,"5min":1.448,"15min":1.448},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0700000000000001,"15min":1.0720000000000001},"min":{"1min":0.79000000000000004,"5min":0.752,"15min":0.752},"max":{"1min":1.4099999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.0820000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.64100000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.198,"5min":1.389,"15min":1.389},"last":1.004},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0489999999999999,"15min":1.0509999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.04}]},{"osd":5,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.044,"15min":1.046},"min":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.111,"15min":1.1080000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.1240000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1040000000000001,"15min":1.1000000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.95599999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.635,"5min":1.665,"15min":1.665},"last":1.28}]}]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.018,"5min":0.878,"15min":0.85499999999999998},"min":{"1min":0.58299999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.90500000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.97099999999999997,"15min":0.96499999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.097},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90100000000000002,"15min":0.89500000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2130000000000001,"5min":1.248,"15min":1.248},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0449999999999999,"15min":1.0329999999999999},"min":{"1min":0.73899999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":3.5310000000000001,"5min":3.5310000000000001,"15min":3.5310000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.0089999999999999,"15min":0.97699999999999998},"min":{"1min":0.70199999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":3.2229999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.0369999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0369999999999999,"15min":1.0269999999999999},"min":{"1min":0.755,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.0609999999999999,"15min":1.034},"min":{"1min":0.84299999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.99099999999999999,"15min":0.98999999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.115,"15min":1.115},"min":{"1min":0.79200000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.88300000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.077,"15min":1.073},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.129,"15min":1.123},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.147}]},{"osd":7,"last update":"Fri Oct 6 04:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2,"15min":1.1990000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2410000000000001,"15min":1.2350000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":3.2120000000000002,"5min":3.2120000000000002,"15min":3.2120000000000002},"last":0.94299999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.85599999999999998,"15min":0.84399999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.01,"15min":1.0169999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2729999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.89800000000000002,"15min":0.89000000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2909999999999999,"5min":1.319,"15min":1.319},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.90800000000000003,"15min":0.91000000000000003},"min":{"1min":0.65400000000000003,"5min":0.62,"15min":0.62},"max":{"1min":1.159,"5min":1.256,"15min":1.256},"last":0.88}]},{"osd":2,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.024,"15min":1.03},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.036},{"interface":"front","average":{"1min":1.044,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3480000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.1559999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.96499999999999997,"15min":0.95699999999999996},"min":{"1min":0.72899999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1,"15min":1.006},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.361,"5min":1.47,"15min":1.47},"last":1.0580000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.76300000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.266,"5min":1.429,"15min":1.429},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.0569999999999999,"15min":1.044},"min":{"1min":0.69299999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.464,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.98299999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0600000000000001,"15min":1.0549999999999999},"min":{"1min":0.80900000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.147,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.97199999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.28}]},{"osd":7,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2130000000000001,"15min":1.204},"min":{"1min":1,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.2},{"interface":"front","average":{"1min":1.248,"5min":1.272,"15min":1.276},"min":{"1min":1.079,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.6459999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.252}]}]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.76200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0369999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55400000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.234,"15min":1.234},"last":1.1619999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.0740000000000001,"5min":1.284,"15min":1.284},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.751,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.046,"5min":1.123,"15min":1.123},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.044,"5min":1,"15min":0.99299999999999999},"min":{"1min":0.64400000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3680000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.1120000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.028,"15min":1.0289999999999999},"min":{"1min":0.70699999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.149,"15min":1.143},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.874}]},{"osd":5,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1859999999999999,"15min":1.181},"min":{"1min":0.86399999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.085,"15min":1.079},"min":{"1min":0.90300000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.3720000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.81299999999999994}]},{"osd":6,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2490000000000001,"15min":1.2569999999999999},"min":{"1min":0.93700000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4770000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.292,"15min":1.29},"min":{"1min":1.0669999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.6579999999999999,"5min":2.048,"15min":2.048},"last":0.96299999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1819999999999999,"15min":1.1739999999999999},"min":{"1min":0.94399999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.016},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2909999999999999,"15min":1.302},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.6060000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0820000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2589999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.0029999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.59599999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.464,"5min":1.53,"15min":1.53},"last":0.503},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.62}]},{"osd":3,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1699999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89400000000000002,"15min":0.88800000000000001},"min":{"1min":0.61599999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.349,"5min":1.903,"15min":1.903},"last":0.66900000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5760000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.042},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.71199999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.385,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.73299999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.153,"15min":1.1519999999999999},"min":{"1min":0.76800000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.675,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1240000000000001,"15min":1.121},"min":{"1min":0.81100000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3740000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.216,"15min":1.2190000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5740000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.206,"15min":1.21},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.6619999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.96699999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:41:01 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.107,"15min":1.0980000000000001},"min":{"1min":0.79600000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.532,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.90400000000000003,"5min":0.624,"15min":0.624},"max":{"1min":1.7529999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.88400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:41:49.373 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-06T04:39:04.598892+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=41, tm_sec=44, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:41:49.374 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-06T04:39:04.598892+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=41, tm_sec=44, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:41:49.374 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-06T04:39:04.598892+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=41, tm_sec=44, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:41:49.374 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-06T04:39:04.598892+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=41, tm_sec=44, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:41:49.374 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-06T04:39:04.598892+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=41, tm_sec=44, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:41:49.374 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T04:39:04.598892+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=41, tm_sec=44, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:41:49.374 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-06T04:39:04.598892+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=41, tm_sec=44, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:41:49.374 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T04:38:57.561617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=38, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=41, tm_sec=44, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:41:49.374 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T04:42:09.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:42:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dff5fd700 1 Processor -- start 2023-10-06T04:42:09.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dff5fd700 1 -- start start 2023-10-06T04:42:09.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dff5fd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5df80cc120 0x7f5df806e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:09.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dff5fd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5df806e740 0x7f5df815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dff5fd700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df806dd70 con 0x7f5df80cbd50 2023-10-06T04:42:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dff5fd700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df806eba0 con 0x7f5df80cc120 2023-10-06T04:42:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dff5fd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df80add50 con 0x7f5df806e740 2023-10-06T04:42:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dfcb98700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5df80cc120 0x7f5df806e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dfcb98700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5df80cc120 0x7f5df806e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41628/0 (socket says 172.21.15.37:41628) 2023-10-06T04:42:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dfcb98700 1 -- 172.21.15.37:0/21807257 learned_addr learned my addr 172.21.15.37:0/21807257 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:42:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dfdb9a700 1 --2- 172.21.15.37:0/21807257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5df806e740 0x7f5df815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dfcb98700 1 -- 172.21.15.37:0/21807257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5df806e740 msgr2=0x7f5df815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:42:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dfcb98700 1 --2- 172.21.15.37:0/21807257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5df806e740 0x7f5df815cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dfcb98700 1 -- 172.21.15.37:0/21807257 >> v1:172.21.15.37:6789/0 conn(0x7f5df80cbd50 legacy=0x7f5df80c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dfcb98700 1 -- 172.21.15.37:0/21807257 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80ae030 con 0x7f5df80cc120 2023-10-06T04:42:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dfcb98700 1 --2- 172.21.15.37:0/21807257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df80cc120 0x7f5df806e200 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009f20 tx=0x7f5df0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca9d566914c785d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:42:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5debfff700 1 -- 172.21.15.37:0/21807257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df000e070 con 0x7f5df80cc120 2023-10-06T04:42:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5debfff700 1 -- 172.21.15.37:0/21807257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df000b9d0 con 0x7f5df80cc120 2023-10-06T04:42:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5debfff700 1 -- 172.21.15.37:0/21807257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00092e0 con 0x7f5df80cc120 2023-10-06T04:42:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dff5fd700 1 -- 172.21.15.37:0/21807257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df80cc120 msgr2=0x7f5df806e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.487+0000 7f5dff5fd700 1 --2- 172.21.15.37:0/21807257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df80cc120 0x7f5df806e200 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009f20 tx=0x7f5df0009840 comp rx=0 tx=0).stop 2023-10-06T04:42:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 -- 172.21.15.37:0/21807257 shutdown_connections 2023-10-06T04:42:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 --2- 172.21.15.37:0/21807257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5df806e740 0x7f5df815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 --2- 172.21.15.37:0/21807257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df80cc120 0x7f5df806e200 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 -- 172.21.15.37:0/21807257 >> 172.21.15.37:0/21807257 conn(0x7f5df80667b0 msgr2=0x7f5df8066bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:42:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 -- 172.21.15.37:0/21807257 shutdown_connections 2023-10-06T04:42:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 -- 172.21.15.37:0/21807257 wait complete. 2023-10-06T04:42:09.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 Processor -- start 2023-10-06T04:42:09.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 -- start start 2023-10-06T04:42:09.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df806e740 0x7f5df80c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:09.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5df80cbd50 0x7f5df814bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:09.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5df80cc120 0x7f5df814c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:09.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df80c1760 con 0x7f5df806e740 2023-10-06T04:42:09.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df815e530 con 0x7f5df80cc120 2023-10-06T04:42:09.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dff5fd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df814c950 con 0x7f5df80cbd50 2023-10-06T04:42:09.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dfd399700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df806e740 0x7f5df80c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:09.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dfd399700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df806e740 0x7f5df80c2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41642/0 (socket says 172.21.15.37:41642) 2023-10-06T04:42:09.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dfd399700 1 -- 172.21.15.37:0/3014188731 learned_addr learned my addr 172.21.15.37:0/3014188731 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:42:09.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dfcb98700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5df80cbd50 0x7f5df814bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:09.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.491+0000 7f5dfdb9a700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5df80cc120 0x7f5df814c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:09.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5dfd399700 1 -- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5df80cbd50 msgr2=0x7f5df814bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:09.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5dfd399700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5df80cbd50 0x7f5df814bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5dfd399700 1 -- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5df80cc120 msgr2=0x7f5df814c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:09.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5dfd399700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5df80cc120 0x7f5df814c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5dfd399700 1 -- 172.21.15.37:0/3014188731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df0009ae0 con 0x7f5df806e740 2023-10-06T04:42:09.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5dfcb98700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5df80cbd50 0x7f5df814bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:42:09.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5dfd399700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df806e740 0x7f5df80c2140 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c590 tx=0x7f5dec00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:42:09.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5de97fa700 1 -- 172.21.15.37:0/3014188731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec011590 con 0x7f5df806e740 2023-10-06T04:42:09.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5de97fa700 1 -- 172.21.15.37:0/3014188731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec011710 con 0x7f5df806e740 2023-10-06T04:42:09.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5dff5fd700 1 -- 172.21.15.37:0/3014188731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df815dc00 con 0x7f5df806e740 2023-10-06T04:42:09.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5de97fa700 1 -- 172.21.15.37:0/3014188731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec011ad0 con 0x7f5df806e740 2023-10-06T04:42:09.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5dff5fd700 1 -- 172.21.15.37:0/3014188731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df815e1c0 con 0x7f5df806e740 2023-10-06T04:42:09.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.495+0000 7f5dff5fd700 1 -- 172.21.15.37:0/3014188731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df8070ee0 con 0x7f5df806e740 2023-10-06T04:42:09.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.499+0000 7f5de97fa700 1 -- 172.21.15.37:0/3014188731 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5dec01b3b0 con 0x7f5df806e740 2023-10-06T04:42:09.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.499+0000 7f5de97fa700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5ddc060550 0x7f5ddc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:09.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.499+0000 7f5de97fa700 1 -- 172.21.15.37:0/3014188731 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f5dec07c000 con 0x7f5df806e740 2023-10-06T04:42:09.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.499+0000 7f5dfcb98700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5ddc060550 0x7f5ddc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:09.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.499+0000 7f5dfcb98700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5ddc060550 0x7f5ddc062a00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009880 tx=0x7f5df0018000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:42:09.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.503+0000 7f5de97fa700 1 -- 172.21.15.37:0/3014188731 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5dec04c670 con 0x7f5df806e740 2023-10-06T04:42:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.663+0000 7f5dff5fd700 1 -- 172.21.15.37:0/3014188731 --> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5df80ae310 con 0x7f5ddc060550 2023-10-06T04:42:09.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.671+0000 7f5de97fa700 1 -- 172.21.15.37:0/3014188731 <== mgr.4111 v2:172.21.15.83:6832/33328 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71134 (secure 0 0 0) 0x7f5df80ae310 con 0x7f5ddc060550 2023-10-06T04:42:09.680 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:42:09.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.675+0000 7f5dff5fd700 1 -- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5ddc060550 msgr2=0x7f5ddc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:09.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.675+0000 7f5dff5fd700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5ddc060550 0x7f5ddc062a00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009880 tx=0x7f5df0018000 comp rx=0 tx=0).stop 2023-10-06T04:42:09.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.675+0000 7f5dff5fd700 1 -- 172.21.15.37:0/3014188731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df806e740 msgr2=0x7f5df80c2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:09.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.675+0000 7f5dff5fd700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df806e740 0x7f5df80c2140 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c590 tx=0x7f5dec00c8a0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.675+0000 7f5dff5fd700 1 -- 172.21.15.37:0/3014188731 shutdown_connections 2023-10-06T04:42:09.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.675+0000 7f5dff5fd700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f5ddc060550 0x7f5ddc062a00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.675+0000 7f5dff5fd700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5df80cc120 0x7f5df814c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.675+0000 7f5dff5fd700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5df80cbd50 0x7f5df814bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.675+0000 7f5dff5fd700 1 --2- 172.21.15.37:0/3014188731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df806e740 0x7f5df80c2140 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.675+0000 7f5dff5fd700 1 -- 172.21.15.37:0/3014188731 >> 172.21.15.37:0/3014188731 conn(0x7f5df80667b0 msgr2=0x7f5df8067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:42:09.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.675+0000 7f5dff5fd700 1 -- 172.21.15.37:0/3014188731 shutdown_connections 2023-10-06T04:42:09.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.675+0000 7f5dff5fd700 1 -- 172.21.15.37:0/3014188731 wait complete. 2023-10-06T04:42:09.683 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:42:09.695 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-10-06T04:42:09.091948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2401640,"kb_used_data":6952,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752573080,"statfs":{"total":773094113280,"available":770634833920,"internally_reserved":0,"allocated":7118848,"data_stored":3939872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003447"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T04:41:51.130823+0000","last_change":"2023-10-06T04:41:51.130727+0000","last_active":"2023-10-06T04:41:51.130823+0000","last_peered":"2023-10-06T04:41:51.130823+0000","last_clean":"2023-10-06T04:41:51.130823+0000","last_became_active":"2023-10-06T04:39:05.628651+0000","last_became_peered":"2023-10-06T04:39:05.628651+0000","last_unstale":"2023-10-06T04:41:51.130823+0000","last_undegraded":"2023-10-06T04:41:51.130823+0000","last_fullsized":"2023-10-06T04:41:51.130823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:41:51.130353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:41:51.130353+0000","last_clean_scrub_stamp":"2023-10-06T04:41:51.130353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:45.052312+0000","scrub_duration":0.0042222759999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T04:41:56.373262+0000","last_change":"2023-10-06T04:41:56.373194+0000","last_active":"2023-10-06T04:41:56.373262+0000","last_peered":"2023-10-06T04:41:56.373262+0000","last_clean":"2023-10-06T04:41:56.373262+0000","last_became_active":"2023-10-06T04:39:05.625945+0000","last_became_peered":"2023-10-06T04:39:05.625945+0000","last_unstale":"2023-10-06T04:41:56.373262+0000","last_undegraded":"2023-10-06T04:41:56.373262+0000","last_fullsized":"2023-10-06T04:41:56.373262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:41:56.372947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:41:56.372947+0000","last_clean_scrub_stamp":"2023-10-06T04:41:56.372947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:43.815364+0000","scrub_duration":0.0047827920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T04:41:57.672168+0000","last_change":"2023-10-06T04:41:57.672097+0000","last_active":"2023-10-06T04:41:57.672168+0000","last_peered":"2023-10-06T04:41:57.672168+0000","last_clean":"2023-10-06T04:41:57.672168+0000","last_became_active":"2023-10-06T04:39:05.964978+0000","last_became_peered":"2023-10-06T04:39:05.964978+0000","last_unstale":"2023-10-06T04:41:57.672168+0000","last_undegraded":"2023-10-06T04:41:57.672168+0000","last_fullsized":"2023-10-06T04:41:57.672168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:41:57.671861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:41:57.671861+0000","last_clean_scrub_stamp":"2023-10-06T04:41:57.671861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:41.303788+0000","scrub_duration":0.0046988919999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T04:41:50.306136+0000","last_change":"2023-10-06T04:41:50.306051+0000","last_active":"2023-10-06T04:41:50.306136+0000","last_peered":"2023-10-06T04:41:50.306136+0000","last_clean":"2023-10-06T04:41:50.306136+0000","last_became_active":"2023-10-06T04:39:05.963584+0000","last_became_peered":"2023-10-06T04:39:05.963584+0000","last_unstale":"2023-10-06T04:41:50.306136+0000","last_undegraded":"2023-10-06T04:41:50.306136+0000","last_fullsized":"2023-10-06T04:41:50.306136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:41:50.305782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:41:50.305782+0000","last_clean_scrub_stamp":"2023-10-06T04:41:50.305782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:50.267735+0000","scrub_duration":0.0043031609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T04:41:52.017028+0000","last_change":"2023-10-06T04:41:52.016927+0000","last_active":"2023-10-06T04:41:52.017028+0000","last_peered":"2023-10-06T04:41:52.017028+0000","last_clean":"2023-10-06T04:41:52.017028+0000","last_became_active":"2023-10-06T04:39:05.628694+0000","last_became_peered":"2023-10-06T04:39:05.628694+0000","last_unstale":"2023-10-06T04:41:52.017028+0000","last_undegraded":"2023-10-06T04:41:52.017028+0000","last_fullsized":"2023-10-06T04:41:52.017028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:41:52.016543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:41:52.016543+0000","last_clean_scrub_stamp":"2023-10-06T04:41:52.016543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:12.669373+0000","scrub_duration":0.0047589540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T04:41:47.062000+0000","last_change":"2023-10-06T04:41:47.061904+0000","last_active":"2023-10-06T04:41:47.062000+0000","last_peered":"2023-10-06T04:41:47.062000+0000","last_clean":"2023-10-06T04:41:47.062000+0000","last_became_active":"2023-10-06T04:39:05.622283+0000","last_became_peered":"2023-10-06T04:39:05.622283+0000","last_unstale":"2023-10-06T04:41:47.062000+0000","last_undegraded":"2023-10-06T04:41:47.062000+0000","last_fullsized":"2023-10-06T04:41:47.062000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:41:47.061539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:41:47.061539+0000","last_clean_scrub_stamp":"2023-10-06T04:41:47.061539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:42.858911+0000","scrub_duration":0.0044297770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T04:41:54.635427+0000","last_change":"2023-10-06T04:41:54.635358+0000","last_active":"2023-10-06T04:41:54.635427+0000","last_peered":"2023-10-06T04:41:54.635427+0000","last_clean":"2023-10-06T04:41:54.635427+0000","last_became_active":"2023-10-06T04:39:05.629920+0000","last_became_peered":"2023-10-06T04:39:05.629920+0000","last_unstale":"2023-10-06T04:41:54.635427+0000","last_undegraded":"2023-10-06T04:41:54.635427+0000","last_fullsized":"2023-10-06T04:41:54.635427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:41:54.635119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:41:54.635119+0000","last_clean_scrub_stamp":"2023-10-06T04:41:54.635119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:24.888988+0000","scrub_duration":0.0049520229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T04:41:52.994060+0000","last_change":"2023-10-06T04:41:52.993976+0000","last_active":"2023-10-06T04:41:52.994060+0000","last_peered":"2023-10-06T04:41:52.994060+0000","last_clean":"2023-10-06T04:41:52.994060+0000","last_became_active":"2023-10-06T04:39:05.627280+0000","last_became_peered":"2023-10-06T04:39:05.627280+0000","last_unstale":"2023-10-06T04:41:52.994060+0000","last_undegraded":"2023-10-06T04:41:52.994060+0000","last_fullsized":"2023-10-06T04:41:52.994060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:41:52.993709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:41:52.993709+0000","last_clean_scrub_stamp":"2023-10-06T04:41:52.993709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:22.379458+0000","scrub_duration":0.0046095240000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"62'119","reported_seq":211,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T04:41:51.673858+0000","last_change":"2023-10-06T04:41:51.673733+0000","last_active":"2023-10-06T04:41:51.673858+0000","last_peered":"2023-10-06T04:41:51.673858+0000","last_clean":"2023-10-06T04:41:51.673858+0000","last_became_active":"2023-10-06T04:38:59.344471+0000","last_became_peered":"2023-10-06T04:38:59.344471+0000","last_unstale":"2023-10-06T04:41:51.673858+0000","last_undegraded":"2023-10-06T04:41:51.673858+0000","last_fullsized":"2023-10-06T04:41:51.673858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'119","last_scrub_stamp":"2023-10-06T04:41:51.673466+0000","last_deep_scrub":"62'119","last_deep_scrub_stamp":"2023-10-06T04:41:51.673466+0000","last_clean_scrub_stamp":"2023-10-06T04:41:51.673466+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:03.909900+0000","scrub_duration":0.013349354000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.107,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.107},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.54500000000000004,"5min":0.314,"15min":0.314},"max":{"1min":1.0720000000000001,"5min":1.673,"15min":1.673},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.57899999999999996,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90400000000000003,"5min":1.069,"15min":1.069},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.53500000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1819999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.76100000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.91100000000000003,"15min":0.92600000000000005},"min":{"1min":0.68300000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.417,"5min":1.744,"15min":1.744},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.66700000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.0109999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.996,"15min":1.012},"min":{"1min":0.71199999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6859999999999999,"5min":1.802,"15min":1.802},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.107,"5min":1.1699999999999999,"15min":1.194},"min":{"1min":0.86699999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.377,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.89500000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:42:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1579999999999999,"15min":1.1719999999999999},"min":{"1min":0.81899999999999995,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5920000000000001,"5min":1.879,"15min":1.879},"last":1.05},{"interface":"front","average":{"1min":1.101,"5min":1.1200000000000001,"15min":1.121},"min":{"1min":0.78200000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4710000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.329}]},{"osd":6,"last update":"Fri Oct 6 04:42:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1890000000000001,"15min":1.206},"min":{"1min":0.86299999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5089999999999999,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.177,"15min":1.1859999999999999},"min":{"1min":0.874,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.29}]},{"osd":7,"last update":"Fri Oct 6 04:42:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2230000000000001,"15min":1.234},"min":{"1min":0.92800000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.871,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.177},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.306,"15min":1.3240000000000001},"min":{"1min":0.90700000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.748,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.2490000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":935260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66900000000000004,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.95099999999999996,"5min":1.173,"15min":1.173},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.48899999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.032,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.73099999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.55300000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.93999999999999995,"15min":0.95599999999999996},"min":{"1min":0.58799999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2669999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.0229999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.006,"15min":0.98799999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.012,"15min":1.0189999999999999},"min":{"1min":0.85899999999999999,"5min":0.629,"15min":0.629},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.153,"15min":1.1739999999999999},"min":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.419},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.135,"15min":1.141},"min":{"1min":1.004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.115,"15min":1.117},"min":{"1min":0.73899999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.23,"15min":1.252},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.601,"5min":1.617,"15min":1.617},"last":1.4890000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.1990000000000001,"15min":1.194},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.4690000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.079},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1819999999999999,"15min":1.1890000000000001},"min":{"1min":0.82599999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.0489999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":935260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90600000000000003,"15min":0.92200000000000004},"min":{"1min":0.53600000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.179,"5min":3.347,"15min":3.347},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.90600000000000003,"15min":0.94299999999999995},"min":{"1min":0.625,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1299999999999999,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.871}]},{"osd":1,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86099999999999999,"15min":0.84699999999999998},"min":{"1min":0.55300000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.879,"15min":0.86799999999999999},"min":{"1min":0.63700000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.107,"5min":1.226,"15min":1.226},"last":0.82699999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.997},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.93100000000000005,"15min":0.93000000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.258,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.94699999999999995,"15min":0.93100000000000005},"min":{"1min":0.65200000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1499999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.1000000000000001,"15min":1.133},"min":{"1min":0.80600000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.26,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.0760000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.96399999999999997,"15min":0.94199999999999995},"min":{"1min":0.76200000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.1319999999999999,"15min":1.177},"min":{"1min":0.78500000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.3029999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.94699999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0800000000000001,"15min":1.119},"min":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2070000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.137,"15min":1.1259999999999999},"min":{"1min":0.98299999999999998,"5min":0.747,"15min":0.747},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.02}]},{"osd":6,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.228,"15min":1.256},"min":{"1min":0.91600000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3720000000000001,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.149},{"interface":"front","average":{"1min":1.155,"5min":1.228,"15min":1.2669999999999999},"min":{"1min":0.93000000000000005,"5min":0.87,"15min":0.87},"max":{"1min":1.5049999999999999,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.125}]}]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.52500000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1859999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.875},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.997,"15min":1.0029999999999999},"min":{"1min":0.68500000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.194,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.139}]},{"osd":1,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84699999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.143,"5min":1.268,"15min":1.268},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.86499999999999999,"15min":0.85499999999999998},"min":{"1min":0.64800000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2609999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.628}]},{"osd":2,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98799999999999999,"15min":0.97599999999999998},"min":{"1min":0.748,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.218,"5min":1.355,"15min":1.355},"last":1.169},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.262,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.0129999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.016,"15min":1.042},"min":{"1min":0.72699999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.081,"5min":1.448,"15min":1.448},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0620000000000001,"15min":1.0700000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.341,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.96099999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.92400000000000004,"15min":0.94299999999999995},"min":{"1min":0.66100000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.242,"5min":1.389,"15min":1.389},"last":0.745},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0349999999999999,"15min":1.046},"min":{"1min":0.73599999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.29,"5min":1.425,"15min":1.425},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.0269999999999999,"15min":1.04},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2250000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.113,"15min":1.109},"min":{"1min":0.83299999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.417,"5min":1.502,"15min":1.502},"last":1.0820000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.103,"15min":1.099},"min":{"1min":0.80700000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3999999999999999,"5min":1.492,"15min":1.492},"last":1.115},{"interface":"front","average":{"1min":1.117,"5min":1.177,"15min":1.1870000000000001},"min":{"1min":0.874,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.3120000000000001,"5min":1.665,"15min":1.665},"last":1.204}]}]},{"osd":5,"up_from":14,"seq":60129542184,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84599999999999997,"15min":0.83199999999999996},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.206,"5min":2.782,"15min":2.782},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88700000000000001,"15min":0.85799999999999998},"min":{"1min":0.64900000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3360000000000001,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.60299999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96999999999999997,"15min":0.96499999999999997},"min":{"1min":0.60299999999999998,"5min":0.495,"15min":0.495},"max":{"1min":1.139,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2270000000000001,"5min":1.248,"15min":1.248},"last":0.75600000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0429999999999999,"15min":1.0329999999999999},"min":{"1min":0.68999999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.274,"5min":3.5310000000000001,"15min":3.5310000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0129999999999999,"15min":0.97799999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2929999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.83599999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.026,"15min":1.0229999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2250000000000001,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.05,"15min":1.03},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2490000000000001,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":1.109}]},{"osd":4,"last update":"Fri Oct 6 04:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.97899999999999998,"15min":0.98599999999999999},"min":{"1min":0.64500000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2390000000000001,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":1.141},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.0880000000000001,"15min":1.1060000000000001},"min":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.266,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.875}]},{"osd":6,"last update":"Fri Oct 6 04:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0649999999999999,"15min":1.069},"min":{"1min":0.76100000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2450000000000001,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.119,"15min":1.1200000000000001},"min":{"1min":0.70899999999999996,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.401,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.018}]},{"osd":7,"last update":"Fri Oct 6 04:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1850000000000001,"15min":1.194},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.3069999999999999,"5min":2.992,"15min":2.992},"last":1.196},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.4630000000000001,"5min":3.2120000000000002,"15min":3.2120000000000002},"last":1.1739999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.85599999999999998,"15min":0.84399999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.111,"5min":1.337,"15min":1.337},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.97499999999999998,"15min":1.0049999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1200000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90000000000000002,"15min":0.89100000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.121,"5min":1.319,"15min":1.319},"last":1.121},{"interface":"front","average":{"1min":0.873,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.65800000000000003,"5min":0.62,"15min":0.62},"max":{"1min":1.147,"5min":1.256,"15min":1.256},"last":0.79100000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.0009999999999999,"15min":1.0229999999999999},"min":{"1min":0.60099999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.371,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0880000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.452,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95399999999999996},"min":{"1min":0.72199999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1539999999999999,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0009999999999999,"15min":1.0069999999999999},"min":{"1min":0.72999999999999998,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.286,"5min":1.47,"15min":1.47},"last":0.97199999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.95399999999999996,"15min":0.96999999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2210000000000001,"5min":1.429,"15min":1.429},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0449999999999999,"15min":1.04},"min":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2869999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.90900000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.054,"15min":1.0529999999999999},"min":{"1min":0.75800000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3340000000000001,"5min":1.458,"15min":1.458},"last":1.179},{"interface":"front","average":{"1min":1.046,"5min":1.125,"15min":1.137},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.3999999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:42:04 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.202,"15min":1.2},"min":{"1min":0.84199999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.4410000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.093},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2549999999999999,"15min":1.27},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.597,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0509999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.53800000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.141,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75700000000000001,"15min":0.75800000000000001},"min":{"1min":0.55000000000000004,"5min":0.438,"15min":0.438},"max":{"1min":1.163,"5min":1.234,"15min":1.234},"last":0.64300000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.59799999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.0920000000000001,"5min":1.284,"15min":1.284},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.752,"15min":0.746},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0529999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.996,"15min":0.99199999999999999},"min":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2270000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.75}]},{"osd":4,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.032,"15min":1.03},"min":{"1min":0.81599999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.998},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1319999999999999,"15min":1.1379999999999999},"min":{"1min":0.86899999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.3149999999999999,"5min":1.905,"15min":1.905},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.1539999999999999,"15min":1.1699999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.202,"5min":1.758,"15min":1.758},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.0780000000000001,"15min":1.077},"min":{"1min":0.81299999999999994,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.0880000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.2190000000000001,"15min":1.2470000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6659999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.268,"15min":1.282},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.395,"5min":2.048,"15min":2.048},"last":1.119}]},{"osd":7,"last update":"Fri Oct 6 04:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1839999999999999,"15min":1.1739999999999999},"min":{"1min":0.995,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.51,"5min":1.653,"15min":1.653},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.2749999999999999,"15min":1.2969999999999999},"min":{"1min":0.999,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.6930000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.25}]}]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":344892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68899999999999995,"15min":0.66900000000000004},"min":{"1min":0.53300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.083,"5min":1.115,"15min":1.115},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.198,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.198}]},{"osd":2,"last update":"Fri Oct 6 04:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.80400000000000005,"15min":0.79700000000000004},"min":{"1min":0.503,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.133,"5min":1.53,"15min":1.53},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.50600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93000000000000005,"5min":1.202,"15min":1.202},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.83699999999999997,"15min":0.83499999999999996},"min":{"1min":0.66700000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.206,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.91100000000000003,"15min":0.89300000000000002},"min":{"1min":0.66900000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4419999999999999,"5min":1.903,"15min":1.903},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Oct 6 04:42:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.014,"15min":0.997},"min":{"1min":0.75900000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3720000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.97999999999999998,"15min":0.98099999999999998},"min":{"1min":0.73299999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.339,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:42:05 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1459999999999999,"15min":1.1499999999999999},"min":{"1min":0.89200000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3899999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.038},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1339999999999999,"15min":1.1240000000000001},"min":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.532,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.393}]},{"osd":6,"last update":"Fri Oct 6 04:42:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2110000000000001,"15min":1.2170000000000001},"min":{"1min":0.80700000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5580000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.427},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.94299999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.617,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.476}]},{"osd":7,"last update":"Fri Oct 6 04:42:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.115,"15min":1.101},"min":{"1min":0.79900000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.4610000000000001,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.246,"15min":1.2470000000000001},"min":{"1min":0.88400000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.512,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.2909999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:42:09.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T04:42:09.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.807+0000 7f273f4e7700 1 Processor -- start 2023-10-06T04:42:09.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.807+0000 7f273f4e7700 1 -- start start 2023-10-06T04:42:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.807+0000 7f273f4e7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2738158d20 0x7f27380cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.807+0000 7f273f4e7700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27380cf050 con 0x7f2738069740 2023-10-06T04:42:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.807+0000 7f273f4e7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27380ce1a0 con 0x7f27380cb150 2023-10-06T04:42:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.807+0000 7f273f4e7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27380d0680 con 0x7f2738158d20 2023-10-06T04:42:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.807+0000 7f273e4e5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2738158d20 0x7f27380cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.807+0000 7f273ece6700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2738069740 0x7f27380af860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36828/0 (socket says 172.21.15.37:36828) 2023-10-06T04:42:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.807+0000 7f273ece6700 1 -- 172.21.15.37:0/851125589 learned_addr learned my addr 172.21.15.37:0/851125589 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:42:09.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273e4e5700 1 -- 172.21.15.37:0/851125589 >> v1:172.21.15.83:6789/0 conn(0x7f27380cb150 legacy=0x7f2738069030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:09.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273e4e5700 1 -- 172.21.15.37:0/851125589 >> v1:172.21.15.37:6789/0 conn(0x7f2738069740 legacy=0x7f27380af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:09.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273e4e5700 1 -- 172.21.15.37:0/851125589 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27380ce440 con 0x7f2738158d20 2023-10-06T04:42:09.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273e4e5700 1 --2- 172.21.15.37:0/851125589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2738158d20 0x7f27380cac10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f27280098e0 tx=0x7f27280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e530c6ac35dbf48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:42:09.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273d4e3700 1 -- 172.21.15.37:0/851125589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728009e80 con 0x7f2738158d20 2023-10-06T04:42:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273d4e3700 1 -- 172.21.15.37:0/851125589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272800b860 con 0x7f2738158d20 2023-10-06T04:42:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273d4e3700 1 -- 172.21.15.37:0/851125589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800bbe0 con 0x7f2738158d20 2023-10-06T04:42:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273f4e7700 1 -- 172.21.15.37:0/851125589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2738158d20 msgr2=0x7f27380cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273f4e7700 1 --2- 172.21.15.37:0/851125589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2738158d20 0x7f27380cac10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f27280098e0 tx=0x7f27280091a0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273f4e7700 1 -- 172.21.15.37:0/851125589 shutdown_connections 2023-10-06T04:42:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273f4e7700 1 --2- 172.21.15.37:0/851125589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2738158d20 0x7f27380cac10 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273f4e7700 1 -- 172.21.15.37:0/851125589 >> 172.21.15.37:0/851125589 conn(0x7f2738068780 msgr2=0x7f27380cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:42:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273f4e7700 1 -- 172.21.15.37:0/851125589 shutdown_connections 2023-10-06T04:42:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273f4e7700 1 -- 172.21.15.37:0/851125589 wait complete. 2023-10-06T04:42:09.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273f4e7700 1 Processor -- start 2023-10-06T04:42:09.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.811+0000 7f273f4e7700 1 -- start start 2023-10-06T04:42:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273f4e7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2738069740 0x7f2738155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273f4e7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27380cb150 0x7f27380c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273f4e7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2738158d20 0x7f2738143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273f4e7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2738154a70 con 0x7f2738158d20 2023-10-06T04:42:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273f4e7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27381558d0 con 0x7f27380cb150 2023-10-06T04:42:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273f4e7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2738154cc0 con 0x7f2738069740 2023-10-06T04:42:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273ece6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2738158d20 0x7f2738143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273ece6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2738158d20 0x7f2738143460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41666/0 (socket says 172.21.15.37:41666) 2023-10-06T04:42:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273ece6700 1 -- 172.21.15.37:0/845188972 learned_addr learned my addr 172.21.15.37:0/845188972 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:42:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273e4e5700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2738069740 0x7f2738155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273dce4700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27380cb150 0x7f27380c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273ece6700 1 -- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2738069740 msgr2=0x7f2738155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273ece6700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2738069740 0x7f2738155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273ece6700 1 -- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27380cb150 msgr2=0x7f27380c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273ece6700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27380cb150 0x7f27380c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273ece6700 1 -- 172.21.15.37:0/845188972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2728009420 con 0x7f2738158d20 2023-10-06T04:42:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273dce4700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27380cb150 0x7f27380c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:42:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273ece6700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2738158d20 0x7f2738143460 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f273000cbf0 tx=0x7f27300019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:42:09.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f27367fc700 1 -- 172.21.15.37:0/845188972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273000a8d0 con 0x7f2738158d20 2023-10-06T04:42:09.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f27367fc700 1 -- 172.21.15.37:0/845188972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273000aa30 con 0x7f2738158d20 2023-10-06T04:42:09.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273f4e7700 1 -- 172.21.15.37:0/845188972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2738154fa0 con 0x7f2738158d20 2023-10-06T04:42:09.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f27367fc700 1 -- 172.21.15.37:0/845188972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273000adf0 con 0x7f2738158d20 2023-10-06T04:42:09.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273f4e7700 1 -- 172.21.15.37:0/845188972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2738155560 con 0x7f2738158d20 2023-10-06T04:42:09.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.815+0000 7f273f4e7700 1 -- 172.21.15.37:0/845188972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2738155a60 con 0x7f2738158d20 2023-10-06T04:42:09.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.819+0000 7f27367fc700 1 -- 172.21.15.37:0/845188972 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2730007300 con 0x7f2738158d20 2023-10-06T04:42:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.819+0000 7f27367fc700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2724060580 0x7f2724062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.819+0000 7f27367fc700 1 -- 172.21.15.37:0/845188972 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f273007ca90 con 0x7f2738158d20 2023-10-06T04:42:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.819+0000 7f273e4e5700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2724060580 0x7f2724062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:09.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.819+0000 7f273e4e5700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2724060580 0x7f2724062a30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f27280093f0 tx=0x7f2728017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:42:09.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.831+0000 7f27367fc700 1 -- 172.21.15.37:0/845188972 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f273004d1b0 con 0x7f2738158d20 2023-10-06T04:42:10.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:09.995+0000 7f273f4e7700 1 -- 172.21.15.37:0/845188972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f27380ce720 con 0x7f2738158d20 2023-10-06T04:42:10.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.003+0000 7f27367fc700 1 -- 172.21.15.37:0/845188972 <== mon.0 v2:172.21.15.37:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f273004d1b0 con 0x7f2738158d20 2023-10-06T04:42:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.003+0000 7f27367fc700 1 -- 172.21.15.37:0/845188972 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f27300507d0 con 0x7f2738158d20 2023-10-06T04:42:10.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.007+0000 7f273f4e7700 1 -- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2724060580 msgr2=0x7f2724062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:10.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.007+0000 7f273f4e7700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2724060580 0x7f2724062a30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f27280093f0 tx=0x7f2728017000 comp rx=0 tx=0).stop 2023-10-06T04:42:10.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.007+0000 7f273f4e7700 1 -- 172.21.15.37:0/845188972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2738158d20 msgr2=0x7f2738143460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.007+0000 7f273f4e7700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2738158d20 0x7f2738143460 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f273000cbf0 tx=0x7f27300019c0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.007+0000 7f273f4e7700 1 -- 172.21.15.37:0/845188972 shutdown_connections 2023-10-06T04:42:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.007+0000 7f273f4e7700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7f2724060580 0x7f2724062a30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.007+0000 7f273f4e7700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27380cb150 0x7f27380c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.007+0000 7f273f4e7700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2738158d20 0x7f2738143460 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.007+0000 7f273f4e7700 1 --2- 172.21.15.37:0/845188972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2738069740 0x7f2738155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.007+0000 7f273f4e7700 1 -- 172.21.15.37:0/845188972 >> 172.21.15.37:0/845188972 conn(0x7f2738068780 msgr2=0x7f27380b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:42:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.007+0000 7f273f4e7700 1 -- 172.21.15.37:0/845188972 shutdown_connections 2023-10-06T04:42:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.007+0000 7f273f4e7700 1 -- 172.21.15.37:0/845188972 wait complete. 2023-10-06T04:42:10.026 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:42:10.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:42:10.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.131+0000 7ffbb759e700 1 Processor -- start 2023-10-06T04:42:10.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.131+0000 7ffbb759e700 1 -- start start 2023-10-06T04:42:10.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbb8155470 0x7ffbb80afce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:10.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffbb80b0220 0x7ffbb80aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:10.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb80adff0 con 0x7ffbb81550a0 2023-10-06T04:42:10.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb80b06a0 con 0x7ffbb80b0220 2023-10-06T04:42:10.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80ab500 con 0x7ffbb8155470 2023-10-06T04:42:10.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb6d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffbb80b0220 0x7ffbb80aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:10.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb5d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbb8155470 0x7ffbb80afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:10.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb659c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ffbb81550a0 0x7ffbb80ae480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:53750/0 (socket says 172.21.15.37:53750) 2023-10-06T04:42:10.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb659c700 1 -- 172.21.15.37:0/1805410305 learned_addr learned my addr 172.21.15.37:0/1805410305 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:42:10.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb6d9d700 1 -- 172.21.15.37:0/1805410305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbb8155470 msgr2=0x7ffbb80afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:42:10.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb6d9d700 1 --2- 172.21.15.37:0/1805410305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbb8155470 0x7ffbb80afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb6d9d700 1 -- 172.21.15.37:0/1805410305 >> v1:172.21.15.83:6789/0 conn(0x7ffbb81550a0 legacy=0x7ffbb80ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:10.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb6d9d700 1 -- 172.21.15.37:0/1805410305 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb80afa50 con 0x7ffbb80b0220 2023-10-06T04:42:10.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb6d9d700 1 --2- 172.21.15.37:0/1805410305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb80b0220 0x7ffbb80aee40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00098e0 tx=0x7ffbb00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3489cd4a33e3303a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:42:10.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb559a700 1 -- 172.21.15.37:0/1805410305 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000b640 con 0x7ffbb80b0220 2023-10-06T04:42:10.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb559a700 1 -- 172.21.15.37:0/1805410305 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffbb000b7a0 con 0x7ffbb80b0220 2023-10-06T04:42:10.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb559a700 1 -- 172.21.15.37:0/1805410305 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000bb60 con 0x7ffbb80b0220 2023-10-06T04:42:10.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 -- 172.21.15.37:0/1805410305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb80b0220 msgr2=0x7ffbb80aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:10.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 --2- 172.21.15.37:0/1805410305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb80b0220 0x7ffbb80aee40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00098e0 tx=0x7ffbb00091a0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 -- 172.21.15.37:0/1805410305 shutdown_connections 2023-10-06T04:42:10.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 --2- 172.21.15.37:0/1805410305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb80b0220 0x7ffbb80aee40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 --2- 172.21.15.37:0/1805410305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbb8155470 0x7ffbb80afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 -- 172.21.15.37:0/1805410305 >> 172.21.15.37:0/1805410305 conn(0x7ffbb80ccb50 msgr2=0x7ffbb806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:42:10.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 -- 172.21.15.37:0/1805410305 shutdown_connections 2023-10-06T04:42:10.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.135+0000 7ffbb759e700 1 -- 172.21.15.37:0/1805410305 wait complete. 2023-10-06T04:42:10.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.139+0000 7ffbb759e700 1 Processor -- start 2023-10-06T04:42:10.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.139+0000 7ffbb759e700 1 -- start start 2023-10-06T04:42:10.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.139+0000 7ffbb759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb80b0220 0x7ffbb8154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:10.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.139+0000 7ffbb759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbb81550a0 0x7ffbb8157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:10.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.139+0000 7ffbb759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8155470 0x7ffbb8158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:10.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.139+0000 7ffbb759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb8154660 con 0x7ffbb8155470 2023-10-06T04:42:10.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.139+0000 7ffbb759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb8168080 con 0x7ffbb80b0220 2023-10-06T04:42:10.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.139+0000 7ffbb759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb8099080 con 0x7ffbb81550a0 2023-10-06T04:42:10.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8155470 0x7ffbb8158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:10.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8155470 0x7ffbb8158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41670/0 (socket says 172.21.15.37:41670) 2023-10-06T04:42:10.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb6d9d700 1 -- 172.21.15.37:0/4015103747 learned_addr learned my addr 172.21.15.37:0/4015103747 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:42:10.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb659c700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb80b0220 0x7ffbb8154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:10.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb5d9b700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbb81550a0 0x7ffbb8157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:10.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb6d9d700 1 -- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbb81550a0 msgr2=0x7ffbb8157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:10.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb6d9d700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbb81550a0 0x7ffbb8157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb6d9d700 1 -- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb80b0220 msgr2=0x7ffbb8154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:10.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb6d9d700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb80b0220 0x7ffbb8154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb6d9d700 1 -- 172.21.15.37:0/4015103747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb0009420 con 0x7ffbb8155470 2023-10-06T04:42:10.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb6d9d700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8155470 0x7ffbb8158040 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ffbb806cef0 tx=0x7ffbb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:42:10.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbae7fc700 1 -- 172.21.15.37:0/4015103747 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000b640 con 0x7ffbb8155470 2023-10-06T04:42:10.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbae7fc700 1 -- 172.21.15.37:0/4015103747 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffbb0019cc0 con 0x7ffbb8155470 2023-10-06T04:42:10.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb759e700 1 -- 172.21.15.37:0/4015103747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb8099360 con 0x7ffbb8155470 2023-10-06T04:42:10.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbae7fc700 1 -- 172.21.15.37:0/4015103747 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0023670 con 0x7ffbb8155470 2023-10-06T04:42:10.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb759e700 1 -- 172.21.15.37:0/4015103747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb8167d10 con 0x7ffbb8155470 2023-10-06T04:42:10.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbb759e700 1 -- 172.21.15.37:0/4015103747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb81681f0 con 0x7ffbb8155470 2023-10-06T04:42:10.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbae7fc700 1 -- 172.21.15.37:0/4015103747 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffbb0021070 con 0x7ffbb8155470 2023-10-06T04:42:10.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.143+0000 7ffbae7fc700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffb98060550 0x7ffb98062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:42:10.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.147+0000 7ffbae7fc700 1 -- 172.21.15.37:0/4015103747 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5698+0+0 (secure 0 0 0) 0x7ffbb007d980 con 0x7ffbb8155470 2023-10-06T04:42:10.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.147+0000 7ffbb659c700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffb98060550 0x7ffb98062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:42:10.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.147+0000 7ffbb659c700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffb98060550 0x7ffb98062a00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffba80020c0 tx=0x7ffba8001a10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:42:10.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.155+0000 7ffbae7fc700 1 -- 172.21.15.37:0/4015103747 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffbb004dff0 con 0x7ffbb8155470 2023-10-06T04:42:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.351+0000 7ffbb759e700 1 -- 172.21.15.37:0/4015103747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbb80708a0 con 0x7ffbb8155470 2023-10-06T04:42:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbae7fc700 1 -- 172.21.15.37:0/4015103747 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3526 (secure 0 0 0) 0x7ffbb0051610 con 0x7ffbb8155470 2023-10-06T04:42:10.360 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:42:10.360 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1137814339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1137814339},{"type":"v1","addr":"172.21.15.83:6835","nonce":1137814339}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3716256971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3716256971},{"type":"v1","addr":"172.21.15.37:6833","nonce":3716256971}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/893255287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":893255287},{"type":"v1","addr":"172.21.15.37:6835","nonce":893255287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3794492713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":3794492713},{"type":"v1","addr":"172.21.15.83:6837","nonce":3794492713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[]} 2023-10-06T04:42:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbb759e700 1 -- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffb98060550 msgr2=0x7ffb98062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbb759e700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffb98060550 0x7ffb98062a00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffba80020c0 tx=0x7ffba8001a10 comp rx=0 tx=0).stop 2023-10-06T04:42:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbb759e700 1 -- 172.21.15.37:0/4015103747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8155470 msgr2=0x7ffbb8158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:42:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbb759e700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8155470 0x7ffbb8158040 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ffbb806cef0 tx=0x7ffbb00091a0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbb759e700 1 -- 172.21.15.37:0/4015103747 shutdown_connections 2023-10-06T04:42:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbb759e700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:6832/33328,v1:172.21.15.83:6833/33328] conn(0x7ffb98060550 0x7ffb98062a00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbb759e700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8155470 0x7ffbb8158040 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbb759e700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbb81550a0 0x7ffbb8157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbb759e700 1 --2- 172.21.15.37:0/4015103747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb80b0220 0x7ffbb8154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:42:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbb759e700 1 -- 172.21.15.37:0/4015103747 >> 172.21.15.37:0/4015103747 conn(0x7ffbb80ccb50 msgr2=0x7ffbb80ab920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:42:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbb759e700 1 -- 172.21.15.37:0/4015103747 shutdown_connections 2023-10-06T04:42:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:42:10.355+0000 7ffbb759e700 1 -- 172.21.15.37:0/4015103747 wait complete. 2023-10-06T04:42:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2023-10-06T04:42:10.375 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T04:42:10.375 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T04:42:10.376 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:42:10.376 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:10.389 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:42:10.390 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:42:10.390 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:10.406 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:42:10.406 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:42:10.406 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:10.421 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:42:10.422 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:42:10.422 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:10.435 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:42:10.435 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T04:42:10.436 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T04:42:10.436 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:10.516 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T04:42:10.517 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T04:42:10.517 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:10.589 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T04:42:10.590 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T04:42:10.590 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:10.655 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T04:42:10.655 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T04:42:10.656 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:10.715 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T04:42:10.715 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T04:42:10.715 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:10.797 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T04:42:10.797 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T04:42:10.797 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:10.878 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T04:42:10.879 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T04:42:10.879 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:10.950 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T04:42:10.950 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T04:42:10.950 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:11.012 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T04:42:11.012 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T04:42:11.012 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T04:42:11.013 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:11.042 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T04:42:11.042 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T04:42:11.042 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:11.075 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T04:42:11.075 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T04:42:11.075 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T04:42:11.075 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:11.102 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T04:42:11.102 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T04:42:11.102 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:11.136 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T04:42:11.136 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T04:42:11.136 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:42:11.153 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T04:42:11.153 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T04:42:11.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'force file system read-only' | egrep -v 'bad backtrace' | egrep -v 'MDS in read-only mode' | egrep -v '\(MDS_READ_ONLY\)' | head -n 1 2023-10-06T04:42:11.174 INFO:teuthology.orchestra.run.smithi037.stdout:1696567145.6099737 mon.a (mon.0) 118 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:42:11.175 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T04:42:11.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'force file system read-only' | egrep -v 'bad backtrace' | egrep -v 'MDS in read-only mode' | egrep -v '\(MDS_READ_ONLY\)' | head -n 1 2023-10-06T04:42:11.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'force file system read-only' | egrep -v 'bad backtrace' | egrep -v 'MDS in read-only mode' | egrep -v '\(MDS_READ_ONLY\)' | head -n 1 2023-10-06T04:42:11.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'force file system read-only' | egrep -v 'bad backtrace' | egrep -v 'MDS in read-only mode' | egrep -v '\(MDS_READ_ONLY\)' | head -n 1 2023-10-06T04:42:11.265 INFO:teuthology.orchestra.run.smithi037.stdout:1696567145.6099737 mon.a (mon.0) 118 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:42:11.266 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:42:11.266 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T04:42:11.638 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:42:11.638 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T04:42:11.861 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:42:11.861 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T04:42:12.020 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:42:12.020 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T04:42:12.211 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:42:12.212 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T04:42:12.564 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:42:12.565 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T04:42:12.751 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:42:12.751 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T04:42:12.963 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:42:12.964 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T04:42:13.180 INFO:tasks.ceph:Archiving mon data... 2023-10-06T04:42:13.181 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283/data/mon.a.tgz 2023-10-06T04:42:13.182 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-10-06T04:42:13.190 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.jgYVhjfXzm 2023-10-06T04:42:13.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.jgYVhjfXzm 2023-10-06T04:42:13.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:42:13.234 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:42:13.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.jgYVhjfXzm 2023-10-06T04:42:13.347 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.jgYVhjfXzm is 355KB 2023-10-06T04:42:13.411 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.jgYVhjfXzm 2023-10-06T04:42:13.417 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283/data/mon.b.tgz 2023-10-06T04:42:13.418 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2023-10-06T04:42:13.424 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.MlGjHa47Ab 2023-10-06T04:42:13.425 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.MlGjHa47Ab 2023-10-06T04:42:13.540 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.MlGjHa47Ab 2023-10-06T04:42:13.561 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.MlGjHa47Ab is 468KB 2023-10-06T04:42:13.628 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.MlGjHa47Ab 2023-10-06T04:42:13.635 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283/data/mon.c.tgz 2023-10-06T04:42:13.635 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2023-10-06T04:42:13.641 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.8Z1ZRPofjG 2023-10-06T04:42:13.641 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.8Z1ZRPofjG 2023-10-06T04:42:13.754 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.8Z1ZRPofjG 2023-10-06T04:42:13.775 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.8Z1ZRPofjG is 468KB 2023-10-06T04:42:13.836 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.8Z1ZRPofjG 2023-10-06T04:42:13.843 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T04:42:13.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:42:13.845 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:42:13.862 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T04:42:13.862 DEBUG:teuthology.orchestra.run.smithi037:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:42:13.905 DEBUG:teuthology.orchestra.run.smithi083:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:42:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:42:13.954 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:42:13.961 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T04:42:13.963 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283/remote/smithi037/crash 2023-10-06T04:42:13.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:42:13.981 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283/remote/smithi083/crash 2023-10-06T04:42:13.982 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:42:13.998 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T04:42:13.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:42:14.001 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:42:14.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:42:14.064 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:42:14.096 INFO:tasks.ceph:Compressing logs... 2023-10-06T04:42:14.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:42:14.099 DEBUG:teuthology.orchestra.run.smithi083:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:42:17.954 INFO:tasks.ceph:Archiving logs... 2023-10-06T04:42:17.954 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283/remote/smithi037/log 2023-10-06T04:42:17.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:42:18.609 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283/remote/smithi083/log 2023-10-06T04:42:18.609 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:42:19.047 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T04:42:19.056 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T04:42:19.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:42:19.059 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:42:19.131 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T04:42:19.143 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T04:42:19.143 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:42:19.146 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:42:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T04:42:19.171 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================== 2023-10-06T04:42:19.171 INFO:teuthology.orchestra.run.smithi037.stdout:*hv01.front.sepi 44.4.53.2 2 u 21 64 177 0.095 0.300 0.707 2023-10-06T04:42:19.171 INFO:teuthology.orchestra.run.smithi037.stdout:+hv02.front.sepi 63.231.80.2 3 u 24 64 177 0.148 1.143 0.755 2023-10-06T04:42:19.171 INFO:teuthology.orchestra.run.smithi037.stdout:+hv03.front.sepi 74.6.168.72 3 u 18 64 177 0.091 0.632 0.421 2023-10-06T04:42:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T04:42:19.172 INFO:teuthology.orchestra.run.smithi083.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T04:42:19.174 INFO:teuthology.orchestra.run.smithi083.stdout:============================================================================== 2023-10-06T04:42:19.174 INFO:teuthology.orchestra.run.smithi083.stdout: hv01.front.sepi 44.4.53.2 2 u 20 64 177 0.077 -0.002 0.386 2023-10-06T04:42:19.174 INFO:teuthology.orchestra.run.smithi083.stdout: hv02.front.sepi 63.231.80.2 3 u 20 64 177 0.086 0.614 0.222 2023-10-06T04:42:19.174 INFO:teuthology.orchestra.run.smithi083.stdout:*hv03.front.sepi 74.6.168.72 3 u 23 64 177 0.077 0.162 0.244 2023-10-06T04:42:19.174 INFO:teuthology.orchestra.run.smithi083.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T04:42:19.175 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T04:42:19.185 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T04:42:19.186 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T04:42:19.199 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T04:42:19.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T04:42:19.221 INFO:teuthology.task.internal:Duration was 776.927272 seconds 2023-10-06T04:42:19.222 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T04:42:19.231 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T04:42:19.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:42:19.234 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:42:19.286 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T04:42:19.286 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:42:19.286 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:42:19.299 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:42:19.299 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:42:19.310 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T04:42:19.310 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:42:19.312 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:42:19.343 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T04:42:19.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:42:19.389 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:42:19.464 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T04:42:19.474 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T04:42:19.474 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:42:19.489 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:42:19.506 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T04:42:19.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:42:19.533 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:42:19.546 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2023-10-06T04:42:19.548 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2023-10-06T04:42:19.564 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:42:19.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:42:19.569 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:42:19.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:42:19.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T04:42:19.623 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T04:42:19.623 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283/remote/smithi037 2023-10-06T04:42:19.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:42:19.647 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283/remote/smithi083 2023-10-06T04:42:19.648 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:42:19.672 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T04:42:19.673 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:42:19.689 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:42:19.697 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T04:42:19.709 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T04:42:19.709 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T04:42:19.724 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T04:42:19.724 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:42:19.727 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:42:19.732 INFO:teuthology.orchestra.run.smithi037.stdout: 924113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:42 /home/ubuntu/cephtest 2023-10-06T04:42:19.745 INFO:teuthology.orchestra.run.smithi083.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:42 /home/ubuntu/cephtest 2023-10-06T04:42:19.748 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T04:42:19.759 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T04:42:19.788 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T04:42:19.817 DEBUG:teuthology.nuke:shortname: smithi037 2023-10-06T04:42:19.817 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:42:19.840 DEBUG:teuthology.nuke:shortname: smithi083 2023-10-06T04:42:19.841 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:42:19.844 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:20:33.053824', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T04:42:19.866 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:20:33.052591', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T04:42:19.896 INFO:teuthology.orchestra.console.smithi037:Power off 2023-10-06T04:42:19.897 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:42:19.919 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-10-06T04:42:19.920 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:42:19.939 INFO:teuthology.orchestra.console.smithi083:Power off 2023-10-06T04:42:19.940 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:42:19.948 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-06T04:42:19.963 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-10-06T04:42:19.963 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:42:19.984 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-06T04:42:23.949 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:42:23.985 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:42:24.062 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-06T04:42:24.095 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-06T04:42:28.063 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:42:28.095 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:42:28.173 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-06T04:42:28.206 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-06T04:42:32.178 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:42:32.207 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:42:32.288 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-10-06T04:42:32.317 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-10-06T04:42:32.390 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-10-06T04:42:32.418 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-10-06T04:42:32.523 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} duration: 776.9272718429565 failure_reason: '"1696567145.6099737 mon.a (mon.0) 118 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T04:42:32.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:42:32.617 INFO:teuthology.run:FAIL